v0.8.0

0.8.0 ChangeLog

Major

• Changes user-agent option from -U to -u.
• New option: --update. Updates to the latest version of Zeiver.
• New options: --wait-download & --random-download. With this addition, the wait before sending HTTP requests for scraping & downloading are independent.
• New option: --print-pages. Prints the HTML document for each URL to the terminal. This is the HTML document Zeiver is able to see from the OD(s).
• More OD support:
  • OdIndex
  • PanIndex
  • OneIndex

Minor

• Update restrictions for some options, namely --input-record.
• Reduce scraping, downloading, recording complexity.
• Improve scraping filters.
• Add examples with demo ODs

Bugs Fixes

• Fix Linux compatibility. (file paths)
• Directories with language characters (ex: 日本語, 项) were not recognized.
• Fix the generation of multiple stat & URL_Record files when handling multiple URLs.
• Inputting a link to a file treats it as a directory.
• Fix Onemanager identifier.
• Fix scraping javascript: links sometimes.
• Fix Downloader downloading only parts of a file.
• Clarify command line option help messages