I would like to know if there exists a python library that I can use in my scripts to archive an html page (given as url) with all of its assets (particularly stylesheets, javascript, images and videos) into a WARC file.

I have seen that there are many programs that do this, but I would like to call the library like this:

from archiving_library import archive_url

archive_url("https://www.google.com/", "google.warc")

So my requirements are:

  • Python library callable from python code
  • Creates WARC files at specified location
  • Includes assets (css, js, images, videos)

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.