I have a local copy of a website with 98,000 pages (I just checked). The uncompressed size is somewhere around 8gb. I'd like to put it all in one file maybe, and compress it, then just use a standard browser to view it. Is there software with which I can do this?
I don't even know what keywords to Google for. (I later searched for 'web archive'.)
- I use Firefox 43.0 on Windows 8 64-bit.
- I already downloaded the site, I don't want to download it again via Scrapbook or similar Firefox plugins because it took me about 60 hours (because I used low bandwidth to be nice). The links in the website have already been "localized" to work on my external USB drive.
- I found Mozilla Archive Format plugin but I'd still have to download the site again it seems, and my OS may not handle a single 4GB file.
File composition: It's mainly html (text) and text can be compressed 65% or more via zip. 2) Format is 98,000 html files, unknown number of images, no movies or audio (I disallowed those) using up 8GB of space. Compression.ca is a really cool website that compares compression rates on different types of files with different compressors even if it hasn't been updated in a while.
Goal: Goal is for the web site to take up less space and be easier to copy to a flash drive.
NOTE: Keep in mind that not every file (uncompressed) takes up the whole disk cluster so with 98,000 files there is a LOT of wasted disk space in the unused parts of 98,000 disk clusters. So putting this in a single ZIP file saves space by eliminating wasted space in each disk cluster.