I personally recommend 7-zip using the 7z archive format and LZMA2 compression algorithm.
Maintains a relative directory structure.
It is designed to be fully functional with filesizes up to "16,000,000,000 GB" (you can read that as 16 exabytes for simplicity)
fairly high quality encryption - AES-256 - so security is mainly dependent on password quality.
The PAQ (official website here) compressors are very efficient (as in compressed file size). It does so at the expense of speed and memory usage (note: this is only true for some of the experimental PAQ versions).
PAQ has won the Hutter Prize and the Calgary Challenge.
NOTE: The ZPAQ Open Standard Journaling Archive is a culmination of all of the ...
After hours of playing with bash, I found a way how Google is doing it. It is using one of these 2 programs:
Both of them support lossless and lossy conversion. I tried the second one, in Ubuntu as jpegoptim Install jpegoptim http://hostmar.co/software-small.
Than to do what I want I have to do the following:
find MyDirectory/ -type ...
The number one answer is most likely: 7-Zip.
Packing / unpacking: 7z, XZ, BZIP2, GZIP, TAR, ZIP and WIM
Unpacking only: ARJ, CAB, CHM, CPIO, CramFS, DEB, DMG, FAT, HFS, ISO, LZH, LZMA, MBR, MSI, NSIS, NTFS, RAR, RPM, SquashFS, UDF, VHD, WIM, XAR and Z.
Its own file format - .7z - offers "high compression ratio with LZMA and LZMA2 compression".
Interesting problem! I don't know any software to achieve what you want, but how about something like this?
import os, operator, sys
limit = int(sys.argv)
dirpath = os.path.abspath(sys.argv)
# make a generator for all file paths within dirpath
all_files = ( (os.path.join(basedir, filename) for basedir, dirs, files in os.walk(...
I'm not sure what you mean exactly with "compression optimizer":
You may want to leave every single PDF object that may be relevant to the rendered pages "as is", and just impose the highest possible lossless compression to object streams which are yet un-compressed, or which are compressed/encoded with a not-so-efficient compression method.
You may be ...
I'd like to coin gzip and bzip2. These two formats are very common on POSIX (e.g. Linux) systems and available on nearly all of them, therefore they also seeped into the surrounding ecosystem (e.g. MySQL).
They both only compress files and are thus usually combined with tar (which concatenates files) yielding .tar.gz and .tar.bz files
PeaZip is a free, open source file and archive manager for 32 and 64 bit Windows and Linux. It is available either as installable and portable application (not needing installation).
Compress, convert, split, encrypt, secure delete,Open RAR TAR 7Z ZIP ZIPX files, 150+ formats supported.
Supported systems: Windows 9x, Windows NT/2K/XP,Windows Vista/7/8 (32 ...
There are many archive and compression formats and tools that mostly do the same thing. 7zip just happens to support the most formats and features. For details and other options see https://en.wikipedia.org/wiki/Comparison_of_file_archivers
There's no way to support all compression formats. Because not every format is known publicly, and even within famous formats like zip and rar there are variants that may not be known or supported2 (have you ever heard of *.zipx)? It's produced by winzip but rarely any other tools can open it). Moreover some formats don't allow you to embed in other tools1
One possibility, which I have to admit I haven't tried, is to use just about any compression software that can create a ISO or ZIP file, some of the mount tools can do this for you and some support other formats as well, to compress/save the directory tree to a single file and then use a tool that will allow you to "mount" that file as if it were a separate ...
Look for Integrity Checking (ex: CRC32) and creation of Recovery Records (ex: Reed-Solomon - ECC) in the Comparison of file archivers page.
Provides Reed-Solomon error correction (same type as PAR) with user-defined size.;
Does smart things like switching between LZMA, PPMD, TrueAudio, Tarnado and GRzip algorithms based on file type;...
Perhaps libarchive is the answer, but I'm not sure if it's ANSI C. Though it's portable and works on most POSIX-like systems (including FreeBSD, Linux, Solaris, etc.) and supports Windows, including Cygwin, MinGW, and Visual Studio.
7-Zip is a free file archiever. It is capable of extracting many formats, including RAR. It can also be executed form the command line, which makes using it in batch scripts possible.
There are many ways to do this. The following are a couple examples:
To extract one file:
7z x item1.rar
To extract all rar files within a directory tree:
WinRAR, if properly configured, can do what you described as 'Smart Extraction'. Quoting its changelog:
New "Remove duplicate folders from extraction path" option in "Settings/Compression" dialog.
If this option is on and you unpack an archive which root folder has no files and only one 'somename' folder and if destination folder is ...
A very good opensource compression software is 7-Zip.
High compression ratio in 7z format with LZMA and LZMA2 compression
Packing / unpacking: 7z, XZ, BZIP2, GZIP, TAR, ZIP and WIM
Unpacking only: ARJ, CAB, CHM, CPIO, CramFS, DEB, DMG, FAT, HFS, ISO, LZH, LZMA, MBR, MSI, NSIS, NTFS, RAR, RPM, SquashFS, UDF, VHD, WIM, XAR ...
ImageMagik convert allows command line usage, batch processing and will convert your jpegs to jpeg2000 which may save you some space and has several other options. Unless you have made a backup first I would recommend not overwriting existing files until you have checked the conversion worked as things can go wrong with any tool.
Note that zip or targz ...
The request is quite specific, I'm not sure if something with that functionality exists out-of-the-box.
My suggestion would be to use something like a custom script, which would
also give you good flexibility.
Since you are using Windows, I quickly developed a simple PowerShell script for you.
Create a .ps1 text file (e.g. Create-MultiZip.ps1) with the ...
Have you looked at pdftk server:
Runs on Linux, OS-X & Windows
Can do a lot of pdf manipulations including Uncompress and Re-Compress Page Streams
Not Open Source but from the web site:
If you plan to distribute PDFtk Server as part of your own software, you will need a PDFtk Server Redistribution License. The exception to ...
Rather than differential compression I would suggest taking a look at tools such as Vagrant Up where you can distribute a recipe, components and settings as plain text files and links to the components.
I think that you will find this a lot more efficient as the large downloads get reused and you can target various VMs, etc.
Well If you want to resize or use lossy compression there is Handbrake, You might like it If you want to compress raw videos, like screen capture. Otherwise modern video codecs are already capable and there is high chance your video is as compressed as it could be, without loss of quality.
Hand brake can compress, i.e. either resize or use better codecs, ....
After reading a lot of manual pages, I can recommend the following:
xz (man page)
As it has in-built integrity check adjustable to SHA-256 using the following switch:
You may specify the number of CPU threads using the following switch:
The default compression level switch is set to 6, you may change that to ...
p7zip is the Unix/Linux port of 7-Zip, a freeware and open source archiver which supports different compression methods through their own 7z format.
Of course, there's a practical limit to how efficient compression methods can be (for arbitrary files), but it's probably worth giving a try.
I would seriously consider taking a look at the HDF5 format as it is specifically designed for this sort of use-case. Details of supported compression formats can be found here but include pre-defined ZLIB and SZIP plus several 3rd party options.
The reference software includes a number of language bindings and there are bindings for python available via ...
If you are still looking for a tool that handles that stuff. There is a project called "rename-css-selectors" if you are handle the code with node:
There is also a Gruntplugin for it:
This will minify all CSS selectors in HTML, JS and CSS files (actually any file ...
Not quite the answer you are looking for but worth mentioning I think.
The python File System library can open a number of different file systems with a unified interface and includes an Opener, fs.opener(), which takes a URI like specifier. This should open the file system appropriately if it is any of the supported types. Current file system types ...
There is a afsctool tool which allow to compress the folders in HFS+ file system.
AFSC (Apple File System Compression) tool is an utility that can be used to apply HFS+ compression to file(s), decompress HFS+ compressed file(s), or get information about existing HFS+ compressed file(s). Mac OS 10.6 or later is required.
However it needs to be ...
Portable Document File PDF Compressor
It Compresses PDF Files & Reduce PDF File Size Easily
There are lots of PDF files need to be copied, transferred or exchanged often on the Internet. However, PDF documents are made from images and the file sizes are very large. It is not easy to send emails with large PDF attachments.
PDF Compressor is a ...
You can use jpeg instead of png.
Use convert on the command-line (from ImageMagick) and jpegoptim:
convert example.png example.jpg; jpegoptim -S100k example.jpg
The resulting file is about 100k.
Readable, but not perfect.
Here is the result: http://www.thomas-guettler.de/tbz/example_jpegoptim_100k.jpg