At compression level 7 out of 9, pigz compressed the 818 MB CSV file down to 95 MB in 4 seconds.pigz does this by default, xz because of the -T0 option Both archiving tools saturated the CPU in our tests.We compared xz to pigz, a gzip implementation that uses multithreading for faster compression and decompression. To test this claim, we used the same 818 MB CSV file, and the same computer with six CPU cores and hyperthreading, as we used to test gzip in Linux. Previously, we stated that xz creates smaller archives than gzip.
#TAR XZ MULTITHREADED ARCHIVE#
We decompress the file and extract its content into the current directory.Please note that we removed the J option here because –use-compress-program already sets the compression program.ĭecompressing a tar archive with xz is also a single step and identical to gzip (except for the different file extension): tar xvf Here, we specify the minimum compression level 1: tar cvf -use-compress-program='xz -1' *.csv We use this option to set the compression level, too. Tar allows setting the compression program through the –use-compress-program option. Which xz compression level does tar pick? It depends on our version of tar, but it probably is the default compression level 6. Unlike xz and gzip, tar doesn’t delete the input files after it creates the archive.Because of the v option, tar shows which files are added to the archive.
We compress all files with a csv extension in the current directory into the compressed archive,.
0 kommentar(er)
