![]() Single threaded LZip has the best compression and uses far less than the multithread version, with a 1/cores speed ratio.Īs for the rest of the config dir, it is much more compressible and much smaller unless you have a bunch of media files in there or something: On systems with 2 or less cores, ZSTD-5 is probably the best option. 4 is a good chunk faster and uses even less memory, but the compression ratio takes a similar hit. Memory constrained systems should use single threaded LZip for best compression or ZSTD levels 4 through 9 for best speed. ZSTD level 9 will typically use half the compression memory of 10. I would use ZSTD-5 if you retain a single backup, have a small db, or want the shortest downtime between upgrades.įaster sysems with ample memory like this make better use of ZSTD-10įor mem requirements, PLZip and ZSTD-10 can use huge amounts of memory, over a gig in some cases. I would use PLZip if retaining lots of backups is important, or if you have larger databases. Level 17 is where size starts to drop, but at that point it is the same speed as PLZip but still not anywhere close to the compression ratio. I tested ZSTD level 15, but the compressed data size was within 1% of level 10 for this type of data, but at half the speed. I did not bother with gzip and lzop because of their poor compression ratio. LZip is also apparently a better format from a data recovery perspective. PLZip has the best combination of file size and speed, it is 4 times faster than XZ because it can use all 4 cores. PBZip retains compatibility with bz2 files, which means compatibility with pretty much any archiving software, even ancient ones. ZSTD will also have the fastest decompression time. So who wins? Depends on the need, ZSTD-10 is faster than it takes to pull the new docker image (if done in parallel, but 5 is obviously the fastest. Tar -c -I"zstd -5 -T0" -f -5 /var/homeassistant/home-assistant_v2.db Tar -c -I"zstd -10 -T0" -f -10 /var/homeassistant/home-assistant_v2.dbĮven faster but compression still not great: Super fast and similar compression to bzip Tar -c -Ipbzip2 -f 2 /var/homeassistant/home-assistant_v2.db ![]() High performance implementation compatible with regular bzip decompression ![]() High performance implementation compatible with regular lzip decompressionĤ times faster than XZ with almost the same compression ratio (both use LZMA) Tar -cJf /var/homeassistant/home-assistant_v2.db Native compression needing no external libs or compressors Files are read off a SATA SSD, processor is a 4-core 4-thread Haswell Xeon, files then are written to another SSD. So you need/want compression, I did a comparison of some methods, speed and size, on a 1GB db file. For those of you using Docker with the standard DB (or even a non-docker install), who want to back up their config prior to pulling a new release, you may also want to backup your DB file, even if it is large.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |