OneFS inline data reduction combines both real-time compression and deduplication. Compression uses a lossless algorithm to reduce the physical size of data when it is written to disk and decompresses the data when it is read back. More specifically, lossless compression reduces the number of bits in each file by identifying and reducing or eliminating statistical redundancy. No information is lost in lossless compression, and a file can easily be decompressed to its original form.
Deduplication differs from data compression in that it eliminates duplicate copies of repeating data. While compression algorithms identify redundant data inside individual files and encode the redundant data more efficiently, deduplication inspects data and identifies sections or even entire files that are identical. Then, it replaces them with a shared copy.
For Safety and Security applications we disable dedupe and compression to improve writing performance. Based on extensive testing in the Dell Technologies Safety & Security Lab, we verified that both inline compression and deduplication offer no benefits for the unique and non-stop writing VMS video footage captured from cameras,