Deduplicating copy utility
This utility copies files while deduplicating on the fly, even when the source and destination filesystem structures differ. Detected duplicates can either be omitted or replaced with hard/soft links to files in one or more reference locations, enabling merging and efficient consolidation of multiple hard drives holding partial backups (e.g. photos and music), maintaining complete source trees on a single destination, or copying only new files.
What it addresses
Many deduplication utilities rely on files being on the same filesystem or having the same structure.
Shared over time
Each entry reflects what was shared on that date. Details may have changed since then.
Deduplicating copy utility
This utility copies files while deduplicating on the fly, even when the source and destination filesystem structures differ. Detected duplicates can either be omitted or replaced with hard/soft links to files in one or more reference locations, enabling merging and efficient consolidation of multiple hard drives holding partial backups (e.g. photos and music), maintaining complete source trees on a single destination, or copying only new files.
Problem: Many deduplication utilities rely on files being on the same filesystem or having the same structure.
Posted by @publlus_enigma · Original comment ↗
“A copy utility that can efficiently deduplicate as it copies, even when the filesystem structure is different. Whilst there are many utilities that can deduplicate, they often either rely on files being on the same filesystem, or having the same structure. If a duplicate is detected, it can either be omitted or hard/soft links created to files in one or more reference locations.”