22 skills found
kopia / KopiaCross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.
bup / BupVery efficient backup system based on the git packfile format, providing fast incremental saves and global deduplication (among and within files, including virtual machine images). Please post problems or patches to the mailing list for discussion (see the end of the README below).
POW-Software / ByteSyncByteSync is a free and open-source tool for file synchronization, backup, and deduplication. It works locally or remotely, with no VPNs or firewall configuration required. Transfers only file differences, compresses data, encrypts end-to-end, and gives you full control over what and when to sync. Runs on Windows, Linux, and macOS.
xolox / DedupfsA Python FUSE file system that features transparent deduplication and compression which make it ideal for archiving backups.
yottabit42 / Gtakeout BackupScripts to assist download, and automate deduplication and backup, of Google Takeout archives.
back-me-up-scotty / BmusBmuS is a powerful free bash based enterprise level backup program for the automated backup of files, directories, and MySQL databases from a Linux system to a NAS or NAS to NAS. With the Docker version you can also backup Win and Mac system. It features encryption, cloud backup, deduplication, multi language support and much more.
rrrlasse / EXdupeUltra fast file archiver with deduplication and incremental backups
X-Ryl669 / FrostA backup program that does deduplication, compression, encryption
tummy-dot-com / Tummy BackupDisc-to-disc backup system using ZFS for deduplication and efficient storage.
iczelia / Modern RzipA backup suite. Supports FLZMA2, bzip3, LZ4, Zstandard, LSH i-node ordering deduplicating archiver, long range deduplication, encryption and recovery records
jedie / PyHardLinkBackupHardlink/Deduplication Backups with Python
drweb86 / ButilBUtil creates incremental backups, incremental synchronization and imports multimedia on your PC with deduplication and FTPS, SFTP, SMB/CIFS transports support for Windows and Linux.
NaPs / MartyAn efficient backup tool inspired by Git, saving your bandwidth and providing global deduplication at file level.
NetApp / SS CDCThe code provides an example C language based implementation of the idea proposed in the paper "SS-CDC: a two-stage parallel content-defined chunking for deduplicating backup storage". It provides an efficient parallel content-defined chunking (CDC) implementation for deduplication systems with Intel AVX-512 instructions, which can achieve high chunking speed as well as zero deduplication ratio reduction compared to sequential CDC methods.
patrickpclee / RevdedupRevDedup: Efficient Hybrid Inline and Out-of-line Deduplication for Backup Storage
zhanleewo / Lazy DeduplicationData deduplication, data reduction, capacity optimized storage - is a specialized data compression technique for eliminating redundant data in the storage file system. It is often designed to make network backups to disk faster and more economical. It removes redundant data segments to compress data into a highly compact form and makes it economical to store backups on disk drive instead of tape drive. The technique identifies unique chunks of data, or byte patterns and stores them during the time of analysis. The chunks of new data are hashed and compared with the existing hashes of the other chunks to determine if there is a match. This project is aimed at creating a data deduplication file system which performs post-processing (lazy) analysis on the data stored into the file system
yaroslaff / HashgetDeduplication/backup tool with extremely high 'compression' rate
courageJ / SMRA Submodular Maximization Rewriting Scheme in Deduplication-based Backup Systems (MSST 2017, TPDS 2019)
codyps / RsnapshotBackups using rsync and hard links for deduplication.
vaultah / ReplicatConfigurable and lightweight backup utility with deduplication and encryption
