Monthly Archives: February 2007

The rsync algorithm applied to S3

Many people would like to see rsync work with S3, unfortunately S3 is a “dumb” file storage that can’t run rsync. It’s possible to run rsync on a EC2 that accesses your files on S3, but it’s complex, (more) expensive and not elegant.
I spent some time reading the rsync algorithm and seeing how it could be adapted to S3 (or any other dumb file storage like a FTP server).

Continue reading