seflless
commented
11 years ago Hey David,
Yeah, I did see that article. Super cool. I've got some back logged task to add at least differential sync based on using the Etags support that's been added to Amazon S3 APIs. This allows you to at least check first if a fill has changed before bothering to send it up. Unfortunately it's file level and not sub file level like railgun/rsync.
I'll get around to that soon enough, just bust with other things. Oh and also I'd like to add support for gzipping (Using Google's new compressorhttp://techcrunch.com/2013/02/28/google-launches-zopfli-compression/) files too at upload time which should further speed up syncing to S3 and of course dramatically speed up http GETs of files from S3.
Francois
On Fri, Mar 8, 2013 at 12:19 PM, David Trejo notifications@github.comwrote:
Hey, did you read about railgun? blog.cloudflare.com/how-to-tell-how-well-railgun-is-working-for-y
Seems pretty cool. I feel like it'd be fun to write a node module that allows you to do the kind of differential request handling and file sending that railgun/rsync do.
As for the specifics of it... that's complicated.
Figured this might be interesting to you considering you wrote s3sync.
Cheers, D
— Reply to this email directly or view it on GitHubhttps://github.com/francoislaberge/s3sync/issues/1 .
Francois Laberge CTO Brass Monkey Inc. http://playbrassmonkey.com/ http://twitter.com/francoislabergehttp://linkedin.com/in/francoislaberge San Francisco | Boston
Hey, did you read about railgun? blog.cloudflare.com/how-to-tell-how-well-railgun-is-working-for-y
Seems pretty cool. I feel like it'd be fun to write a node module that allows you to do the kind of differential request handling and file sending that railgun/rsync do.
As for the specifics of it... that's complicated.
Figured this might be interesting to you considering you wrote s3sync.
Cheers, D