wimleers / fileconveyor

File Conveyor is a daemon written in Python to detect, process and sync files. In particular, it's designed to sync files to CDNs. Amazon S3 and Rackspace Cloud Files, as well as any Origin Pull or (S)FTP Push CDN, are supported. Originally written for my bachelor thesis at Hasselt University in Belgium.
https://wimleers.com/fileconveyor
The Unlicense
341 stars 95 forks source link

Issues with setup #115

Open chrisivens opened 12 years ago

chrisivens commented 12 years ago

I grabbed the latest version with pip on my RHEL 5 machine. My main problem was that the S3BotoStorage class that is called within transporter_s3.py had the wrong variables being sent to it. For now, I have edited mine to:

S3BotoStorage(
                self.settings["bucket_name"].encode('utf-8'),
                self.settings["access_key_id"].encode('utf-8'),
                self.settings["secret_access_key"].encode('utf-8'),
                "public-read",
                "public-read",
                self.__class__.headers
            )

I also had the issue of the failed files and the persistent queue causing an error when a file exists in both queues. This is documented in ticket #96. The above snippet also includes the fixes mentioned in ticket #85. I also encountered the issue mentioned in ticket #110 but I edited s3boto.py as quick hack.

jmcgonegal commented 12 years ago

This worked for me. Thank you.

wimleers commented 12 years ago

@chrisivens If you could send pull requests, that'd be great :)

chrisivens commented 12 years ago

I'll see what I can do with getting one over to you. My fork is a bit messed up because I've implemented a few changes like the swapping mosso and cumulus over. I've also deliberately broken file deletion propagation which looks to be fixed in a recent commit on here.

wimleers commented 12 years ago

Yes, you may want to set up a new branch, start from the 0.2-dev tag (which is equal to the tip of the master branch ATM), and then start cherry-picking commits from your own branch :)