search

wimleers / fileconveyor

File Conveyor is a daemon written in Python to detect, process and sync files. In particular, it's designed to sync files to CDNs. Amazon S3 and Rackspace Cloud Files, as well as any Origin Pull or (S)FTP Push CDN, are supported. Originally written for my bachelor thesis at Hasselt University in Belgium.
https://wimleers.com/fileconveyor
The Unlicense
341 stars 95 forks source link

Arbitrator keeps rejecting transporters #5

Closed farreres closed 15 years ago

farreres commented 15 years ago

This is the error

ERROR - The Transporter module 'transporters.transporter_ftp' could not be found.

May it be caused by some problem in the configuration? When I check transporters directory I see ftp has pyc extension so I understand it has been found and byte compiled.

wimleers commented 15 years ago

Now that's odd!

Could you please post your log file? And try running python arbitrator.py from within the daemon's directory, does that make any difference?

farreres commented 15 years ago

I don't know why did this happen. Now it is not happening anymore, although I have been moved from one host to another. Perhaps some environment variable badly set or anything.

wimleers commented 15 years ago

File Conveyor does not depend at all on environment variables. Not sure what caused this. Glad that it's solved though :)

synesthete commented 14 years ago

I am having similar trouble with the transporters being reported as not found.

2010-09-30 16:11:10,046 - Arbitrator - ERROR - The Transporter module 'transporters.transporter_cf' could not be found. <class 'main.TransporterAvailabilityTestError'> Consult the log file for details

The log shows:

2010-09-30 15:58:13,585 - Arbitrator - WARNING - Arbitrator is initializing. 2010-09-30 15:58:13,585 - Arbitrator - INFO - Loading config file. 2010-09-30 15:58:13,587 - Arbitrator.Config - INFO - Parsing sources. 2010-09-30 15:58:13,587 - Arbitrator.Config - INFO - Parsing servers. 2010-09-30 15:58:13,587 - Arbitrator.Config - INFO - Parsing rules. 2010-09-30 15:58:13,587 - Arbitrator - WARNING - Loaded config file. 2010-09-30 15:58:13,971 - Arbitrator - ERROR - The Transporter module 'transporters.transporter_cf' could not be found.

Sadly, not seeming all that informative.

I am on Dreamhost (which farreres also seemed to be). Have a python virtualenv running 2.5.2 and have installed pyinotify 0.9.0 . .pyc files are being generated for the transporters I have tried...ftp and cf.

Any insight or ideas on things to check would be most welcome.

IvanZugec commented 14 years ago

Yes I'm getting the same error. "ERROR - The Transporter module 'transporters.transporter_ftp' could not be found."

I'm on a Mac 10.5.8 "Python 2.5.1 (r251:54863, Feb 6 2009, 19:02:12)".

Also if "" is in the config.xml I get a "- ERROR - The Processor module 'link_updater' could not be found." error.

wimleers commented 14 years ago

Try calling arbitrator.py from within the same directory and see if that works — if it does, then that means something is wrong with File Conveyor's path handling.

I.e. you should change directories until you can type the following command: python arbitrator.py.

jdrusch commented 13 years ago

I encountered this problem and tracked it down to a more recent version of django being installed on the system.

I changed 1 line in arbitrator.py to fix:

Remove: sys.path.append(os.path.abspath(os.path.join(sys.path[0], 'dependencies')))
And replace with: sys.path.insert(1,os.path.abspath(os.path.join(sys.path[0], 'dependencies')))

wimleers commented 13 years ago

@aljosh: thanks for the detective work! Could you maybe fork this project, make the changes and then do a pull request? :)

jdrusch commented 13 years ago

Sure, I can try that when I make it back to the project I was working on (integrating cloudfiles with our website).