search

wimleers / fileconveyor

File Conveyor is a daemon written in Python to detect, process and sync files. In particular, it's designed to sync files to CDNs. Amazon S3 and Rackspace Cloud Files, as well as any Origin Pull or (S)FTP Push CDN, are supported. Originally written for my bachelor thesis at Hasselt University in Belgium.
https://wimleers.com/fileconveyor
The Unlicense
343 stars 95 forks source link

config.xml settings for Fileconveyor on CentOs and Drupal multi-sites #44

Closed wunluv closed 13 years ago

wunluv commented 13 years ago

Hi Wim,

I'm testing out fileconveyor with the Drupal CDN module.

I've setup the fileconveyor daemon on our CentOs vps with ftp push to a Cachefly CDN account. When I run the arbitrator file, the daemon does not appear to be picking up any of the files of the Drupal multi-site source I provided in the config.xml file, which leads me to think I have not configured this correctly.

Our drupal core is located at: /home/devmojah/domains/mojahflow/ Multi-sites are here: /home/devmojah/domains/mojahflow/sites/sitename.com

Excerpt from config.xml

<sources ignoredDirs="CVS:.svn">
<source name="MojahFlow" scanPath="/home/devmojah/domains/mojahflow/sites/flow.mojahmedia.net" documentRoot="/home/devmojah/domains/mojahflow/sites/flow.mojahmedia.net" basepath="/home/devmojah/domains/mojahflow/sites/flow.mojahmedia.net/" />
</sources>

Below is the terminal output. No files are sent to the CDN account.

[root@host code]# python arbitrator.py -v 2011-02-16 14:12:47,743 - Arbitrator - WARNING - Arbitrator is initializing. 2011-02-16 14:12:47,746 - Arbitrator - WARNING - Loaded config file. 2011-02-16 14:12:48,007 - Arbitrator - WARNING - Created 'ftp' transporter for the 'ftp push cdn' server. 2011-02-16 14:12:48,161 - Arbitrator - WARNING - Server connection tests succesful! 2011-02-16 14:12:48,186 - Arbitrator - WARNING - Setup: created transporter pool for the 'ftp push cdn' server. 2011-02-16 14:12:48,187 - Arbitrator - WARNING - Setup: initialized 'pipeline' persistent queue, contains 0 items. 2011-02-16 14:12:48,187 - Arbitrator - WARNING - Setup: initialized 'files_in_pipeline' persistent list, contains 0 items. 2011-02-16 14:12:48,188 - Arbitrator - WARNING - Setup: initialized 'failed_files' persistent list, contains 0 items. 2011-02-16 14:12:48,188 - Arbitrator - WARNING - Setup: moved 0 items from the 'files_in_pipeline' persistent list into the 'pipeline' persistent queue. 2011-02-16 14:12:48,189 - Arbitrator - WARNING - Setup: connected to the synced files DB. Contains metadata for 0 previously synced files. 2011-02-16 14:12:48,224 - Arbitrator - WARNING - Setup: initialized FSMonitor. 2011-02-16 14:12:48,224 - Arbitrator - WARNING - Fully up and running now

wimleers commented 13 years ago

And what are your filters?

wunluv commented 13 years ago
files:modules:themes ico:js:css:gif:png:jpg:jpeg:svg:swf

I'm closing this because I managed to get it working. It appears to have been something related to the sourcepath settings.

wimleers commented 13 years ago

Excellent :)