search

wimleers / fileconveyor

File Conveyor is a daemon written in Python to detect, process and sync files. In particular, it's designed to sync files to CDNs. Amazon S3 and Rackspace Cloud Files, as well as any Origin Pull or (S)FTP Push CDN, are supported. Originally written for my bachelor thesis at Hasselt University in Belgium.
https://wimleers.com/fileconveyor
The Unlicense
341 stars 95 forks source link

Transporter not finding file #48

Closed unixbhaskar closed 13 years ago

unixbhaskar commented 13 years ago

from sets import Set, ImmutableSet 2011-03-18 17:14:56,868 - Arbitrator - WARNING - Arbitrator is initializing. 2011-03-18 17:14:56,911 - Arbitrator - WARNING - Loaded config file. 2011-03-18 17:14:57,774 - Arbitrator - WARNING - Created 'symlink_or_copy' transporter for the 'bhaskar-laptop' server. 2011-03-18 17:14:57,774 - Arbitrator - WARNING - Server connection tests succesful! 2011-03-18 17:14:57,775 - Arbitrator - WARNING - Setup: created transporter pool for the 'bhaskar-laptop' server. 2011-03-18 17:14:57,780 - Arbitrator - WARNING - Setup: initialized 'pipeline' persistent queue, contains 0 items. 2011-03-18 17:14:57,782 - Arbitrator - WARNING - Setup: initialized 'files_in_pipeline' persistent list, contains 16 items. 2011-03-18 17:14:57,785 - Arbitrator - WARNING - Setup: initialized 'failed_files' persistent list, contains 169 items. 2011-03-18 17:14:57,842 - Arbitrator - WARNING - Setup: moved 16 items from the 'files_in_pipeline' persistent list into the 'pipeline' persistent queue. 2011-03-18 17:14:57,931 - Arbitrator - WARNING - Moved 20 items from the 'failed_files' persistent list into the 'pipeline' persistent queue. 2011-03-18 17:14:57,939 - Arbitrator - WARNING - Setup: connected to the synced files DB. Contains metadata for 18 previously synced files. 2011-03-18 17:14:58,166 - Arbitrator - WARNING - Setup: initialized FSMonitor. 2011-03-18 17:14:58,189 - Arbitrator - WARNING - Fully up and running now. 2011-03-18 17:14:59,285 - Arbitrator - WARNING - Created 'symlink_or_copy' transporter for the 'bhaskar-laptop' server. 2011-03-18 17:14:59,692 - Arbitrator - WARNING - Created 'symlink_or_copy' transporter for the 'bhaskar-laptop' server. 2011-03-18 17:14:59,788 - Arbitrator.Transporter - ERROR - The transporter 'SYMLINK_OR_COPY' has failed while transporting the file '/tmp/daemon/var/www/drupal/themes/pushbutton/tabs-option-hover-rtl.png' (action: 1). Error: '[Errno 2] No such file or directory: '/tmp/daemon/var/www/drupal/themes/pushbutton/tabs-option-hover-rtl.png''. 2011-03-18 17:14:59,789 - Arbitrator.Transporter - ERROR - The transporter 'SYMLINK_OR_COPY' has failed while transporting the file '/tmp/daemon/var/www/drupal/themes/pushbutton/arrow-prev-hover.png' (action: 1). Error: '[Errno 2] No such file or directory: '/tmp/daemon/var/www/drupal/themes/pushbutton/arrow-prev-hover.png''. 2011-03-18 17:14:59,904 - Arbitrator.ProcessorChain - ERROR - The processsor 'yui_compressor.YUICompressor' has failed while processing the file '/var/www/drupal/misc/collapse.js'. Exception class: <type 'exceptions.IOError'>. Message: [Errno 2] No such file or directory: '/tmp/daemon/var/www/drupal/misc/collapse.js.tmp'. 2011-03-18 17:14:59,922 - Arbitrator - WARNING - Retry queue -> 'failed_files' persistent list: '/var/www/drupal/themes/pushbutton/tabs-option-hover-rtl.png'. Retrying later. 2011-03-18 17:14:59,927 - Arbitrator - WARNING - Retry queue -> 'failed_files' persistent list: '/var/www/drupal/themes/pushbutton/arrow-prev-hover.png'. Retrying later. 2011-03-18 17:14:59,931 - Arbitrator - WARNING - Retry queue -> 'failed_files' persistent list: '/var/www/drupal/misc/collapse.js'. Retrying later. 2011-03-18 17:15:00,137 - Arbitrator.ProcessorChain - ERROR - The processsor 'yui_compressor.YUICompressor' has failed while processing the file '/var/www/drupal/misc/tableselect.js'. Exception class: <type 'exceptions.IOError'>. Message: [Errno 2] No such file or directory: '/tmp/daemon/var/www/drupal/misc/tableselect.js.tmp'. 2011-03-18 17:15:00,195 - Arbitrator.Transporter - ERROR - The transporter 'SYMLINK_OR_COPY' has failed while transporting the file '/tmp/daemon/var/www/drupal/themes/pushbutton/tabs-option-off.png' (action: 1). Error: '[Errno 2] No such file or directory: '/tmp/daemon/var/www/drupal/themes/pushbutton/tabs-option-off.png''. 2011-03-18 17:15:00,290 - Arbitrator.Transporter - ERROR - The transporter 'SYMLINK_OR_COPY' has failed while transporting the file '/tmp/daemon/var/www/drupal/misc/watchdog-error.png' (action: 1). Error: '[Errno 2] No such file or directory: '/tmp/daemon/var/www/drupal/misc/watchdog-error.png''. 2011-03-18 17:15:00,374 - Arbitrator.ProcessorChain - ERROR - The processsor 'yui_compressor.YUICompressor' has failed while processing the file '/var/www/drupal/modules/locale/locale.css'. Exception class: <type 'exceptions.IOError'>. Message: [Errno 2] No such file or directory: '/tmp/daemon/var/www/drupal/modules/locale/locale.css.tmp'. 2011-03-18 17:15:00,381 - Arbitrator - WARNING - Retry queue -> 'failed_files' persistent list: '/var/www/drupal/misc/tableselect.js'. Retrying later. 2011-03-18 17:15:00,385 - Arbitrator - WARNING - Retry queue -> 'failed_files' persistent list: '/var/www/drupal/themes/pushbutton/tabs-option-off.png'. Retrying later. 2011-03-18 17:15:00,392 - Arbitrator - WARNING - Retry queue -> 'failed_files' persistent list: '/var/www/drupal/misc/watchdog-error.png'. Retrying later. 2011-03-18 17:15:00,400 - Arbitrator - WARNING - Retry queue -> 'failed_files' persistent list: '/var/www/drupal/modules/locale/locale.css'. Retrying later. 2011-03-18 17:15:00,809 - Arbitrator.ProcessorChain - ERROR - The processsor 'yui_compressor.YUICompressor' has failed while processing the file '/var/www/drupal/modules/block/block.css'. Exception class: <type 'exceptions.IOError'>. Message: [Errno 2] No such file or directory: '/tmp/daemon/var/www/drupal/modules/block/block.css.tmp'. ^C2011-03-18 17:15:00,954 - Arbitrator - WARNING - Signaling to stop. 2011-03-18 17:15:01,005 - Arbitrator - WARNING - Stopping. 2011-03-18 17:15:01,141 - Arbitrator - WARNING - Stopped FSMonitor. ^C2011-03-18 17:15:01,698 - Arbitrator - WARNING - Stopped transporters for the 'bhaskar-laptop' server. 2011-03-18 17:15:01,698 - Arbitrator - WARNING - 'pipeline' persistent queue contains 0 items. 2011-03-18 17:15:01,699 - Arbitrator - WARNING - 'files_in_pipeline' persistent list contains 29 items. 2011-03-18 17:15:01,699 - Arbitrator - WARNING - 'failed_files' persistent list contains 156 items. 2011-03-18 17:15:01,700 - Arbitrator - WARNING - synced files DB contains metadata for 18 synced files. 2011-03-18 17:15:01,703 - Arbitrator - WARNING - Signaling to stop.

Here is my config.xml:

<?xml version="1.0" encoding="UTF-8"?> 2 3 4 5 6 7 8 9 10 11 12 /var/www/daemontest 13 http://bhaskar-laptop/daemontest 14 15 24 25 26 27 28 29 30 misc:profiles:modules:themes:sites/all:sites/default 31 ico:js:css:gif:png:jpg:jpeg:svg:swf 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 modules:misc 49 flv:mov:avi:wmv 50 1000000 51 52 53 55 56 57 58 59 60 61 62 mov:avi:mkv 63 ./([a-zA-Z- ])+720([a-zA-Z- ]).[a-zA-Z]{3}$ 64 65 66 67 68 69 70 71

Kindly help.

Cheers! Bhaskar

emosbaugh commented 13 years ago

Same issue here. Any resolution? Thanks!

emosbaugh commented 13 years ago

I'm going to answer my own question. Java wasnt install on my CentOS server.

wimleers commented 13 years ago

Nice find, emosbaugh.

This was documented earlier today at https://github.com/wimleers/fileconveyor/wiki/Troubleshooting.