search

wimleers / fileconveyor

File Conveyor is a daemon written in Python to detect, process and sync files. In particular, it's designed to sync files to CDNs. Amazon S3 and Rackspace Cloud Files, as well as any Origin Pull or (S)FTP Push CDN, are supported. Originally written for my bachelor thesis at Hasselt University in Belgium.
https://wimleers.com/fileconveyor
The Unlicense
340 stars 95 forks source link

Mosso transporter - object has no attribute 'content_type' #102

Closed ghost closed 11 years ago

ghost commented 12 years ago

Hi,

After following the INSTALL.txt instructions for installing File Conveyor via PIP, I am receiving log messages similar to the this when attempting to use the Mosso Rackspace Cloudfiles transporter:

Error: ''cStringIO.StringO' object has no attribute 'content_type''.

It seems as though this is related to a new field 'content_type' added to the version of python-cloudfiles which was automatically installed by PIP - version 1.7.9.3. Is this a recognised issue? What version of the package is recommended to avoid issues with fileconveyor?

Kind regards, James Balean

mnestor commented 12 years ago

James, did you get anywhere with this yet?

mpoythress commented 12 years ago

Having the same issue, so would love to hear how to solve it...

webdobe commented 12 years ago

Subscribe. Same issue. Posted an issue at Drupal.org http://drupal.org/node/1460726 as I thought it may have something to do with the CDN module however I don't believe it does anymore. Something I would also like to note for this issue. When I execute file conveyor with arbitrator.py. The first lines that popup are: /opt/fileconveyor/fileconveyor/filter.py:10: DeprecationWarning: the sets module is deprecated from sets import Set, ImmutableSet 2012-02-29 20:38:52,016 - Arbitrator - WARNING - File Conveyor is initializing. 2012-02-29 20:38:52,029 - Arbitrator - WARNING - Loaded config file. /usr/lib/python2.6/site-packages/django_storages-1.1.4-py2.6.egg/storages/backends/mosso.py:11: PendingDeprecationWarning: The mosso module will be deprecated in version 1.2 of django-storages. The CloudFiles code has been moved intodjango-cumulus at http://github.com/richleland/django-cumulus. PendingDeprecationWarning) 2012-02-29 14:38:52,338 - Arbitrator - WARNING - Created 'mosso' transporter for the 'cloudfiles' server. 2012-02-29 14:38:52,339 - Arbitrator - WARNING - Server connection tests succesful! 2012-02-29 14:38:52,340 - Arbitrator - WARNING - Setup: created transporter pool for the 'cloudfiles' server. 2012-02-29 14:38:52,540 - Arbitrator - WARNING - Setup: initialized 'pipeline' persistent queue, contains 5964 items. 2012-02-29 14:38:52,541 - Arbitrator - WARNING - Setup: initialized 'files_in_pipeline' persistent list, contains 26 items. 2012-02-29 14:38:52,579 - Arbitrator - WARNING - Setup: initialized 'failed_files' persistent list, contains 3075 items. 2012-02-29 14:38:52,580 - Arbitrator - WARNING - Setup: initialized 'files_to_delete' persistent list, contains 0 items. 2012-02-29 14:38:52,766 - Arbitrator - WARNING - Setup: moved 26 items from the 'files_in_pipeline' persistent list into the 'pipeline' persistent queue. 2012-02-29 14:38:52,915 - Arbitrator - WARNING - Moved 20 items from the 'failed_files' persistent list into the 'pipeline' persistent queue. 2012-02-29 14:38:52,915 - Arbitrator - WARNING - Setup: connected to the synced files DB. Contains metadata for 0 previously synced files. ^F2012-02-29 14:38:53,343 - Arbitrator - WARNING - Setup: initialized FSMonitor. 2012-02-29 14:38:53,409 - Arbitrator - WARNING - Fully up and running now. 2012-02-29 14:38:54,472 - Arbitrator - WARNING - Created 'mosso' transporter for the 'cloudfiles' server. 2012-02-29 14:38:54,474 - Arbitrator - WARNING - Created 'mosso' transporter for the 'cloudfiles' server.

Any help from Mr. Wim Leers about this issue would be much appreciated.

satheshf12000 commented 12 years ago

Any updates on this issue guys? I'm getting the same error too..

2012-03-25 22:34:03,532 - Arbitrator.Transporter - ERROR - The transporter 'mosso' has failed while transporting the file '/tmp/fileconveyor/home/gallery/public_html/sites/all/modules/views_slideshow/contrib/views_slideshow_singleframe/help/images/admin/content/types/add-content-type-link_1331802684.png' (action: 1). Error: ''cStringIO.StringO' object has no attribute 'content_type''.

If you've found a work around, please share the solution here for the community.

Any help is appreciated guys.

mpoythress commented 12 years ago

No workaround here; still dead in the water.

satheshf12000 commented 12 years ago

The patch here seems to work for me but please make you you have a backup of django-storages/storages/backends/mosso.py file..

http://code.larlet.fr/django-storages/issue/98/attributeerror-at-collectstatic-with

kennywyland commented 12 years ago

I'm trying to set this up for the first time and I've getting this problem as well.

Arbitrator.Transporter - ERROR - The transporter 'mosso' has failed while transporting the file '/home/drupal/html/modules/toolbar/toolbar-rtl.css' (action: 1). Error: ''cStringIO.StringO' object has no attribute 'content_type''.

Here is my config.xml:

[?xml version="1.0" encoding="UTF-8"?] [config] [!-- Sources --] [sources ignoredDirs="CVS:.svn"] [source name="drupal" scanPath="/home/drupal/html" documentRoot="/home/drupal/html" basePath="/" /] [/sources]

[!-- Servers --] [servers] [server name="cloudfiles" transporter="mosso"] [username]myusername[/username] [api_key]myapikey[/api_key] [container]DrupalTest[/container] [/server] [/servers]

[!-- Rules --] [rules] [rule for="drupal" label="CSS, JS, images and Flash"] [filter] [paths]misc:profiles:modules:themes:sites/all:sites/default[/paths] [extensions]ico:js:css:gif:png:jpg:jpeg:svg:swf[/extensions] [/filter] [processorChain] [!-- none, I just want to copy --] [/processorChain] [destinations] [destination server="cloudfiles" path="static" /] [/destinations] [/rule] [/rules] [/config]

chrisivens commented 12 years ago

Have a look at the fork by mrfelton (systemseed). They've incorporated cumulus instead of the deprecated mosso transporter.

wimleers commented 11 years ago

Fixed in #118.