search

redbo / cloudfuse

Filesystem (fuse) implemented on Mosso's Cloud Files
http://redbo.github.com/cloudfuse/
MIT License
392 stars 114 forks source link

df: `/media/cloudfiles': Transport endpoint is not connected #15

Open mandmZoom opened 13 years ago

mandmZoom commented 13 years ago

I keep getting this error periodically on my installation of cloud fuse and it occurs both on ubuntu 10.04 as well as 10.10. I am using rackspace cloud servers

when i type a df -h i see this error df: `/media/cloudfiles': Transport endpoint is not connected

and in the /var/log/syslog i see this error kernel: [249662.999667] cloudfuse[2459]: segfault at 1000000d7 ip 00007f8da9424095 sp 00007f8da460a000 error 4 in libxml2.so.2.7.7[7f8da93ec000+144000]

it has been really difficult for me to scale due to this issue occurring on my servers at randoom time intervals. My configuration is such that i mount all my media files to the cloud files and then all my servers can access the same files

The second issue is that if the media file is uploaded from one server it takes about 5 to 10 mins for the other server to see it

This is the command i use for mounting cloudfiles

sudo cloudfuse /media/cloudfiles -o allow_other,nonempty

Please let me know whats missing here?

intel352 commented 13 years ago

the cloudfuse configuration has a cache setting, so that's likely causing the delay between servers seeing the files (or cloud files is caching it's output).

additionally, I received the Transport error multiple times when attempting to copy a >5gb file to the cloudfuse mount point. Turns out that cloud files only supports 5gb file segments, so if you want a larger filesize, you must segment the files for storage.

Howto: http://www.rackspace.com/knowledge_center/index.php/Does_Cloud_Files_support_large_file_transfer

davidlevy commented 13 years ago

I am having the same problem ( Transport endpoint is not connected ) even with very low traffic (developement stage) and few files. Is there a way to reconnect automatically ?

It seems it just disconnects after some inactivity. Does it ?

mandmZoom commented 13 years ago

hi David, no there does not seem to be any resolution on this, so i am using nfs mounts

From: davidlevy reply@reply.github.com To: mandm_zoom@yahoo.com Sent: Saturday, July 30, 2011 5:02 PM Subject: Re: [cloudfuse] df: `/media/cloudfiles': Transport endpoint is not connected (#15)

I am having the same problem ( Transport endpoint is not connected ) even with very low traffic (developement stage) and few files. Is there a way to reconnect automatically ?

It seems it just disconnects after some inactivity. Does it ?

Reply to this email directly or view it on GitHub: https://github.com/redbo/cloudfuse/issues/15#issuecomment-1692045

davidlevy commented 13 years ago

@mandnZoom : you mean you could mount CloudFiles with NFS ?

as for me, I wrote a small sh script checking the mount point every x seconds and remounting it if necessary :S

mandmZoom commented 13 years ago

no i could not mount cloudfiles using NFS, so instead use a bigger server with more hard drive space

yes i also used a script to mount it every so often, but after a while all my apache connections started hanging, so i needed to reboot the server which was becoming very risky

From: davidlevy reply@reply.github.com To: mandm_zoom@yahoo.com Sent: Wednesday, August 3, 2011 6:16 AM Subject: Re: [cloudfuse] df: `/media/cloudfiles': Transport endpoint is not connected (#15)

@mandnZoom : you mean you could mount CloudFiles with NFS ?

as for me, I wrote a small sh script checking the mount point every x seconds and remounting it if necessary :S

Reply to this email directly or view it on GitHub: https://github.com/redbo/cloudfuse/issues/15#issuecomment-1716857

redbo commented 13 years ago

Sorry, I haven't been able to reproduce cloudfuse crashing or shutting down. Can you tell me what OS you're running on and what sort of operations you're doing on the mounted drive so I can try to reproduce?

mandmZoom commented 13 years ago

hi Thanks for the reply, I am running on ubuntu 10.04 and i am reading and writing media files to the mounted drive and i have more than 100k media files

From: redbo reply@reply.github.com To: mandm_zoom@yahoo.com Sent: Friday, August 12, 2011 6:10 AM Subject: Re: [cloudfuse] df: `/media/cloudfiles': Transport endpoint is not connected (#15)

Sorry, I haven't been able to reproduce cloudfuse crashing or shutting down. Can you tell me what OS you're running on and what sort of operations you're doing on the mounted drive so I can try to reproduce?

Reply to this email directly or view it on GitHub: https://github.com/redbo/cloudfuse/issues/15#issuecomment-1790173

davidlevy commented 13 years ago

@redbo : Same for me with Debian 5.

For now I have very few accesses per day (testing) and it's still disconnecting every once in a while (like once a day). Is there a timeout when no accesses are done for a long period of time ?

davidlevy commented 13 years ago

Still no fix/explanation ? :O thanks!

bocomrx commented 12 years ago

same for me with centos 5.8 also did remounting scripts. a daily one and a health-check one. the scripts will only work if the process (backup for example) is not stuck in the middle of operation. (or else, I can't umount, obviously)

help???

bocomrx commented 12 years ago

someone here mentioned nfs? how can i mount cloudfiles with nfs?