handyman5 / acd_fuse

FUSE filesystem driver for Amazon Cloud Drive
Other
187 stars 23 forks source link

Low {read} throughput - high CPU #9

Open conihorse opened 9 years ago

conihorse commented 9 years ago

Hi Firstly thanks for updating this!

I've been running tests on two different systems in separate locations with the same issue where I get ~100% CPU use from the python2 acd thread and throughput is maxed out at 200KB/s.

I'm measuring throughput rate using pv -r amazondrive/remotefile > ./localfile

I'm presuming that the low rate is linked to the high CPU? Is this usual performance? Cheers

conihorse commented 9 years ago

I should note filesize is 448M, so I wonder if this is the same issue as #7?

conihorse commented 9 years ago

Interesting that I don't get this issue when I am writing a file - ~670MB written at around 10MB/s - cpu was < 20%

handyman5 commented 9 years ago

I believe that the expected behavior is that writes go to the local cache and then return successfully to the calling process while they're being uploaded in the background, but I wrote this a long time ago and I don't really remember. Anyway, this entire library is a wrapper around HTML form fields, so I don't really expect superb performance from it. I'd be happy to accept any patches.