No uploads possible - Insufficient storage

gfr commented 11 years ago

Expected behaviour

The client should upload the files.

Actual behaviour

However there is a lot of free disk space available and ownCloud quota is set to unlimited

# df -h
Dateisystem               Größe Benutzt Verf. Verw% Eingehängt auf
/dev/md0                    37G     24G   12G   67% /
none                       4,0K       0  4,0K    0% /sys/fs/cgroup
udev                       3,9G     12K  3,9G    1% /dev
tmpfs                      791M    2,4M  788M    1% /run
none                       5,0M    4,0K  5,0M    1% /run/lock
none                       3,9G       0  3,9G    0% /run/shm
none                       100M     12K  100M    1% /run/user
/dev/md1                   881G    628G  209G   76% /data

Server configuration

Operating system: Ubuntu 13.04

Web server: Apache

Database: MySQL 5.5.32

PHP version: 5.4.9-4ubuntu2.3

ownCloud version: 5.0.12

Client configuration

Owncloud Sync Client 1.4.1

Operating system Windows 7 x64

Logs

ownCloud log (data/owncloud.log)

{"app":"PHP","message":"filemtime(): stat failed for \/data\/owncloud\/\/xxx\/files\/Daten\/Fotos\/xxx 2oo4 - 2oo8\/xxx-xxx at \/var\/www\/owncloud\/lib\/files\/storage\/local.php#92","level":2,"time":"2013-10-07T07:59:35+00:00"}
{"app":"PHP","message":"filemtime(): stat failed for \/data\/owncloud\/\/xxx\/files\/Daten\/Fotos\/xxx 2oo4 - 2oo8\/xxx-xxx at \/var\/www\/owncloud\/lib\/files\/storage\/local.php#92","level":2,"time":"2013-10-07T07:59:35+00:00"}
{"app":"PHP","message":"filemtime(): stat failed for \/data\/owncloud\/\/xxx\/files\/Daten\/Fotos\/xxx 2oo4 - 2oo8\/xxx-xxx at \/var\/www\/owncloud\/lib\/files\/storage\/local.php#92","level":2,"time":"2013-10-07T07:59:35+00:00"}

karlitschek commented 11 years ago

Can you check the quota at the users page?

gfr commented 11 years ago

Users page says: Du verwendest 4.8 GB der verfügbaren 212.5 GB

DeepDiver1975 commented 11 years ago

@gfr Can we please have a screenshot of the insufficient message? THX

gfr commented 11 years ago

Here you are: oc-screen

gfr commented 11 years ago

Any ideas how to debug this issue?

karlitschek commented 11 years ago

Strange. Can you try to upload a file from the webinterface? Does this work and if not, what error message do you get? Can you try the same via WebDAV please? Thanks.

neebski commented 11 years ago

I am getting this same issue. It's intermittent though. I'll be syncing via the owncloud client and it shows in the sync log locally. I'll login to the web interface and receive an error when viewing the storage usage in personal settings. I'll get a screenshot next time this happens. On Oct 10, 2013 4:27 AM, "Frank Karlitschek" notifications@github.com wrote:

Strange. Can you try to upload a file from the webinterface? Does this work and if not, what error message do you get? Can you try the same via WebDAV please? Thanks.

— Reply to this email directly or view it on GitHubhttps://github.com/owncloud/core/issues/5163#issuecomment-26036569 .

neebski commented 11 years ago

Here we go, OC6

screen shot 2013-10-11 at 2 51 30 pm

neebski commented 11 years ago

screen shot 2013-10-11 at 2 52 33 pm

gfr commented 10 years ago

My root filesystem has 12GB of free space and my owncloud directory on an extra partition has a size of 12GB too. Could it be that there are some wrong calculations so that owncloud checks if there is enough space on the root filesystem for all the data?

The webinterface of owncloud is showing the right amount of freespace. Also the upload is working as expected. Access via webdav is not possible. Windows says that the connected device is not working as expected.

clipo commented 10 years ago

I have the same problem. The quota for the disk is set to "unlimited" and the account has a default "unlimited" storage setting in owncloud.

neebski commented 10 years ago

Just tried setting all users to a 10 GB manually - didn't work Tried uploading on the website - didn't work error stating not enough space, next to the upload icon where it would normally say the file size available to be uploaded noted "Upload Max. 0 B" not sure but this might be our issue. Tried changing my PHP.ini config a bit with no luck.

pornex commented 10 years ago

Same issure here!! But I found out, if you add file by file to your owncloud directory (e.g., /home/user/myOwnCloud), the syncing process proceeds perfectly. If you put into your owncloud directory a bunch of files at the same time, the syncing process failds becaus of "insufficient storage".

Somes ideas here?

All the best

PVince81 commented 10 years ago

Yes @pornex, I just managed to reproduce it. See #5509

It seems the "size" column in the DB is reset to "-1" each time a scan is running, but that value is needed to compute the free size, so the "free size" becomes zero while a scanning process is running. When the scanning process is done, the updated size is written into that "size" column, which explains why it works when you do it with smaller sync "sessions".

See #5509

Edit: sync -> scan in the first sentence.

Scanning is the process that checks file thumbnails and updates the directory sizes in the DB.

PVince81 commented 10 years ago

Okay, I am assuming that this ticket here is about not being able to upload with UNLIMITED, which means that no quota is set. This is not the same issue as #5509.

@pornex @neebski can you confirm that you also get the "Insufficient Storage" issue even when no quota is set ?

Did you all guys set a quota at first, then removed it afterwards ? Are you guys using encryption ?

I'm just trying to figure out how to reproduce this issue.

PVince81 commented 10 years ago

Do you have the "data" dir on a separate non-root partition ? If yes, did you mount it into the owncloud dir or just modified config.php to point at it ?

I'm going to try that next.

clipo commented 10 years ago

In my case, I have the quota disabled (it was never enabled).

Carl Lipo, Professor Department of Anthropology and IIRMES California State University Long Beach 1250 Bellflower Blvd. Long Beach, CA 90840

Ph: 562-985-2393 Fx: 562-985-5179 Email: clipo@csulb.edumailto:clipo@csulb.edu Blog: http://www.evobeach.com Web: http://www.lipolab.org

On Nov 4, 2013, at 8:46 :33AM, Vincent Petry notifications@github.com<mailto:notifications@github.com> wrote:

Okay, I am assuming that this ticket here is about not being able to upload with UNLIMITED, which means that no quota is set. This is not the same issue as #5509https://github.com/owncloud/core/issues/5509.

@pornexhttps://github.com/pornex @neebskihttps://github.com/neebski can you confirm that you also get the "Insufficient Storage" issue even when no quota is set ?

Did you all guys set a quota at first, then removed it afterwards ? Are you guys using encryption ?

I'm just trying to figure out how to reproduce this issue.

— Reply to this email directly or view it on GitHubhttps://github.com/owncloud/core/issues/5163#issuecomment-27700716.

PVince81 commented 10 years ago

Just tried with OC6 Beta 2 and OC 5.0.12 using a separate partition for the data. I've created a new user with 'unlimited' quota. The personal page shows the correct free space value. I'm able to upload files. This is on openSUSE 12.3 32 bits with PHP 5.3.17

I'm going to have a try with a setup as close as possible to @gfr's (with Ubuntu 13.10)

kiranos commented 10 years ago

Its not as simple as inodes are hitting the roof?

df -i instead of df -h

neebski commented 10 years ago

@PVince81 I can't say I'm having the issue now that I have oc 6 beta 2 installed...

PVince81 commented 10 years ago

@gfr are you able to test with OC 6 Beta 2 ? Else you can wait for 5.0.13 and try with that one instead. I'll have a quick go with Ubuntu 13.04 tomorrow to be closer to @gfr's env and PHP version.

pornex commented 10 years ago

I've set quota first and disabled it afterwards. I've no problems since I disabled it. The data directory (/home/username/ocData/) differs from the owncloud directory (/var/www/username/html/owncloud).

PVince81 commented 10 years ago

@pornex ok thanks for the info, so your issue was likely the one from #5509

pornex commented 10 years ago

@PVince81 exactly. Just have seen in #5509, that some related issue is written here. Just to give further information to help out a bit. just my 2 cents ;-)

PVince81 commented 10 years ago

Guys, pleas have a try with OC6 beta 5. There have been further fixes to the total size calculation which also affect your cases where quota is disabled.

I'm going to close this ticket for now as I think this should be covered. If you still have issues with "insufficient storage" appearing with disable quota, feel free to reopen.

Thanks.

PVince81 commented 10 years ago

Should be fixed by this PR #5924

nicokaiser commented 10 years ago

Looks good with v6.0.0beta5

PVince81 commented 10 years ago

Thanks for the info @nicokaiser. Would be good to hear from @gfr @neebski and @clipo as well :smile:

neebski commented 10 years ago

No issues OC6 beta 5. Thanks! On Nov 23, 2013 9:03 AM, "Vincent Petry" notifications@github.com wrote:

Thanks for th einf @nicokaiser https://github.com/nicokaiser. Would be good to hear from @gfr https://github.com/gfr @neebskihttps://github.com/neebskiand @clipo https://github.com/clipo as well [image: :smile:]

— Reply to this email directly or view it on GitHubhttps://github.com/owncloud/core/issues/5163#issuecomment-29132892 .

Boran commented 10 years ago

I have OC6 RC4 and just got hit with this "Insufficient storage" using a Mac client (1.4.2 stable). On the same server I have a Windows user + 1.50beta2 client and no problems. Its not a file system or inode issue.

It happened after creating a new account, for the mac, and trying to upload 2GB of files (quota was 10GB) I've now disable quotas, but the mac client still sits there say "calculating quota". Tried to restart the client, and even to re initialize the account via Settings > modify client, to no avail. The recent changes and detailed sync protocol lists are empty. Connecting and authenticating via the web UI works fine.

Edit: Running the client with --logwindow says connection/credienatls ok, client is on the latest version, but then nothing else. Edit: moving to 1.50 beta3 helped, after resync several files were downloaded, but its stalling ("unknown error" on some files). Not much happening. So at least the original "Insufficient storage" problem has disappeared, just need to figure out how to get syncing going again..

PVince81 commented 10 years ago

@Boran please try again with OC 6.0.0a and the 1.5.0 sync client (non-beta). Are you using external storage ?

Boran commented 10 years ago

I'm not using external storage. I've just tested two 1.5.0 clients on Windows 8 with 600a. No problems (a folder with 1.5GB of test data synced fine). Mac will be tested tonight.

Boran commented 10 years ago

Actually on the two windows clients, an issue has appeared: windows shortcut files keep getting synced, every few minutes, although they have not changed:

15:33:12 test.LOTS OF FILES/apps.install/autoruns.exe.lnk ownCloud Download 502 B
15:33:12 owncloud-tests/ownCloud-config.lnk ownCloud Download 1.4 kB
15:26:56 test.LOTS OF FILES/apps.install/autoruns.exe.lnk ownCloud Upload 502 B
15:26:55 owncloud-tests/ownCloud-config.lnk ownCloud Upload 1.4 kB

both windows clients report this. Should I create a separate issue?

PVince81 commented 10 years ago

Yes, please make a separate issue. Could be a sync client issue: https://github.com/owncloud/mirall/

ZacharyDuBois commented 10 years ago

Same problem. I've had a ticket opened for awhile. Still no response: https://github.com/owncloud/mirall/issues/1245

PVince81 commented 10 years ago

@ZacharyDuBois can you check whether https://github.com/owncloud/core/issues/6526 is related to your issue, if yes, please join us there.

timmie commented 10 years ago

I have the same issue in OC6

after disabling the storage limit the sync works. It occurred after adding a lot of new binary files.

PVince81 commented 10 years ago

@timmie yes, there was another issue related to that in 6.0.0a which should be fixed in the next release: #6526

gfr commented 10 years ago

Today I had time to test this issue again. First I reinstalled the current owncloud server and also the current windows client. After a while the client stopped uploading the files and in the logfile I can see a lot of 403-Forbidden response codes. But suddenly the client started deleting a lot of local files. I found out that the client deleted all files which are missing on the server.

ZacharyDuBois commented 10 years ago

@gfr Please use the lastest ownCloud server and client. This has been fixed over at issue #6526.

gfr commented 10 years ago

@ZacharyDuBois I already use ownCloud server 6.0.1 and client 1.5.2

PVince81 commented 10 years ago

@gfr please double check the permissions in the data folder, the web server needs to be able to write there.

Please upgrade to 6.0.2. There is some new logging code that will output more useful information in the server's log in case of errors when syncing, so it might help finding out why you're getting the 403 forbidden error.

And lastly, CC @dragotin for the deletion behavior.

godfuture commented 10 years ago

Having the same problem. insufficient storage

Fatal   webdav  Exception: Sabre_DAV_Exception_InsufficientStorage:     2014-04-04T18:22:32+00:00
Error   PHP     filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/bachelorarbeit/harvard-dhbw-citation-style-for-word at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:22:32+00:00
Error   PHP     filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/bachelorarbeit/harvard-dhbw-citation-style-for-word at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:22:32+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/dokumentation/zeichnungen at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:22:55+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/dokumentation/zeichnungen at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:22:55+00:00
Fatal   webdav  Exception: Sabre_DAV_Exception_MethodNotAllowed: The resource you tried to create already exists    2014-04-04T18:22:55+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/dokumentation/zeichnungen at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:22:55+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/dokumentation at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:22:55+00:00
Fatal   webdav  Exception: Sabre_DAV_Exception_InsufficientStorage:     2014-04-04T18:22:54+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/dokumentation/trash at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135    2014-04-04T18:22:54+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/dokumentation/trash at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135    2014-04-04T18:22:54+00:00
Fatal   webdav  Exception: Sabre_DAV_Exception_MethodNotAllowed: The resource you tried to create already exists    2014-04-04T18:22:54+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/dokumentation/trash at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135    2014-04-04T18:22:54+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/dokumentation/zeichnungen at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:22:56+00:00
Fatal   webdav  Exception: Sabre_DAV_Exception_InsufficientStorage:     2014-04-04T18:22:55+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/dokumentation/zeichnungen at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:22:55+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/dokumentation/zeichnungen at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:22:55+00:00
Fatal   webdav  Exception: Sabre_DAV_Exception_MethodNotAllowed: The resource you tried to create already exists    2014-04-04T18:22:55+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/dokumentation/zeichnungen at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:22:55+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/dokumentation at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:22:55+00:00
Fatal   webdav  Exception: Sabre_DAV_Exception_InsufficientStorage:     2014-04-04T18:22:54+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/dokumentation/trash at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135    2014-04-04T18:22:54+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/dokumentation/trash at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135    2014-04-04T18:22:54+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/prasentation/temp at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:23:02+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/prasentation/temp at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:23:02+00:00
Fatal   webdav  Exception: Sabre_DAV_Exception_MethodNotAllowed: The resource you tried to create already exists    2014-04-04T18:23:02+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/prasentation/temp at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:23:02+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/prasentation at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135   2014-04-04T18:23:02+00:00
Fatal   webdav  Exception: Sabre_DAV_Exception_InsufficientStorage:     2014-04-04T18:22:58+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/prasentation at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135   2014-04-04T18:22:58+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/prasentation at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135   2014-04-04T18:22:57+00:00
Fatal   webdav  Exception: Sabre_DAV_Exception_MethodNotAllowed: The resource you tried to create already exists    2014-04-04T18:22:57+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/prasentation at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135   2014-04-04T18:22:57+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/dokumentation at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:27:26+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/dokumentation at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:27:25+00:00
Fatal   webdav  Exception: Sabre_DAV_Exception_MethodNotAllowed: The resource you tried to create already exists    2014-04-04T18:27:25+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/jave-ee-cocktailmixer/dokumentation at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:27:25+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/bachelorarbeit/wissenschaftliches-arbeiten at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135   2014-04-04T18:27:25+00:00
Fatal   webdav  Exception: Sabre_DAV_Exception_MethodNotAllowed: The resource you tried to create already exists    2014-04-04T18:27:25+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/bachelorarbeit/wissenschaftliches-arbeiten at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135   2014-04-04T18:27:25+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/bachelorarbeit/harvard-dhbw-citation-style-for-word at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:27:25+00:00
Fatal   webdav  Exception: Sabre_DAV_Exception_MethodNotAllowed: The resource you tried to create already exists    2014-04-04T18:27:25+00:00
Error   PHP filemtime(): stat failed for C:\inetpub\data\owncloud/future/files/computer/powel/bachelorarbeit/harvard-dhbw-citation-style-for-word at C:\inetpub\wwwroot\owncloud\lib\private\files\storage\mappedlocal.php#135  2014-04-04T18:27:25+00:00

Is the formation of the slash critical to the file lib? Owncloud is mixing the slash formations under windows... Path to data folder: C:\inetpub\data\owncloud (backslash) Path to user folder: /future/files/ (forwardslash)

Owncloud 6.0.2 Client 1.5.3 IIS 7.5 PHP 5.5

PVince81 commented 10 years ago

@godfuture are you trying to upload a file that is bigger than 50% of the remaining space ? Can you check the remaining space on your server while it is uploading ? This is because file chunks are uploaded into the cache folder first, then assembled into a part file. I suspect it could be that.

Are you using quota ?

It might be more useful to raise a new issue because it might not be the same cause as the original one.

owncloud / core