search

owncloud / core

:cloud: ownCloud web server core (Files, DAV, etc.)
https://owncloud.com
GNU Affero General Public License v3.0
8.32k stars 2.06k forks source link

server did not acknowledge the last chunk. (No e-tag were present) #12725

Closed toadhall closed 8 years ago

toadhall commented 9 years ago

Environment: root server Server: Debian Wheezy Database: SQLite Client: Debian Testing OC-Version: 7.0.3 PHP-Version: 5.4.35-0

Since updating to 7.0.3 I keep on getting this error:

The item is not synced because of previous errors: The server did not acknowledge the last chunk. (No e-tag were present)

Worked fine in version 7.0.2.1 and only started appearing on random files (all of the small, between 40 and 70kb) in version 7.0.3.

Please let me know if there is anything else you need from me (specific logs, etc.)

Many thanks in advance!

ghost commented 9 years ago

Hi,

seems finally someone has manged to report this in here. There is a longer thread at the forums about this issue: https://forum.owncloud.org/viewtopic.php?f=29&t=25164

PVince81 commented 9 years ago

Are you getting timeouts on the last chunk ? Does it take a long time for the request to finish ?

toadhall commented 9 years ago

Cheers PVince81,

nope, the client on my desktop is pretty quick in telling me that the server rejected the sync attempt.

PVince81 commented 9 years ago

Does this happen for any file or a specific file ? Could you use the issue template and post the server logs ? https://raw.github.com/owncloud/core/master/issue_template.md

You could also try upgrading to 7.0.4 but I'm not aware of any related fix in that version though.

multivac61 commented 9 years ago

I'm having the same problem with my setup. I have already updated to 7.0.4 but the errors persist. What can I do to help?

DeepDiver1975 commented 9 years ago

It would be great to have client and server logs for exactly the point in time when this happens.

I'm aware that we face timeout issues with large files being synced - for small files it has to be a different cause.

multivac61 commented 9 years ago

So, I followed the issue_template but I'm having some problems with getting the server-side log to function properly due to permission issues. Maybe you could point out how I could fix it. Here's the data filled out form so far...

Steps to reproduce

  1. Update Owncloud to 7.0.2 2. 3.

Expected behaviour

Tell us what should happen

There should not be an error message when trying to sync files. The files that give error message seem to be files I added AFTER updating to 7.0.2 and are of .gif format. Updating to the latest version, 7.0.4, has not solved the issue

Actual behaviour

Tell us what happens instead There is an error message which says something like: 'folder/picture.gif: The server did not acknowledge the last chunk. (No e-tag was present)' and 'folder/some_picture.png: The server did not acknowledge the last chunk'. I do however seem to be able to upload larger files of *.tar.gz format without any error messages

Server configuration

Operating system: Ubuntu 14.04.1 LTS

Web server: Default (newest version)

Database: Default (sqlite3)

PHP version: PHP 5.5.9-1ubuntu4.5

ownCloud version: (see ownCloud admin page) 7.0.4

Updated from an older ownCloud or fresh install: Updated from an older ownCloud (7.0.2)

List of activated apps: Default, none

The content of config/config.php:

<?php
$CONFIG = array (
  'instanceid' => XXX
  'passwordsalt' => XXX
  'trusted_domains' => 
  array (
    0 => XXX
    1 => XXX
  ),
  'datadirectory' => '/var/www/owncloud/data',
  'dbtype' => 'sqlite3',
  'version' => '7.0.4.2',
  'installed' => true,
  'logtimezone' => 'America/New_York',
  'logfile' => '/var/log/owncloud.log',
  'loglevel' => '0',
  'log_authfailip' => true,
  'theme' => '',
  'maintenance' => false,
  'dbtype' => 'sqlite3',
  'version' => '7.0.4.2',
  'installed' => true,
  'logtimezone' => 'America/New_York',
  'logfile' => '/var/log/owncloud.log',
  'loglevel' => '0',
  'log_authfailip' => true,
  'theme' => '',
  'maintenance' => false,
  'secret' => XXX
);

Are you using external storage, if yes which one: local/smb/sftp/... No

Are you using encryption: yes/no yes

Client configuration

Browser: Firefox

Operating system: Ubuntu 14.04

Logs

Web server error log

Insert your webserver log here

ownCloud log (data/owncloud.log)

{"reqId":"548a4821485f2","app":"PHP","message":"touch(): Unable to create file \/var\/log\/owncloud.log because Permission denied at \/var\/www\/owncloud\/lib\/private\/log\/owncloud.php#49","level":3,"time":"2014-12-11T20:42:57-05:00","method":"GET","url":"\/owncloud\/index.php\/settings\/ajax\/checksetup"}
{"reqId":"548a48275b386","app":"PHP","message":"touch(): Unable to create file \/var\/log\/owncloud.log because Permission denied at \/var\/www\/owncloud\/lib\/private\/log\/owncloud.php#49","level":3,"time":"2014-12-11T20:43:03-05:00","method":"GET","url":"\/owncloud\/index.php\/settings\/ajax\/getlog.php?offset=23&count=10"}
{"reqId":"548a4827aeffe","app":"PHP","message":"touch(): Unable to create file \/var\/log\/owncloud.log because Permission denied at \/var\/www\/owncloud\/lib\/private\/log\/owncloud.php#49","level":3,"time":"2014-12-11T20:43:03-05:00","method":"GET","url":"\/owncloud\/index.php\/settings\/ajax\/getlog.php?offset=23&count=10"}

I've been trying to edit my permissions but haven't succeded yet. The user 'www-data' needs to own the file \var\log\owncloud.log right?

Ubuntu client log

12-12 01:39:30:662 0x15bf6f0 !!! Mirall::PUTFileJob created for  QUrl( "https://my_webpage.com/owncloud" )  querying "/verkefni/Fuzz_lélegt.gif" 
12-12 01:39:30:662 0x15bf6f0 void Mirall::SyncEngine::slotJobCompleted(const Mirall::SyncFileItem&) "verkefni/MS20Clone2.gif" 6 "The item is not synced because of previous errors: Error downloading https://my_webpage.com/owncloud/remote.php/webdav/verkefni/MS20Clone2.gif - server replied: Internal Server Error" 
12-12 01:39:31:282 0x15bf6f0 SSL-Errors happened for url  "https://my_webpage.com/owncloud/remote.php/webdav/verkefni/Fuzz_lélegt.gif" 
12-12 01:39:31:283 0x15bf6f0    Error in  QSslCertificate( "3" , "8f:82:00:8e:01:ee:74:ae" , "nNVZ2Qic0aBz7c7+Xwg5fw==" , "Ramnode" , "Ramnode" , QMap() , QDateTime("mán sep 15 12:59:46 2014") , QDateTime("þri sep 15 12:59:46 2015") ) : "The host name did not match any of the valid hosts for this certificate" ( "The host name did not match any of the valid hosts for this certificate" ) 
12-12 01:39:31:283 0x15bf6f0    Error in  QSslCertificate( "3" , "8f:82:00:8e:01:ee:74:ae" , "nNVZ2Qic0aBz7c7+Xwg5fw==" , "Ramnode" , "Ramnode" , QMap() , QDateTime("mán sep 15 12:59:46 2014") , QDateTime("þri sep 15 12:59:46 2015") ) : "The certificate is self-signed, and untrusted" ( "The certificate is self-signed, and untrusted" ) 
12-12 01:39:31:284 0x15bf6f0 Certs are already known and trusted, Errors are not valid. 
12-12 01:39:32:575 0x15bf6f0 void Mirall::PropagateUploadFileQNAM::slotPutFinished()  QUrl( "https://my_webpage.com/owncloud/remote.php/webdav/verkefni/Fuzz_lélegt.gif" )  FINISHED WITH STATUS 0 "" QVariant(int, 302) QVariant(QString, "Found") 
12-12 01:39:32:575 0x15bf6f0 This error is not blacklisted  0 
12-12 01:39:32:575 0x15bf6f0 void Mirall::SyncEngine::slotJobCompleted(const Mirall::SyncFileItem&) "verkefni/Fuzz_lélegt.gif" 2 "The server did not acknowledge the last chunk. (No e-tag were present)" 
12-12 01:39:32:582 0x15bf6f0 void Mirall::AbstractNetworkJob::setTimeout(qint64) 300000 
12-12 01:39:32:582 0x15bf6f0 !!! Mirall::PUTFileJob created for  QUrl( "https://my_webpage.com/owncloud" )  querying "/verkefni/png_cookie_by_ellatutorials-d5r8nel.png" 
12-12 01:39:32:583 0x15bf6f0 void Mirall::AbstractNetworkJob::setTimeout(qint64) 300000 
12-12 01:39:32:583 0x15bf6f0 !!! Mirall::PUTFileJob created for  QUrl( "https://my_webpage.com/owncloud" )  querying "/verkefni/voodoolaboverdrive.gif" 
12-12 01:39:33:202 0x15bf6f0 SSL-Errors happened for url  "https://my_webpage.com/owncloud/remote.php/webdav/verkefni/voodoolaboverdrive.gif" 
12-12 01:39:33:202 0x15bf6f0    Error in  QSslCertificate( "3" , "8f:82:00:8e:01:ee:74:ae" , "nNVZ2Qic0aBz7c7+Xwg5fw==" , "Ramnode" , "Ramnode" , QMap() , QDateTime("mán sep 15 12:59:46 2014") , QDateTime("þri sep 15 12:59:46 2015") ) : "The host name did not match any of the valid hosts for this certificate" ( "The host name did not match any of the valid hosts for this certificate" ) 
12-12 01:39:33:202 0x15bf6f0    Error in  QSslCertificate( "3" , "8f:82:00:8e:01:ee:74:ae" , "nNVZ2Qic0aBz7c7+Xwg5fw==" , "Ramnode" , "Ramnode" , QMap() , QDateTime("mán sep 15 12:59:46 2014") , QDateTime("þri sep 15 12:59:46 2015") ) : "The certificate is self-signed, and untrusted" ( "The certificate is self-signed, and untrusted" ) 
12-12 01:39:33:203 0x15bf6f0 Certs are already known and trusted, Errors are not valid. 
12-12 01:39:33:899 0x15bf6f0 void Mirall::PropagateUploadFileQNAM::slotPutFinished()  QUrl( "https://my_webpage.com/owncloud/remote.php/webdav/verkefni/voodoolaboverdrive.gif" )  FINISHED WITH STATUS 0 "" QVariant(int, 302) QVariant(QString, "Found") 
12-12 01:39:33:899 0x15bf6f0 This error is not blacklisted  0 
12-12 01:39:33:899 0x15bf6f0 void Mirall::SyncEngine::slotJobCompleted(const Mirall::SyncFileItem&) "verkefni/voodoolaboverdrive.gif" 2 "The server did not acknowledge the last chunk. (No e-tag were present)" 
12-12 01:39:34:423 0x15bf6f0 void Mirall::PropagateUploadFileQNAM::slotPutFinished()  QUrl( "https://my_webpage.com/owncloud/remote.php/webdav/verkefni/png_cookie_by_ellatutorials-d5r8nel.png" )  FINISHED WITH STATUS 0 "" QVariant(int, 302) QVariant(QString, "Found") 
12-12 01:39:34:423 0x15bf6f0 This error is not blacklisted  0 
12-12 01:39:34:423 0x15bf6f0 void Mirall::SyncEngine::slotJobCompleted(const Mirall::SyncFileItem&) "verkefni/png_cookie_by_ellatutorials-d5r8nel.png" 2 "The server did not acknowledge the last chunk. (No e-tag were present)" 
12-12 01:39:34:514 0x15bf6f0 void Mirall::SyncJournalDb::walCheckpoint() took 0 msec 
12-12 01:39:34:515 0x15bf6f0 void Mirall::SyncJournalDb::commitInternal(const QString&, bool) Transaction commit  "All Finished."  
12-12 01:39:34:630 0x15bf6f0 CSync run took  14190 
12-12 01:39:34:632 0x15bf6f0 -> SyncEngine finished without problem. 
12-12 01:39:34:633 0x15bf6f0 Processing result list and logging took  0  Milliseconds. 
12-12 01:39:34:634 0x15bf6f0 OO folder slotSyncFinished: result:  3 
12-12 01:39:34:651 0x15bf6f0   ** error Strings:  ("verkefni/Fuzz_lélegt.gif: The server did not acknowledge the last chunk. (No e-tag were present)", "verkefni/png_cookie_by_ellatutorials-d5r8nel.png: The server did not acknowledge the last chunk. (No e-tag were present)", "verkefni/voodoolaboverdrive.gif: The server did not acknowledge the last chunk. (No e-tag were present)") 
12-12 01:39:34:651 0x15bf6f0     * owncloud csync thread finished with error 
12-12 01:39:34:651 0x15bf6f0 the last 1 syncs failed 
12-12 01:39:34:775 0x15bf6f0 Folder in overallStatus Message:  Mirall::Folder(0x1816ed0)  with name  "ownCloud" 
12-12 01:39:34:775 0x15bf6f0 Sync state changed for folder  "ownCloud" :  "Error" 
12-12 01:39:34:975 0x15bf6f0 <===================================== sync finished for  "ownCloud" 
12-12 01:39:35:176 0x15bf6f0 XX slotScheduleFolderSync: folderQueue size:  0
PVince81 commented 9 years ago

I've been trying to edit my permissions but haven't succeded yet. The user 'www-data' needs to own the file \var\log\owncloud.log right?

Yes. The web server must have permission to write into owncloud.log

PVince81 commented 9 years ago

Are you using a reverse proxy or anything that might truncate the files ? Can you give us the exact size of some of the failing files ?

toadhall commented 9 years ago

Right, here are my 2cts - oh, and no proxies and the current size of my odt file is 92k.

Steps to reproduce

  1. save file on local machine 2. 3.

Expected behaviour

Actual behaviour

well...

Server configuration

Operating System: Debian Wheezy Web server: Apache2 Database: SQLite PHP version: 5.4.35-0 ownCloud version: (see ownCloud admin page) 7.0.4 Updated from an older ownCloud or fresh install: updated from 5.x (progressively) List of activated apps: default? The content of config/config.php: root@178:~# cat /var/www/owncloud/config/config.php <?php $CONFIG = array ( 'instanceid' => 'XXX', 'passwordsalt' => 'XXX', 'trusted_domains' => array ( 0 => 'XXX', ), 'datadirectory' => '/var/www/owncloud/data', 'dbtype' => 'sqlite3', 'version' => '7.0.4.2', 'installed' => true, 'forcessl' => true, 'theme' => '', 'maintenance' => false, 'user_webdavauth_url' => 'XXX', 'mail_smtpmode' => 'smtp', 'mail_from_address' => 'XXX', 'mail_domain' => 'XXX', 'mail_smtpsecure' => 'tls', 'mail_smtpauthtype' => 'LOGIN', 'mail_smtpauth' => 1, 'mail_smtphost' => 'XXX', 'mail_smtpport' => 'XXX', 'mail_smtpname' => 'XXX', 'mail_smtppassword' => 'XXX', 'loglevel' => '0', 'secret' => 'XXX', ); Are you using external storage, if yes which one: local/smb/sftp/... NOPE Are you using encryption: yes/no yes

Client configuration

Browser: Iceweasel/Firefox Operating system: Debian testing

Logs

Web server error log

[Fri Dec 12 03:51:09 2014] [error] [client 217.112.97.187] File does not exist: /var/www/owncloud/vtigercrm [Fri Dec 12 11:13:45 2014] [error] [client 92.75.174.10] Negotiation: discovered file(s) matching request: /var/www/owncloud/settings/admin (None could be negotiated)., referer: https://XXX/index.php/apps/files/ [Fri Dec 12 11:13:46 2014] [error] [client 178.248.242.105] client denied by server configuration: /var/www/owncloud/data/htaccesstest.txt [Fri Dec 12 11:13:56 2014] [error] [client 92.75.174.10] Negotiation: discovered file(s) matching request: /var/www/owncloud/settings/ajax/checksetup (None could be negotiated)., referer: https://XXX/index.php/settings/admin

Insert your webserver log here

ownCloud log (data/owncloud.log)

{"reqId":"5481868f4ca8c","app":"OC\Files\Cache\Scanner","message":"!!! No reuse of etag for 'files\/translations\/XXX' !!! \ncache: Array\n(\n [fileid] => 26605\n [storage] => home::toad\n [path] => files\/translations\XXX\n [parent] => 746\n [name] => XXX\n [mimetype] => httpd\/unix-directory\n [mimepart] => httpd\n [size] => 2935772\n [mtime] => 1417706079\n [storage_mtime] => 1417706077\n [encrypted] => \n [unencrypted_size] => 2189241\n [etag] => 54807a5f4ad16\n [permissions] => 31\n)\n \ndata: Array\n(\n [mimetype] => httpd\/unix-directory\n [mtime] => 1417707028\n [size] => -1\n [etag] => 5481868fb3fea\n [storage_mtime] => 1417707028\n [permissions] => 31\n [parent] => 746\n)\n","level":0,"time":"2014-12-05T10:18:55+00:00","method":"PUT","url":"\/remote.php\/webdav\/translations\XXX/wd5.odt"}

Browser log

12-12 12:31:41:120 Item is on blacklist: "translations/XXX/wd5.odt" retries: 0 12-12 12:31:44:660 void Mirall::SyncEngine::slotJobCompleted(const Mirall::SyncFileItem&) "translations/XXX/wd5.odt" 6 "The item is not synced because of previous errors: The server did not acknowledge the last chunk. (No e-tag were present)" Insert your browser log here, this could for example include:

a) The javascript console log b) The network log c) ...

PVince81 commented 9 years ago

Okay, so you're both using encryption. Could be a clue.

Unfortunately the server log file doesn't contain any clue about what is happening with the last chunk :frowning:

adamsewell commented 9 years ago

I'm seeing the same issue with encryption as well.

maste9 commented 9 years ago

Steps to reproduce

Update OC from 7.0.3 to 7.0.4 Create file < 2MB in oc-directory Let desktop-client sync.

Expected behaviour

Sync should work properly.

Actual behaviour

Upload fails with No-E-Tag-message in client.

Server configuration

Operating system:

Raspbian for bananaPi (wheezy-based)

Web server:

Apache/2.2.22 (Debian)

Database:

sqlite3

PHP version:

PHP 5.4.35-0+deb7u2 (cli) (built: Nov 19 2014 13:13:59)

ownCloud version: (see ownCloud admin page)

ownCloud 7.0.4 (stable)

Updated from an older ownCloud or fresh install:

Updated via apt from 7.0.3

List of activated apps:

Acitivty, Bookmarks, Calendar, Contacts, Deleted Files, Documents, Encryption, External Storage Support, First Run, Dependencies, PDF Viewer, Pictures, Share Files, Text Editor, Updater, Versions, Charts, Mozilla_Sync

The content of config/config.php:

<?php $CONFIG = array ( 'instanceid' => 'oc7c54c4be43', 'passwordsalt' => '[secret]', 'datadirectory' => '/var/www/owncloud/data', 'dbtype' => 'sqlite3', 'version' => '7.0.3.4', 'installed' => true, 'forcessl' => true, 'theme' => '', 'maintenance' => false, 'enable_previews' => false, 'trusted_domains' => array ( 0 => '[mydomain.de]', 1 => '192.168.[x.x]', 2 => 'mirror.[mydomain.de]', ), 'mail_smtpmode' => 'php', 'mail_from_address' => 'owncloud', 'mail_domain' => '[mydomain.de]', 'loglevel' => '1', 'overwritewebroot' => '/owncloud', );

Are you using external storage, if yes which one: local/smb/sftp/...

sftp

Are you using encryption: yes

Client configuration

Browser:

Firefox 34.0

Operating system:

Linux Mint 17

Logs

owncloud.log

{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-12T21:11:39+00:00"}
{"app":"remote","message":"An exception occurred while executing 'UPDATE \"oc_filecache\" SET \"size\" = ?, \"unencrypted_size\"=? WHERE \"fileid\" = ?':\n\nSQLSTATE[HY000]: General error: 5 database is locked","level":4,"time":"2014-12-12T21:14:50+00:00"}
{"app":"PHP","message":"Session has been closed - no further changes to the session as allowed at \/var\/www\/owncloud\/lib\/private\/session\/memory.php#80","level":3,"time":"2014-12-12T21:14:50+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:15:38+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_delete): No preview providers","level":3,"time":"2014-12-12T21:15:38+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:15:38+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-12T21:15:38+00:00"}
{"app":"PHP","message":"unlink(\/maste9\/files_encryption\/share-keys\/Projekte\/#MuensteranerErklaerung.txt#.recovery_f8dc8165.shareKey): No such file or directory at \/var\/www\/owncloud\/apps\/files_trashbin\/lib\/trashbin.php#305","level":3,"time":"2014-12-12T21:16:00+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:16:00+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_delete_files): No preview providers","level":3,"time":"2014-12-12T21:16:00+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:16:13+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-12T21:16:13+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:19:02+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-12T21:19:02+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:22:24+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-12T21:22:24+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:23:48+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-12T21:23:48+00:00"}
{"app":"PHP","message":"unlink(\/maste9\/files_encryption\/share-keys\/Projekte\/#MuensteranerErklaerung.txt#.recovery_f8dc8165.shareKey): No such file or directory at \/var\/www\/owncloud\/apps\/files_trashbin\/lib\/trashbin.php#305","level":3,"time":"2014-12-12T21:25:24+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:25:24+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_delete_files): No preview providers","level":3,"time":"2014-12-12T21:25:24+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:25:32+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-12T21:25:32+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:27:19+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-12T21:27:19+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:28:27+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-12T21:28:27+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:29:29+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-12T21:29:29+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:32:19+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-12T21:32:19+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:34:07+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-12T21:34:07+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:34:41+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-12T21:34:41+00:00"}
{"app":"PHP","message":"unlink(\/maste9\/files_encryption\/share-keys\/Projekte\/#MuensteranerErklaerung.txt#.recovery_f8dc8165.shareKey): No such file or directory at \/var\/www\/owncloud\/apps\/files_trashbin\/lib\/trashbin.php#305","level":3,"time":"2014-12-12T21:36:54+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:36:55+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_delete_files): No preview providers","level":3,"time":"2014-12-12T21:36:55+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:37:02+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-12T21:37:02+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:38:13+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-12T21:38:13+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-12T21:44:20+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-12T21:44:20+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-13T18:16:00+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-13T18:16:00+00:00"}
{"app":"Encryption library","message":"No share key found for user \"maste9\" for file \"Namenloser Ordner\"","level":2,"time":"2014-12-13T18:16:18+00:00"}
{"app":"Encryption library","message":"No share key found for user \"recovery_f8dc8165\" for file \"Namenloser Ordner\"","level":2,"time":"2014-12-13T18:16:18+00:00"}
{"app":"Encryption library","message":"No share keys found for \"\/Projekte\/Namenloser Ordner\"","level":2,"time":"2014-12-13T18:16:18+00:00"}
{"app":"core","message":"unable to rename, file is not writable : files_encryption\/share-keys\/Projekte\/Namenloser Ordner","level":3,"time":"2014-12-13T18:16:22+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-13T18:36:05+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-13T18:36:05+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-14T19:08:00+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-14T19:08:00+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-14T19:08:36+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-14T19:08:36+00:00"}
{"app":"remote","message":"An exception occurred while executing 'UPDATE \"oc_filecache\" SET \"size\"=? WHERE \"fileid\" = ?':\n\nSQLSTATE[HY000]: General error: 5 database is locked","level":4,"time":"2014-12-14T19:08:42+00:00"}
{"app":"PHP","message":"Session has been closed - no further changes to the session as allowed at \/var\/www\/owncloud\/lib\/private\/session\/memory.php#80","level":3,"time":"2014-12-14T19:08:42+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-14T19:08:51+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-14T19:08:51+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-14T19:16:17+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-14T19:16:17+00:00"}
{"app":"remote","message":"An exception occurred while executing 'UPDATE \"oc_filecache\" SET \"size\"=? WHERE \"fileid\" = ?':\n\nSQLSTATE[HY000]: General error: 5 database is locked","level":4,"time":"2014-12-14T19:16:21+00:00"}
{"app":"PHP","message":"Session has been closed - no further changes to the session as allowed at \/var\/www\/owncloud\/lib\/private\/session\/memory.php#80","level":3,"time":"2014-12-14T19:16:21+00:00"}
{"app":"remote","message":"An exception occurred while executing 'UPDATE \"oc_filecache\" SET \"size\"=? WHERE \"fileid\" = ?':\n\nSQLSTATE[HY000]: General error: 5 database is locked","level":4,"time":"2014-12-14T19:16:28+00:00"}
{"app":"PHP","message":"Session has been closed - no further changes to the session as allowed at \/var\/www\/owncloud\/lib\/private\/session\/memory.php#80","level":3,"time":"2014-12-14T19:16:28+00:00"}
{"app":"remote","message":"An exception occurred while executing 'UPDATE \"oc_filecache\" SET \"unencrypted_size\"=? WHERE \"fileid\" = ?':\n\nSQLSTATE[HY000]: General error: 5 database is locked","level":4,"time":"2014-12-14T19:16:28+00:00"}
{"app":"PHP","message":"Session has been closed - no further changes to the session as allowed at \/var\/www\/owncloud\/lib\/private\/session\/memory.php#80","level":3,"time":"2014-12-14T19:16:28+00:00"}
{"app":"remote","message":"An exception occurred while executing 'UPDATE \"oc_filecache\" SET \"size\"=? WHERE \"fileid\" = ?':\n\nSQLSTATE[HY000]: General error: 5 database is locked","level":4,"time":"2014-12-14T19:16:55+00:00"}
{"app":"PHP","message":"Session has been closed - no further changes to the session as allowed at \/var\/www\/owncloud\/lib\/private\/session\/memory.php#80","level":3,"time":"2014-12-14T19:16:55+00:00"}
{"app":"hook","message":"error while running hook (OCA\\Files_Versions\\Hooks::write_hook): An exception occurred while executing 'UPDATE \"oc_filecache\" SET \"unencrypted_size\"=? WHERE \"fileid\" = ?':\n\nSQLSTATE[HY000]: General error: 5 database is locked","level":3,"time":"2014-12-14T19:16:55+00:00"}
{"app":"remote","message":"An exception occurred while executing 'UPDATE \"oc_filecache\" SET \"size\"=? WHERE \"fileid\" = ?':\n\nSQLSTATE[HY000]: General error: 5 database is locked","level":4,"time":"2014-12-14T19:16:57+00:00"}
{"app":"PHP","message":"Session has been closed - no further changes to the session as allowed at \/var\/www\/owncloud\/lib\/private\/session\/memory.php#80","level":3,"time":"2014-12-14T19:16:57+00:00"}
{"app":"remote","message":"An exception occurred while executing 'UPDATE \"oc_filecache\" SET \"size\"=? WHERE \"fileid\" = ?':\n\nSQLSTATE[HY000]: General error: 5 database is locked","level":4,"time":"2014-12-14T19:16:57+00:00"}
{"app":"PHP","message":"Session has been closed - no further changes to the session as allowed at \/var\/www\/owncloud\/lib\/private\/session\/memory.php#80","level":3,"time":"2014-12-14T19:16:57+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-14T19:16:59+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-14T19:16:59+00:00"}
{"app":"remote","message":"An exception occurred while executing 'UPDATE \"oc_filecache\" SET \"size\"=? WHERE \"fileid\" = ?':\n\nSQLSTATE[HY000]: General error: 5 database is locked","level":4,"time":"2014-12-14T19:17:06+00:00"}
{"app":"PHP","message":"Session has been closed - no further changes to the session as allowed at \/var\/www\/owncloud\/lib\/private\/session\/memory.php#80","level":3,"time":"2014-12-14T19:17:06+00:00"}
{"app":"remote","message":"An exception occurred while executing 'UPDATE \"oc_filecache\" SET \"unencrypted_size\"=? WHERE \"fileid\" = ?':\n\nSQLSTATE[HY000]: General error: 5 database is locked","level":4,"time":"2014-12-14T19:17:06+00:00"}
{"app":"PHP","message":"Session has been closed - no further changes to the session as allowed at \/var\/www\/owncloud\/lib\/private\/session\/memory.php#80","level":3,"time":"2014-12-14T19:17:06+00:00"}
{"app":"remote","message":"An exception occurred while executing 'UPDATE \"oc_filecache\" SET \"size\"=? WHERE \"fileid\" = ?':\n\nSQLSTATE[HY000]: General error: 5 database is locked","level":4,"time":"2014-12-14T19:18:08+00:00"}
{"app":"PHP","message":"Session has been closed - no further changes to the session as allowed at \/var\/www\/owncloud\/lib\/private\/session\/memory.php#80","level":3,"time":"2014-12-14T19:18:08+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-14T19:18:08+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-14T19:18:08+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-14T19:22:37+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-14T19:22:37+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-14T19:24:10+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-14T19:24:10+00:00"}
{"app":"Encryption library","message":"No share key found for user \"maste9\" for file \"Test.txt\"","level":2,"time":"2014-12-14T19:24:43+00:00"}
{"app":"Encryption library","message":"No share key found for user \"recovery_f8dc8165\" for file \"Test.txt\"","level":2,"time":"2014-12-14T19:24:43+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-14T19:24:43+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_delete_files): No preview providers","level":3,"time":"2014-12-14T19:24:43+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-14T19:28:35+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_delete_files): No preview providers","level":3,"time":"2014-12-14T19:28:35+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-15T06:09:42+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-15T06:09:42+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-15T06:10:38+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-15T06:10:38+00:00"}
{"app":"remote","message":"An exception occurred while executing 'UPDATE \"oc_filecache\" SET \"size\"=? WHERE \"fileid\" = ?':\n\nSQLSTATE[HY000]: General error: 5 database is locked","level":4,"time":"2014-12-15T06:17:24+00:00"}
{"app":"PHP","message":"Session has been closed - no further changes to the session as allowed at \/var\/www\/owncloud\/lib\/private\/session\/memory.php#80","level":3,"time":"2014-12-15T06:17:24+00:00"}
{"app":"remote","message":"An exception occurred while executing 'UPDATE \"oc_filecache\" SET \"size\"=? WHERE \"fileid\" = ?':\n\nSQLSTATE[HY000]: General error: 5 database is locked","level":4,"time":"2014-12-15T06:17:24+00:00"}
{"app":"PHP","message":"Session has been closed - no further changes to the session as allowed at \/var\/www\/owncloud\/lib\/private\/session\/memory.php#80","level":3,"time":"2014-12-15T06:17:24+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-15T06:18:32+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-15T06:18:32+00:00"}
{"app":"Encryption library","message":"No share key found for user \"recovery_f8dc8165\" for file \"BasisregelSheet-1.jpg\"","level":2,"time":"2014-12-15T06:26:26+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-15T06:26:26+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_delete_files): No preview providers","level":3,"time":"2014-12-15T06:26:26+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-15T12:45:22+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-15T12:45:22+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-15T12:46:07+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-15T12:46:07+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-15T13:20:36+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-15T13:20:36+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-15T13:31:52+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_write): No preview providers","level":3,"time":"2014-12-15T13:31:52+00:00"}
{"app":"Encryption library","message":"No share key found for user \"maste9\" for file \"Test.txt\"","level":2,"time":"2014-12-15T13:32:31+00:00"}
{"app":"Encryption library","message":"No share key found for user \"recovery_f8dc8165\" for file \"Test.txt\"","level":2,"time":"2014-12-15T13:32:31+00:00"}
{"app":"core","message":"No preview providers exist","level":3,"time":"2014-12-15T13:32:31+00:00"}
{"app":"hook","message":"error while running hook (OC\\Preview::post_delete_files): No preview providers","level":3,"time":"2014-12-15T13:32:31+00:00"}
PVince81 commented 9 years ago

Also another question is whether this happens when overwriting an existing file (potentially reusing the encryption keys) or uploading a new file ?

toadhall commented 9 years ago

PVInce81 - with me it happened in both cases, new files and overwrites.

Another question - what sort of server log entry should one be looking for? I grepped for "chunk" but got nothing...

maste9 commented 9 years ago

Here in my case it only happens with new files - strangely not with all!

I made a new dir in an existing subdirectory, which worked. Then I entered 3 freshly scanned jpeg. The first syncs well. 2 and 3 show the error in question. Yesterday I tried save a zim-save (desktop-wiki) there. One file synced correctly, the rest did not. A minute ago I changed an existing odt-file. No error message, sync completed.

PVince81 commented 9 years ago

@toadhall any entry that contains the file name you are uploading, and all entries close to that one.

You can also search for "shareKey" or "encrypt" in case it's an issue with encryption keys.

maste9 commented 9 years ago

@PVince81 Seems to be the case looking into my log ... {"app":"Encryption library","message":"No share key found for user \"maste9\" for file \"Test.txt\"","level":2,"time":"2014-12-14T19:24:43+00:00"}

armaccloud commented 9 years ago

Hi,

I have the error as well. I this case, server.csr was added on a local drive which is synchronized with oc.

FINISHED WITH STATUS 0 "" QVariant(int, 302) QVariant(QString, "Found") 12-15 17:40:19:313 0x768ea60 owncloudpropagator.cpp:93 This error is not blacklisted 0 12-15 17:40:19:314 0x768ea60 syncengine.cpp:766 void Mirall::SyncEngine::slotJobCompleted(const Mirall::SyncFileItem&) "Administration/Owncloud/server.csr" 2 "The server did not acknowledge the last chunk. (No e-tag were present)" 12-15 17:40:19:315 0x768ea60 socketapi.cpp:320 SocketApi: Sending message: "STATUS:ERROR:Z:\Administration\Owncloud\server.csr" 12-15 17:40:19:316 0x768ea60 socketapi.cpp:320 SocketApi: Sending message: "STATUS:ERROR:Z:\Administration\Owncloud\server.csr" 12-15 17:40:19:326 0x768ea60 syncjournalfilerecord.cpp:80 Mirall::SyncJournalFileRecord::SyncJournalFileRecord(const Mirall::SyncFileItem&, const QString&) "Z:/Books/Africa" Retrieved inode 5222488 (previous item inode: 5222488 ) 12-15 17:40:19:326 0x768ea60 syncjournaldb.cpp:515 "INSERT OR REPLACE INTO metadata (phash, pathlen, path, inode, uid, gid, mode, modtime, type, md5, fileid, remotePerm) VALUES (?1 , ?2, ?3 , ?4 , ?5 , ?6 , ?7, ?8 , ?9 , ?10, ?11, ?12);" -8135989111767739166 12 "Books/Africa" 5222488 0 "1414095743" "2" "544963eeccdf0" "00016020occ2acd5dbe5" "RDNVCK" 12-15 17:40:19:336 0x768ea60 syncjournalfilerecord.cpp:80

ianbmacdonald commented 9 years ago

Bump. Our Debian Stable ownCloud server is showing this too for small files (916B example below). Seems to consistently happen by just moving a bunch of new files into client-only folders or shared folders. Encryption: Enabled Server Side: 7.0.4-3 (Debian 7 amd64 openvz) Client Side: 1.7.1 (Ubuntu 14.10 amd64)

Workaround is to put the file in a different location. So we have a growing number of temporary folders we would like to get rid of soon before they get out of control.

Client Side: 9:32 AM config_archive/vpn/iandell.key ownCloud The server did not acknowledge the last chunk. (No e-tag were present)

Server Side: {"reqId":"54982ba12aa18","app":"OC\Files\Cache\Scanner","message":"!!! Path 'files\/config_archive\/vpn2\/iandell.key' is not readable !!!","level":0,"time":"December 22, 2014 09:33:05","method":"PUT","url":"\/remote.php\/webdav\/config_archive\/vpn2\/iandell.key"} {"reqId":"54982ba12aa18","app":"OC\Files\Cache\Scanner","message":"!!! No reuse of etag for 'files\/config_archive\/vpn2\/iandell.key' !!! \ncache: Array\n(\n [fileid] => 46401\n [storage] => home::07ccffe8-32d8-1033-8b25-29c953816bfe\n [path] => files\/config_archive\/vpn2\/iandell.key\n [parent] => 46395\n [name] => iandell.key\n [mimetype] => application\/x-iwork-keynote-sffkey\n [mimepart] => application\n [size] => 9440\n [mtime] => 1419258784\n [storage_mtime] => 1419258784\n [encrypted] => 1\n [unencrypted_size] => 916\n [etag] => 54982ba15701a\n [permissions] => 27\n)\n \ndata: Array\n(\n [mimetype] => application\/x-iwork-keynote-sffkey\n [mtime] => 1419200791\n [size] => 9440\n [etag] => 54982ba18139b\n [storage_mtime] => 1419200791\n [permissions] => 27\n [parent] => 46395\n)\n","level":0,"time":"December 22, 2014 09:33:05","method":"PUT","url":"\/remote.php\/webdav\/config_archive\/vpn2\/iandell.key"}

ianbmacdonald commented 9 years ago

I noticed on the client side changes these two changes related to E-Tags. Can't be sure, but could be related.

We do use LDAPS as well for authentication currently.

Munken commented 9 years ago

Experienced the same problem. Disabling encryption did the trick. Not really an optimal solution.

owzim commented 9 years ago

I am on 7.0.4 an have the same problem on random files with encryption. Is there an easy and reliable way to downgrade to 7.0.2 until this is fixed?

viorel-anghel commented 9 years ago

I have the same problem on Ubuntu and I was wondering maybe it's a client-only problem. BEsides the trick with rename, i have discovered this behaviour: if I copy the files one by one, it is working ok. If I try to copy more than 3 files at once, it start to give the error "server did not acknowledge the last chunk. (No e-tag were present)" and it is never recovering from this error unless you rename one file, wait for sync, rename it back.

simonspa commented 9 years ago

Same problem here, running ownCloud 7.0.4 on Debian stable, Server nginx with encryption enabled. The missing e-tag appears randomly, I managed to upload several thousand files (8 GB inn total) and it appeared only a couple of dozens of times. However, for those files it is persistent.

PVince81 commented 9 years ago

CC @schiesbn

Do you guys all see messages like "share key is missing" or "something.key" is missing related to the broken files ?

simonspa commented 9 years ago

Yes, I see messages like this in my owncloud log, and the files are exactly the problematic ones:

{"app":"encryption library","message":"No keys available to decrypt the file: username\/filename.ext.ocTransferId1897145941.part","level":3,"time":"2015-01-06T20:49:05+00:00"}
ianbmacdonald commented 9 years ago

This issue is persistent.. I don't have any "No keys available" errors in my logs. Here is the latest example, currently jamming up client notifications on my desktop right now.

This is an excerpt from the logs from the initial creation of new folders and files that led to the "The server did not acknowledge the last chunk. (No e-tag were present)" issue on my own 1.7.1 ubuntu client appearing every minute now.

The relevant part on the server side logs, I believe begins with the "OC\Files\Cache\Scanner","message" message.

I'd be happy to share larger sections of logs directly with developers. It would be nice to get rid of the log file permission errors and webdav auth errors too, but I expect they are just loose ends from the packaging permissions and use of LDAP for authentication and not causing issues to my knowledge.

{"reqId":"54aec9285ff7b","app":"PHP","message":"rename(\/var\/log\/owncloud.log,\/var\/log\/owncloud.log.1): Permission denied at \/var\/www\/owncloud\/lib\/private\/log\/rotate.php#31","level":3,"time":"January 08, 2015 13:15:04","method":"--","url":"--"} {"reqId":"54aec9285ff7b","app":"OC\Log\Rotate","message":"Log file \"\/var\/log\/owncloud.log\" was over 1 bytes, moved to \"\/var\/log\/owncloud.log.1\"","level":2,"time":"January 08, 2015 13:15:04","method":"--","url":"--"} {"reqId":"54aec9801795b","app":"webdav","message":"Sabre\DAV\Exception\NotAuthenticated: No basic authentication headers were found","level":0,"time":"January 08, 2015 13:16:32","method":"PROPFIND","url":"\/remote.php\/webdav"} {"reqId":"54aec9d21b2ce","app":"webdav","message":"Sabre\DAV\Exception\NotAuthenticated: No basic authentication headers were found","level":0,"time":"January 08, 2015 13:17:54","method":"PROPFIND","url":"\/remote.php\/webdav"} {"reqId":"54aecab083815","app":"webdav","message":"Sabre\DAV\Exception\NotAuthenticated: No basic authentication headers were found","level":0,"time":"January 08, 2015 13:21:36","method":"PROPFIND","url":"\/remote.php\/webdav"} {"reqId":"54aecaca46dba","app":"webdav","message":"Sabre\DAV\Exception\NotAuthenticated: No basic authentication headers were found","level":0,"time":"January 08, 2015 13:22:02","method":"PROPFIND","url":"\/remote.php\/webdav"} {"reqId":"54aecbcfcf887","app":"OC\Files\Cache\Scanner","message":"!!! No reuse of etag for 'Huawei Doc Reader\/Hedex Lite' !!! \ncache: Array\n(\n [displayname_owner] => admin\n [path] => Huawei Doc Reader\/Hedex Lite\n [uid_owner] => admin\n [permissions] => 31\n)\n \ndata: Array\n(\n [mimetype] => httpd\/unix-directory\n [mtime] => 1420741583\n [size] => -1\n [etag] => 54aecbcfcbac1\n [storage_mtime] => 1420741583\n [permissions] => 31\n [parent] => 31931\n)\n","level":0,"time":"January 08, 2015 13:26:23","method":"MKCOL","url":"\/remote.php\/webdav\/Corp_Software\/Huawei%20Doc%20Reader\/Hedex%20Lite\/"} {"reqId":"54aecbd909cda","app":"OC\Files\Cache\Scanner","message":"!!! No reuse of etag for 'Huawei Doc Reader\/Hedex Lite\/bin' !!! \ncache: Array\n(\n [displayname_owner] => admin\n [path] => Huawei Doc Reader\/Hedex Lite\/bin\n [uid_owner] => admin\n [permissions] => 31\n)\n \ndata: Array\n(\n [mimetype] => httpd\/unix-directory\n [mtime] => 1420741592\n [size] => -1\n [etag] => 54aecbd9018b7\n [storage_mtime] => 1420741592\n [permissions] => 31\n [parent] => 54714\n)\n","level":0,"time":"January 08, 2015 13:26:33","method":"MKCOL","url":"\/remote.php\/webdav\/Corp_Software\/Huawei%20Doc%20Reader\/Hedex%20Lite\/bin\/"} {"reqId":"54aecbddd071e","app":"remote","message":"An exception occurred while executing 'INSERT INTO oc_filecache (mimepart, mimetype, mtime, size, etag, storage_mtime, permissions, parent, path_hash, path, name, storage) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)':\n\nSQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry '1-192aa4a6fccb1e073ee2bc783bf903dc' for key 'fs_storage_path_hash'","level":4,"time":"January 08, 2015 13:26:37","method":"PUT","url":"\/remote.php\/webdav\/Corp_Software\/Huawei%20Doc%20Reader\/Hedex%20Lite\/bin\/HedExLite.exe"} {"reqId":"54aecbddd071e","app":"PHP","message":"Session has been closed - no further changes to the session as allowed at \/var\/www\/owncloud\/lib\/private\/session\/memory.php#80","level":3,"time":"January 08, 2015 13:26:37","method":"PUT","url":"\/remote.php\/webdav\/Corp_Software\/Huawei%20Doc%20Reader\/Hedex%20Lite\/bin\/HedExLite.exe"}

PVince81 commented 9 years ago

Hmmm, it seems like you guys are experiencing different bugs but with the same symptom. As I always say, the error message "server did not return etag" is the equivalent of "general server error during upload". Only the logs can tell.

For @simonspa it's related to missing encryption keys. Did you have concurrent file access during upload ? Did someone share/reshare the folder while files were being uploaded into it ? (known issue that happens randomly)

For the others with missing encryption keys: same question as for @simonspa. Was this a plain upload or was there concurrency ? Need to find steps to be able to reproduce this. Were these brand new files or overwritten files ? Maybe if you all include your steps we can find out a common pattern.

For @ianbmacdonald: looks like the duplicate entry issue again Integrity constraint violation: 1062 Duplicate entry CC @icewind1991

maste9 commented 9 years ago

@PVince81 In my case it's been only brand new files. All existing files could be altered and overwritten without failure. I today tried to create and sync two simple text-files in main folder and subfolder which worked properly. I then tried to copy two image-files simultanouesly into subfolder which suprisingly again worked. So at the moment I cannot willingly reproduce failure and will report if this changes again ...

tflidd commented 9 years ago

I also experienced it with a new file. I copied some files into a folder before Christmas but one file failed (error with last chunk). In the client-log I have this message:

01-09 14:47:44:227 0x76beba8 socketapi.cpp:382 void Mirall::SocketApi::command_RETRIEVE_FILE_STATUS(const QString&, Mirall::SocketType*) "F:\ownCloud\folder\File Name 08.DOC"
01-09 14:47:44:227 0x76beba8 socketapi.cpp:584 Mirall::SyncFileStatus Mirall::SocketApi::fileStatus(Mirall::Folder*, const QString&, c_strlist_t*) Could not determine state for file "folder/File Name 08.DOC" will set STATUS_NEW
01-09 14:47:44:227 0x76beba8 socketapi.cpp:325 SocketApi:  Sending message:  "STATUS:NEW:F:\ownCloud\folder\File Name 08.DOC"
01-09 14:47:46:551 0xa3db87c csync_walker: file: F:\ownCloud\folder\File Name 08.DOC [inode=115589 size=20992]
01-09 14:47:46:551 0xa3db87c _csync_detect_update: Checking for rename based on inode # 115589
01-09 14:47:46:551 0xa3db87c _csync_detect_update: file: folder/File Name 08.DOC, instruction: INSTRUCTION_NEW <<=

All files perfectly synced except this one. It contains some spaces in the name. I removed the spaces, then the file synced, I renamed it back to it's initial name and it was renamed.

I still have the original file. I recopied it to a new folder, tried also some testfiles but I couldn't reproduce this error.

I'm also using the encryption-app -> issues/11405

simonspa commented 9 years ago

@PVince81 hm, I can't completely exclude concurrent file access since there are two clients that sync from this account. None of the folders where shared with other users though, all private.

Since it happens randomly at some (new) files I can't really come up with a reproducible procedure. If I manage, I will let you know.

ianbmacdonald commented 9 years ago

On my issue "the duplicate entry issue again" .. is that something that can be fixed or merged from a previous patch?

PVince81 commented 9 years ago

Unfortunately no. It's a mysterious issue that popped up many times. See https://github.com/owncloud/core/issues/2566 and linked tickets.

JohnnyricoMC commented 9 years ago

We're experiencing similar issues. I've tried to get as many details as possible from the affected user, but I fear what I can contribute is rather sparse:

Steps to reproduce

Affected user tries to add new file via web interface or desktop client, When using the web-interface, the user received a message (translated this): Cannot decrypt this file, it is probably a shared file. Ask the owner to share the file with you again. Original text: Kan dit bestand niet ontcijferen, waarschijnlijk is het een gedeeld bestand, Vraag de eigenaar om het bestand opnieuw met u te delen. When using the desktop client the message Dir1/Dir2/Dir3/Dir4/index.css: The server did not acknowledge the last chunk. (No e-tag were present) appeared in the client.

Server configuration:

$CONFIG = array (
  'passwordsalt' => 'OMITTED',
  'datadirectory' => '/var/www/owncloud/data',
  'dbtype' => 'mysql',
  'version' => '7.0.4.2',
  'dbname' => 'owncloud_mysql',
  'dbhost' => 'localhost',
  'dbtableprefix' => 'oc_',
  'dbuser' => 'owncloud_mysql',
  'dbpassword' => 'OMITTED',
  'installed' => true,
  'instanceid' => 'OMITTED',
  'loglevel' => '0',
  'forcessl' => true,
  'theme' => '',
  'maintenance' => false,
  'trusted_domains' => 
  array (
    0 => 'subdomain.domain1.tld',
    1 => 'subdomain.domain2.tld',
  ),
  'share_folder' => '/Shared',
  'secret' => 'OMITTED',
);

Client configuration

Browsers: Google Chrome Owncloud Desktop app in Windows 8.1

Activated apps:

Web server error log

No entries appeared while reproducing issue

Owncloud log

The first line seems unrelated, I only included it because it appears to concern the same file:

{"reqId":"54b8e1474947c","app":"OC\\Files\\Cache\\Scanner","message":"!!! Path 'thumbnails\/120676' is not readable !!!","level":0,"time":"2015-01-16T10:00:39+00:00","method":"GET","url":"\/index.php\/core\/preview.png?file=%2FUsername%2FDir1%2FDir2%2FDir3%2FDir4%2Findex.css&c=54b8e11f71032&x=36&y=36&forceIcon=0"}

{"reqId":"54b8e15979ada","app":"OC\\Files\\Cache\\Scanner","message":"!!! No reuse of etag for 'files\/Username\/Dir1\/Dir2\/Dir3\/Dir4\/index.css' !!! \ncache: Array\n(\n    [fileid] => 137599\n    [storage] => home::Username\n    [path] => files\/Username\/Dir1\/Dir2\/Dir3\/Dir4\/index.css\n    [parent] => 137064\n    [name] => index.css\n    [mimetype] => text\/css\n    [mimepart] => text\n    [size] => 0\n    [mtime] => 1421402399\n    [storage_mtime] => 1421402399\n    [encrypted] => \n    [unencrypted_size] => 0\n    [etag] => 54b8e11f71032\n    [permissions] => 27\n)\n \ndata: Array\n(\n    [mimetype] => text\/css\n    [mtime] => 1421402457\n    [size] => 0\n    [etag] => 54b8e15979649\n    [storage_mtime] => 1421402457\n    [permissions] => 27\n    [parent] => 137064\n)\n","level":0,"time":"2015-01-16T10:00:57+00:00","method":"POST","url":"\/index.php\/apps\/files\/ajax\/upload.php"}
zo0ok commented 9 years ago

I got this one too. I have been running 7.0.2. Upgrade to 7.0.4 did not fix the problem. Server is Debian Stable on PowerPC, with apache/mysql. Encryption is activated.

Error behaviours: Trying to download file with webbrowser: Can not decrypt this file, probably this is a shared file. Please ask the file owner to reshare the file with you. The downloading desktop client (Mac OS X): produces a 0-byte file with correct filename. The uploading client (Ubuntu), when "touch" the file to trigger re-upload: The server did not acknowledge the last chunk. (No e-tag were present)

Renaming the file on the uploading system fixes the problem.

To, me this happened to ~10 out of ~20 .tgz-files with sizes 30kb-10mb when I moved them all into a directory. The first ~10 files where fine, the last not fine, alphabetically.

I was worried this could have happened to random files and be difficult to discover until far too late. But since the desktop client creates a 0-byte file, it is quite easy to search for such files in the owncloud directory. On my Mac OS X client: $ find ~/owncloud -size 0

Update: I had zero shares configured in my owncloud.

PVince81 commented 9 years ago

The only way I found to reproduce a similar issue was with concurrency:

  1. Move a folder into or out of a shared folder
  2. While the folder is being moved, rename the source or target folder

See https://github.com/owncloud/core/issues/13330

Avalanchediver commented 9 years ago

I am having the same error "The item is not synced because of previous errors: The server did not acknowledge the last chunk. (No e-tag were present)" only for me it is only on larger files. I am a more elementary user and do not understand a lot of what is posted in the thread above. Can anyone give me some simple suggestions to resolve my error. I happens on large video files and a 6GB outlook.pst file I would like to have backed up.

guruz commented 9 years ago

@Avalanchediver There is a "Retry sync" button in the settings dialog.

viorel-anghel commented 9 years ago

this bug is affecting the core functionality of the product so i have decided to investigate alternatives. found this on the web: http://blog.patshead.com/2014/09/self-hosted-cloud-storage-comparison-2014-edition.html

zo0ok commented 9 years ago

@viorel-anghel, I reluctantly keep using ownCloud. I disabled encryption (and decrypted all files, not a process that gave me very much confidence). As it seems to me, encryption is a non-mandatory module, and the problem seems to be with it. So someone might argue that it is not a core functionality. But I agree with you. And I consider alternatives.

PVince81 commented 9 years ago

It seems you're all using SQLite3 ? And @maste9 had the "database is locked" issue.

The ones of you who are using SQLite on OC 7, please try applying this patch: https://github.com/owncloud/core/commit/234f33e01e630f763f34c51114d25986bae02b42.patch

PVince81 commented 9 years ago

Ok some are using MySQL too, not sure about that one.

Avalanchediver commented 9 years ago

I have tried re-syncing many times. The only solution to get it to sync so far has been to move my larger video files out of my folders that are synced. I know there is no problem with the files as they sync on One-drive just fine.

legrx commented 9 years ago

same issue here:

Debian Squeeze-LTS Owncloud 7.0.4-3 PHP 5.3.3-7+squeeze19 Nginx 1.6.2 w/ Fast-CGI and MySQL-Server

Encryption is on. I would say it's since the Update from 7.0.2-7.0.3:

Files get randomly (don't see a connection by size or file extension) not synced, because users get an E-Tag Error (server did not acknowledge last chunk). It seems to affect users with the windows client. If they try to upload them by web-interface, it says that the file is already there. Which is in fact true, but it's only 8192bytes in size plus dozens of *.parts files. And if they try to overwrite them, owncloud says afterwards, that it can't decrypt it, because the file was previously shared.

It's very weird, i started to disable encryption for now to see if this changes something. i'll see.

tflidd commented 9 years ago

I have this error again right now. OS X client (1.7.0). On apache with php module, OC 7.0.4 (encryption enabled). Client throws error: The server did no acknowledge the last junk. From the client logs (to be found several times):

02-05 11:27:01:784 0x104a0eca0 folder.cpp:856   ** error Strings:  (“path/to/file/12_42_16.843.mat: The server did not acknowledge the last chunk. (No e-tag were present)")

02-05 11:27:01:951 0x104a0eca0 socketapi.cpp:372 void Mirall::SocketApi::command_RETRIEVE_FILE_STATUS(const QString &, SocketType *) “/local/path/to/file/12_42_16.843.mat"
02-05 11:27:01:951 0x104a0eca0 socketapi.cpp:572 Mirall::SyncFileStatus Mirall::SocketApi::fileStatus(Mirall::Folder *, const QString &, c_strlist_t *) Could not determine state for file "path/to/file/12_42_16.843.mat" will set STATUS_NEW
02-05 11:27:01:951 0x104a0eca0 socketapi.cpp:320 SocketApi:  Sending message:  "STATUS:NEW:/local/path/to/file/12_42_16.843.mat

In the apache-logfile I find:

x.x.x.x - user [05/Feb/2015:10:32:50 +0000] "PUT /owncloud/remote.php/webdav/path/to/file/12_42_16.843.mat HTTP/1.1" 302 982 "-" "Mozilla/5.0 (Macintosh) mirall/1.7.0"

No php-errors. Restart of client and server, turned off OPCache, nothing helped. The *.mat is a matlab file containing some data (8 KB). I have similar files in the same folder which already synced without problems.

I'm still in the state of this error and could provide more information if this can help you...

viorel-anghel commented 9 years ago

it seems like my problems were solved by the migration to mysql from sqlite. the good thing is that onwcloud has tools to make this migration very easy: http://doc.owncloud.org/server/8.0/admin_manual/maintenance/convert_db.html

sleepysmurf commented 9 years ago

I am also have this problem on OwnCloud 7 .4 using the owncloud sync tool on windows version 1.7.1 - E Tag missing. This is a brand new install on CentOS (nothing else running but the required dependencies)

PVince81 commented 9 years ago

"E-Tag missing" is the same as "generic server error". Please always include the matching snippet from your "owncloud.log" to see what specific error appeared on the server. Thanks.

sleepysmurf commented 9 years ago

Error PHP Session has been closed - no further changes to the session as allowed at /var/www/html/owncloud/lib/private/session/memory.php#80 2015-02-06T05:55:23+00:00 Fatal remote An exception occurred while executing 'UPDATE "oc_filecache" SET "size"=? WHERE "fileid" = ?': SQLSTATE[HY000]: General error: 5 database is locked