Update to 6.0.0 from 5.13 :Column not found: 1054 Unknown column 'mail_send'

Siedlerchr commented 10 years ago

Expected behaviour

Update schould work succesfully

Actual behaviour

Maintenance update/upgrade page showing (update in progres.,..refresh page)

Steps to reproduce

Update from 5.013
Insert SQL Fix for oc_jobs
create preupdate.php for lucenee rror fix
Server configuration

Apache-Version 2.2.26 PHP-Version 5.3.27 MySQL-Version 5.5.32-cll Architecture: x86_64 OS. linux Path to sendmail /usr/sbin/sendmail Path to PERL /usr/bin/perl Kernel-Version 2.6.32-042stab068.8

ownCloud version: 5.0.13/6.0.0

Updated from an older ownCloud or fresh install: Migration from 5.0.13 (as told in manual with data folder and config folder)

The content of config/config.php: (Without the database password and passwordsalt) <?php $CONFIG = array ( 'instanceid' => '522b44e093443', 'passwordsalt' => 'xxxx', 'datadirectory' => '/home/siedlerc/public_html/data', 'dbtype' => 'mysql', 'version' => '6.0.0.13', 'dbname' => 'siedlercowncloud', 'dbhost' => 'localhost', 'dbtableprefix' => 'oc', 'dbuser' => 'xxxx', 'dbpassword' =>xxx '', 'installed' => true, 'forcessl' => true, 'maxZipInputSize' => 838860800, 'allowZipDownload' => true, 'loglevel' => '1', 'theme' => '', 'maintenance' => true, );

Client configuration

Browser: Firefox x86 latest version

Operating system: Win 7 x86

Logs

Web server error log

... ErrorLog of webserver is empty

ownCloud log (data/owncloud.log)

{"app":"hook","message":"error while running hook (\OC\Files\Storage\Shared::setup): An exception occurred while executing 'SELECT oc_share.id, item_type, item_source, item_target,\n\t\t\t\t\t\t\toc_share.parent, share_type, share_with, uid_owner,\n\t\t\t\t\t\t\tfile_source, path, file_target, permissions, stime, expiration, token, storage, mail_send FROM oc_share INNER JOIN oc_filecache ON file_source = oc_filecache.fileid WHERE file_target IS NOT NULL AND share_type IN (?,?,?) AND share_with IN (?,?) AND uid_owner != ?':\n\nSQLSTATE[42S22]: Column not found: 1054 Unknown column 'mail_send' in 'field list'","level":3,"time":"2013-12-12T16:38:24+00:00"}

Browser log

Irrelevant.

Regards Siedlerchr

karlitschek commented 10 years ago

Can you post a full bug report as described here: https://github.com/owncloud/core/blob/master/CONTRIBUTING.md

Siedlerchr commented 10 years ago

@karlitschek I have used the template and thought my bug report is complete, so please tell me which info is missing. I also searched the issues and the forum for corresponding problems, but didn't find anyhting.

OS

I am on a shared server and only know its a unix/linux based system.

Here is again the

OwnCloud log:

message":"error while running hook (\OC\Files\Storage\Shared::setup): An exception occurred while executing 'SELECT oc_share.id, item_type, item_source, item_target,\n\t\t\t\t\t\t\toc_share.parent, share_type, share_with, uid_owner,\n\t\t\t\t\t\t\tfile_source, path, file_target, permissions, stime, expiration, token, storage, mail_send FROM oc_share INNER JOIN oc_filecache ON file_source = oc_filecache.fileid WHERE file_target IS NOT NULL AND share_type IN (?,?,?) AND share_with IN (?,?) AND uid_owner != ?':\n\nSQLSTATE[42S22]: Column not found: 1054 Unknown column 'mail_send' in 'field list'","level":3,"time":"2013-12-12T21:21:27+00:00"} {"app":"no app in context","message":"Error while running background job: An exception occurred while executing 'SELECT fileid, storage, path, parent, name, mimetype, mimepart, size, mtime,\n\t\t\t\t\t storage_mtime, encrypted, unencrypted_size, etag\n\t\t\t\tFROM oc_filecache WHERE storage = ? AND path_hash = ?':\n\nSQLSTATE[42S22]: Column not found: 1054 Unknown column 'storage_mtime' in 'field list'","level":3,"time":"2013-12-12T21:21:31+00:00"} {"app":"hook","message":"error while running hook (\OC\Files\Storage\Shared::setup): An exception occurred while executing 'SELECT oc_share.id, item_type, item_source, item_target,\n\t\t\t\t\t\t\toc_share.parent, share_type, share_with, uid_owner,\n\t\t\t\t\t\t\tfile_source, path, file_target, permissions, stime, expiration, token, storage, mail_send FROM oc_share INNER JOIN oc_filecache ON file_source = oc_filecache.fileid WHERE file_target IS NOT NULL AND share_type IN (?,?,?) AND share_with IN (?,?) AND uid_owner != ?':\n\nSQLSTATE[42S22]: Column not found: 1054 Unknown column 'mail_send' in 'field list'","level":3,"time":"2013-12-12T21:21:32+00:00"} {"app":"hook","message":"error while running hook (\OC\Files\Storage\Shared::setup): An exception occurred while executing 'SELECT oc_share.id, item_type, item_source, item_target,\n\t\t\t\t\t\t\toc_share.parent, share_type, share_with, uid_owner,\n\t\t\t\t\t\t\tfile_source, path, file_target, permissions, stime, expiration, token, storage, mail_send FROM oc_share INNER JOIN oc_filecache ON file_source = oc_filecache.fileid WHERE file_target IS NOT NULL AND share_type IN (?,?,?) AND share_with IN (?,?) AND uid_owner != ?':\n\nSQLSTATE[42S22]: Column not found: 1054 Unknown column 'mail_send' in 'field list'","level":3,"time":"2013-12-12T21:21:57+00:00"} {"app":"hook","message":"error while running hook (\OC\Files\Storage\Shared::setup): An exception occurred while executing 'SELECT oc_share.id, item_type, item_source, item_target,\n\t\t\t\t\t\t\toc_share.parent, share_type, share_with, uid_owner,\n\t\t\t\t\t\t\tfile_source, path, file_target, permissions, stime, expiration, token, storage, mail_send FROM oc_share INNER JOIN oc_filecache ON file_source = oc_filecache.fileid WHERE file_target IS NOT NULL AND share_type IN (?,?,?) AND share_with IN (?,?) AND uid_owner != ?':\n\nSQLSTATE[42S22]: Column not found: 1054 Unknown column 'mail_send' in 'field list'","level":3,"time":"2013-12-12T21:22:03+00:00"}

and here is the

Browser log

I hope this are all the information you need. If not, please tell me which information you need!

ubergesundheit commented 10 years ago

I have the same error in the log files

victort commented 10 years ago

i have this issue too, same error in file,

hook error while running hook (\OC\Files\Storage\Shared::setup): An exception occurred while executing 'SELECT "oc_share"."id", "item_type", "item_source", "item_target", "oc_share"."parent", "share_type", "share_with", "uid_owner", "file_source", "path", "file_target", "permissions", "stime", "expiration", "token", "storage", "mail_send" FROM "oc_share" INNER JOIN "oc_filecache" ON "file_source" = "oc_filecache"."fileid" WHERE "file_target" IS NOT NULL AND "share_type" IN (?,?,?) AND "share_with" IN (?,?,?,?,?,?,?) AND "uid_owner" != ?': SQLSTATE[42703]: Undefined column: 7 ERROR: column "mail_send" does not exist LINE 3: ...ions", "stime", "expiration", "token", "storage", "mail_send... ^

additionally i cannot share or be shared with. the option to share any files is gone.

fossxplorer commented 10 years ago

I can confirm this issue too. Did upgrade from stable5 from 13/12-2013 to stable6.

[SOLVED] Additionally i also see {"app":"remote","message":"js file not found: script:js\/jquery.mousewheel-3.1.1 formfactor: serverroot:\/var\/www\/oc-test\/public_html","level":4,"time":"December 13, 2013 14:34:08"}. The web GUI is partly broken as i don't see any fileactions anymore. Uploading files end up nowhere.

EDIT: missing jquery.mousewheel-3.1.1 is now solved as it was caused my me!

karlitschek commented 10 years ago

Can you test again with 6.0.0a please? http://download.owncloud.org/community/owncloud-6.0.0a.tar.bz2

fossxplorer commented 10 years ago

@karlitschek i will and come back with feedback. Thanks.

Siedlerchr commented 10 years ago

Hi I will test this, too and post my feedback. Regards

2013/12/14 Frank Karlitschek notifications@github.com

Can you test again with 6.0.0a please? http://download.owncloud.org/community/owncloud-6.0.0a.tar.bz2

— Reply to this email directly or view it on GitHubhttps://github.com/owncloud/core/issues/6361#issuecomment-30587750 .

Siedlerchr commented 10 years ago

@karlitschek It looks fine now, but first I had to disable maintenance mode in config (I was stuck in maintenance modus and couldn't figure out why ) The issue #6412 was my inspiration and then it was alright. No more database error in log. Only some app error (can't remove app because its not installed)

Best regards for the fast fix! Siedlerchr

fossxplorer commented 10 years ago

Unfortunately i still have issues: Turned on maintenance mode An exception occurred while executing 'ALTER TABLE oc_preferences ADD PRIMARY KEY (userid, appid, configkey)':

SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'testuser-core-enabled' for key 'PRIMARY' Turned off maintenance mode Update successful

Output from the log:

{"app":"PHP","message":"require_once(\/var\/www\oc-test\/3rdparty\/phpass\/PasswordHash.php): failed to open stream: No such file or directory at \/var\/www\/oc-test\/public_html\/lib\/user\/database.php#36","level":2,"time":"December 15, 2013 16:26:59"} {"app":"PHP","message":"require_once(): Failed opening required '\/var\/www\/oc-test\/3rdparty\/phpass\/PasswordHash.php' (include_path='\/var\/www\/oc-test\/public_html\/lib:\/var\/www\/oc-test\/public_html\/config:\/var\/www\/oc-test\/public_html\/3rdparty:\/var\/www\/oc-test\/public_html\/apps:\/var\/www\/oc-test\/public_html\/apps3:\/var\/www\/oc-test\/public_html\/apps2:\/var\/www\/oc-test\/public_html\/lib:.:\/usr\/share\/pear:\/usr\/share\/php:\/var\/www\/oc-test\/public_html') at \/var\/www\/oc-test\/public_html\/lib\/user\/database.php#36","level":4,"time":"December 15, 2013 16:26:59"} {"app":"cron","message":"An exception occurred while executing 'SELECT id, class, last_run, argument FROM oc_jobs':\n\nSQLSTATE[42S02]: Base table or view not found: 1146 Table 'oc-test.oc_jobs' doesn't exist","level":4,"time":"December 15, 2013 16:30:02"}

{"app":"PHP","message":"filemtime(): stat failed for \/var\/www\/oc-test\/public_html\/data\/fossxplorer\/ at \/var\/www\/oc-test\/public_html\/lib\/private\/files\/storage\/local.php#127","level":2,"time":"December 15, 2013 16:45:01"}

{"app":"hook","message":"error while running hook (\OC\Files\Storage\Shared::setup): An exception occurred while executing 'SELECT oc_share.id, item_type, it em_source, item_target,\n\t\t\t\t\t\t\toc_share.parent, share_type, share_with, uid_owner,\n\t\t\t\t\t\t\tfile_source, path, file_target, permissions, stime, expiration, token, storage, mail_send FROM oc_share INNER JOIN oc_filecache ON file_source = oc_filecache.fileid WHERE file_target IS NOT NULL AND share_type IN (?,?,?) AND share_with IN (?,?) AND uid_owner != ?':\n\nSQLSTATE[42S22]: Column not found: 1054 Unknown column 'mail_send' in 'field list'","level":3,"time":"December 15, 2013 16:54:08"}

I can confirm /3rdparty/phpass/PasswordHash.php is there. Fileaction for sharing doesn't work, i.e the dropdown isn't showing up on click. I will test again now without user testuser in the system.

karlitschek commented 10 years ago

@bantu @DeepDiver1975 Any idea?

kyleabrams commented 10 years ago

Having the same problem, and when I upgrade to 6.0.0a the share App no longer works because of this error.

PVince81 commented 10 years ago

The "mail_send" column is a new column in OC 6. Maybe it hasn't been create because some other issue aborted the migration before that. (incomplete migration)

CC @schiesbn

kyleabrams commented 10 years ago

@PVince81 is there a way to restart the migration from the beginning in hopes that the column will be created? At this point I re-installed the old 5 version.

Siedlerchr commented 10 years ago

Before I tried the updating with the 6.0.0.a, I restored the mysql backup from OC 5. And than this worked!

2013/12/18 Vincent Petry notifications@github.com

The "mail_send" column is a new column in OC 6. Maybe it hasn't been create because some other issue aborted the migration before that. (incomplete migration)

CC @schiesbn https://github.com/schiesbn

— Reply to this email directly or view it on GitHubhttps://github.com/owncloud/core/issues/6361#issuecomment-30845677 .

PVince81 commented 10 years ago

If you saw the error when you migrated to 6.0.0 (NOT 6.0.0a), then re-trying the migration from 5 to 6.0.0a might fix it.

I don't know of any ways to revert a badly migrated ownCloud. You need to restore the old code and also your backup of the DB and of the "data" dir.

PVince81 commented 10 years ago

Glad to hear it @Siedlerchr

@fossxplorer did you migrate from 6.0.0 to 6.0.0a or from 5 to 6.0.0a ? 6.0.0 to 6.0.0a might not work if you already have a broken migration.

fossxplorer commented 10 years ago

@PVince81 @karlitschek Migration was from stable5 -> stable6 (at that time 6.0.0a). My third attempt to upgrade from stable5 on the test VM was indeed successful with some minor adjustments. Very nice to have OC6. Thank you very much.

AdamWill commented 10 years ago

As per https://github.com/owncloud/core/issues/6556 , I think there's a genuine bug here and it's not fixed in 6.0.0a.

I tested a very clean install of OC 5.0.14a, initial setup with MySQL database, then immediate upgrade direct to 6.0.0a, and I see this error in the logs, one second before database migration is attempted:

Dec 28 10:58:35 localhost.localdomain ownCloud[2355]: {hook} error while running hook (\OC\Files\Storage\Shared::setup): An exception occurred while executing 'SELECT `oc_share`.`id`, `item_type`, `item_source`, `item_target`,
                                                                                                              `oc_share`.`parent`, `share_type`, `share_with`, `uid_owner`,
                                                                                                              `file_source`, `path`, `file_target`, `permissions`, `stime`, `expiration`, `token`, `storage`, `mail_send` FROM `oc_share` INNER JOIN `oc_filecache` ON `file_source` = `oc_filecache`.`fileid` WHERE `file_target` IS NOT NULL AND `share_type` IN (?,?,?) AND `share_with` IN (?,?) AND `uid_owner` != ?':

                                                      SQLSTATE[42S22]: Column not found: 1054 Unknown column 'mail_send' in 'field list'
Dec 28 10:58:35 localhost.localdomain ownCloud[2355]: {contacts} starting app upgrade from 0.2.5 to 0.3
Dec 28 10:58:35 localhost.localdomain ownCloud[2357]: {core} starting upgrade from 5.0.28 to 6.0.0.14
Dec 28 10:58:36 localhost.localdomain ownCloud[2357]: {core} Failed to update database structure

(and then the database migration explodes for unrelated reasons on my system, but the key point here is that something tries to run that hook before database migration occurs).

PVince81 commented 10 years ago

I tried upgrade from 5.0.14a to stable6 wiht PostgreSQL and also got these warnings, but the app works correctly. And the mail_send column is there, so there was probably something trying to access it too early like you said.

PVince81 commented 10 years ago

Note that before doing the upgrade I did the following:

Upload some pics, view in pictures app
Create a calendar event
Create one contact, click on "select group" that seems to trigger indexing
Click on the search field on the top right to trigger indexing
Do the upgrade

I'll try to pinpoint the smaller steps to reproduce this consistently so we can debug it.

PVince81 commented 10 years ago

Upgrading from the v5.0.14a tag to stable6 also causes it.

@Siedlerchr I quickly re-read your original report and your upgrade issues are probably not related to that warning message about "mail_send". I'll still investigate it just in case it might have side-effects.

Siedlerchr commented 10 years ago

@PVince81 Thx for the info, did you notice the "manual steps" I did before?

Steps to reproduce

Update from 5.013
Insert SQL Fix for oc_jobs
create preupdate.php for lucenee rror fix

PVince81 commented 10 years ago

@Siedlerchr yes, your steps might cause other issues to appear. Have you tried upgrading to 5.0.14a first (which might fix those issues), then to OC 6.0.0a ?

PVince81 commented 10 years ago

Debugging results:

Stack:

0  OC\Files\Storage\Shared::setup() /srv/www/htdocs/owncloud/apps/files_sharing/lib/sharedstorage.php:394
1  call_user_func() /srv/www/htdocs/owncloud/lib/private/hook.php:72
2  OC_Hook::emit() /srv/www/htdocs/owncloud/lib/private/hook.php:72
3  OC_Util::setupFS() /srv/www/htdocs/owncloud/lib/private/util.php:84
4  require_once()  /srv/www/htdocs/owncloud/lib/private/files/filesystem.php:800
5  OC\Autoloader->load() /srv/www/htdocs/owncloud/lib/autoloader.php:143
6  require_once()  /srv/www/htdocs/owncloud/lib/private/app.php:0
7  OC_App::loadApp() /srv/www/htdocs/owncloud/lib/private/app.php:93
8  OC_App::updateApp() /srv/www/htdocs/owncloud/lib/private/app.php:961
9  OC_App::checkUpgrade() /srv/www/htdocs/owncloud/lib/private/app.php:867
10 OC_App::loadApp() /srv/www/htdocs/owncloud/lib/private/app.php:92
11 OC_App::loadApps() /srv/www/htdocs/owncloud/lib/private/app.php:66
12 OC::handleRequest() /srv/www/htdocs/owncloud/lib/base.php:693
13 {main}          /srv/www/htdocs/owncloud/index.php:30

It's trying to setup the filesystem to upgrade apps (at this point it's "search_lucene" but it could be any app), and sets up the FS and mounts the shared storage, which is part of the filesystem. Trouble is that at this point we can't setup the shares correctly as the shared storage is expecting the DB to already have been migrated correctly. (@schiesbn @icewind1991)

I'll try and check which apps are upgraded and try and understand why it still works correctly for me and maybe doesn't for other people.

Siedlerchr commented 10 years ago

No, I after the upgrade to 6.0.0 and then 6.0.0a I didn't want to change the running system again :)

2014/1/17 Vincent Petry notifications@github.com

@Siedlerchr https://github.com/Siedlerchr yes, your steps might cause other issues to appear. Have you tried upgrading to 5.0.14a first (which might fix those issues), then to OC 6.0.0a ?

— Reply to this email directly or view it on GitHubhttps://github.com/owncloud/core/issues/6361#issuecomment-32618634 .

PVince81 commented 10 years ago

I've added some debug code and it seems the upgrade just ignores that mount failure. So I guess the worst case that could happen here is that the apps, while upgrading, have no access to shared files, and might not be able to run their migration code against these files (if needed).

{"app":"search_lucene","message":"starting app upgrade from 0.5.1.1 to 0.5.2","level":0,"time":"2014-01-17T16:22:24+00:00"}
{"app":"update","message":"Updating app \"search_lucene\": start","level":0,"time":"2014-01-17T16:22:24+00:00"}
{"app":"update","message":"Updating app \"search_lucene\": load app","level":0,"time":"2014-01-17T16:22:24+00:00"}
{"app":"hook","message":"error while running hook (\\OC\\Files\\Storage\\Shared::setup): An exception occurred while executing 'SELECT `oc_share`.`id`, `item_type`, `item_source`, `item_target`,\n\t\t\t\t\t\t\t`oc_share`.`parent`, `share_type`, `share_with`, `uid_owner`,\n\t\t\t\t\t\t\t`file_source`, `path`, `file_target`, `permissions`, `stime`, `expiration`, `token`, `storage`, `mail_send` FROM `oc_share` INNER JOIN `oc_filecache` ON `file_source` = `oc_filecache`.`fileid` WHERE `file_target` IS NOT NULL AND `share_type` IN (?,?,?) AND `share_with` IN (?,?) AND `uid_owner` != ?':\n\nSQLSTATE[42S22]: Column not found: 1054 Unknown column 'mail_send' in 'field list'","level":3,"time":"2014-01-17T16:22:24+00:00"}
{"app":"update","message":"Updating app \"search_lucene\": preupdate","level":0,"time":"2014-01-17T16:22:24+00:00"}
{"app":"update","message":"Updating app \"search_lucene\": DB update","level":0,"time":"2014-01-17T16:22:24+00:00"}
{"app":"update","message":"Updating app \"search_lucene\": load app again","level":0,"time":"2014-01-17T16:22:24+00:00"}
{"app":"update","message":"Updating app \"search_lucene\": done","level":0,"time":"2014-01-17T16:22:24+00:00"}

misse commented 10 years ago

Any update on how to solve this?

misse commented 10 years ago

A folder I shared stopped being available for the user whom I shared with, this was the only error in the log. I manually added the column, and the share started working again.

LukasReschke commented 10 years ago

I’m closing this issue because it has been inactive for a few months. This probably means that the issue is not reproducible or it has been fixed in a newer version.

Please reopen if you still encounter this issue with the latest stable version and then please use the issue template.

Thank you!

owncloud / core