search

hypery2k / owncloud

In this repo you'll find apps and enhancements for owncloud
Other
156 stars 85 forks source link

Storage Charts 2 almost triples request time even on reads #356

Closed XANi closed 7 years ago

XANi commented 8 years ago

OC 8.1.1 SC 2.6.1

Enabling storage charts makes simple requets like downloading image for preview work 3x-4x as slow, looking at strace it looks like it tries to recalculate on every read

mckaygerhard commented 8 years ago

well this project currently are stalled but u can paste here the log and point the trace that u xpected are the issue

of course there-s a line code that paste in log when this operation will be performed.. as "..running in owncloud ..."

mckaygerhard commented 8 years ago

i retest that into OC 7 and OC 6 and theres no problem (i'm using OC and SC since 2013 and no problems), as i said, the real problem its change the thinks that already works..

i any body have a code that solve the situation please made a pull request and will be analized, tested and merged, of course, backguard compatibility must be!

bugsyb commented 8 years ago

I have the very same issue. With Storage Charts 2 enabled WebUI is extremely slow. At the same time WebDAV access seems to be not impacted that much (if at all).

mckaygerhard commented 8 years ago

@bugsyb please could u report what version of OC are using and php, also server. please without that we cannot help, i'm using OC 7 with SC2 and works perfect!

bugsyb commented 8 years ago

@mckaygerhard I'm using: ownCloud - Version ownCloud 8.2.2 (stable)

$ php -v PHP 5.5.9-1ubuntu4.14 (cli) (built: Oct 28 2015 01:34:46) Copyright (c) 1997-2014 The PHP Group Zend Engine v2.5.0, Copyright (c) 1998-2014 Zend Technologies with Zend OPcache v7.0.3, Copyright (c) 1999-2014, by Zend Technologies

$ apache2 -v Server version: Apache/2.4.7 (Ubuntu) Server built: Oct 14 2015 14:20:21

mckaygerhard commented 8 years ago

@bugsyb oficial supported version are the optimized such 6.X and 7.X, in 8.X.X (with X.X >> 1.9) OC have lower performance rather than older OC versions..

takin in consideration this, SC make some extra calls to mantain up to date the available space respect user storage and king of user that makes those calls, so its obvius that are more slower with those newer versions..

please can u provide me logs, but in this behavior: 1) login to OC with SC enabled and no more plugins, go tho the images places (not at file, use image icon aside left) and stop at this point (no more actions 2) just after, delete the log file (assuming the install at /var/www/html) the file its called owncloud.log at the data directory 3) then make one only requets a refresh and then copycat the log file with no more actions

called this log file "owncloud1.log" and then repeat the process but now with a request in file (not image icon, just inside file directory of images) but inside the directory of images where are stored called this second file "owncloud2.log"

then paste here (PLEASE FORMATED WITH MARKDOWN) or attach here (github issues support attached files)

i cannot guarantee support for OC 8.X due i prefered OC <<< 8 and php 5.3 due performance are much better so far away!! but i try to find something..

hypery2k commented 8 years ago

it should be possible to use hooks to overcome this issue

mckaygerhard commented 8 years ago

hooks its the right, but means hard/close development and i all ready know, i not have enought time to implemented.. and the development of the plugins here are staled.. inclusivelly, currently i not have scheduled make anything in RC or OC until july where i'll make some work to support my two production OC (i used oc 7 and oc 6 and works perfect)

mckaygerhard commented 7 years ago

i added the bug label takin in consideration that SC make some extra calls to mantain up to date the available space respect user storage and king of user that makes those calls, so its obvius that are more slower with those newer versions..

by the moment if server are not apache and oc version are not >> 8 the performance are not impacted so much

due development are staled patches are free welcome or until some have time to investigate solution to this

mckaygerhard commented 7 years ago

I'll concluding thiss stupit isue after reading some pooor performance using the mysql DBMS:

clarify cpu load if used poor engine db as mysql, see similar issues like:

i see similar problems with nextcloud, also similar behavior if used osticket and mysql.. the engine has some problems of performance

bugsyb commented 7 years ago

Apologies, but I won't be able to move my installation to postgres.

Given the very small size of installation (couple of users with 3-4 active, low number of changes, just high number of untouched files) it is difficult to agree that this is due to MySQL performance. The host does not provide any other services and sports 16GB of RAM and plenty of CPU power.

Regards, Dawid

On 17/02/17 14:20, PICCORO Lenz McKAY wrote:

I'll concluding thiss stupit isue after reading some pooor performance using the mysql DBMS:

clarify cpu load if used poor engine db as mysql, see similar issues like:

i see similar problems with nextcloud, also similar behavior if used osticket and mysql.. the engine has some problems of performance

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/hypery2k/owncloud/issues/356#issuecomment-280647294, or mute the thread https://github.com/notifications/unsubscribe-auth/AFRY3TcBZoV3CmW8V5IVitDS1C6-3nw6ks5rdZ6WgaJpZM4GbvOk.

mckaygerhard commented 7 years ago

hi @bugsyb i dont said u must move u'r installation.. i just said that the problem rely on the duple mysql+oc so its not a bug this issue..

so then i'm sorry could not help you. its true that staoregechars need some cicles to get stats, but i use postgres and oracle and the bug its'n reproducible in that behaviour,

so the problem relies in the mysql engine and the charge of may little files, i confirmed that using mysql the problems appears.. so in the future if that issues referenced by oc get some solution i'll try to help on this

bugsyb commented 7 years ago

Thanks for swift and helpful responses.

I'm sorry I couldn't test it with postgres, the effort required to move to postgres wouldn't bring the results.

Thanks for help!

On 09/03/17 21:25, PICCORO Lenz McKAY wrote:

hi @bugsyb https://github.com/bugsyb i dont said u must move u'r installation.. i just said that the problem rely on the duple mysql+oc so its not a bug this issue..

so then i'm sorry could not help you. its true that staoregechars need some cicles to get stats, but i use postgres and oracle and the bug its'n reproducible in that behaviour,

so the problem relies in the mysql engine and the charge of may little files, i confirmed that using mysql the problems appears.. so in the future if that issues referenced by oc get some solution i'll try to help on this

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/hypery2k/owncloud/issues/356#issuecomment-285471370, or mute the thread https://github.com/notifications/unsubscribe-auth/AFRY3QX4pVAOOG_GekD3JjqJSSAMVunMks5rkGBMgaJpZM4GbvOk.

mckaygerhard commented 7 years ago

NEWS: forget to said, i use mariadb 5.3.11 and debian 5 (9 years old) and the problems does not happened... in the oc forums there's more info in similar situations