openbudgets / platform

Tracking issues related to the working around the OpenBudgets.eu platform (WP4).
GNU General Public License v3.0
1 stars 0 forks source link

descriptive statistics return http 500 at front side #63

Closed HimmelStein closed 6 years ago

HimmelStein commented 7 years ago

please use the following link and check http://apps.openbudgets.eu/cube/analytics/bonn-budget-2019__40559/descriptive_statistics/facts?amounts=amount&dimensions=operationCharacter.prefLabel%7CbusinessArea.prefLabel%7Corganization.organization%7CfunctionalClassification.prefLabel%7CbudgetPhase.prefLabel&json_data=http%3A%2F%2Fapps.openbudgets.eu%2Fapi%2F3%2Fcubes%2Fbonn-budget-2019__40559%2Ffacts%3F

liyakun commented 7 years ago

error I attached one screenshot about where the error happens.

skarampatakis commented 7 years ago

found this on the logs

PHP message: PHP Fatal error:  Allowed memory size of 134217728 bytes exhausted (tried to allocate 32768 bytes) in /var/www/rudolf/vendor/symfony/debug/Exception/FatalErrorException.php on line 1" while reading response header from upstream, client: 155.207.200.73, server: apps.openbudgets.eu, request: "GET /api/3/cubes/bonn-budget-2019__40559/facts? HTTP/1.1", upstream: "fastcgi://172.20.0.18:8890", host: "apps.openbudgets.eu
larjohn commented 7 years ago

It seems that parseJSON times out:

EasyRdf_Sparql_Result->parseJson() in Result.php line 71

A solution would be to paginate results, as this dataset is HUGE.

image

HimmelStein commented 6 years ago

thanks, we will try to use pagination

wk0206 commented 6 years ago

@larjohn @HimmelStein I read the log, seems it is the mining server in Greece or Ruldorf out of memory, I am not sure what our side can do with it, as you know, DAM only deliver a Ruldorf link , or a link of JSON file. So from my point of view, DAM can not paginate the input data(because it is a link from Ruldorf). If it is the case the output data is too big, then maybe DAM can do some pagination. If you have anything our side can do, please tell me.

skarampatakis commented 6 years ago

@wk0206 Have you managed to make DAM work with the OpenCPU docker container?

HimmelStein commented 6 years ago

@skarampatakis @liyakun Yakun made a docker container for OpenCPU https://github.com/openbudgets/integration/tree/master/docker-config

liyakun commented 6 years ago

@skarampatakis yes, DAM now works with OpenCPU deployed on FHG server.

skarampatakis commented 6 years ago

On the php.ini for rudolf the memory limit is defined to 128M. Please change this to -1 and test again

liyakun commented 6 years ago

update on fhg server from 128M to -1.

wk0206 commented 6 years ago

The link is working now @HimmelStein One more thing is , indigo seems not stop running after the result is on the screen. indigo

skarampatakis commented 6 years ago

Reduce the limit to 1G or 2G.

liyakun commented 6 years ago

reduced to 2G.

liyakun commented 6 years ago

@wk0206 I was updating the server, Indigo should work normally now.

skarampatakis commented 6 years ago

Can we close this?