search

HSLdevcom / transitlog

Explore observed public transport and compare with the intended traffic
https://reittiloki.hsl.fi/
Creative Commons Attribution 4.0 International
5 stars 1 forks source link

Postgresql cannot insert stuff because it runs out of memory #13

Closed paasovaara closed 5 years ago

paasovaara commented 5 years ago

the process itself stays up so it must be some dynamic memory allocation.

this seems to happen during data insert from hasurino via hasura.

2019-01-08T15:04:35+00:00 localhost.localdomain eb95ab7343bb[1135]: {"timestamp":"2019-01-08T15:04:35.569+0000","level":"info","type":"http-log","detail":{"status":500,"query_hash":"2ea87d68c412c48b6dbb4840e3146171fd5e9450","http_version":"HTTP/1.1","query_execution_time":3.936811261,"request_id":null,"url":"/v1alpha1/graphql","ip":"172.18.0.3","response_size":174188,"user":{"x-hasura-role":"admin"},"method":"POST","detail":{"error":{"internal":{"statement":"WITH \"public_vehicles__mutation_result_alias\" AS (INSERT INTO \"public\".\"vehicles\" ( \"owner_operator_id\", \"journey_type\", \"dir\", \"spd\", \"long\", \"journey_start_time\", \"received_at\", \"start\", \"mode\", \"hdg\", \"tst\", \"line\", \"unique_vehicle_id\", \"geohash_level\", \"lat\", \"odo\", \"topic_version\", \"vehicle: ...

2019-01-08T15:04:36+00:00 localhost.localdomain 13550f816cda[1135]: 2019-01-08T15:04:35.945Z urllib3.connectionpool: DEBUG: http://hasura:8888 "POST /v1alpha1/graphql HTTP/1.1" 500 None 2019-01-08T15:04:36+00:00 localhost.localdomain 13550f816cda[1135]: 2019-01-08T15:04:35.951Z hasurino.hasurino: ERROR: Fatal error 2019-01-08T15:04:36+00:00 localhost.localdomain 13550f816cda[1135]: 2019-01-08T15:04:35.951Z hasurino.hasurino: INFO: Stopping MQTT subscriber 2019-01-08T15:04:59+00:00 localhost.localdomain 13c1242beaf2[1135]: Grand total: 306520 bytes in 19 blocks; 37296 free (17 chunks); 269224 used 2019-01-08T15:04:59+00:00 localhost.localdomain 13c1242beaf2[1135]: 2019-01-08 15:04:58.766 UTC [10709]: [1-1] @ERROR: 53200: out of memory 2019-01-08T15:04:59+00:00 localhost.localdomain 13c1242beaf2[1135]: 2019-01-08 15:04:58.766 UTC [10709]: [2-1] @DETAIL: Failed on request of size 432. 2019-01-08T15:04:59+00:00 localhost.localdomain 13c1242beaf2[1135]: 2019-01-08 15:04:58.766 UTC [10709]: [3-1] @LOCATION: palloc0, mcxt.c:898 2019-01-08T15:05:59+00:00 localhost.localdomain 13c1242beaf2[1135]: 2019-01-08 15:05:58.986 UTC [1]: [19-1] @LOG: 00000: could not fork autovacuum worker process: Out of memory 2019-01-08T15:05:59+00:00 localhost.localdomain 13c1242beaf2[1135]: 2019-01-08 15:05:58.986 UTC [1]: [20-1] @LOCATION: StartAutoVacWorker, autovacuum.c:1493

paasovaara commented 5 years ago

new app doesn't have this issue.