search

etalab / transport-site

Rendre disponible, valoriser et améliorer les données transports
https://transport.data.gouv.fr
190 stars 29 forks source link

"Memory cgroup out of memory" en production #2359

Closed thbar closed 2 years ago

thbar commented 2 years ago 
65813
2022-05-05T08:40:09+02:00 08:40:09.574 [info] Running ResourceUnavailableJob for 8792
2022-05-05T08:40:09+02:00 08:40:08.973 [info] Running ResourceUnavailableJob for 65812
2022-05-05T08:40:09+02:00 08:40:09.341 [info] Running ResourceUnavailableJob for 74892
2022-05-05T08:40:10+02:00 08:40:10.031 [info] Running ResourceUnavailableJob for 58918
2022-05-05T08:40:10+02:00 08:40:10.100 [info] Running ResourceUnavailableJob for 46721
2022-05-05T08:40:10+02:00 08:40:09.804 [info] Running ResourceUnavailableJob for 79221
2022-05-05T08:40:10+02:00 08:40:09.897 [info] Running ResourceUnavailableJob for 79222
2022-05-05T08:40:10+02:00 08:40:09.981 [info] Running ResourceUnavailableJob for 58917
2022-05-05T08:40:15+02:00 2022-05-05T06:40:15.358506Z INFO multipart_upload_lib::uploader: Uploaded part=4
2022-05-05T08:40:20+02:00 08:40:19.750 request_id=FuwiP5EXa5BzIDUAAAsh [info] HEAD /health-check
2022-05-05T08:40:20+02:00 08:40:19.753 request_id=FuwiP5EXa5BzIDUAAAsh [info] Sent 200 in 2ms
2022-05-05T08:40:23+02:00 2022-05-05T06:40:23.270156Z INFO multipart_upload_lib::uploader: Uploaded part=5
2022-05-05T08:40:29+02:00 2022-05-05T06:40:29.832640Z INFO multipart_upload_lib::uploader: Uploaded part=6
2022-05-05T08:40:34+02:00 08:40:34.652 request_id=FuwiQwlLYz-VeuQAAAtB [info] HEAD /health-check
2022-05-05T08:40:34+02:00 08:40:34.654 request_id=FuwiQwlLYz-VeuQAAAtB [info] Sent 200 in 2ms
2022-05-05T08:40:37+02:00 2022-05-05T06:40:37.364605Z INFO multipart_upload_lib::uploader: Uploaded part=7
2022-05-05T08:40:43+02:00 08:40:43.005 request_id=FuwiRPssNFJlp5oAAAth [info] GET /
2022-05-05T08:40:43+02:00 08:40:43.005 request_id=FuwiRPssNFJlp5oAAAth [info] Sent 200 in 86µs
2022-05-05T08:40:45+02:00 2022-05-05T06:40:45.359705Z INFO multipart_upload_lib::uploader: Uploaded part=8
2022-05-05T08:40:47+02:00 Done uploading build cache archive
2022-05-05T08:40:47+02:00 2022-05-05T06:40:46.790983Z INFO multipart_upload_lib::uploader: Uploaded part=9
2022-05-05T08:40:47+02:00 2022-05-05T06:40:46.884029Z INFO multipart_upload_lib::uploader: Completed the multipart upload
2022-05-05T08:40:49+02:00 08:40:49.638 request_id=FuwiRoaLvuOUweIAAAuB [info] HEAD /health-check
2022-05-05T08:40:49+02:00 08:40:49.641 request_id=FuwiRoaLvuOUweIAAAuB [info] Sent 200 in 2ms
2022-05-05T08:41:02+02:00 Memory cgroup out of memory: Killed process 2348 (gtfs2netexfr) total-vm:3805732kB, anon-rss:2987680kB, file-rss:6080kB, shmem-rss:0kB, UID:0 pgtables:6008kB oom_score_adj:0
2022-05-05T08:41:02+02:00 08:41:02.323 [info] Starting conversion of download uuid 381979ba-d896-4bab-94ca-c7a1444f5efc, from GTFS to NeTEx
2022-05-05T08:41:02+02:00 08:41:02.304 [warning] Job 4901596 handled by Transport.Jobs.SingleGtfsToNetexConverterJob called with args %{"resource_history_id" => 479} failed in 84588347990. Error: %MatchError{term: {:error, ""}}
2022-05-05T08:41:04+02:00 08:41:04.596 request_id=FuwiSgIBLPcThdQAAAvB [info] Sent 200 in 2ms
2022-05-05T08:41:04+02:00 08:41:04.594 request_id=FuwiSgIBLPcThdQAAAvB [info] HEAD /health-check
2022-05-05T08:41:19+02:00 08:41:19.470 request_id=FuwiTXhw1YR6t-8AAAvh [info] Sent 200 in 3ms
2022-05-05T08:41:19+02:00 08:41:19.466 request_id=FuwiTXhw1YR6t-8AAAvh [info] HEAD /health-check
2022-05-05T08:41:34+02:00 08:41:34.431 request_id=FuwiUPRnFnDvEIoAAAwB [info] HEAD /health-check
2022-05-05T08:41:34+02:00 08:41:34.433 request_id=FuwiUPRnFnDvEIoAAAwB [info] Sent 200 in 1ms
AntoineAugusti commented 2 years ago

Vu quelques fois en investiguant https://github.com/etalab/transport-site/issues/2360 avec un exit code à 143

thbar commented 2 years ago

Je clôture pour l'instant.