geneontology / pipeline

Declarative pipeline for the Gene Ontology.
https://build.geneontology.org/job/geneontology/job/pipeline/
BSD 3-Clause "New" or "Revised" License
5 stars 5 forks source link

issue-265-go-cam-products pipeline no longer completes due to timeout #375

Closed kltm closed 2 months ago

kltm commented 2 months ago

Looking at historical successful runs, for some time, we have only had occasional success due to marginal call:

    [2024-04-08T22:08:35.408Z] + wget http://localhost:8888/models/gp -O gocam-gps.json
    [2024-04-08T22:08:35.408Z] --2024-04-08 22:08:35--  http://localhost:8888/models/gp
    [2024-04-08T22:08:35.408Z] Resolving localhost (localhost)... 127.0.0.1, ::1
    [2024-04-08T22:08:35.408Z] Connecting to localhost (localhost)|127.0.0.1|:8888... connected.
    [2024-04-08T22:23:41.671Z] HTTP request sent, awaiting response... Read error (Connection timed out) in headers.
    [2024-04-08T22:23:41.671Z] Retrying.
    [2024-04-08T22:23:41.671Z]

It seems that we were occasionally hitting the wget 15m limit. Since the 9th, we have had no succeses at that point.

kltm commented 2 months ago

@pgaudet moving this from pipeline maintenance to this project, as it seems to be part of the constellation of issues that have passed the threshold of usability recently.

kltm commented 2 months ago

Looking at what we have now that's passing, the current wait time is 17m--easy to see how borderline we were with the 15m.