search

biothings / bte_regression_test

0 stars 1 forks source link

Address GH Action time out #10

Open ariutta opened 3 years ago

ariutta commented 3 years ago

This timed out after 6 hours: https://github.com/biothings/bte_regression_test/actions/runs/779366292

Possible solutions:

  1. get access to longer time limits
  2. use batch mode when querying API
  3. split up each query template into its own workflow
andrewsu commented 3 years ago

Ugh, looks like github has per-job time limits, independent of our total allotment per month. Most notably from https://docs.github.com/en/actions/reference/usage-limits-billing-and-administration:

Job execution time - Each job in a workflow can run for up to 6 hours of execution time. If a job reaches this limit, the job is terminated and fails to complete. Workflow run time - Each workflow run is limited to 72 hours. If a workflow run reaches this limit, the workflow run is cancelled.

This suggests we may need to run it on our own hardware? @ariutta do you have some local server you can use for testing? BTE is mostly IO, so shouldn't require a very beefy machine at all... Or, any other solutions we want to explore? I think that six hour limit is going to be a dealbreaker for Github Actions...

ariutta commented 3 years ago

We do have local hardware we could try. Maybe I'll try 2 and 3, see if that works, and if not, run it locally for now.