search

codalab / codalab-worksheets

A collaborative platform for reproducible research (web interface and CLI).
Other
154 stars 82 forks source link

Fix stress testing via GitHub Actions #4226

Open leilenah opened 1 year ago

leilenah commented 1 year ago

The deployment documentation says "NOTE: Stress tests on GitHub Actions are currently broken. To run stress tests, go to the "Manually stress testing" section to see how the tests are triggered."

The scope of this issue is to look into what it would take to fix stress testing w/ GitHub Actions.

leilenah commented 1 year ago

@epicfaace do you have context around this?

epicfaace commented 1 year ago

Currently, running stress tests from GitHub actions is broken.

Note that here

https://codalab.org/deployment/deployment/deployment-process/#3-run-stress-tests

we say

image
leilenah commented 1 year ago

@epicfaace I meant do you have context around why they are broken. Seems like they were a thing at one point.

epicfaace commented 1 year ago

Not sure, I think they just time out now / run out of memory? You can try running stress tests yourself on github actions and then checking the logs?

leilenah commented 1 year ago

cc @yifanmai

percyliang commented 1 year ago

Blocked by #4404

percyliang commented 9 months ago

Now that #4404 is in, can we fix this?

pranavjain commented 1 month ago

@HidyHan Do you know if this is now fixed?