Closed Michaelvll closed 2 weeks ago
WAL is more robust for more parallel access, as we have done for #3863 #3923
Tested (run the relevant ones):
bash format.sh
[x] Any manual or new tests for this PR (please specify below)
import subprocess from multiprocessing.pool import ThreadPool
def run_task(task): print(f'Running task {task}') subprocess.run( f'sky jobs launch -n job-{task} -dy --fast --cloud aws -t t3.medium --use-spot "echo hi {task}; sleep 3600"', shell=True )
with ThreadPool(8) as pool: pool.map(run_task, range(1000))
pytest tests/test_smoke.py
pytest tests/test_smoke.py::test_fill_in_the_name
conda deactivate; bash -i tests/backward_compatibility_tests.sh
WAL is more robust for more parallel access, as we have done for #3863 #3923
Tested (run the relevant ones):
bash format.sh[x] Any manual or new tests for this PR (please specify below)
def run_task(task): print(f'Running task {task}') subprocess.run( f'sky jobs launch -n job-{task} -dy --fast --cloud aws -t t3.medium --use-spot "echo hi {task}; sleep 3600"', shell=True )
with ThreadPool(8) as pool: pool.map(run_task, range(1000))
pytest tests/test_smoke.pypytest tests/test_smoke.py::test_fill_in_the_nameconda deactivate; bash -i tests/backward_compatibility_tests.sh