neuralmagic / nm-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs
https://nm-vllm.readthedocs.io
Other
251 stars 10 forks source link

set PYTHON-3-10 job to gcp #318

Closed derekk-nm closed 4 months ago

derekk-nm commented 4 months ago

Updated the PYTHON-3-10 job to use the same test_label_solo as the other python jobs. This to avoid the job running out of disk space, as was happening in the g5.2xlarge aws instance it is currently using.

PYTHON-3-10 / TEST-SOLO / TEST System.IO.IOException: No space left on device : '/opt/actions-runner/_diag/Worker_20240612-022311-utc.log'

nm remote push is currently running at https://github.com/neuralmagic/nm-vllm/actions/runs/9613896193