Installation
git clone https://github.com/MARIO-Math-Reasoning/vllm
cd vllm
pip install .
modified files
vllm/core/scheduler.py
vllm/engine/llm_engine.py
vllm/model_executor/model_loader.py
vllm/model_executor/models/__init__.py
vllm/outputs.py
vllm/sequence.py
vllm/worker/model_runner.py
pyproject.toml # because setuptools 70.0.0 was released May 21 2024, need to pin version of setuptools.
requirements-build.txt # because setuptools 70.0.0 was released May 21 2024, need to pin version of setuptools.
added files
tests/test_regression_withvalue.py
vllm/model_executor/models/modeling_value_head.py