Open nemerna opened 3 months ago
INFO 08-06 12:35:26.612 ngc_injector.py:141] Selected profile: 7680b65db3dde6ebb3cb045e9176426b32d2e14023e61f1cd2137216dd1dc789 (vllm-fp16-tp1) Traceback (most recent call last): File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/lib/python3.10/runpy.py", line 86, in _run_code exec(code, run_globals) File "/usr/local/lib/python3.10/dist-packages/vllm_nvext/entrypoints/openai/api_server.py", line 492, in engine_args, extracted_name = inject_ngc_hub(engine_args) File "/usr/local/lib/python3.10/dist-packages/vllm_nvext/hub/ngc_injector.py", line 143, in inject_ngc_hub repo = optimal_config.workspace() Exception: Error { context: "initializing ngc repo from repo_id: ngc://nim/mistralai/mistral-7b-instruct-v03:hf", source: CommonError( Error { context: "fetching file_map", source: CommonError( Error { context: "fetching file map with bearer token", source: reqwest::Error { kind: Builder, source: http::Error( InvalidHeaderValue, ), }, }, ), }, ), }
INFO 08-06 12:35:26.612 ngc_injector.py:141] Selected profile: 7680b65db3dde6ebb3cb045e9176426b32d2e14023e61f1cd2137216dd1dc789 (vllm-fp16-tp1) Traceback (most recent call last): File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/lib/python3.10/runpy.py", line 86, in _run_code exec(code, run_globals) File "/usr/local/lib/python3.10/dist-packages/vllm_nvext/entrypoints/openai/api_server.py", line 492, in
engine_args, extracted_name = inject_ngc_hub(engine_args)
File "/usr/local/lib/python3.10/dist-packages/vllm_nvext/hub/ngc_injector.py", line 143, in inject_ngc_hub
repo = optimal_config.workspace()
Exception: Error {
context: "initializing ngc repo from repo_id: ngc://nim/mistralai/mistral-7b-instruct-v03:hf",
source: CommonError(
Error {
context: "fetching file_map",
source: CommonError(
Error {
context: "fetching file map with bearer token",
source: reqwest::Error {
kind: Builder,
source: http::Error(
InvalidHeaderValue,
),
},
},
),
},
),
}