-
### Your current environment
```text
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.4 LTS (x86_64)
GCC ve…
-
配置文件内容如下:
`
# 如果你没有 OPENAI API Key，可以使用 g4f 代替，或者使用国内的 Moonshot API
llm_provider="openai" # "openai" or "moonshot" or "oneapi" or "g4f" or "azure"
########## OpenAI API Key
# …
-
### Summary
i get error after run command 👍
` wasmedge --dir .:. --nn-preload default:GGML:CPU:/root/.cache/nexa/hub/official/Qwen2.5-Coder-1.5B-Instruct/q4_0.gguf llama-api-server.wasm --pro…
-
Hi thanks for providing such wonderful evaluation toolkit.
I was wondering why evaluation on `mmlu_generative` returns 0 accuracy whenever what models I try (pythia, qwen).
I understand it as …
-
### 🥰 需求描述
由于o1-mini以及o1-preview模型的API接口不支持流式传输及temperature必须为1，无法调用此API模型，希望能够适配完成
### 🧐 解决方案
希望适配o1-mini以及o1-preview模型
### 📝 补充信息
.
- [X] I hav…
-
### Your current environment
```text
Collecting environment information...
WARNING 07-23 19:11:42 _custom_ops.py:14] Failed to import from vllm._C with ModuleNotFoundError("No module named 'vllm.…