-
Currently, we only have two option for Orchestrator that either QueryPipeline or AgentOrchestrator without custom prompt parameters.
Can we have something similar like prompt in FunctionCallingAgen…
-
### Your current environment
The output of `python collect_env.py`
```text
Your output of `python collect_env.py` here
```
vllm 0.5.4
### 🐛 Describe the bug
目前在8 * A800上进行推理,vl…
-
**Is your feature request related to a problem? Please describe.**
Our bot currently has very many tools, most of them using a different JDBC driver, different APIs (REST, GQL, gRPC). This comes wi…
-
**Describe the bug**
What the bug is, and how to reproduce, better with screenshots(描述bug以及复现过程,最好有截图)
ms-swift 2.2.5
![Uploading 企业微信截图_17230037694865.png…]()
已经更新到最新…
-
Hi there, I would like a raise an issue about the future enhancement of `nano-graphrag`. One of the big direction is add more components to adapt various scenes.
What would you guys like to add? Fo…
-
-
Example of command:
```python benchmark_throughput.py --model gpt2 --input-len 256 --output-len 256```
Output:
```Namespace(backend='vllm', dataset=None, input_len=256, output_len=256, model='gpt…
-
Hi,
i m sorry, i don't find how unload model. like i load a model, i delete the object and i call the garbage collector but it does nothing.
How we are suppose to unload model?
I want to load a mo…
-
LLaMA-Factory是不是版本啥的不对了?还是我没安装好?
全部的报错如下:
`
(langchain) zeng@zeng:~/llm/medical-chatbot$ sh run_training.sh
04/29/2024 15:43:19 - WARNING - llmtuner.hparams.parser - We recommend enable mixed p…
-
## 🚀 Feature Request
Currently StreamingDataset handles distributed data parallel training by itself. This makes it incompatible with Trainers that handles data distribution, such as transformers.Tra…