-
## 聊天机器人
1. 向量数据库:预处理好的语料,用于与用户输入做匹配
2. 限制回答范围?llma_index提供类似摘要索引,类似搜索引擎。将摘要作为上下文知识,通过prompt喂给GPT
3. GPT总结回答,调用[API](https://platform.openai.com/examples)即可
-
### Bug Description
In a Windows environment, when the OS system proxy is set, using llamaIndex to access the local Ollama environment LLM , It will results in an access error.
Httpx.HTTPStatusErro…
-
I have follow this training
LLaMA-Factory
Here we provide a script for supervised finetuning Qwen2-VL with LLaMA-Factory . This script for supervised finetuning (SFT) has the following features:
…
-
**Describe the bug**
I have an instance of Arize Phoenix running in a Docker container. I've been using the [instrument.py](https://github.com/Arize-ai/openinference/blob/main/python/examples/llama-i…
-
您好,如题所示,megatron/core/tensor_parallel/layers.py中的243行处报错。
按照我先前的经验,这种报错的原因通常是因为维度不匹配。但因为我第一次用llama和megatron,因此还是想请教下您,看看您是否先前也遇到过这个问题。
不知道是不是我数据预处理时用的vocab-file和merge-file是gpt2的原因所导致的这个问题,或者还是说因为其它原…
-
### Bug Description
When I try to ingest data using with async pipeline and more than 1 workers
```
await pipeline.arun(show_progress=True, documents=batch, num_workers=2)
```
I get below error.
…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
I am on llama-index-llms-anthropic v0.1.6 and llama-index-multi-modal-llms-anthropic v0.…
-
[from the notebook ](https://github.com/hwchase17/langchain/blob/master/docs/modules/models/llms/examples/streaming_llm.ipynb
) It says: LangChain provides streaming support for LLMs. Currently, we s…
-
### Bug Description
When I use
```
from llama_index.llms.ollama import Ollama
...
Settings.llm = Ollama(model="mistral", request_timeout=60.0)
```
I am getting error
```
INFO:httpx:HTTP Re…
-
# Prerequisites
I have searched and tried for a week now.
# Expected Behavior
I am installing five llms on a A100 40GB GPU, each running a model of 6GB (which is the llama-3 8B instruct mode…