-
**Describe the issue**
When I use `pip install intel-extension-for-transformers` in a fresh conda environment, there are some packages missing that I have to manually install before I can run a model…
-
### Description
Is a chance to add integration with other AI models, maybe some open source which allow to create own serwer?
### Suggested Solution
llama
### Alternatives
_No response_
### Addi…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [Yes] I am running the latest code. Development is very rapid so there are no tagged versions as …
y6t4 updated
4 months ago
-
Hi @yixchen,
Niels here from the open-source team at Hugging Face. I discovered your work through ECCV, it was featured on daily papers here: https://huggingface.co/papers/2401.09340 (feel free to …
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
How can I use astream_chat method with chatEngine, How can I use it with API (fastapi) t…
-
### Prerequisites
- [X] I am running the latest code. Mention the version if possible as well.
- [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md)…
-
- 环境
- docker: registry.cn-hangzhou.aliyuncs.com/havenask/rtp_llm:0.1.13_cuda12
- cuda: 12.1
- driver: 515.105.01
- 模型:
- llama: https://huggingface.co/lmsys/vicuna-33b-v1.3
…
-
# Installation
1. Use this [link](https://ai.meta.com/resources/models-and-libraries/llama-downloads/) to request a access email with downloadable link.
In order to download the model weights and…
-
Simple script like:
```
import llm
model = llm.get_model("orca-mini-3b-gguf2-q4_0")
for i in range(70):
print(i, model.prompt("How are you today?"))
```
seems to always crash on the 61th …
-
### Feature Description
Implement a calculator with Python, the calculator can add, subtract, multiply and divide two numbers.
### Reason
_No response_
### Value of Feature
_No response_
Checklist
…