-
### System Info
latest tgi docker image (I think 2.0)
ubuntu 20
### Information
- [X] Docker
- [ ] The CLI directly
### Tasks
- [ ] An officially supported command
- [ ] My own modifications
##…
onel updated
2 months ago
-
I'm creating POC for testing microservices architecture in GPU system provided by opea.
[Build Mega Service of ChatQnA on Xeon](https://github.com/opea-project/GenAIExamples/blob/main/ChatQnA/docker/…
-
stenograph and setting system
https://photos.app.goo.gl/j62FuspMoYdL1s1h6
Judicial Notice ]
-
### Model description
If I uploaded the model to TGI, should I prepare the text in the required template for the generate query? Or does TGI itself perform this operation at the time of receiving the…
-
### What happened?
When I use `stream=True` for TGI Endpoint, I always get _eos_token_ at the end. It doesn't seem like it should be like this.
Request example:
```
curl -X POST --location 'http…
-
### System Info
text-generation-launcher --env
2024-07-26T03:39:42.960734Z INFO text_generation_launcher: Runtime environment:
Target: x86_64-unknown-linux-gnu
Cargo version: 1.79.0
Commit sha…
-
Some OPEA image names are not up to date. Need to refactor them:
- embedding: opea/gen-ai-comps:embedding-tei-server
- retriever: opea/gen-ai-comps:retriever-redis-server
- reranking: opea/gen-ai…
-
The app is able to get the list of all genres but when I try to open any of them I get the following error
An error occurred
{
"headers": {
"normalizedNames": {},
"lazyUpdate": null
…
-
### System Info
OS version: WSL 2. ubuntu 22.04
model: llama3-8B-Instruct
Hardware: no GPU
There is no gpu, but I installed the nvcc library in wsl using this command. `sudo apt install nvidia…
Hhhh8 updated
4 weeks ago
-
Hello,
Is there some optimization to follow to obtain better performances with pycatia?
When I use the same macro developed in python with pycatia than one developed in VBA, I can see that the p…