-
Request
The ask is to introduce a openai text generation API compatibility layer (chat completion endpoint) to kserve/TGIS.
Why
Having an openai API compatibility layer will allow more open sourc…
-
I have 2 2070 supers and would love to be able to use them in parallel. Would be possible to enable memory pooling. I know it is in theory supported by pytorch. Any chance it can be added here so that…
-
Dear all,
thanks for your work on Switch. It seems really interesting.
However, I failed to install Switch and run examples. I have installed both from conda and in dev mode with pip install with…
-
Hi there,
I am hosting IDEFICS on TGI locally and hitting it via Chat-UI. When I go to a URL, it is able to correctly work with images, as seen here:
However, when I use the "upload image" fe…
-
Someone approached me on IRC and asked about how to use text output in TGI. Should be easy enough - i thought. Until i tried to add some simple text output to the existing TGI sample. Apparently not o…
-
The documentation states that the CSVs will have a datetime format matching `Ymd\TGisv` (from PHP DateTime->format(). However sometimes we see a response that is only `Ymd\TGis` which is unexpected.
…
-
I'm trying to deploy Llama3 8b on GKE using optimum but running into some troubles.
Following instructions here: https://github.com/huggingface/optimum-tpu/tree/main/text-generation-inference. I bu…
-
https://threatpost.com/tgi-fridays-data-exposure/147849/
-
The Python instructions are not in the right place in the contents list, and there are scattered stubs that have no docs under them.
There is a Python entry under Programming Environments that is emp…
-
**Is your feature request related to a problem? Please describe.**
Modules that process spatio-temporal data often use date and time input. It would be useful to have some standard parser options for…