-
Project's Readme says that
`python gradio_chat.py --baseonly `
should start a local web server for inference
but the command generates this error:
```
torch_dtype = torch. # Set the appropriat…
-
### Describe the bug
For example with fireworks.ai model: FireFunction V1
Ref: https://fireworks.ai/models/fireworks/firefunction-v1
The base url is informed as: https://api.fireworks.ai/infere…
-
Hello,
I use Perplexity to connect Hoarder. But I get the following error message.
2024-06-30T08:42:33.745Z error: [inference][31] inference job failed: Error: 400 Last message must have role `u…
-
[12/12]
[MoviePy] >>>> Building video D:\00_AI_TOOLS\ComfyUI-aki-v1.2\output\hallo_1719451232483069200.mp4
[MoviePy] Writing audio in hallo_1719451232483069200TEMP_MPY_wvf_snd.mp3
[MoviePy] Done.
…
-
For the inference part I would love to see [Ollama](http://ollama.ai)
and for IDE with AI I would love to see [Cody](http://sourcegraph.com/cody)
Thank you for the landscape overview.
-
I have been trying llm_inference on android (https://github.com/google-ai-edge/mediapipe-samples/tree/main/examples/llm_inference/android). While the model performs perfectly in the emulator, it start…
-
Scope; many openEO users want to enable AI model inference through openEO. However, they do want to limit what users can do with the model (e.g. downloading the weights)
Currently we run model infere…
-
### Bug Description
I tried running the code snippet in this example
https://docs.llamaindex.ai/en/stable/examples/embeddings/text_embedding_inference/
I got the following error
```
JSONDecode…
-
Premise: this is a model which does not accept the `guidance_scale` param and loads a specific set of model weights according to the amount of `num_inference_steps` you want to do (1, 2, 4 or 8 steps)…
-
I've been having a tough time figuring this out. On coderealtime.com I am seeing an issue where the AI chatbot connection appears to stop responding after a period of time.
Curious if anyone is see…