-
### How are you running AnythingLLM?
Docker (local)
### What happened?
Going into workspace settings and can choose every LLM provider except LM studio. I have added 2 models to LM studio playgroun…
-
**Problem Description**
Many hospitals we work with have multiple servers (e.g., one with GPU for training and another without for inference). Right now, it's not possible to add multiple nodes from…
-
By using this model from Intel :
https://docs.openvino.ai/2024/omz_models_model_age_gender_recognition_retail_0013.html
I can't get good results (Or this model offers really good accuracy in the …
-
### What is the issue?
When testing llava-llama3 on an agentic task of interpreting an image and generating an action. I specified the role of the 'environment' as 'environment'. This leads to ollama…
-
I have configured an ensemble model in Triton Inference Server, which includes DALI preprocessing and TensorRT inference. When I uploaded a GIF image from the client, the Triton server crashed with th…
Bycqg updated
3 months ago
-
Hi there!
Galactica [tokenizer](https://huggingface.co/facebook/galactica-120b/blob/main/tokenizer_config.json)'s `eos_token_id` is not set but it's set in its model config. We account for tokenize…
-
The data at Download Link (Legacy) at your front page is for test set v1 or v1.1? When i submit it on the server, it just shows me the result with test set without any explicit version(v1 or v1.1). Al…
-
### 🚀 The feature
## Author: Li Ning
## Background
A stateful model possesses the ability to detect interdependencies between successive inference requests. This type of model maintains a persist…
-
**Description**
Hi, I have setup Triton version 2.47 for Windows, along with ONNX runtime backend, based on the assets for Triton 2.47 that are mentioned in this URL : https://github.com/triton-infer…
-
/usr/bin/ld: ../libtritonserver.so: undefined reference to `absl::lts_20220623::StartsWithIgnoreCase(absl::lts_20220623::string_view, absl::lts_20220623::string_view)'
/usr/bin/ld: ../libtritonserv…