-
**What would you like to be added/modified**:
Based on the current multiedge inference benchmark on ianvs, we would like to extend the multiedge inference on multiple heterogeneous edges (e.g., m…
-
### Feature request
In the documentation, there is not enough info about the default values TGI enforces if client request do not contain parameters like `temperature`, `top_p`, `presence_frequency` …
-
When I try to evaluate my model or make predictions on the val set, I get the following error:
```
---------------------------------------------------------------------------
ValueError …
-
Hi team,
I was trying to look for an API to access Anuvad tool and reached this link: https://github.com/project-anuvaad/anuvaad/tree/master/anuvaad-nmt-inference
There is documentation link men…
-
Hello mlcommons team,
I want to run the "Automated command to run the benchmark via MLCommons CM" (from the example: https://github.com/mlcommons/inference/tree/master/language/llama2-70b) with a d…
-
Dynamic LoRA (Low-Rank Adaptation) switching functionality, allowing users to change LoRA models on-the-fly during inference without reloading the entire model.
-
This has multiple steps:
- Calling mrbayes_volpiano on an alignment
- Implementing the URL endpoint for the frontend to call
Peripheral issues that will get their own issue:
- More robust MAFF…
-
- [x] I'd be willing to implement this feature ([contributing guide](https://github.com/nrwl/nx/blob/master/CONTRIBUTING.md))
## Description
Nx plugins must be written in CJS
## Motivat…
-
### Question
Hello
I was going through the issues section to find out an solution for the issue i am facing.. I did tried some of the solutions provided by xenova but it seems like I am getting…
-
Hi Authors @PicoAudio , thanks for the nice paper. Just curious when do you plan to open-source the code.
Thanks
Ojasv