-
Per the [recent paper from Meta](https://arxiv.org/abs/2404.19737), it appears that models that predict multiple future tokens can exhibit significantly greater sample efficiency than models trained o…
-
[Kraken](https://github.com/mittagessen/kraken/blob/a0c395727c011d3283b34b5f7a9ef6d85970e6d0/kraken/rpred.py) offers "multi-script" (actually multi-model) prediction in one pass, so instead of a fixed…
-
Like most people, i run a CPAP cooler as well as aux parts cooling and interestingly and i suppose not suprisingly the rscs aux fan provides more cooling than the CPAP. (22.2W for the the CPAP and 26.…
-
Error 123 description: "firmware file supplied does not match the connected device model"
Affected model: MultiPlus-II 48/3000/35-32 (2699xxx)
Bug since all Venus versions up to date.
VictronCo…
-
I'm experimenting with the new implementation of CUDA acceleration for quantized models and wondering how to use sharded tensors in this context. I'm having a hard time adapting the `ShardedVarBuilder…
-
### Description
All modern browsers rely on multiple OS processes for security and reliability. For example this is essential to ensure that if one website crashes or hangs (uses too much memory, tri…
-
### Feature request
Microsoft published its light-weight version of multi-modal model which also supports images. Is there any possibility to support this model in TGI?
### Motivation
Supporting mu…
-
/kind feature
When we runs models using the InferenceService object provided by kserve, we would like to isolate them such that only certain pods can talk to a set of model pods. We tried using net…
-
I reinstall `pip install flash-attn==2.6.1` in NGC pytorch docker image 24.06.
When I run train job, I got follow error:
```
Traceback (most recent call last):
File "/data1/nfs15/nfs/bigdata/zha…
-
I couldn't find the multi-view models when I launched Streamlit. I think it only looks for the models containing "predictions.csv" but the multi-view models have "predictions_VIEWNAME.csv".