-
## Description
(A clear and concise description of what the bug is.)
Model artifacts are in the (TRT-LLM) LMI model format:
` aws s3 ls ***
PRE 1/
2024-10-25 14:59:…
-
Hello, I ran into the following TypeError when running SDPA in python 3.11.
File ~/miniconda3/envs/******/lib/python3.11/site-packages/sdpap/convert.py:80, in clp_toLMI(A, b, c, K, J)
75 # --…
-
*Concise Description:*
**[vLLM v0.6.0](https://blog.vllm.ai/2024/09/05/perf-update.html) provides 2.7x throughput improvement and 5x latency reduction over the previous version (v0.5.3)**
*DLC i…
-
## Description
vLLM sampling parameters include a [richer set of values](https://github.com/vllm-project/vllm/blob/c9b45adeeb0e5b2f597d1687e0b8f24167602395/vllm/sampling_params.py), among which `lo…
-
`IMMENSITY-X-LMI-REL-7.1.0-LTO-453602552-25.09.22.zip` on my device (Redmi K30 Pro) does not boot, it just shows the logo for about 3s and bootlooping.
OS is the stock latest MIUI 14.0.4 CN version…
-
LISPM1; LMI 845
When run, wants to read LISPM; LMCOLD LOAD.
-
**Beschreibung**
Als Entwickler möchte ich vorab der Entwicklung eines Forntends genau verstehen, welche Nutzergruppen mittels welcher Interaktionen mit der Datenplattform in Kontakt treten sollen/müs…
-
## Description
Currently, the options for [Transformers-NeuronX Engine in LMI](https://docs.djl.ai/master/docs/serving/serving/docs/lmi/tutorials/tnx_aot_tutorial.html) don't include the possibility …
-
## Description
In the current version (using LMI sagemaker image), we are running into the following error:
```
File "/usr/local/lib/python3.10/dist-packages/vllm/config.py", line 1288, in __post…
-
### team
LMI
### corresponding
ProchazkaDavid
### tasks
1, 2, and 3
### members
David Procházka, Masaryk University
Terézia Slanináková, Masaryk University
Jaroslav Oľha, Masaryk University
…