-
I successfully quantized the mistralai/Mistral-Nemo-Instruct-2407 model to ONNX using the following command:
`python awq-quantized-model.py --model_path mistralai/Mistral-Nemo-Instruct-2407 --quant_p…
-
- Incorporate ASR confidence estimation scores with ConfidenceConfig in NVIDIA NeMO : https://github.com/NVIDIA/NeMo/blob/main/tutorials/asr/ASR_Confidence_Estimation.ipynb
- Investigate incorporating…
-
Hi,
I try to use my LoRA weights that I got from PEFT using NeMo Framework container (with tp=pp=2, 4 gpus) with TensorRT-LLM ModelRunner (the [TensorRT-LLM/examples/run.py](https://github.com/NVIDIA…
-
**Describe the bug**
HuggingFace datasets imported by nemo.collections.llm.gpt.data in /opt/NeMo/nemo/collections/llm/gpt/data/__init__.py:15
`from nemo.collections.llm.gpt.data.dolly import DollyDat…
-
```
import nemo.collections.asr as nemo_asr
asr_model = nemo_asr.models.EncDecCTCModel.from_pretrained("path_to_model.nemo")
transcript = asr_model.transcribe(paths=["path_to_audio.wav"], batch…
-
**Describe the bug**
I have trained a llama-like model with nemo using the below model config:
```
model:
mcore_gpt: True
micro_batch_size: 1
global_batch_size: 512
tensor_model_parallel_size…
-
### Distribution
Fedora 40
### Package version
6.2.8
### Frequency
Always
### Bug description
This is a Regression, as those files worked before!
```
(nemo:175450): Nemo-WARNING **: 18:45:4…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### This issue exists in the latest npm version
- [X] I am using the latest npm
### Current Behavior
i'm unable …
-
RuntimeError: Caught RuntimeError in DataLoader worker process 2.
Original Traceback (most recent call last):
File "/wiz-llm-storage/anaconda3/envs/h2_nemo/lib/python3.10/site-packages/torch/utils…
-
**Bug Description
The NeMo Curator DataCurator class does not seem to work as expected when running a data curation script in the NVIDIA NeMo Docker container (nvcr.io/nvidia/nemo:24.07). The script l…