-
### Your current environment
The output of `python collect_env.py`
```
Collecting environment information...
Traceback (most recent call last):
File "/home/kojoe/EasyAnimate/easyanimate/i…
-
### Summary
INFO - Downloading Plugin: wasmedge_rustls
ERROR - Download error from urllib: HTTP Error 404: Not Found
ERROR - URL: https://github.com/WasmEdge/WasmEdge/releases/download/0.1…
-
Borrowing from the `LlamaEdge` example, I put the [chatbot-ui](https://github.com/LlamaEdge/chatbot-ui) frontend in the root directory before starting the RAG API server.
This seems to work well in…
-
I was trying to compile the huggingface Llama 2 model using the following code:
```python
import os
import torch
import torch_tensorrt
import torch.backends.cudnn as cudnn
from transformers im…
BDHU updated
10 months ago
-
Hello,
I would like to access the loss of the model, for example to compute perplexity, on a RTX 3050.
Usual inference works great, but accessing model().loss triggers a OOM :
```python
from …
-
### Search before asking
- [X] I have searched the YOLOv5 [issues](https://github.com/ultralytics/yolov5/issues) and [discussions](https://github.com/ultralytics/yolov5/discussions) and found no si…
-
I wanted to test WhisperFusions on rtx3090.
Went throught build.sh and then:
`docker run --gpus all --shm-size 64G -p 6006:6006 -p 8888:8888 -it ghcr.io/collabora/whisperfusion:latest
`
and I ru…
rvsh2 updated
4 months ago
-
I use images：nvcr.io/nvidia/nemo:24.03.framework，and successfully run /NeMo/examples/nlp/language_modeling/tuning/megatron_gpt_finetuning.py
but when I run /NeMo/examples/nlp/language_modeling/tuni…
-
### System Info
Generating with GPTQ models encounters the following errors after merging this PR: https://github.com/huggingface/transformers/pull/30209 @younesbelkada @SunMarc
The error inform…
-
### Summary
## Create an LLM app with deep understanding of a GitHub repo
### Description
LLM assisted coding is one of the most promising application areas for modern AI. It will also have pro…