-
lmdeploy lite auto_awq \
/root/models/internlm2_5-1_8b-chat \
--calib-dataset 'ptb' \
--calib-samples 128 \
--calib-seqlen 2048 \
--w-bits 4 \
--w-group-size 128 \
--batch-size 1…
-
I uploaded my superadmin user as a member of a test chapter I created. I only filled in the mandatory fields:
`username,membership_type_id,chapter_id`
The upload was successful but when I try to…
-
* Problem: When I import a model inherited from MPTTModel from an app's __init__.py, I get a django.core.exceptions.AppRegistryNotReady exception.
* Django-mptt Version: 0.16.0
* Django: 4.x
* Mini…
-
Hi TensorRT-LLM team, Your work is incredible.
By following the READme file for [multi-modeling](https://github.com/NVIDIA/TensorRT-LLM/blob/main/examples/multimodal/README.md), we were sucess to run…
-
**Describe the bug**
Running into an import error, seems like its limited to Python 3.9. Python 3.9 EOL is 2025. Is there a reason why the package only supports 3.10 and above. Atleast thats my under…
-
### Description
When attempting to run our agents on AWS Lambda, I encounter the `[Errno 30] Read-only file system error`. This issue arises because Lambda only allows writing to the `/tmp` directory…
-
On my machine python is installed as python3 which was a breaking change in run_localGPT_API.py:
```python
run_langest_commands = ["python", "ingest.py"]
if DEVICE_TYPE == "cpu":
run_langest…
-
## Issue
Tox does not manage to run the tests on the defined Python version list, but it does manage to run the tests on the Python version pinned with `uv`. The remaining fails when trying to crea…
-
**Bug description**
While uploading a large number of findings to defectdojo, the most of them are uploaded, however the action encounter an error and the reminder findings cannot upload. For example…
-
The dataset name is "train-00000-of-00001.parquet".
I am very confused about this question.
When I run the "scripts/training/train.py", the error as follows:
```
/home/miniconda3/envs/chronos/li…