-
### Describe the feature request
Assess performance capability without downloading the full model.
### Describe scenario use case
For some models, the performance may be a blocker. Since model do…
-
First of all thank you to the author of this tool. Installed and Run successfully in 1 go.
So I installed it and used 2 commands to generate NPY and MP4.
python generation.py folder=model_weight…
-
Hello,
After thoroughly reviewing the source code of both BitNet and T-MAC, I noticed a high degree of overlap between the two. The code implementation seems quite similar, which raises some questions…
-
This comment indicates that considerable compute resources were needed to train NeuralGCM: https://github.com/google-research/neuralgcm/issues/101#issue-2426040472
This puts the value of neuralgcm…
-
In /vllm/model_executor/weight_utils.py
```
elif use_safetensors:
for st_file in hf_weights_files:
with safe_open(st_file, framework="pt") as f:
for name in f.keys(): # noqa: SIM…
-
The link to Pretrained model weights are broken. Is there any other links to downloads the weights from?
-
The pretrained model weights at ML_UVvisModels/UVvis-MPNN/original are missing in the repo (they are there for the other chemprop models with e.g. 3D distances as input features).
I would love to t…
-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussion…
-
### What is the issue?
Previously, I was using 515 version of NVIDIA driver and cuda11.7, and I could load a model (qwen1.5_32b_q8) on two GPUs by setting OLLAMA_SCHED_SPREAD=1.
But now I am usin…
-
### Add Link
When I use fsdp, Because the flattened parameters, I always meet some question.
for examples:
`
RuntimeError: mat2 must be a matrix, got 1-D tensor
`
and
`
RuntimeError: weight sh…