-
I just started using TreeQSM, and I'm stuck with an error when i try to make_models_parallel for a very small tree.
It says there is an issue in the line 218 (i guess from my inputs).
QSMs(m:m+a…
-
**Submitting author:** @AlanPearl (Alan Pearl)
**Repository:** https://github.com/AlanPearl/diffopt
**Branch with paper.md** (empty if default branch): paper
**Version:** v1.0.0
**Editor:** @jbytecode…
-
Just opening this to add support for all models following #34184
Lets bring support to all model! 🤗
- [x] Llama
It would be great to add the support for more architectures such as
- [ ] Qwe…
-
Run models in parallel.
To save the cost of running everything in GPU nodes, consider
* separating data alignment. See also #257
* running sklearn models in cpu
* nn models in gpu
-
Greetings, a big thumbs up for this project. I have an issue with inverter model POW-HVM5.5K-48V-LIP (with parallel) - according to powmr website it also supports rs232 wifi dongle however for some …
-
I used the interface from the vllm repository (https://github.com/vllm-project/vllm) to load the model and ran
```bash
torchrun --nproc-per-node=8 run.py --data Video-MME --model Qwen2_VL-M-RoPE-80…
-
**What would you like to be added**:
Similar to kserve https://kserve.github.io/website/latest/modelserving/v1beta1/custom/custom_model/#parallel-model-inference
**Why is this needed**:
*…
-
**Describe the bug**
I have trained a llama-like model with nemo using the below model config:
```
model:
mcore_gpt: True
micro_batch_size: 1
global_batch_size: 512
tensor_model_parallel_size…
-
### Problem Description
Ran following example:
https://pytorch.org/tutorials/beginner/blitz/data_parallel_tutorial.html with little modification but it failed during run:
if I apply nn.dataParall…
-
I am using keras 2.2.4
My error is as below:
--------------------------------------------------------------------------------------
Traceback (most recent call last):
File "C:\Users\gana\AppDa…
ganav updated
2 months ago