-
-
**Describe the bug**
I use llama-2 7b, and when I start stage 2 in EE-Tuning, the bug occurs.
**To Reproduce**
here is `llama2_7B_1_exit_mlp_pt.sh` I modified:
``` bash
#!/bin/bash
PROJECT…
-
## features
- [ ] tensor fusion/multivariate functions
- [ ] impure functions (`&` and `&mut`)
- [ ] assess what to pack into kernel typestate w/ traits
- e.g., dims, rank, crate metadata, compi…
-
Hi, guys, I'm not reporting a bug here. But asking for your advice here.
I have a 6b model, like chatglm1-6b. And I also have a machine with 256gb cpu memory and 4 gpus (3090, each with 24gb gpu mem…
-
## ❓ Questions and Help
Sir i m facing an issue
1. undefined symbol: _ZN3c105ErrorC1ENS_14SourceLocationERKSs
2. subprocess.CalledProcessError: Command '['/home/cse/anaconda3/envs/scene_graph_be…
-
HI @kriswiner
I have a question regarding the value for the beta and zeta of the Magwidck algorithm.
Starting in the folliwng [line](https://github.com/kriswiner/EM7180_SENtral_sensor_hub/blob/3…
-
I am trying to setup Polycoder inferencing on my machine with 2xP100 GPUs, and use the docker command as available in README:
```bash
nvidia-docker run --rm -it -e NVIDIA_VISIBLE_DEVICES=0,1 --shm-s…
-
Hi Cadene,
I think the decomposition part is in fusion.py. But i have get them all clear yet. Would mind helping me out? Because I want to code a Tensorflow version based on your pytorch code. And …
ghost updated
6 years ago
-
[7_gpu_pp1.log](https://github.com/FlagOpen/FlagScale/files/14720175/7_gpu_pp1.log)
[31_gpu_pp4.log](https://github.com/FlagOpen/FlagScale/files/14720184/31_gpu_pp4.log)
![378074e481adec4316fc6dd978…
-
Hello,
I am encountering an issue with the GPT-NeoX library. When I set either `pipe_parallel_size` or `model_parallel_size` to 2, I get the following assertion error:
```
[2024-07-11 06:28:59,…