-
**Describe the bug**
4张80G的A100好像不能支持基于lora的7b bloom在batch为4的条件下训练,Colossalai是可以的,比较困惑,我对比了一下,batch只能设置到1
**To Reproduce**
下面是我稍微修改适配bloom的脚本(官方只公开适配facebook的opt脚本)
官方指出gradient_checkpointing和o…
-
**System Info:**
Memory: 500G
GPU: 8 * A100 80G
Question:
**Why using multi gpus in init of DeepSpeedRLHFEngine used much more memroy compared to using single gpu ?**
**Reproduce:**
Copy mode…
-
I am using heltec automation LoRa chip for transmitting LoRa packets. Using the LoRa Rx flowgraph in examples, I am not able to rx msgs for SF 5 and 6 . SF 7 to 12 works absolutely fine. Screenshots a…
-
Well, no kidding, of course it doesn't.
But given how well Direwolf works and how practical and well thought out the interface is, wouldn't it be nice if the community could come together and fork…
-
Good day Gimasi,
I have updated the firmware of my GMX_LR1 through my Tuino1 with the binary file you are providing and it worked fine.
I want to do the same from the source code in the gimasi/GMX…
-
Hi there! Getting started with Meshtastic is pretty straightforward. Here are the basic steps:
1. **Purchase Supported Hardware**: You'll need a device with a compatible microcontroller unit (MCU) …
-
Hello all,
I have recently managed to convert the flan-t5 base model to GGUF #2215 . But I also have multiple LoRA adapters trained for different tasks.
@EricLBuehler @LaurentMazare So I wish t…
-
### Your current environment
The output of `python collect_env.py`
```text
PyTorch version: 2.4.0+cu118
Is debug build: False
CUDA used to build PyTorch: 11.8
ROCM used to build PyTorch: N…
-
### Summary
The primary objectives of this project are to create a WasmEdge plugin and an SDK to use these functions with the following features:
- Support txt2img
- Support img2img
- Allow user…
-
I'm currently trying to figure out if and how I can use EMANE to emulate a LoRa channel.
I have an application for which I want to write an interface to EMANE. However, since I'm working with LoRa,…