-
您好,这篇论文 最近有开源计划吗
-
### Required prerequisites
- [X] I have read the documentation .
- [X] I have searched the [Issue Tracker](https://github.com/PKU-Alignment/safe-rlhf/issues) and [Discussions](https://github.com/PKU-…
-
### 🚀 The feature, motivation and pitch
Fuyou Training Framework Integration for PyTorch
Description:
Integrate the Fuyou training framework into PyTorch to enable efficient fine-tuning of larg…
-
Hi, I feel confused about this bug when using memory_efficient_attention. It seems that the embed per head you choose can't match with xformers?
```
NotImplementedError: No operator found for `memo…
-
> Today we’re releasing the next step: QDoRA. This is just as memory efficient and scalable as FSDP/QLoRA, and critically is also as accurate for continued pre-training as full weight training. We thi…
-
Can you provide a detailed guide on how to use LoRA or QLoRA finetuning of VideoLLaMA2 and also for inference. Moreoever, can you provide the guide on how to make the finetuning dataset for images , …
-
Deepspeed support finetune extra model with lora ?
-
To enable efficient training on GPUs and scale our repository for models with millions to billions of parameters—essential for working with large visual language models—we must implement optimization …
-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussions) and fou…
-
Hi Team,
We are currently running the HDBSCAN algorithm on a large and diverse dataset using one of our products to execute the script in Python. Below is the script we are using along with the in…