search

rail-berkeley / bridge_data_v2

MIT License
128 stars 24 forks source link

Pytorch BC/RL Implementations for BridgeData V2 #12

Closed Stardust-hyx closed 4 months ago

Stardust-hyx commented 1 year ago

Distributed training code (based on deepspeed) for BridgeData is now available! See https://github.com/Stardust-hyx/Bridge-Torch Since most open-source LLMs are implemented with Pytorch and require memory-efficient distributed training frameworks to fine-tune on, we believe our repository can greatly facilitate the application of Multimodal LLMs on this field.

We provide implementations for the following methods:

By the way, a novel generative VLM-based BC method is under development by us. Stay tuned.

Stardust-hyx commented 1 year ago

A checkpoint for GCBC as well as a torch-version of eval.py is also provided in https://github.com/Stardust-hyx/Bridge-Torch. We will be grateful if you can help check the validity of the checkpoint by trying it out. @HomerW Thanks in advance!