X-LANCE / SLAM-LLM

Speech, Language, Audio, Music Processing with Large Language Model
MIT License
579 stars 52 forks source link

ddp, hydra, lr_scheduler, q-former #35

Closed ddlBoJack closed 9 months ago

ddlBoJack commented 9 months ago

What does this PR do?

  1. Fix bugs in ddp and hydra
  2. Change epoch lr_scheduler to step lr_scheduler
  3. Fix bugs using q-former with multi gpus
  4. Support more huggingface llm besides llama and vicuna

Feature/Issue validation/testing

Please describe the tests that you ran to verify your changes and relevant result summary. Provide instructions so it can be reproduced. Please also list any relevant details for your test configuration.

Before submitting

Thanks for contributing 🎉!