How long does it takes to train an epoch for critic/generator model on llama-7B with 8 A100?

AkariAsai / self-rag

This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.

https://selfrag.github.io/

MIT License

1.76k stars 162 forks source link

How long does it takes to train an epoch for critic/generator model on llama-7B with 8 A100? #64

Closed hummingbird2030 closed 5 months ago