hyunwoongko / openchat

OpenChat: Easy to use opensource chatting framework via neural networks
Apache License 2.0
437 stars 57 forks source link

support pytorch lightning for fine-tuning on GPU & TPU #12

Closed hyunwoongko closed 3 years ago

hyunwoongko commented 3 years ago

I realized that training with pytorch-lightning and TPU is very slow. Therefore, we do not proceed with TPU development.