Open cyj95 opened 3 months ago
Hi, Merlin is the pretrained weights and Merlin-Chat is the weights after SFT. The entire training process is conducted on 64 NVIDIA A800 GPUs, with approximately 12 hours required for pre-training and 3 hours for instruction-tuning. Detailed informantion will be updated in the next version of Merlin. Best
what's the difference between Merlin and Merlin-Chat models? How long time does it cost to train the model? how many GPUs does the model need to train?