Closed JingyiWang3 closed 10 months ago
Hi,thank you for your excellent work! I would like to know if augmented datasets like MuggleMath or RFT are suitable for pre-training?
RFT is used for pre-training as we stated in Qwen.
Hi,thank you for your excellent work! I would like to know if augmented datasets like MuggleMath or RFT are suitable for pre-training?