Closed w32zhong closed 1 year ago
Thank you for your interest in our work, our training data is currently not publicly available. If you want to evaluate the GSM8k or MATH benchmarks, please refer to the "Evalution" section of the WizardMath README.
Thank you for your response.
I want to evaluate the model, but given that the data is not available, I hope we can know at least on which datasets it is trained, do we need to train it on MATH training set? is it zero-shot? For it to be used in a research evaluation, I think these are important information.
Due to company policies,Our training data is currently not publicly available. You can learn about in detail how our training data are constructed through our paper https://arxiv.org/abs/2308.09583
Thanks for your notice and sharing your paper. I will close this issue.
Hello, when can we get math_instruction_data.json? We want to reproduce your evaluation, but we don't have the necessary data. Could you release the dataset?
Without the data math_instruction_data.json, how can I reproduce your evaluation?