search

microsoft / FILM

Official repo for "Make Your LLM Fully Utilize the Context"
MIT License
241 stars 19 forks source link

How to get the training model？ #5

Open mozhu621 opened 5 months ago

mozhu621 commented 5 months ago

I didn't find your dataset, and the code about model training with it? Do you make it public?

an1006634493 commented 5 months ago

The training data will not be released very soon.

ACMCMC commented 1 month ago

So - essentially - there's no way to reproduce the results? Please correct me if I'm wrong.

an1006634493 commented 1 month ago

So - essentially - there's no way to reproduce the results? Please correct me if I'm wrong.

Currently, you can reproduce the evaluation results using our model on the huggingface hub https://huggingface.co/In2Training/FILM-7B. This repository provides a guide to the evaluation process and our evaluation logs.

If you urgently need to reproduce the training process, you can find training details such as how to construct the training dataset and how to set the training hyperparameters in our preprints https://arxiv.org/abs/2404.16811.

Our data is still in the internal review process and we are trying to move forward. Sorry for any inconvenience.