This repository contains code for GFlowNet fine-tuning of language models, as described in the paper
Amortizing intractable inference in large language models
Edward J. Hu, Moksh Jain, Eric Elmoznino, Younesse Kaddar, Guillaume Lajoie, Yoshua Bengio, Nikolay Malkin
Paper: https://arxiv.org/abs/2310.04363
Visit the subdirectories to find code and documentation for each experiment in the paper:
rng
next_sentence
infill_subj_arithmetic
infill_subj_arithmetic
infill_subj_arithmetic
Please contact us or post an issue if you have any questions.