search

shaigue / pmi_masking

This repository contains code that takes a text corpus and creates a PMI masking vocabulary for it.
MIT License
2 stars 0 forks source link

integration with LLM training code #14

Open shaigue opened 1 year ago

shaigue commented 1 year ago

discuss and decide on the best way to integrate this code with LLM training.