bigscience-workshop / metadata

Experiments on including metadata such as URLs, timestamps, website descriptions and HTML tags during pretraining.
Apache License 2.0
30 stars 12 forks source link

`Title` preprocessor #134

Closed manandey closed 2 years ago

manandey commented 2 years ago

This PR has the implementation and the tests for the TitlePreprocesor

cc. @SaulLu