bigscience-workshop / metadata

Experiments on including metadata such as URLs, timestamps, website descriptions and HTML tags during pretraining.
Apache License 2.0
30 stars 12 forks source link

build: bump nltk to 3.6.7 for security and performance #130

Closed tianjianjiang closed 2 years ago

tianjianjiang commented 2 years ago

@shanyas10 and @SaulLu I'm going to merge it since it is based on dependabot. But if this makes website description preprocessing slower or even unusable, we can always revert it.