source corpus of glove common crawls 42B and 840B

stanfordnlp / GloVe

Software in C and data files for the popular GloVe model for distributed word representations, a.k.a. word vectors or embeddings

Apache License 2.0

6.81k stars 1.51k forks source link

source corpus of glove common crawls 42B and 840B #204

Open sulmansarwar opened 2 years ago

sulmansarwar commented 2 years ago

Hi there,

I know Common Crawls (CC) is open source and raw corpus is available online. What I am after is the source corpus that was used for generating pre-trained 42B and 840B word vectors? Or at least can someone describe me the dates of the CC dumps used and I'll get them directly from CC?? Any help is appreciated.

Context of this request is that I need to contextualise the dataset in terms of time period for my research.

Thanks