search

hassonlab / 247-pickling

Contains code to create pickles from raw/processed data
1 stars 9 forks source link

gpt2 or gpt2-xl? #32

Closed hvgazula closed 2 years ago

hvgazula commented 3 years ago

https://github.com/hassonlab/247-pickling/blob/main/code/tfspkl_main.py#L211 Shouldn't it be gpt2-xl? Or do they have the same tokenizer?

hvgazula commented 2 years ago

This is what I reached out to you about.