Powerkrieger / NobbyGPT

Reimplementation of nanoGPT for educational purposes
0 stars 0 forks source link

3b. Diglot-Weave ourselves #4

Closed Kuckuck44 closed 7 months ago

Kuckuck44 commented 9 months ago
  1. Read up on diglot weave
  2. Find a way to create diglot-weave texts by ourselves → e.g. gutenberg-project partly translated
  3. Generate some diglot-weave-texts for the fine-tuning

PS: We could also compare diglot-weave with just replacing random words in the text

Powerkrieger commented 7 months ago

not needed