Is prepare_instruct_dataset.ipynb incomplete?

cindysridykhan / instruct_storyteller_tinyllama2

Training and Fine-tuning an llm in Python and PyTorch.

38 stars 7 forks source link

Is prepare_instruct_dataset.ipynb incomplete? #2

Open ZoroDerVonCodier opened 7 months ago

ZoroDerVonCodier commented 7 months ago

@cindysridykhan I am going through you're prepare_instruct_dataset.ipynb and it appears incomplete. In the 'Preprocessing functions' section you just have a line 'replace_w'.

What is the complete instruction to replace_words? and with what parameters?

Thanks!

ZoroDerVonCodier commented 7 months ago

Disregard - I figured it out. Looks like that line is just a left-over and not used.