karpathy / minbpe

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
MIT License
9.19k stars 866 forks source link

Add pytest to requirements.txt #91

Open shoumikhin opened 3 weeks ago