karpathy / minbpe

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
MIT License
9.2k stars 866 forks source link

OSS-Fuzz Integration #80

Open ennamarie19 opened 5 months ago

ennamarie19 commented 5 months ago

My name is McKenna Dallmeyer and I would like to submit minbpe to OSS-Fuzz. If you are not familiar with the project, OSS-Fuzz is Google's platform for continuous fuzzing of Open Source Software. In order to get the most out of this program, it would be greatly beneficial to be able to merge-in my fuzz harness and build scripts into the upstream repository and contribute bug fixes if they come up. Is this something that you would support me putting the effort into?

Thank you!