search

google / trax

Trax — Deep Learning with Clear Code and Speed
Apache License 2.0
8.01k stars 813 forks source link

Can I do simple tokenization? #1783

Open mihalt opened 10 months ago

mihalt commented 10 months ago

Can I do simple tokenization like this with trax?