search

ml-explore / mlx-examples

Examples in the MLX framework
MIT License
5.5k stars 791 forks source link

Fix streaming SPM decoder for Yi #852

Closed awni closed 6 days ago

awni commented 6 days ago

Closes #844

awni commented 6 days ago

Not that bad actually. It was pretty clear it was accessing an invalid token from the error message. The thing I wasn't sure about is why that tokenizer is missing tokens and how to deal with them... I think from this discussion they are safe to ignore.