Closed mlinmg closed 2 days ago
@cpfiffer didn't you use Pixtral with Outlines?
I did! @mlinmg can you look at this cookbook to see if that helps?
https://dottxt-ai.github.io/outlines/main/cookbook/receipt-digitization/
Yes sorry I found out about pixtral community later.
Describe the issue as clearly as possible:
When using Pixtral outlines gives an error, specifically in vllm. The problems seems that mistral uses a different tokenizer (Tekken)
Steps/code to reproduce the bug:
Expected result:
Error message:
No response
Outlines/Python version information:
Version information
Context for the issue:
No response