Closed areibman closed 3 months ago
The issue is unrelated (user was querying an invalid model name) but we did have an issue where we were always assuming the wrong tokenizer for non-openai inference providers like Azure.
This pr fixes that
The issue is unrelated (user was querying an invalid model name) but we did have an issue where we were always assuming the wrong tokenizer for non-openai inference providers like Azure.
This pr fixes that