chatting with mistral generates answer with no spaces

[micrem73]

Bug description

steps to reproduce the issue:

1. litgpt chat checkpoints/mistralai/Mistral-7B-Instruct-v0.3 --max_new_tokens 2048
2. enter any prompt

I get answer with no space between words, i.e.: "Hello!I'mjustacomputerprogram,soIdon'thavefeelingslikeahumandoes.ButI'mheretohelpyouwithanyquestionsortasksyoumighthave!HowcanIassistyoutoday?"

Here is the full log:

⚡ ~ litgpt chat checkpoints/mistralai/Mistral-7B-Instruct-v0.3 --max_new_tokens 2048 {'access_token': None, 'checkpoint_dir': PosixPath('checkpoints/mistralai/Mistral-7B-Instruct-v0.3'), 'compile': False, 'max_new_tokens': 2048, 'multiline': False, 'precision': None, 'quantize': None, 'temperature': 0.8, 'top_k': 50, 'top_p': 1.0} Now chatting with Mistral-7B-Instruct-v0.3. To exit, press 'Enter' on an empty prompt.

Seed set to 1234

Prompt: hi, how are you? Reply: Hello!I'mjustacomputerprogram,soIdon'thavefeelingslikeahumandoes.ButI'mheretohelpyouwithanyquestionsortasksyoumighthave!HowcanIassistyoutoday? Time for inference: 3.55 sec total, 12.96 tokens/sec, 46 tokens

What operating system are you using?

Unknown

LitGPT Version

⚡ ~ pip show litgpt | grep Version
Version: 0.5.2 Version 2.0, January 2004 Licensed under the Apache License, Version 2.0 (the "License");

[rasbt]

Thanks for flagging this. I know Mistral is using their own tokenizer, but I could swear this worked before. Something to look into some time.