Open vlad-ivanov-name opened 3 months ago
Could you paste in the conversation if you still have it available?
Unfortunately I deleted the plan but here's the prompt:
you are provided with mistral-common library source code. it's support code
for mistral LLM. could you please answer the following question: I'm trying
to understand how tokenizers work because I will need to implement mistral
tokenizer in rust. I understand that the input of the tokenizer is text.
What is output of it? what type in this codebase represents it? also, I'm
only concerned about simple chat scenario -- no tool use, nothing like that
also I noticed plandex trying to build files:
Model: claude via openrouter Prompt is a question about code without any instructions to build files