Open showgood163 opened 1 month ago
I'm trying to, but keep getting ModuleNotFoundError: No module named 'nemo'
Working on trying to fix this.
Fixed it but I'm not sure about the engine type / not loading the model anymore.
You are available to use vLLM or HF to run inference. BTW, I just found they change their claimed context length from 128K to 32K.
Hi there,
Will you test Mistral-Small-Instruct-2409?
22B so not too expensive for a test.