Open thatname opened 2 months ago
That's really weird, I haven't noticed this before. @sgsdxzy any ideas? I can't think of a reason why this would even happen.
Is it related to mirostat? now that we removed miro it's no longer a problem...
Is this still an issue?
Your current environment
🐛 Describe the bug
I have a 3090 and a 4090, aphrodite launched in a WSL CLI:
First I used curl to test the server, the generation speed was 14.0 tok/s at average, then, I use SillyTarven to test, the generation speed decreased to 4.0 tok/s, and stay at 4.0 tok/s even swich back to curl again.
Log: