Closed raingart closed 1 month ago
For temp, top_k, top_p, I'd just try a bit and use what works best; no recommended setting but don't expect it to be very different from other LMs.
I don't quite follow your example - if you clearly paste the prompt and model response I can take a look
For temp, top_k, top_p, I'd just try a bit and use what works best; no recommended setting but don't expect it to be very different from other LMs.
I don't quite follow your example - if you clearly paste the prompt and model response I can take a look