Closed leondz closed 3 days ago
resolves #748
OpenAICompatible
None
nim
one question - why are these defaults defined twice?
# template defaults optionally override when extending DEFAULT_PARAMS = Generator.DEFAULT_PARAMS | { "temperature": 0.7, "top_p": 1.0, "frequency_penalty": 0.0, "presence_penalty": 0.0, "stop": ["#", ";"], "blocked_params": set(), } temperature = 0.7 top_p = 1.0 frequency_penalty = 0.0 presence_penalty = 0.0 stop = ["#", ";"] blocked_params = set()
-- ideally would have liked to have done this via config, not sure it woulda been possible though
resolves #748
OpenAICompatible
so we can control verbosity of payloadsNone
s from OpenAI API payloadsnim
one question - why are these defaults defined twice?