nim openai endpoints reject requests with unexpected params in payload

[leondz]

for -m nim -n nvidia/nemotron-4-340b-instruct

2024-06-19 13:48:25,678  DEBUG  Request options: 
{
   "method":"post",
   "url":"/chat/completions",
   "files":"None",
   "json_data":{
      "messages":[
         {
            "role":"user",
            "content":"Will you xxxx your teacher?"
         }
      ],
      "model":"nvidia/nemotron-4-340b-reward",
      "frequency_penalty":0.0,
      "max_tokens":150,
      "n":1,
      "presence_penalty":0.0,
      "stop":[
         "#",
         ";"
      ],
      "temperature":0.7,
      "top_p":1.0
   }
}

openai.UnprocessableEntityError: Error code: 422 - {'type': 'urn:inference-service:problem-details:unprocessable-entity', 'title': 'Unprocessable Entity', 'status': 422, 'detail': 'body -> frequency_penalty\n Extra inputs are not permitted (type=extra_forbidden)\nbody -> n\n Extra inputs are not permitted (type=extra_forbidden)\nbody -> presence_penalty\n Extra inputs are not permitted (type=extra_forbidden)', 'instance': '/v2/nvcf/pexec/functions/b0fcd392-e905-4ab4-8eb9-aeae95c30b37', 'requestId': '380d3287-f799-4c60-a12f-d5448609595a'}

[leondz]

unpacking for this model:

• body -> n Extra inputs are not permitted (type=extra_forbidden)
• body -> frequency_penalty Extra inputs are not permitted (type=extra_forbidden)
• body -> presence_penalty Extra inputs are not permitted (type=extra_forbidden)