Let OpenAI ChatCompletionRequest accept List[Dict] messages

The OpenAI v1/chat/completions endpoint would fail to properly parse a request.messages of the List[Dict] format

Test

Server command:

deepsparse.server --integration openai --task text-generation --model_path hf:mgoin/TinyStories-1M-ds

Client command:

curl http://localhost:5543/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer dummy" \
  -d '{
    "model": "hf:mgoin/TinyStories-1M-ds",
    "messages": [
      {
        "role": "system",
        "content": "You are a helpful assistant."
      },
      {
        "role": "user",
        "content": "Hello!"
      }
    ]
  }'

Before:

{"object":"error","message":"Message role not recognized","type":"invalid_request_error","param":null,"code":null}

After:

{"id":"cmpl-e3bd5431cc384dab8782254ac0a2f862","object":"chat.completion","created":1703185938,"model":"hf:mgoin/TinyStories-1M-ds","choices":[{"message":{"role":"assistant","content":" \"Welcome to the best friends! I have a special place to you. I"},"finish_reason":"length"}],"usage":{"prompt_tokens":453,"total_tokens":469,"completion_tokens":16}}

neuralmagic / deepsparse

Let OpenAI ChatCompletionRequest accept List[Dict] messages #1497

Test