nv-morpheus / Morpheus

Morpheus SDK
Apache License 2.0
347 stars 130 forks source link

[DOC]: Update LLM example to default to OpenAI #1722

Open exactlyallan opened 4 months ago

exactlyallan commented 4 months ago

How would you describe the priority of this documentation request

Medium

Please provide a link or source to the relevant docs

https://github.com/nv-morpheus/Morpheus/tree/branch-24.06/examples/llm/completion#options

Describe the problems in the documentation

Current LLM example defaults to NemoLLM. Default should switch to OpenAI for better accessibility. Also would be helpful to link to openAI quickstart to help guide to key setup.

`--llm_service [NemoLLM|OpenAI]

Description: LLM service to issue requests to. Default: NemoLLM`

(Optional) Propose a correction

No response

Code of Conduct