[Question]: OpenAILike with custom OPENAI_API_BASE

[omar-araboghli]

Hi,

is it possible to use custom LLMs hosted privately through the OpenAILike object of LlamaIndex with a custom OPENAI_API_BASE ?

I saw the possibility of defining openailike in the docs but with no further information regarding the private host.

Thanks! :)

[vkehfdl1]

@omar-araboghli Of course you can. You can put any parameters from LlamaIndex OpenAILike LLM class. LlamaIndex Docs

nodes:
  - node_line_name: node_line_1
    nodes:
      - node_type: generator
        modules:
          - module_type: llama_index_llm
            llm: openailike
            model: mistralai/Mistral-7B-Instruct-v0.2
            api_base: your_api_base
            api_key: your_api_key

[vkehfdl1]

I think we need update docs for clarifying this. @bwook00

[omar-araboghli]

Thanks @vkehfdl1, I'll give it a try!