How to integrate custom endpoints and headers to connect to private llm service on cloud ?

victordibia / llmx

An API for Chat Fine-Tuned Large Language Models (llm)

MIT License

72 stars 27 forks source link

How to integrate custom endpoints and headers to connect to private llm service on cloud ? #21

Open pushinwork opened 4 months ago

pushinwork commented 4 months ago

I try to modify the llmx by adding my custom LLM service and install the update project from source using pip install -e . on windows and I have issues to run Lida with the customized llmx. Could you help me please ?

pushinwork commented 4 months ago

When I do this change, I need also to change data_folder in lida/web/app.py -> data_folder=os.path.join(root_file_path, "files", "data") then when I start lida. The app works with windows file system but the api service visualize don’t return image encoded in base64 but open image in a new window. The image is not embed in ui app. Could you help me build from source lida and llmx on windows using anaconda with python 3.10