neokd / NeoGPT

Chat effortlessly, execute commands, and interpret code with Llama3, Phi3, and more - your local AI assistant. Enjoy seamless interaction while ensuring ultimate privacy
https://neogpt.dev
MIT License
68 stars 60 forks source link

streamlit ui_enhancements #121

Closed rahim-khan-iitg closed 6 months ago

rahim-khan-iitg commented 6 months ago

Now all the available models can be loaded dynamically in ui mode and all the available db can be loaded dynamically . I have not touched the file handling in ui. llm_only mode is also supported in ui image

rahim-khan-iitg commented 6 months ago

Wait do not merge it there is some issue. Let me verify it first

neokd commented 6 months ago

You can directly pass UI args into the function rather than writing a JSON.

rahim-khan-iitg commented 6 months ago

How?

Get Outlook for Androidhttps://aka.ms/AAb9ysg


From: Kuldeep @.> Sent: Wednesday, December 13, 2023 11:50:37 PM To: neokd/NeoGPT @.> Cc: RAHIM KHAN @.>; Author @.> Subject: Re: [neokd/NeoGPT] streamlit ui_enhancements (PR #121)

You can directly pass UI args into the function rather than writing a JSON.

— Reply to this email directly, view it on GitHubhttps://github.com/neokd/NeoGPT/pull/121#issuecomment-1854488470, or unsubscribehttps://github.com/notifications/unsubscribe-auth/A2FUFQVRZ3W5SG3DCEKRPITYJHWXLAVCNFSM6AAAAABASUTFIOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNJUGQ4DQNBXGA. You are receiving this because you authored the thread.Message ID: @.***>

neokd commented 6 months ago

As function params

rahim-khan-iitg commented 6 months ago

if args.ui: with open(UI_ARGS_PATH,'w') as file: json.dump(UI_ARGS,file) logging.info("Starting the UI server for NeoGPT 🤖") logging.info("Note: The UI server only supports local retriever and Chroma DB") sys.argv = ["streamlit", "run", "neogpt/ui.py"] sys.exit(stcli.main())

where to pass those arguments i m not getting😒

neokd commented 6 months ago

The one which ur passing the ui_args.json are already present in the config.py then y you have to pass a separate file?

{"DEVICE_TYPE": "cuda", "DB": "Chroma", "RETRIEVER": "local", "PERSONA": "default", "MODEL_TYPE": "llama", "WRITE": null, "BUILD": false, "SHOW_SOURCE": false, "DEBUG": false, "VERBOSE": false, "LOG": false, "RECURSIVE": false, "VERSION": false, "TRIES": 5, "MODE": "llm_only"}

rahim-khan-iitg commented 6 months ago

Those are the defaults i should not mess with them🙄

Get Outlook for Androidhttps://aka.ms/AAb9ysg


From: Kuldeep @.> Sent: Friday, December 15, 2023 8:08:18 PM To: neokd/NeoGPT @.> Cc: RAHIM KHAN @.>; Author @.> Subject: Re: [neokd/NeoGPT] streamlit ui_enhancements (PR #121)

The one which ur passing the ui_args.json are already present in the config.py then y you have to pass a separate file?

— Reply to this email directly, view it on GitHubhttps://github.com/neokd/NeoGPT/pull/121#issuecomment-1857985778, or unsubscribehttps://github.com/notifications/unsubscribe-auth/A2FUFQVKZLKKN72Q27HZWU3YJROFVAVCNFSM6AAAAABASUTFIOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNJXHE4DKNZXHA. You are receiving this because you authored the thread.Message ID: @.***>