search

nextcloud / assistant

✨ Nextcloud Assistant
GNU Affero General Public License v3.0
23 stars 4 forks source link

Include an option to immediately submit OpenAI requests instead of scheduling them #10

Open S0ulf3re opened 11 months ago

S0ulf3re commented 11 months ago

Describe the feature you'd like to request

For requests sent to OpenAI's servers, the nextcloud assistant waits until cron is ran. This is understandable for larger scale servers. But isn't as useful on smaller servers where nowhere near as many requests will be made. The nextcloud assistant should have an administration option to immediately send a request instead of waiting around for cron to run.

Describe the solution you'd like

There should be an option in the assistant settings to make it so that requests to OpenAI are immediately sent to their servers instead. As opposed to scheduling them.

Describe alternatives you've considered

There is technically the ChatGPT extension that can be used from the smart picker. But often, I forget it's there, and I like having a button that I can click on to process editing.

zydisney commented 10 months ago

Agree! The significant delay of response is really a bad experience. Immediately reply in the pop-up window would be more efficient.

theCalcaholic commented 10 months ago

I don't think, this should be tied to external APIs - a better job scheduler that allows for immediate execution if there are no jobs in queue would make this feature much more useful.