Streaming

[thuongtin]

Impressed with your project. But currently, does it not support streaming?

[HemulGM]

Impressed with your project. But currently, does it not support streaming?

The client, no, but the wrapper allows. But while it will be difficult to implement in the client. Because he doesn't use HTML

[jiahut]

This feature is highly important, and I sincerely hope that it can be implemented.

[Yona544]

Can you explain what you mean with streaming

[HemulGM]

@Yona544 In the official client via the web, the text appears as it is generated by the neural network. It's not just animation for beauty. In the API, there are two different ways to get a response from a neural network. Simple. Request - response. Streaming. Request and sequential receipt of responses from the neural network. Usually, several tokens at a time. In the second case, the answer comes a little faster than in the first. Because you don’t have to wait until the neural network generates the entire answer.

[Yona544]

Thanks for the fast response. In the feature list you write: Send message as assistant, user or system

Can you explain this to me? Alos

• GPT functions (external load from "funcs" folder)

I download a pre compiled windows version and i dont see any func folder and is this used for

On Thu, Jul 27, 2023 at 4:18 PM HemulGM @.***> wrote:

@Yona544 https://github.com/Yona544 In the official client via the web, the text appears as it is generated by the neural network. It's not just animation for beauty. In the API, there are two different ways to get a response from a neural network. Simple. Request - response. streaming. Request and sequential receipt of responses from the neural network. Usually, several tokens at a time. In the second option, the answer comes a little faster than in the first. Because you don’t have to wait until the neural network generates the entire answer.

— Reply to this email directly, view it on GitHub https://github.com/HemulGM/ChatGPT/issues/29#issuecomment-1654508287, or unsubscribe https://github.com/notifications/unsubscribe-auth/BAFUORSTUAA3GR6OADOLNVTXSLEKRANCNFSM6AAAAAAYAGFHJY . You are receiving this because you were mentioned.Message ID: @.***>

-- Yona Tauber | Computer Dimensions P 718.625.7043 F 347.382.9340 E @.***

[HemulGM]

@Yona544

1. /system And your text
2. Just create funcs folder next to exe

[HemulGM]

@Yona544 Oh, and there is no actual build to work with the features. Not yet. This is being tested. Requires manual build.

[Yona544]

no problem, i'm a delphi developer and have the latest version

But how is this funcs folder used? what is it made for

On a side note I wish we could have Copilot in the delphi

On Thu, Jul 27, 2023 at 5:00 PM HemulGM @.***> wrote:

@Yona544 https://github.com/Yona544 Oh, and there is no actual build to work with the features. Not yet. This is being tested. Requires manual assembly.

— Reply to this email directly, view it on GitHub https://github.com/HemulGM/ChatGPT/issues/29#issuecomment-1654579334, or unsubscribe https://github.com/notifications/unsubscribe-auth/BAFUORQRVBJ5CPSZVXNR25DXSLJINANCNFSM6AAAAAAYAGFHJY . You are receiving this because you were mentioned.Message ID: @.***>

-- Yona Tauber | Computer Dimensions P 718.625.7043 F 347.382.9340 E @.***

[HemulGM]

@Yona544 If the folder exists, all dll files are loaded from it. If libraries contain a specific exportable function that returns a set of available GPT functions, then it uses those functions to work with GPT. For functions to work in GPT requests, you must enable their use in the general settings (or chat settings) and select a model that can work with functions. And not all models can work with them. One of the models that can work with them is gpt-3.5-turbo-0613.

[HemulGM]

@Yona544 And we have something like a copilot. https://github.com/AliDehbansiahkarbon/ChatGPTWizard Of course, it does not work in real time, but it can help

[Yona544]

can you please explain me how a GPT function is used

On Thu, Jul 27, 2023 at 5:10 PM HemulGM @.***> wrote:

@Yona544 https://github.com/Yona544 If the folder exists, all dll files are loaded from it. If libraries contain a specific exportable function that returns a set of available GPT functions, then it uses those functions to work with GPT. For functions to work in GPT requests, you must enable their use in the general settings (or chat settings) and select a model that can work with functions. And not all models can work with them. One of the models that can work with them is gpt-3.5-turbo-0613.

— Reply to this email directly, view it on GitHub https://github.com/HemulGM/ChatGPT/issues/29#issuecomment-1654590749, or unsubscribe https://github.com/notifications/unsubscribe-auth/BAFUORTXQOKRSPXU3466DY3XSLKNNANCNFSM6AAAAAAYAGFHJY . You are receiving this because you were mentioned.Message ID: @.***>

-- Yona Tauber | Computer Dimensions P 718.625.7043 F 347.382.9340 E @.***

[HemulGM]

@Yona544 In general settings, you can see a list of loaded functions from libraries.

Next, we select a model and enable features in the chat settings.

Now we can make normal neural network requests, and if it considers that one of the functions is required to complete the request, it asks to perform it.

We accept the request and allow the function to be executed (or there is an auto mode). After that, the data from the function is transferred to the neural network and it, using them, answers our question

[Yona544]

Ok, thanks for the clarification. I guess this is how plugins work on the Chatgpt web interface

On Thu, Jul 27, 2023 at 5:21 PM HemulGM @.***> wrote:

In general settings, you can see a list of loaded functions from libraries. [image: image] https://user-images.githubusercontent.com/22197242/256666887-7768291d-eefa-4bc0-9327-bc1ecede6738.png

Next, we select a model and enable features in the chat settings. [image: image] https://user-images.githubusercontent.com/22197242/256667034-12601a14-252d-4b8d-b320-01fd0ae49129.png

Now we can make normal neural network requests, and if it considers that one of the functions is required to complete the request, it asks to perform it. [image: image] https://user-images.githubusercontent.com/22197242/256667148-2264355b-87f2-443b-a3ef-c592990ced01.png [image: image] https://user-images.githubusercontent.com/22197242/256667366-777b5933-dd96-4a0b-9179-55175f52d73b.png

We accept the request and allow the function to be executed (or there is an auto mode). After that, the data from the function is transferred to the neural network and it, using them, answers our question [image: image] https://user-images.githubusercontent.com/22197242/256667430-bcbb036e-d613-47e9-93a0-8c0bbf8bb513.png

— Reply to this email directly, view it on GitHub https://github.com/HemulGM/ChatGPT/issues/29#issuecomment-1654602801, or unsubscribe https://github.com/notifications/unsubscribe-auth/BAFUORVW45H7SDZ6RI7FB5TXSLLUDANCNFSM6AAAAAAYAGFHJY . You are receiving this because you were mentioned.Message ID: @.***>

-- Yona Tauber | Computer Dimensions P 718.625.7043 F 347.382.9340 E @.***

[HemulGM]

@Yona544 Yes, but we can do much more. For example, work with a computer.

Or even edit files. Such functions can be done.

[Yona544]

Got It.

Can I write new functions in Delphi How about integrating the Delphi IDE with ChatGPT

Me: GPT review the highlighted code and fix the problem (GPT fixes some things but the debugger isn't happy, so GPT keeps working until it is resolved)

On Thu, Jul 27, 2023 at 5:27 PM HemulGM @.***> wrote:

@Yona544 https://github.com/Yona544 Yes, but we can do much more. For example, work with a computer. [image: image] https://user-images.githubusercontent.com/22197242/256668213-859dc1d9-b155-4c70-8e47-4f6ebec0d200.png

[image: image] https://user-images.githubusercontent.com/22197242/256668642-5652ba0d-85a1-490d-82c3-26c7b6d5b805.png

— Reply to this email directly, view it on GitHub https://github.com/HemulGM/ChatGPT/issues/29#issuecomment-1654608783, or unsubscribe https://github.com/notifications/unsubscribe-auth/BAFUORVKTQ3OMGRSIVPJMJTXSLMKNANCNFSM6AAAAAAYAGFHJY . You are receiving this because you were mentioned.Message ID: @.***>

-- Yona Tauber | Computer Dimensions P 718.625.7043 F 347.382.9340 E @.***

[HemulGM]

@Yona544 I gave you a link above to an existing plugin for the environment. He does just that. https://github.com/AliDehbansiahkarbon/ChatGPTWizard

[Yona544]

I'm using it but it is not a 2-way communication with Delphi Chat-GPT may insert code but it can not see if there are any errors in the code and auto-fix it

On Thu, Jul 27, 2023 at 5:38 PM HemulGM @.***> wrote:

@Yona544 https://github.com/Yona544 I gave you a link above to an existing plugin for the environment. He does just that. https://github.com/AliDehbansiahkarbon/ChatGPTWizard

— Reply to this email directly, view it on GitHub https://github.com/HemulGM/ChatGPT/issues/29#issuecomment-1654620290, or unsubscribe https://github.com/notifications/unsubscribe-auth/BAFUORSN3OQ4BX3PEM2WBCLXSLNW5ANCNFSM6AAAAAAYAGFHJY . You are receiving this because you were mentioned.Message ID: @.***>

-- Yona Tauber | Computer Dimensions P 718.625.7043 F 347.382.9340 E @.***

[HemulGM]

@Yona544 Take it as a basis and improve