The bot's response was not as expected when using (docsearch)

[Nguyen-Thi-Huong]

I'm using Serve.py to run, I use the internal document search function (https://github.com/docsearch). For questions that are not in the document, I expect it to answer that I don't know or that I don't have the information, but currently it returns results according to its knowledge. Can you help me solve this problem

[pablomarin]

If you are using gpt3.5 it can do that some times . Gpt4 is more reliable in adhering to the instructions . If you still want to use 3.5 , add some reminders to the instructions saying something like: “remember that you can only answer from your context from your tools and not from your own knowledge”

On Wed, May 8, 2024 at 6:16 AM Nguyen-Thi-Huong @.***> wrote:

I'm using Serve.py to run, I use the internal document search function ( https://github.com/docsearch). For questions that are not in the document, I expect it to answer that I don't know or that I don't have the information, but currently it returns results according to its knowledge. Can you help me solve this problem

— Reply to this email directly, view it on GitHub https://github.com/pablomarin/GPT-Azure-Search-Engine/issues/86 or unsubscribe https://github.com/notifications/unsubscribe-auth/AAUPWIDIZBRQFVAQ6YV63QTZBICQNBFKMF2HI4TJMJ2XIZLTSOBKK5TBNR2WLJDUOJ2WLJDOMFWWLO3UNBZGKYLEL5YGC4TUNFRWS4DBNZ2F6YLDORUXM2LUPGBKK5TBNR2WLJLJONZXKZNENZQW2ZNLORUHEZLBMRPXI6LQMWBKK5TBNR2WLJDUOJ2WLJDOMFWWLLTXMF2GG2C7MFRXI2LWNF2HTLDTOVRGUZLDORPXI6LQMWSUS43TOVS2M5DPOBUWG44SQKSHI6LQMWVHEZLQN5ZWS5DPOJ42K5TBNR2WLKJWGA2DOMJZGIZTFAVEOR4XAZNFNFZXG5LFUV3GC3DVMWVDEMRYGUZTIMBYGUZKO5DSNFTWOZLSUZRXEZLBORSQ . You are receiving this email because you are subscribed to this thread.

Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub .

[Nguyen-Thi-Huong]

I switched to using gpt4 and the answer is better, but gpt4 responds very slowly, with gpt3.5 still having problems bot answering with its knowledge. Do you have a better solution for this problem?

[pablomarin]

Nothing to do really . Stream the answer so it looks faster. Eventually gpt4 models will be faster and problem solved. Multi agentic architectures need at least gpt4 , hence they need to be fast. Code now a solution and wait for the models to be cheaper and faster, by the time you are in production , speed will be there

On Tue, May 14, 2024 at 1:55 AM Nguyen-Thi-Huong @.***> wrote:

I switched to using gpt4 and the answer is better, but gpt4 responds very slowly, with gpt3.5 still having problems bot answering with its knowledge. Do you have a better solution for this problem?

— Reply to this email directly, view it on GitHub https://github.com/pablomarin/GPT-Azure-Search-Engine/issues/86#issuecomment-2109420498 or unsubscribe https://github.com/notifications/unsubscribe-auth/AAUPWIDYJ7GMXV4BT3R2RBTZCGYPNBFKMF2HI4TJMJ2XIZLTSOBKK5TBNR2WLJDUOJ2WLJDOMFWWLO3UNBZGKYLEL5YGC4TUNFRWS4DBNZ2F6YLDORUXM2LUPGBKK5TBNR2WLJDUOJ2WLJDOMFWWLLTXMF2GG2C7MFRXI2LWNF2HTAVFOZQWY5LFUVUXG43VMWSG4YLNMWVXI2DSMVQWIX3UPFYGLLDTOVRGUZLDORPXI6LQMWWES43TOVSUG33NNVSW45FGORXXA2LDOOJIFJDUPFYGLKTSMVYG643JORXXE6NFOZQWY5LFVE3DANBXGE4TEMZSQKSHI6LQMWSWS43TOVS2K5TBNR2WLKRSGI4DKMZUGA4DKMVHORZGSZ3HMVZKMY3SMVQXIZI . You are receiving this email because you commented on the thread.

Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub .