search

microsoft / azurechat

🤖 💼 Azure Chat Solution Accelerator powered by Azure Open AI Service
MIT License
1.15k stars 958 forks source link

File Upload Option #275

Open CommunicaAccounts opened 6 months ago

CommunicaAccounts commented 6 months ago

  1. What is the easiest way to remove the file upload option? I am looking to control our service costs, and I believe that removing the file upload option could help reduce our expenses. I should be able to remove the button myself, but I want to explore if there's a more efficient method.

  2. What are the recommended settings for around 50 users? It seems to be increasing quickly. Upon reviewing the search service, I noticed that we are using 1/36 search units, with an estimated cost of CAD $339.18 per month. If it’s around $339.18, we can definitely manage that, but we want to avoid it going up to five times the cost.

jussiroine commented 6 months ago

Hey @CommunicaAccounts, I believe for #1, if you don't provision Document Intelligence, then File Upload doesn't work. It will be be in the UI, of course. And to remove that, you'd have to edit src/features/chat/chat-ui/chat-file/chat-file-ui.tsx at least.

For #2, I find it depends a lot on the usage. 50 passive users, vs. 50 highly actively users makes a world of difference. For deployments of this size, I find it's still perfectly usable with Azure AI Search Basic SKU, which is <80 €/month.

CommunicaAccounts commented 6 months ago

Hi @jussiroine

Thank you for the quick response.

  1. Our file upload and PDF recognition functionalities are performing well. I am considering whether disabling these features could help minimize the running costs. Although I am not a programmer, I find the source code very easy to understand, and I am confident in my ability to remove or modify certain components. I am currently exploring how to include text files for uploading.

  2. At this stage of testing, we have limited user activity. For our Search service, we currently have 1/36 search units, with an estimated monthly cost of CAD$339.18. Are you referring to the Azure AI Search Basic SKU?

Moreover, I aim to harness machine learning to support responses to company-related inquiries. As I delve into this, I am convinced that the solution aligns with our needs and ensures the safeguarding of sensitive company information, in contrast to the chat GPT.

jussiroine commented 6 months ago

Hey @CommunicaAccounts - yeah, for file upload, it should be pretty straightforward to just hide the File Upload icon. Then again, keep in mind that any future updates to this repo would then require you to manage those changes when deploying updates.

For #2, search units, per se, are not the factor here. If you need to save on total cost, re-deploy the solution with Azure AI Search Basic SKU. By default. the template opts for Standard SKU, which is around CAD$339. Basic SKU is around CAD$100. It performs very well, but obviously has limits for index size and scalability.

CommunicaAccounts commented 6 months ago

Understood. Once configured to the Standard plan, switching to the Basic plan is not possible. I believe I can create a new search service and connect it to our existing web app. I have found that I can set up a new search service under the Canada server, which is not an option in the current template. It appears that I only need to update the AZURE_SEARCH_NAME and AZURE_SEARCH_API_KEY (I am currently exploring how to do that). Thank you very much for your help. It has been incredibly helpful, and I'm finding this small project quite enjoyable. I am confident that our users will appreciate it.