This app can answer general questions from famous entrepreneurs' perspectives. Currently, the app only supports Q&A with Jack Ma and Elon Musk. The answers are based on transcripts of interviews with the subject. The application uses a Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and OpenAI large language models. You can ask questions in the format of "What does Elon Musk think of space flight?"
Improvements made for LLM performance for Chinese
The original text splitting parameters do not optimize chunking for CJK languages. We implemented a function to change the section length for chunking size depending on the language. The section length needed to be considerably smaller as Chinese text contains more information in a shorter amount of text.
For the model to look up multiple languages more accurately, we implemented a translation function that translated the user prompt so the prompt is in both English and Chinese.
Modified punctuation for detecting word breaks better by incorporating Chinese punctuation characters.
P.S. thanks pamelafox
P.P.S It could be the free tier of Azure deployments causes some delay when loading the endpoint. Please try again if it does not load for the first time.
Project name
Ask An Entrepreneur
Description
Summary
This app can answer general questions from famous entrepreneurs' perspectives. Currently, the app only supports Q&A with Jack Ma and Elon Musk. The answers are based on transcripts of interviews with the subject. The application uses a Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and OpenAI large language models. You can ask questions in the format of "What does Elon Musk think of space flight?"
Improvements made for LLM performance for Chinese
P.S. thanks pamelafox
P.P.S It could be the free tier of Azure deployments causes some delay when loading the endpoint. Please try again if it does not load for the first time.
Language
English, Chinese
Project Repository URL
https://github.com/AshleyZhao/ai-rag-entrepreneur-qa/tree/main
Deployed Endpoint URL
https://app-backend-edxc4c4wxgjxo.azurewebsites.net/
Project video
https://www.youtube.com/watch?v=02SXIUjNn6U
Team members
AshleyZhao, katieyang
Showcase Consent
Yes