search

bosmanbos / Query-Processing

AI-powered query processing system that decomposes complex questions, analyzes them using multiple AI models (OpenAI GPT & Anthropic Claude), and provides comprehensive answers. Features include dynamic model selection, web search integration, and efficient caching for enhanced performance and accuracy.
2 stars 0 forks source link

Regarding the code details #1

Open kKKainga opened 3 months ago

kKKainga commented 3 months ago

I would like to ask if this project's code supports Chinese datasets.

bosmanbos commented 3 months ago

There is no explicit support or handling specifically for Chinese datasets. However, because the code is language-agnostic in its core functionality, it could potentially work with Chinese data under certain conditions. The code uses OpenAI and Anthropic API's for language processing tasks and these API's generally support multiple languages, but the overall effectiveness may vary.

The web search tool should work without issues and should be able to handle Chinese characters in both the input queries and the search results. The effectiveness depends on DuckDuckGo's support for Chinese languages searches though.

I haven't tested myself so ultimately I am not sure, but I am curious so if you could let me know how well it works that would be much appreciated.