opea-project / GenAIExamples

Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.
https://opea.dev
Apache License 2.0
172 stars 81 forks source link
chatqna codegen copilot gaudi2 genai llms rag summarization tgi xeon
# Generative AI Examples This project provides a collective list of Generative AI (GenAI) and Retrieval-Augmented Generation (RAG) examples such as chatbot with question and answering (ChatQnA), code generation (CodeGen), document summary (DocSum), etc. [![version](https://img.shields.io/badge/release-0.6-green)](https://github.com/opea-project/GenAIExamples/releases) [![license](https://img.shields.io/badge/license-Apache%202-blue)](https://github.com/intel/neural-compressor/blob/master/LICENSE) ---
## GenAI Examples All the examples are well-validated on Intel platforms. In addition, these examples are: - Easy to use. Use ecosystem-compliant APIs to build the end-to-end GenAI examples - Easy to customize. Customize the example using different framework, LLM, embedding, serving etc. - Easy to deploy. Deploy the GenAI examples with performance on Intel platforms > **Note**: > The below support matrix gives the validated configurations. Feel free to customize per your needs. ### ChatQnA [ChatQnA](./ChatQnA/README.md) is an example of chatbot for question and answering through retrieval argumented generation (RAG).
Framework LLM Embedding Vector Database Serving HW Description
LangChain/LlamaIndex NeuralChat-7B BGE-Base Redis TGI TEI Xeon/Gaudi2/GPU Chatbot
LangChain/LlamaIndex NeuralChat-7B BGE-Base Chroma TGI TEI Xeon/Gaudi2 Chatbot
LangChain/LlamaIndex Mistral-7B BGE-Base Redis TGI TEI Xeon/Gaudi2 Chatbot
LangChain/LlamaIndex Mistral-7B BGE-Base Qdrant TGI TEI Xeon/Gaudi2 Chatbot
LangChain/LlamaIndex Qwen2-7B BGE-Base Redis TEI Xeon/Gaudi2 Chatbot
### CodeGen [CodeGen](./CodeGen/README.md) is an example of copilot designed for code generation in Visual Studio Code.
Framework LLM Serving HW Description
LangChain/LlamaIndex meta-llama/CodeLlama-7b-hf TGI Xeon/Gaudi2 Copilot
### CodeTrans [CodeTrans](./CodeTrans/README.md) is an example of chatbot for converting code written in one programming language to another programming language while maintaining the same functionality.
Framework LLM Serving HW Description
LangChain/LlamaIndex HuggingFaceH4/mistral-7b-grok TGI Xeon/Gaudi2 Code Translation
### DocSum [DocSum](./DocSum/README.md) is an example of chatbot for summarizing the content of documents or reports.
Framework LLM Serving HW Description
LangChain/LlamaIndex NeuralChat-7B TGI Xeon/Gaudi2 Chatbot
LangChain/LlamaIndex Mistral-7B TGI Xeon/Gaudi2 Chatbot
### Language Translation [Language Translation](./Translation/README.md) is an example of chatbot for converting a source-language text to an equivalent target-language text.
Framework LLM Serving HW Description
LangChain/LlamaIndex haoranxu/ALMA-13B TGI Xeon/Gaudi2 Language Translation
### SearchQnA [SearchQnA](./SearchQnA/README.md) is an example of chatbot for using search engine to enhance QA quality.
Framework LLM Serving HW Description
LangChain/LlamaIndex NeuralChat-7B TGI Xeon/Gaudi2 Chatbot
LangChain/LlamaIndex Mistral-7B TGI Xeon/Gaudi2 Chatbot
### VisualQnA [VisualQnA](./VisualQnA/README.md) is an example of chatbot for question and answering based on the images.
Framework LLM Serving HW Description
LangChain/LlamaIndex LLaVA-1.5-7B TGI Gaudi2 Chatbot
> **_NOTE:_** The `Language Translation`, `SearchQnA`, `VisualQnA` and other use cases not listing here are in active development. The code structure of these use cases are subject to change. ## Additional Content - [Code of Conduct](https://github.com/opea-project/docs/tree/main/community/CODE_OF_CONDUCT.md) - [Contribution](https://github.com/opea-project/docs/tree/main/community/CONTRIBUTING.md) - [Security Policy](https://github.com/opea-project/docs/tree/main/community/SECURITY.md) - [Legal Information](/LEGAL_INFORMATION.md)