search

opea-project / GenAIExamples

Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.
https://opea.dev
Apache License 2.0
177 stars 86 forks source link

ChantQnA example on Xeon in AWS needs security groups to be opened #157

Closed mandalrajiv closed 1 month ago

mandalrajiv commented 1 month ago

For running the Xeon example for ChatQnA in AWS, certain security groups for the EC2 instance need to be opened. The Readme.md instruction should be updated for the same. Below are the details for the security groups to be opened.

For running in the AWS EC2 instance open the necessary ports in the instance's security group. Below is an example. Please open relevant IPV4 addresses for these ports based on your requirements.

redis-vector-db

Port 6379 - Open to 0.0.0.0/0 Port 8001 - Open to 0.0.0.0/0

tei_embedding_service

Port 6006 - Open to 0.0.0.0/0

embedding

Port 6000 - Open to 0.0.0.0/0

retriever

Port 7000 - Open to 0.0.0.0/0

tei_xeon_service

Port 8808 - Open to 0.0.0.0/0

reranking

Port 8000 - Open to 0.0.0.0/0

tgi_service

Port 9009 - Open to 0.0.0.0/0

llm

Port 9000 - Open to 0.0.0.0/0

chaqna-xeon-backend-server

Port 8888 - Open to 0.0.0.0/0

chaqna-xeon-ui-server

Port 5173 - Open to 0.0.0.0/0

kding1 commented 1 month ago

Thanks! Yes we will add those instructions in the readme. @lvliang-intel

hshen14 commented 1 month ago

Done in https://github.com/opea-project/GenAIExamples/pull/156