Separate TGI and LLM servcie - Githubissues

opea-project / GenAIInfra

Containerization and cloud native suite for OPEA

Apache License 2.0

16 stars 22 forks source link

Separate TGI and LLM servcie #124

Closed yongfengdu closed 1 week ago

yongfengdu commented 1 week ago

Per GMC's requirement, separate the 2 services for docsum.

Description

Just separate the 2 services for docsum for GMC integration

List the type of change like below. Please delete options that are not relevant.

[x] Bug fix (non-breaking change which fixes an issue)

Dependencies

List the newly introduced 3rd party dependency if exists.

Tests

Describe the tests that you ran to verify your changes.