opea-project / GenAIInfra

Containerization and cloud native suite for OPEA
Apache License 2.0
16 stars 22 forks source link

CodeTrans llm component support #97

Closed yongfengdu closed 1 week ago

yongfengdu commented 2 weeks ago

Description

Add support for CodeTrans. The scope is limited to LLM service, pipeline will be implemented by GMC

Type of change

List the type of change like below. Please delete options that are not relevant.

Tests

curl http://llm-llm-uservice:9000/v1/chat/completions\ -X POST \ -d '{"text":" ### System: Please translate the following Golang codes into Python codes. ### Original codes: '\'''\'''\''Golang \npackage main\n\nimport \"fmt\"\nfunc main() {\n fmt.Println(\"Hello, World!\");\n '\'''\'''\'' ### Translated codes:"}' \ -H 'Content-Type: application/json'

leslieluyu commented 1 week ago

LGTM