Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.
Codegen UI shows meaningless for the input of "Write a python program to add two numbers and return the result" in the UI:
Also, the RESTful API call also shows empty response:
$ curl http://${host_ip}:7778/v1/codegen -H "Content-Type: application/json" -d '{"messages": "Write a python program to add two numbers and return the result."}'
data: b'\n'
data: b'\n'
data: b'\n'
data: b'\n'
data: b'\n'
data: b'\n'
data: b'\n'
<... omit ...>
data: [DONE]
Reproduce steps
launch the codegen using docker-compose or helm following the guide, and enter "Write a python program to add two numbers and return the result" in the UI.
$ sudo -E docker compose -f compose.yaml logs codegen-gaudi-backend-server
codegen-gaudi-backend-server | /usr/local/lib/python3.11/site-packages/pydantic/_internal/_fields.py:132: UserWarning: Field "model_name_or_path" in Audio2TextDoc has conflict with protected namespace "model_".
codegen-gaudi-backend-server |
codegen-gaudi-backend-server | You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.
codegen-gaudi-backend-server | warnings.warn(
codegen-gaudi-backend-server | [2024-10-23 05:48:06,227] [ INFO] - Base service - CORS is enabled.
codegen-gaudi-backend-server | [2024-10-23 05:48:06,228] [ INFO] - Base service - Setting up HTTP server
codegen-gaudi-backend-server | [2024-10-23 05:48:06,229] [ INFO] - Base service - Uvicorn server setup on port 7778
codegen-gaudi-backend-server | INFO: Waiting for application startup.
codegen-gaudi-backend-server | INFO: Application startup complete.
codegen-gaudi-backend-server | INFO: Uvicorn running on http://0.0.0.0:7778 (Press CTRL+C to quit)
codegen-gaudi-backend-server | [2024-10-23 05:48:06,239] [ INFO] - Base service - HTTP server setup successful
codegen-gaudi-backend-server | INFO: 100.83.122.254:57922 - "OPTIONS /v1/codegen HTTP/1.1" 200 OK
codegen-gaudi-backend-server | INFO: 100.83.122.254:57922 - "POST /v1/codegen HTTP/1.1" 200 OK
codegen-gaudi-backend-server | INFO: 100.83.122.254:57230 - "POST /v1/codegen HTTP/1.1" 200 OK
codegen-gaudi-backend-server | INFO: 100.83.122.254:37096 - "POST /v1/codegen HTTP/1.1" 200 OK
Priority
Undecided
OS type
Ubuntu
Hardware type
Gaudi2
Installation method
Deploy method
Running nodes
Single Node
What's the version?
commit id: a3f9811f7ef3d561357674218c64b4cb9d42803a
Description
Codegen UI shows meaningless for the input of "Write a python program to add two numbers and return the result" in the UI:
Also, the RESTful API call also shows empty response:
Reproduce steps
launch the codegen using docker-compose or helm following the guide, and enter "Write a python program to add two numbers and return the result" in the UI.
Raw log