[FIX] Production ready Prompt Service dockerfile & Handling timeout exceptions - Githubissues

Zipstack / unstract

No-code LLM Platform to launch APIs and ETL Pipelines to structure unstructured documents

https://unstract.com

GNU Affero General Public License v3.0

2.26k stars 126 forks source link

[FIX] Production ready Prompt Service dockerfile & Handling timeout exceptions #347

Closed harini-venkataraman closed 4 months ago

harini-venkataraman commented 4 months ago

What

This PR adds an entrypoint script to Prompt service. ...

Why

Prompt service is running with default settings and it is not scalable with increasing requests. ...

How

Adding threads and increasing timeout. ...

Can this PR break any existing features. If yes, please list possible items. If no, please explain why. (PS: Admins do not merge the PR without this section filled)

No, the prompt service is started and is up and running. ...

Database Migrations

Not applicable. ...

Env Config

Not applicable ...

Relevant Docs

-

Related Issues or PRs

https://zipstack.atlassian.net/browse/UN-1265 ...

Dependencies Versions

-

Notes on Testing

-

Screenshots

Checklist

I have read and understood the [Contribution Guidelines]().

sonarcloud[bot] commented 4 months ago

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
0.0% Duplication on New Code

See analysis details on SonarCloud