Optimise process with API

jwpf100 / text-generator

An app integrated with ChatGPT to allow easy generation of cover letters, taking inputs such as resume and job description to create personalised letters. It is written using Typescript, React, Express/Node Authenticated with Auth0

0 stars 0 forks source link

Optimise process with API #18

Open jwpf100 opened 5 months ago

jwpf100 commented 5 months ago

Render basic version isn't great:

Streaming hits rate limits, so convert to the standard version. Could see if there's a free option on GCP or AWS that I could use?

Also add something so that when a person logs in, the api activates otherwise the delays are too great.

Alternatively, could switch to a microservice type api. But this is a lot of work up front. So this could just be an option in the backlog.

jwpf100 commented 5 months ago

[x] Convert text greneration from stream to stadard completion (add switch on front end to select but default to standard when deployed - use env var)
[x] Add cron job to keep api alive