search

aiku-ai / AiKu

AiKu is life.
https://aiku.netlify.app/
6 stars 2 forks source link

"Keep Warm" ping to Replicate API to eliminate cold start issue #35

Closed danwritecode closed 1 year ago

danwritecode commented 1 year ago

The cold start time on the replicate API is brutal. We should setup a service to ping it every 10 minutes or so (may have to experiment to find good balance).

adragione commented 1 year ago

New codebase started for this at the following Github repo:

https://github.com/adragione/AiKu-BEND.git

adragione commented 1 year ago

Code review of v1 by @danwritecode requested on following pull request:

https://github.com/adragione/AiKu-BEND/pull/1

adragione commented 1 year ago

Few changes made today; once pull request is reviewed by @danwritecode and merged, I'll close out this issue/feature.

adragione commented 1 year ago

Made final revisions based on @danwritecode code review; merged into main and currently deployed on DellaLabs servers. Process will fire off an API call every 30 minutes.