search

defenseunicorns / leapfrogai

Production-ready Generative AI for local, cloud native, airgap, and edge deployments.
https://leapfrog.ai
Apache License 2.0
257 stars 28 forks source link

feat(test) Staging Environment #515

Open andrewrisse opened 5 months ago

andrewrisse commented 5 months ago

User Story

As a LFAI product manager I want a staging environment So that I have a stable environment with the latest features off main for demos and release testing

Acceptance Criteria

Features merged into main are auto-released into staging environment.

Must not be publicly accessible, only internal to LF team

Additional context

Should this be non GPU to save on cost?

barronstone commented 5 months ago

I think we're currently using a p3.8xlarge instance for burning.boats and (eventually) uds.is. While tackling this issue, we should investigate if another cheaper instance type would work for us, with key limitations being the GPU needs to be a new enough architecture and the instance needs to be available in GovCloud regions.

The g4dn.12xlarge seems like it might be a viable contender with 4 NVIDIA T4 Tensor Core GPUs. It's roughly 1/3 the cost of the p3.8xlarge we're currently using.

References: