Learn to serve Stable Diffusion models on cloud infrastructure at scale. This Lightning App shows load-balancing, orchestrating, pre-provisioning, dynamic batching, GPU-inference, micro-services working together via the Lightning Apps framework.
Don't start the initial servers with the flow (needed as they have random names which we rely on the state to track, but state is empty when the app starts in the cloud so the work gets lost)
only affects launching from the CLI, gallery clone'n'run is fine
PR review
Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in Github issues there's a high chance it will not be merged.
Before submitting
What does this PR do?
Don't start the initial servers with the flow (needed as they have random names which we rely on the state to track, but state is empty when the app starts in the cloud so the work gets lost)
only affects launching from the CLI, gallery clone'n'run is fine
PR review
Anyone in the community is free to review the PR once the tests have passed. If we didn't discuss your PR in Github issues there's a high chance it will not be merged.
Did you have fun?
Make sure you had fun coding 🙃