issues
search
sayakpaul
/
ml-deployment-k8s-fastapi
This project shows how to serve an ONNX-optimized image classification model as a web service with FastAPI, Docker, and Kubernetes.
https://medium.com/google-developer-experts/load-testing-tensorflow-serving-and-fastapi-on-gke-411bc14d96b2
Apache License 2.0
198
stars
36
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Inquiry Regarding Scalability Best Practices for FastAPI ML Model Deployment on Kubernetes
#42
yihong1120
opened
11 months ago
1
add front image
#41
deep-diver
closed
2 years ago
1
feat: support for pulling in the latest model.
#40
sayakpaul
closed
2 years ago
1
Update README.md
#39
sayakpaul
closed
2 years ago
1
Refactor repo with the best FastAPI configs
#38
sayakpaul
closed
2 years ago
3
Update requirements.txt
#37
deep-diver
closed
2 years ago
0
remove encoding/decoding parts
#36
deep-diver
closed
2 years ago
2
Feat/locust grpc
#35
sayakpaul
closed
2 years ago
18
[WIP] Create TF Serving notebook
#34
deep-diver
closed
2 years ago
3
Setup TF Serving based deployment
#33
deep-diver
closed
2 years ago
11
[WIP] add kustomize overlays for exp 1
#32
deep-diver
opened
2 years ago
3
Feat: locust
#31
deep-diver
closed
2 years ago
1
chore: applied black formatting isort and modified readme.
#30
sayakpaul
closed
2 years ago
1
feat: tensorflow scripts for comparison
#29
sayakpaul
opened
2 years ago
1
Set up another API similarly with the pure TensorFlow model for comparison
#28
sayakpaul
closed
2 years ago
3
Provision namespacing in the k8s deployment
#27
sayakpaul
closed
2 years ago
7
Perform load testing with Locust
#26
sayakpaul
closed
2 years ago
10
Find a better way to report the latest API endpoint.
#25
sayakpaul
closed
2 years ago
4
Set up logging for the k8s pods.
#24
sayakpaul
closed
2 years ago
4
Deployment on GKE with GitHub Actions
#23
sayakpaul
closed
2 years ago
2
feat: deployment on gke with github actions
#22
sayakpaul
closed
2 years ago
0
fix: kustomize related steps in the workflow.
#21
sayakpaul
closed
2 years ago
0
chore: commented unused steps in the actions file.
#20
sayakpaul
closed
2 years ago
0
feat: deployment to gke.
#19
sayakpaul
closed
2 years ago
0
Feat/actions
#18
sayakpaul
closed
2 years ago
0
add: gke interaction support in github actions.
#17
sayakpaul
closed
2 years ago
0
add: cloud support in github actions.
#16
sayakpaul
closed
2 years ago
0
fix: working-directory option.
#15
sayakpaul
closed
2 years ago
0
fix: working-directory option.
#14
sayakpaul
closed
2 years ago
0
fix: working-directory option.
#13
sayakpaul
closed
2 years ago
0
fix: working-directory option.
#12
sayakpaul
closed
2 years ago
0
Feat/actions
#11
sayakpaul
closed
2 years ago
0
add basic gke resources
#10
deep-diver
closed
2 years ago
0
4 dockerize
#9
deep-diver
closed
2 years ago
4
chore: move requirements.txt from ./api/utils to ./api
#8
deep-diver
closed
2 years ago
1
Automate deployment with GitHub Actions
#7
sayakpaul
closed
2 years ago
0
Deploy the Docker image on GKE
#6
sayakpaul
closed
2 years ago
12
Create k8s cluster on GKE
#5
sayakpaul
closed
2 years ago
0
Dockerize the API
#4
sayakpaul
closed
2 years ago
0
ONNX model exposed as an API
#3
sayakpaul
closed
2 years ago
0
chore: refactored the colab notebook.
#2
sayakpaul
closed
2 years ago
2
add notebook for tf to onnx conversion
#1
deep-diver
closed
2 years ago
5