Folder containing files to run a Fast API server to return NER predictions.
This is necessary for serving predictions for custom models in GCP vertex.
Refer to README.md for guidance.
It contains components:
main.py: The Fast API implementation for serving NER predictions from requests.
Dockerfile: A docker file for building a Docker image to build everything needed to run the API, so it
can be pushed to GCP.
cloudbuild.yaml: GCP Cloud Build configuration file to automate steps to build and push the docker image to
GCP. Crucially, this file also downloads the model from GCP into the image as it is being build. This is more
efficient than downloading at runtime inside the main.py script.
Checklists
This pull/merge request meets the following requirements:
Summary
Folder containing files to run a Fast API server to return NER predictions. This is necessary for serving predictions for custom models in GCP vertex.
Refer to
README.mdfor guidance.It contains components:
main.py: The Fast API implementation for serving NER predictions from requests.Dockerfile: A docker file for building a Docker image to build everything needed to run the API, so it can be pushed to GCP.cloudbuild.yaml: GCP Cloud Build configuration file to automate steps to build and push the docker image to GCP. Crucially, this file also downloads the model from GCP into the image as it is being build. This is more efficient than downloading at runtime inside themain.pyscript.Checklists
This pull/merge request meets the following requirements:
docs/aqa/aqa_plan.md)docs/aqa/data_log.md), if necessarydocs/aqa/assumptions_caveats.md), if necessarydocsfolderComments have been added below around the incomplete checks.