zenml-io / mlstacks

A series of Terraform based recipes to provision popular MLOps stacks on the cloud.
https://mlstacks.zenml.io/
Apache License 2.0
247 stars 32 forks source link

Implement Feast Feature Store Deployment Option #135

Open strickvl opened 8 months ago

strickvl commented 8 months ago

MLStacks framework notionally supports feature stores but lacks an explicit deployment option for Feast, a popular feature store for machine learning. This task involves integrating Feast as a ComponentFlavorEnum within MLStacks and implementing its deployment via Terraform.

Task Description

To enhance MLStacks' feature store capabilities, this task aims to add Feast as a deployable feature store option. This requires updating enums and constants to recognize Feast as a component flavor and creating a Terraform module for deploying Feast on Kubernetes clusters, guided by the Feast repository's Terraform configuration.

Expected Outcome

Steps to Implement

  1. Update src/mlstacks/enums.py to add feast to the ComponentFlavorEnum for feature stores.
  2. Modify src/mlstacks/constants.py to recognize feature_store as a stack component and include feast as an available flavor.
  3. Develop a Terraform module for deploying Feast on Kubernetes, referencing the Feast Terraform guide for best practices and configurations.
  4. Ensure the Terraform module supports deployment across AWS, Azure, and GCP, with configurations and resources appropriately tailored for each cloud provider.
  5. Conduct comprehensive testing on each cloud provider to verify that the Feast deployment functions as expected and integrates smoothly with MLStacks.
  6. Document the deployment process, configuration options, and any provider-specific considerations for users looking to deploy Feast as part of their MLStacks setup.

Additional Context

By incorporating Feast as a feature store deployment option, MLStacks will significantly enhance its data management capabilities, offering users a robust and scalable solution for managing features in machine learning workflows.

Code of Conduct

Pistonamey commented 7 months ago

Hey @strickvl , I want to contribute to this issue. I would like to request you to assign this issue to me.

Pistonamey commented 7 months ago

Thank you! I will start working on it.

strickvl commented 7 months ago

Thanks @Pistonamey! Let us know if you have any questions!

Pistonamey commented 7 months ago

@strickvl Updates on the implementation: Made changes to the constants and enums file to recognize feature_store as a stack component and include feast as an available flavor.

Currently working on developing the Terraform module.