search

mobiusml / aana_sdk

Aana SDK is a powerful framework for building AI enabled multimodal applications.
https://www.mobiuslabs.com/
Apache License 2.0
12 stars 1 forks source link

Hugging Face Deployments #104

Closed movchan74 closed 2 months ago

movchan74 commented 2 months ago

Summary:
This update enhances integration with Hugging Face by adding support for Hugging Face Pipelines and Text Generation Deployments, alongside creating a unified base deployment for text generation.

Key Changes:

  1. Deployment for Hugging Face Pipelines: Implemented deployment for Hugging Face Pipelines, enabling the deployment of a wide range of models from the HF hub.
  2. Hugging Face Text Generation Models: Added deployment support for Hugging Face Text Generation models, utilizing a similar interface to vLLM deployment but leveraging the HF transformers library.
  3. Base Deployment for Text Generation: Added base deployment for text generation, which is used by both Hugging Face Text Generation and vLLM deployments.
  4. Deployment Tests: Introduced a suite of tests to validate the new deployment functionalities.

Related issues: https://github.com/mobiusml/aana_sdk/issues/99