search

aws-samples / amazon-sagemaker-generativeai

Repository for training and deploying Generative AI models, including text-text, text-to-image generation and prompt engineering playground using SageMaker Studio.
MIT No Attribution
130 stars 88 forks source link

Example code for LLMOps with SM Model Registry, Collections and Experiments #29

Closed pranavvm26 closed 1 year ago

pranavvm26 commented 1 year ago

This example code walks users through,

  1. Fine-tuning HuggingFace LLMs using SageMaker Model Training
  2. Hugging face model management

    Combined Model Management (Base + Adapter) Separated Model Management (Base and Adapter)

  3. Model Collection to logically group LLMs
  4. Deploy from Model Registry to SageMaker Endpoint for RT Inference
  5. Using SageMaker Experiments to track model training metrics, parameters and hyperparameters using transformers callbacks
pranavvm26 commented 1 year ago

Added top level readme to fmops