Sweep: Add feature for LLM finetuning from HuggingFace (transformer models only)

[sweep-ai[bot]]

Description

This pull request introduces a new feature that allows for fine-tuning of transformer models from HuggingFace within our LLM (Large Language Models) gateway. It includes backend implementations for initiating fine-tuning and checking the status of these operations, as well as frontend adjustments to enable this functionality within our studio app.

Summary

• Added backend API endpoints in gateway/internal/api/v1/finetune.go for:
  • Initiating fine-tuning of models with HuggingFace (InitiateFineTuning)
  • Checking the status of fine-tuning operations (CheckFineTuningStatus)
• Implemented a new provider in gateway/internal/provider/huggingface/huggingface.go to interact with HuggingFace's API for model fine-tuning.
• Updated the frontend component modelselector.tsx in playgrounds/apps/studio/app/(llm)/playground/components to include a toggle for selecting models specifically for fine-tuning.
• Modified the useModelFetch.tsx hook in playgrounds/apps/studio/app/(llm)/playground/hooks to support fetching models based on whether fine-tuning is enabled or not.

These changes collectively introduce the capability to fine-tune transformer models from HuggingFace, enhancing the flexibility and power of MissingStudios LLM offerings.

🎉 Unity AI Development Trusts Sweep For Quick Development!

[sweep-ai[bot]]

Rollback Files For Sweep

• [ ] Rollback changes to playgrounds/apps/studio/app/(llm)/playground/hooks/useModelFetch.tsx
• [ ] Rollback changes to gateway/internal/api/v1/finetune.go
• [ ] Rollback changes to playgrounds/apps/studio/app/(llm)/playground/components/modelselector.tsx
• [ ] Rollback changes to gateway/internal/api/v1/v1.go
• [ ] Rollback changes to gateway/internal/provider/huggingface/huggingface.go

This is an automated message generated by Sweep AI.