search

anarchy-ai / LLM-VM

irresponsible innovation. Try now at https://chat.dev/
https://anarchy.ai/
MIT License
465 stars 150 forks source link

Hosted inference + finetuning interface for Azure #377

Open VictorOdede opened 8 months ago

Aryan8912 commented 7 months ago

please assign to me so I can work on this issue

lucylililiwang commented 4 months ago

Hi, Can I please also work on this issue? Thank you!

lucylililiwang commented 4 months ago

Hi! Vik. When we are hosting inference and fine-tuning the interface for Azure, which platform should we choose? Could you please give me some guidence? Thank you! There are the three most commonly used options:

  1. Azure App Service: Best for hosting web applications or APIs.

  2. Azure Kubernetes Service (AKS): Ideal for containerized applications that require scalability, orchestration, and management.

  3. Azure Functions: A serverless computing platform for event-driven applications.

  4. Azure Virtual Machines: Offers full control over the virtual machine environment, including the choice of operating system, runtime, and software stack.