search

anarchy-ai / LLM-VM

irresponsible innovation. Try now at https://chat.dev/
https://anarchy.ai/
MIT License
465 stars 150 forks source link

Hosted inference + finetuning interface for AWS #356

Open VictorOdede opened 8 months ago

VictorOdede commented 8 months ago

Enable user to specify GPU/CPU specs and automatically create a cloud instance to run inference/finetuning

Abdevna commented 8 months ago

Hey @VictorOdede can we use Boto3 (AWS SDK) when working with AWS services including EC2

VictorOdede commented 8 months ago

@Abdevna Yeah, that sounds like a great idea

VictorOdede commented 8 months ago

Check out https://aws.amazon.com/sagemaker/

T3CH3Y commented 8 months ago

I'm willing to start looking into this.