j143 / systemds

An opensource ML system for end-to-end data science lifecycle
Apache License 2.0
0 stars 1 forks source link

EC2 service with SystemDS #19

Open j143 opened 4 years ago

j143 commented 4 years ago

What is proposed?

See how to make use of ECS for SystemDS run https://aws.amazon.com/ecs

TL;DR: Make SystemDS run smooth on AWS

j143 commented 3 years ago

Create distributions or configurations like these...

image

j143 commented 2 years ago

Make sure this works as intended:

https://github.com/j143/systemds/blob/2f1c22b41fd5ecde51cc1c49826f253039d71219/scripts/aws/spinup_systemds_cluster.sh#L41-L89

j143 commented 2 years ago

Of course, this one too.

https://github.com/j143/systemds/blob/2f1c22b41fd5ecde51cc1c49826f253039d71219/scripts/aws/run_systemds_script.sh#L44-L60