stanford-futuredata / gavel

Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020
MIT License
125 stars 31 forks source link

The availability of gavel AMI #243

Open sunshineffmx opened 2 years ago

sunshineffmx commented 2 years ago

Hi, Is the AMI 'gavel' still available and how can I find it?

deepakn94 commented 2 years ago

I am not sure it is, and I don't have access to that AWS account anymore to check.

However, I think these instructions should still work (we tried on Ubuntu 16.04, but newer versions of Ubuntu should work too though the exact installation commands might change):

apt-get -y install cmake g++ gcc libnuma-dev make numactl zlib1g-dev
pip install -r scheduler/requirements.txt
cd scheduler; make
sunshineffmx commented 2 years ago

Thanks for your reply. These instructions you give can be executed. But I want to access the workloads data in pyhsical cluster experiments, I search the public AWS AMI and don't find the AMI ID of gavel.