Extend interface to make it more useable for other people

[tomtseng]

Here are some adjustments to the interface that would make this more useable for other researchers who want to run or benchmark this. (In the meantime, hopefully this helps anyone else who wants to launch this. I didn't manage to fully launch it.)

• Allow AWS region to passed as a config value instead of hardcoding the AWS region to be us-west-2 (both in the parameter server and in the Python front-end here and here)
• Don't hard-code the path to the worker function bundle as a global path that won't match the path for other users
• When front-end is sshing to another machine to start the parameter server, use the ssh key file (with ssh -i ...) provided in the config
• Don't hardcode VPC settings but make the user specify them
• Describe briefly what this is and how to run it in the README -- it's not clear how to run the frontend. (It's located in python/frontend/cirrus, and the examples directory gives some guidance as to how to run the frontend.)
• Link or cite the paper Cirrus: a Serverless Framework for End-to-end ML Workflows in the README

[jcarreira]

Hi Tom, thanks for the comment. At the moment I'm the only one on this. I will try to go over as many of your comments as possible (and your PR) in the next week or so.

[tomtseng]

No problem, thanks!

(This isn't blocking me on anything, I was just looking at this for part of a class project. We decided to pivot elsewhere. So there's no rush on this from my end, I just wanted to put up an issue to describe some problems I ran into when trying to run this.)

[dansantan]

what the version of aws-cpp-sdk do you use? I use the Version 1.8, now I meet the make error ,

/usr/bin/ld: /home/cirrus-master/third_party/aws-sdk-cpp/aws-cpp-sdk-core/include/aws/core/utils/event/EventHeader.h:59: undefined reference to `aws_event_stream_header_value_as_byte'

Do you have any suggestions?

@andrewmzhang

[dansantan]

Update！ I use ubuntu 18.04 and aws-cpp-sdk 1.6.0，it is work now ！