Upgrade AWS Java SDK to support for EMR releases

ogrodnek / spark-plug

scala driver for launching Amazon EMR jobs

Apache License 2.0

39 stars 11 forks source link

Upgrade AWS Java SDK to support for EMR releases #7

Closed pkallos closed 9 years ago

pkallos commented 9 years ago

Java SDK release 1.10.6 introduces support for "emr releases" detailed here

This changeset introduces the ability to spawn EMR clusters with emr-4.0.0, and also enables creating EMR clusters with Spark preinstalled.

Added an DSL for adding Applications to JobFlowRequests
Added a SparkStep dsl + test

pkallos commented 9 years ago

CircleCI is complaining update: sbt.ResolveException: unresolved dependency: com.typesafe.sbt#sbt-ghpage but sbt test:compile is working locally, please advise!

stephenh commented 9 years ago

Thanks! Not sure about the circleci thing...we'll take a look.

ogrodnek commented 9 years ago

I don't think I ever got the circleci integration working, but the Travis CI is passing so I think we're good.

Thanks, Phil!

pkallos commented 9 years ago

Thanks @ogrodnek, are you able to push another build to Maven Central?

ogrodnek commented 9 years ago

Just pushed to maven central as 1.2.5

On Thu, Sep 10, 2015 at 6:38 PM, Phil Kallos notifications@github.com wrote:

Thanks @ogrodnek https://github.com/ogrodnek, are you able to push another build to Maven Central?

— Reply to this email directly or view it on GitHub https://github.com/ogrodnek/spark-plug/pull/7#issuecomment-139426875.

pkallos commented 9 years ago

Amazing, thanks!