Skip to content
This repository was archived by the owner on Feb 1, 2021. It is now read-only.

New EMR features (Applications | Release Label) #120

Merged
merged 9 commits into from
Jan 28, 2016

Conversation

robert2d
Copy link
Collaborator

Add New EMR features

This pull request aims to incorporate the latest EMR changes but still allow older applications to use this library with an upgrade. This will allow people using any of the supported applications (hadoop, hive, pig and spark) see here for blog post on latest updates by Jeff.

Changes

  • added Application class to handle adding emr applications
  • release_label attribute added.
  • prevented adding ami_version and release_label
  • prevented adding applications without adding release_label

Important notes

  • ami_version is now set in config preamble and will default to latest when release label isn't set
  • release label is a swap out for ami version for EMR > 4.0* but it does not default to anything

AWS EMR release notes

See the Release Notes for the changes I have included in this pull request

@robert2d
Copy link
Collaborator Author

@rslifka
Copy link
Owner

rslifka commented Oct 11, 2015

Awesome @robert2d! Going to do a release?

@robert2d
Copy link
Collaborator Author

Yea I just wanted to wait till after RE:Invent to see if they were going to change things even further but this is pretty much good to go. I am spike-ing a Spark job this week, so i'll incorporate this branch into it to do some final testing etc..

@robert2d
Copy link
Collaborator Author

Before this goes in it needs the readme updated. I have begun work on a new EMR project and will be merging this in next week after updating the documentation and trying this branch out as a ad hoc integration test. links too: https://github.com/rslifka/elasticity/issues/121

@fblundun fblundun mentioned this pull request Jan 6, 2016
robert2d added a commit that referenced this pull request Jan 28, 2016
New EMR features (Applications | Release Label)
@robert2d robert2d merged commit 0f63ea3 into rslifka:master Jan 28, 2016
@robert2d robert2d deleted the robert2d/application-beginnings branch January 28, 2016 23:48
# for free to subscribe to this conversation on GitHub. Already have an account? #.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants