Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Add support for using AWS_PROFILE from local aws config #61

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

yochum
Copy link

@yochum yochum commented Sep 13, 2019

No description provided.

@@ -13,6 +13,10 @@ To start `spark-shell` with your AWS credentials:

docker run --rm -it -e "AWS_ACCESS_KEY_ID=YOURKEY" -e "AWS_SECRET_ACCESS_KEY=YOURSECRET" -p 4040:4040 gettyimages/spark bin/spark-shell

To start `spark-shell` with your desired AWS_PROFILE from ${HOME}/.aws/credentials:

docker run --rm -it -e "AWS_PROFILE=YOURPROFILE" -v "${HOME}/.aws":/root/.aws -p 4040:4040 gettyimages/spark bin/spark-shell

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How does this credentials mount get mapped to other workers?

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants