Repository navigation

Clean up and simplify Spark configuration - #299

Closed

pwendell wants to merge 32 commits into

apache:masterfrom

pwendell:config-cleanup

Closed

Clean up and simplify Spark configuration#299
pwendell wants to merge 32 commits into
apache:masterfrom
pwendell:config-cleanup

Commits on Apr 13, 2014
- Change spark.local.dir -> SPARK_LOCAL_DIRS
  pwendell
  committed
  ac2d65e
- Stash of adding config options in submit script and YARN
  pwendell
  committed
  0faa3b6
- executorJavaOpts
  pwendell
  committed
  6eaf7d0
- Remove SPARK_LIBRARY_PATH
  pwendell
  committed
  4982331
- SPARK_JAVA_OPTS --> SPARK_MASTER_OPTS for master settings
  pwendell
  committed
  1f75238
- Small clean-up
  pwendell
  committed
  84cc5e5
- Don't ship executor envs
  pwendell
  committed
  5b0ba8e
- Clean up terminology inside of spark-env script
  pwendell
  committed
  7cc70e4
- Library path and classpath for drivers
  pwendell
  committed
  761ebcd
- Small fix
  pwendell
  committed
  437aed1
- Review feedback and import clean-ups
  pwendell
  committed
  46555c1
- Review feedback for spark env file
  pwendell
  committed
  b72d183
- Responses to review feedback.
  pwendell
  committed
  ace4ead
- Additional improvements.
  pwendell
  committed
  b08893b
Commits on Apr 14, 2014
- Cleaning up line limits and two compile errors.
  pwendell
  committed
  afc9ed8
- Making YARN doc changes consistent
  pwendell
  committed
  4ee6f9d
- Test compile fixes
  pwendell
  committed
  c2a2909
Commits on Apr 15, 2014
- Handle case where SPARK_HOME is not set
  pwendell
  committed
  be42f35
- Changes to allow re-use of test applications
  pwendell
  committed
  e83cd8f
- Properly escape quotes and other clean-up for YARN
  pwendell
  committed
  308f1f6
- Note
  pwendell
  committed
  fda0301
Commits on Apr 18, 2014
- Review feedback
  pwendell
  committed
  ffa00fe
- Fixing test failures
  pwendell
  committed
  a762901
- Merge remote-tracking branch 'apache/master' into config-cleanup
  pwendell
  committed
  d50c388
- Responses to Tom's review
  pwendell
  committed
  a56b125
- Automatically add user jar
  pwendell
  committed
  af0adf7
Commits on Apr 20, 2014
- Cleanup of spark-submit script and Scala quick start guide
  pwendell
  committed
  b16e6a2
Commits on Apr 21, 2014
- Mention config file in docs and clean-up docs
  pwendell
  committed
  af09e3e
- Minor style fixes
  pwendell
  committed
  0086939
- spark-defaults.properties -> spark-defaults.conf
  pwendell
  committed
  b4b496c
- Moving properties file template.
  pwendell
  committed
  a006464
- Improvements to testing
  pwendell
  committed
  127f301

Commits

Commits on Apr 13, 2014

Commits on Apr 14, 2014

Commits on Apr 15, 2014

Commits on Apr 18, 2014

Commits on Apr 20, 2014

Commits on Apr 21, 2014