Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Resync with apache-spark-on-k8s upstream #248

Merged
merged 7 commits into from
Aug 24, 2017
Merged

Resync with apache-spark-on-k8s upstream #248

merged 7 commits into from
Aug 24, 2017

Commits on Aug 23, 2017

  1. Revert "Support spark.executor.extraJavaOptions." 

    This reverts commit 50c690d.
    @ash211
    ash211 committed Aug 23, 2017
    Configuration menu
    Copy the full SHA
    ec8e9fc View commit details
    Browse the repository at this point in the history

  2. Revert "Use a list of environment variables for JVM options." 

    This reverts commit 34d7af2.
    @ash211
    ash211 committed Aug 23, 2017
    Configuration menu
    Copy the full SHA
    88e2b0e View commit details
    Browse the repository at this point in the history

  3. Use a secret to mount small files in driver and executors 

    * Use a secret to mount small files in driver and executors.

Allows bypassing the resource staging server in a few scenarios.

* Fix scalstyle

* Address comments and add tests.

* Lightly brush up formatting.

* Make the working directory empty so that added files don't clobber existing binaries.

* Address comments.

* Drop testing file size to N+1 of the limit

(cherry picked from commit 455317d)
    @mccheah @ash211
    mccheah authored and ash211 committed Aug 23, 2017
    Configuration menu
    Copy the full SHA
    a8c6d09 View commit details
    Browse the repository at this point in the history

  4. Updated devloper doc to include a install step for first time compila… 

    …tion

(cherry picked from commit 58cebd1)
    @liyinan926 @ash211
    liyinan926 authored and ash211 committed Aug 23, 2017
    Configuration menu
    Copy the full SHA
    6b3a1e3 View commit details
    Browse the repository at this point in the history

  5. Use a list of environment variables for JVM options 

    * Use a list of environment variables for JVM options.

* Fix merge conflicts.

(cherry picked from commit f7b5820)
    @mccheah @ash211
    mccheah authored and ash211 committed Aug 23, 2017
    Configuration menu
    Copy the full SHA
    6a1632d View commit details
    Browse the repository at this point in the history

  6. Properly wrap getOrElse in a tuple 

    (cherry picked from commit a7f7176)
    @mccheah @ash211
    mccheah authored and ash211 committed Aug 23, 2017
    Configuration menu
    Copy the full SHA
    ebcec14 View commit details
    Browse the repository at this point in the history

  7. Scalastyle fix

    @ash211
    ash211 committed Aug 23, 2017
    Configuration menu
    Copy the full SHA
    a41e968 View commit details
    Browse the repository at this point in the history