Skip to content

Commit

Permalink
Do not fail fast if Yarn shuffle jar does not exist
Browse files Browse the repository at this point in the history
  • Loading branch information
Andrew Or committed Nov 13, 2014
1 parent 484fecb commit 42b3d37
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion make-distribution.sh
Original file line number Diff line number Diff line change
Expand Up @@ -181,7 +181,9 @@ echo "Spark $VERSION$GITREVSTRING built for Hadoop $SPARK_HADOOP_VERSION" > "$DI
# Copy jars
cp "$FWDIR"/assembly/target/scala*/*assembly*hadoop*.jar "$DISTDIR/lib/"
cp "$FWDIR"/examples/target/scala*/spark-examples*.jar "$DISTDIR/lib/"
cp "$FWDIR"/network/yarn/target/scala*/spark-*-yarn-shuffle.jar "$DISTDIR/lib/"
# This will fail if the -Pyarn profile is not provided
# In this case, silence the error and ignore the return code of this command
cp "$FWDIR"/network/yarn/target/scala*/spark-*-yarn-shuffle.jar "$DISTDIR/lib/" &> /dev/null || :

# Copy example sources (needed for python and SQL)
mkdir -p "$DISTDIR/examples/src/main"
Expand Down

0 comments on commit 42b3d37

Please sign in to comment.