Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-18764][Core]Add a warning log when skipping a corrupted file #16192

Closed
wants to merge 1 commit into from
Closed

[SPARK-18764][Core]Add a warning log when skipping a corrupted file #16192

wants to merge 1 commit into from

Conversation

zsxwing
Copy link
Member

@zsxwing zsxwing commented Dec 7, 2016

What changes were proposed in this pull request?

It's better to add a warning log when skipping a corrupted file. It will be helpful when we want to finish the job first, then find them in the log and fix these files.

How was this patch tested?

Jenkins

@SparkQA
Copy link

SparkQA commented Dec 7, 2016

Test build #69782 has started for PR 16192 at commit 96b4836.

@rxin
Copy link
Contributor

rxin commented Dec 7, 2016

LGTM.

@zsxwing
Copy link
Member Author

zsxwing commented Dec 7, 2016

retest this please

@SparkQA
Copy link

SparkQA commented Dec 7, 2016

Test build #69783 has finished for PR 16192 at commit 96b4836.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Dec 7, 2016

Test build #69785 has finished for PR 16192 at commit 96b4836.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@zsxwing
Copy link
Member Author

zsxwing commented Dec 7, 2016

Thanks. Merging to master and 2.1.

@asfgit asfgit closed this in dbf3e29 Dec 7, 2016
asfgit pushed a commit that referenced this pull request Dec 7, 2016
## What changes were proposed in this pull request?

It's better to add a warning log when skipping a corrupted file. It will be helpful when we want to finish the job first, then find them in the log and fix these files.

## How was this patch tested?

Jenkins

Author: Shixiong Zhu <[email protected]>

Closes #16192 from zsxwing/SPARK-18764.

(cherry picked from commit dbf3e29)
Signed-off-by: Shixiong Zhu <[email protected]>
@zsxwing zsxwing deleted the SPARK-18764 branch December 7, 2016 18:34
robert3005 pushed a commit to palantir/spark that referenced this pull request Dec 15, 2016
## What changes were proposed in this pull request?

It's better to add a warning log when skipping a corrupted file. It will be helpful when we want to finish the job first, then find them in the log and fix these files.

## How was this patch tested?

Jenkins

Author: Shixiong Zhu <[email protected]>

Closes apache#16192 from zsxwing/SPARK-18764.
uzadude pushed a commit to uzadude/spark that referenced this pull request Jan 27, 2017
## What changes were proposed in this pull request?

It's better to add a warning log when skipping a corrupted file. It will be helpful when we want to finish the job first, then find them in the log and fix these files.

## How was this patch tested?

Jenkins

Author: Shixiong Zhu <[email protected]>

Closes apache#16192 from zsxwing/SPARK-18764.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants