Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-7554][STREAMING] Throw exception when an active/stopped StreamingContext is used to create DStreams and output operations #6099

Closed
wants to merge 1 commit into from

Conversation

tdas
Copy link
Contributor

@tdas tdas commented May 12, 2015

No description provided.

@@ -171,7 +173,22 @@ abstract class DStream[T: ClassTag] (
dependencies.foreach(_.initialize(zeroTime))
}

private[streaming] def validate() {
private def validateAtInit(): Unit = {
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I renamed validate() to validateAtStart(), and added validateAtInit()

@tdas
Copy link
Contributor Author

tdas commented May 12, 2015

@zsxwing

@AmplabJenkins
Copy link

Merged build triggered.

@AmplabJenkins
Copy link

Merged build started.

@zsxwing
Copy link
Member

zsxwing commented May 12, 2015

LGTM

@SparkQA
Copy link

SparkQA commented May 12, 2015

Test build #32540 has started for PR 6099 at commit 2cd4158.

@SparkQA
Copy link

SparkQA commented May 12, 2015

Test build #32540 has finished for PR 6099 at commit 2cd4158.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

Merged build finished. Test PASSed.

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32540/
Test PASSed.

@tdas
Copy link
Contributor Author

tdas commented May 12, 2015

@harishreedharan Can you take a look?

@harishreedharan
Copy link
Contributor

+1

@tdas
Copy link
Contributor Author

tdas commented May 13, 2015

Merging this. Thanks all!

asfgit pushed a commit that referenced this pull request May 13, 2015
…mingContext is used to create DStreams and output operations

Author: Tathagata Das <[email protected]>

Closes #6099 from tdas/SPARK-7554 and squashes the following commits:

2cd4158 [Tathagata Das] Throw exceptions on attempts to add stuff to active and stopped contexts.

(cherry picked from commit 23f7d66)
Signed-off-by: Tathagata Das <[email protected]>
@asfgit asfgit closed this in 23f7d66 May 13, 2015
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request May 28, 2015
…mingContext is used to create DStreams and output operations

Author: Tathagata Das <[email protected]>

Closes apache#6099 from tdas/SPARK-7554 and squashes the following commits:

2cd4158 [Tathagata Das] Throw exceptions on attempts to add stuff to active and stopped contexts.
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request Jun 12, 2015
…mingContext is used to create DStreams and output operations

Author: Tathagata Das <[email protected]>

Closes apache#6099 from tdas/SPARK-7554 and squashes the following commits:

2cd4158 [Tathagata Das] Throw exceptions on attempts to add stuff to active and stopped contexts.
nemccarthy pushed a commit to nemccarthy/spark that referenced this pull request Jun 19, 2015
…mingContext is used to create DStreams and output operations

Author: Tathagata Das <[email protected]>

Closes apache#6099 from tdas/SPARK-7554 and squashes the following commits:

2cd4158 [Tathagata Das] Throw exceptions on attempts to add stuff to active and stopped contexts.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants