Skip to content

[SPARK-6948][MLLIB] compress vectors in VectorAssembler - #5985

Closed
mengxr wants to merge 2 commits into
apache:masterfrom
mengxr:SPARK-6948
Closed

mengxr wants to merge 2 commits into
apache:masterfrom
mengxr:SPARK-6948

Conversation

@mengxr

@mengxr mengxr commented May 7, 2015

Copy link
Copy Markdown
Contributor

The compression is based on storage. @brkyvz

@AmplabJenkins

Copy link
Copy Markdown

Merged build triggered.

@AmplabJenkins

Copy link
Copy Markdown

Merged build started.

@SparkQA

SparkQA commented May 7, 2015

Copy link
Copy Markdown

Test build #32139 has started for PR 5985 at commit df56a00.

@SparkQA

SparkQA commented May 7, 2015

Copy link
Copy Markdown

Test build #32139 has finished for PR 5985 at commit df56a00.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • class StringArrayParam(parent: Params, name: String, doc: String, isValid: Array[String] => Boolean)
    • class VectorAssembler(JavaTransformer, HasInputCols, HasOutputCol):
    • class HasInputCols(Params):
    • class RegressionMetrics(JavaModelWrapper):

@AmplabJenkins

Copy link
Copy Markdown

Merged build finished. Test PASSed.

@AmplabJenkins

Copy link
Copy Markdown

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32139/
Test PASSed.

@brkyvz

brkyvz commented May 7, 2015

Copy link
Copy Markdown
Contributor

LGTM

@mengxr

mengxr commented May 7, 2015

Copy link
Copy Markdown
Contributor Author

Merged into master and branch-1.4.

@asfgit asfgit closed this in e43803b May 7, 2015
asfgit pushed a commit that referenced this pull request May 7, 2015
The compression is based on storage. brkyvz

Author: Xiangrui Meng <meng@databricks.com>

Closes #5985 from mengxr/SPARK-6948 and squashes the following commits:

df56a00 [Xiangrui Meng] update python tests
6d90d45 [Xiangrui Meng] compress vectors in VectorAssembler

(cherry picked from commit e43803b)
Signed-off-by: Xiangrui Meng <meng@databricks.com>
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request May 28, 2015
The compression is based on storage. brkyvz

Author: Xiangrui Meng <meng@databricks.com>

Closes apache#5985 from mengxr/SPARK-6948 and squashes the following commits:

df56a00 [Xiangrui Meng] update python tests
6d90d45 [Xiangrui Meng] compress vectors in VectorAssembler
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request Jun 12, 2015
The compression is based on storage. brkyvz

Author: Xiangrui Meng <meng@databricks.com>

Closes apache#5985 from mengxr/SPARK-6948 and squashes the following commits:

df56a00 [Xiangrui Meng] update python tests
6d90d45 [Xiangrui Meng] compress vectors in VectorAssembler
nemccarthy pushed a commit to nemccarthy/spark that referenced this pull request Jun 19, 2015
The compression is based on storage. brkyvz

Author: Xiangrui Meng <meng@databricks.com>

Closes apache#5985 from mengxr/SPARK-6948 and squashes the following commits:

df56a00 [Xiangrui Meng] update python tests
6d90d45 [Xiangrui Meng] compress vectors in VectorAssembler
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants