Repository navigation
Conversation
|
Test build #28393 has started for PR 4951 at commit
|
|
Test build #28394 has started for PR 4951 at commit
|
|
Test build #28393 has finished for PR 4951 at commit
|
|
Test PASSed. |
|
Test build #28394 has finished for PR 4951 at commit
|
|
Test PASSed. |
There was a problem hiding this comment.
- We don't need
wrapper.serializefor vectors. - We need to store cluster indices. If the centers are saved to more than one partitions, we cannot easily load them back in the original order.
|
Test build #28408 has started for PR 4951 at commit
|
There was a problem hiding this comment.
How about using Int here to represent indexes? I think there is no need to use Long.
There was a problem hiding this comment.
Yes, Int is sufficient. This class should be private. Please also check the scope of other classes.
There was a problem hiding this comment.
make this private. The class name could be changed to case class Cluster(id: Int, center: Vector). IndexedPoint is too general.
|
Test build #28408 has finished for PR 4951 at commit
|
|
Test PASSed. |
There was a problem hiding this comment.
Be specific about the imports. You only need Vector.
|
Test build #28453 has started for PR 4951 at commit
|
|
Test build #28453 has finished for PR 4951 at commit
|
|
Test PASSed. |
|
LGTM. Merged into master. Thanks! |
This PR adds save/load for K-means as described in SPARK-5986. Python version will be added in another PR.