Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-26757][GraphX] Return 0 for count on empty Edge/Vertex RDDs #23681

Closed
wants to merge 3 commits into from
Closed

[SPARK-26757][GraphX] Return 0 for count on empty Edge/Vertex RDDs #23681

wants to merge 3 commits into from

Commits on Jan 29, 2019

  1. [SPARK-26757][GraphX] Return 0 for count on empty Edge/Vertex RDDs 

    Previously a "java.lang.UnsupportedOperationException: empty
collection" exception would be thrown due to using `reduce`, rather
than `fold` or similar that can tolerate empty RDDs.

This behaviour has existed for the Vertex RDDs since it was introduced
in b30e0ae. It seems this behaviour
was inherited by the Edge RDDs via copy-paste in
ee29ef3.
    @huonw
    huonw committed Jan 29, 2019
    Configuration menu
    Copy the full SHA
    a843a0b View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2019

  1. [SPARK-26757][GraphX] Remove unused variable

    @huonw
    huonw committed Jan 31, 2019
    Configuration menu
    Copy the full SHA
    1f9dd8f View commit details
    Browse the repository at this point in the history

  2. [SPARK-26757][GraphX] Make SVD++ work with no edges 

    Similar to `VertexRDD.count` and `EdgeRDD.count`, this used `reduce`
which fails on an empty RDD.
    @huonw
    huonw committed Jan 31, 2019
    Configuration menu
    Copy the full SHA
    de47631 View commit details
    Browse the repository at this point in the history