spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiangrui Meng (JIRA)" <>
Subject [jira] [Resolved] (SPARK-3934) RandomForest bug in sanity check in DTStatsAggregator
Date Fri, 17 Oct 2014 22:04:33 GMT


Xiangrui Meng resolved SPARK-3934.
       Resolution: Fixed
    Fix Version/s: 1.2.0

Issue resolved by pull request 2785

> RandomForest bug in sanity check in DTStatsAggregator
> -----------------------------------------------------
>                 Key: SPARK-3934
>                 URL:
>             Project: Spark
>          Issue Type: Bug
>          Components: MLlib
>            Reporter: Joseph K. Bradley
>            Assignee: Joseph K. Bradley
>             Fix For: 1.2.0
> When run with a mix of unordered categorical and continuous features, on multiclass classification,
RandomForest fails.  The bug is in the sanity checks in getFeatureOffset and getLeftRightFeatureOffsets,
which use the wrong indices for checking whether features are unordered.
> Proposal: Remove the sanity checks since they are not really needed, and since they would
require DTStatsAggregator to keep track of an extra set of indices (for the feature subset).

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message