spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Manish Amde (JIRA)" <>
Subject [jira] [Created] (SPARK-1544) Add support for creating deep decision trees.
Date Mon, 21 Apr 2014 00:02:14 GMT
Manish Amde created SPARK-1544:

             Summary: Add support for creating deep decision trees.
                 Key: SPARK-1544
             Project: Spark
          Issue Type: Improvement
          Components: MLlib
    Affects Versions: 1.0.0
            Reporter: Manish Amde

The current tree implementation stores an Array[Double] of size O(#features \ #splits * 2^maxDepth)*
in memory for aggregating histograms over partitions. The current implementation might not
scale to very deep trees since the memory requirement grows exponentially with tree depth.

This task enables construction of arbitrary deep trees.

This message was sent by Atlassian JIRA

View raw message