spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ndjido Ardo BAR <ndj...@gmail.com>
Subject Re: Grid search with Random Forest
Date Tue, 01 Dec 2015 18:50:18 GMT
Thanks for the clarification. Gonna test that and give you feedbacks.

Ndjido
On Tue, 1 Dec 2015 at 19:29, Joseph Bradley <joseph@databricks.com> wrote:

> You can do grid search if you set the evaluator to a
> MulticlassClassificationEvaluator, which expects a prediction column, not a
> rawPrediction column.  There's a JIRA for making
> BinaryClassificationEvaluator accept prediction instead of rawPrediction.
> Joseph
>
> On Tue, Dec 1, 2015 at 5:10 AM, Benjamin Fradet <benjamin.fradet@gmail.com
> > wrote:
>
>> Someone correct me if I'm wrong but no there isn't one that I am aware of.
>>
>> Unless someone is willing to explain how to obtain the raw prediction
>> column with the GBTClassifier. In this case I'd be happy to work on a PR.
>> On 1 Dec 2015 8:43 a.m., "Ndjido Ardo BAR" <ndjido@gmail.com> wrote:
>>
>>> Hi Benjamin,
>>>
>>> Thanks, the documentation you sent is clear.
>>> Is there any other way to perform a Grid Search with GBT?
>>>
>>>
>>> Ndjido
>>> On Tue, 1 Dec 2015 at 08:32, Benjamin Fradet <benjamin.fradet@gmail.com>
>>> wrote:
>>>
>>>> Hi Ndjido,
>>>>
>>>> This is because GBTClassifier doesn't yet have a rawPredictionCol like
>>>> the. RandomForestClassifier has.
>>>> Cf:
>>>> http://spark.apache.org/docs/latest/ml-ensembles.html#output-columns-predictions-1
>>>> On 1 Dec 2015 3:57 a.m., "Ndjido Ardo BAR" <ndjido@gmail.com> wrote:
>>>>
>>>>> Hi Joseph,
>>>>>
>>>>> Yes Random Forest support Grid Search on Spark 1.5.+ . But I'm getting
>>>>> a "rawPredictionCol field does not exist exception" on Spark 1.5.2 for
>>>>> Gradient Boosting Trees classifier.
>>>>>
>>>>>
>>>>> Ardo
>>>>> On Tue, 1 Dec 2015 at 01:34, Joseph Bradley <joseph@databricks.com>
>>>>> wrote:
>>>>>
>>>>>> It should work with 1.5+.
>>>>>>
>>>>>> On Thu, Nov 26, 2015 at 12:53 PM, Ndjido Ardo Bar <ndjido@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>>
>>>>>>> Hi folks,
>>>>>>>
>>>>>>> Does anyone know whether the Grid Search capability is enabled
since
>>>>>>> the issue spark-9011 of version 1.4.0 ? I'm getting the "rawPredictionCol
>>>>>>> column doesn't exist" when trying to perform a grid search with
Spark 1.4.0.
>>>>>>>
>>>>>>> Cheers,
>>>>>>> Ardo
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> ---------------------------------------------------------------------
>>>>>>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>>>>>>> For additional commands, e-mail: user-help@spark.apache.org
>>>>>>>
>>>>>>>
>>>>>>
>

Mime
View raw message