spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Evan Sparks <>
Subject Re: multinomial logistic regression
Date Mon, 06 Jan 2014 19:13:57 GMT
Hi Michael,

What strategy are you using to train the multinomial classifier? One-vs-all? I've got an optimized
version of that method that I've been meaning to clean up and commit for a while. In particular,
rather than shipping a (potentially very big) model with each map task, I ship it once before
each iteration with a broadcast variable. Perhaps we can compare versions and incorporate
some of my optimizations into your code?


> On Jan 6, 2014, at 10:57 AM, Michael Kun Yang <> wrote:
> Hi Spark-ers,
> I implemented a SGD version of multinomial logistic regression based on
> mllib's optimization package. If this classifier is in the future plan of
> mllib, I will be happy to contribute my code.
> Cheers

View raw message