spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Debasish Das <>
Subject Re: MLLib - Thoughts about refactoring Updater for LBFGS?
Date Sun, 02 Mar 2014 18:23:14 GMT
Hi DB,

1. Could you point to the BFGS repositories used to publish artifacts to
maven central ? What's the best way to add changes to it ? I fork the repo
at my github ? Basically as I mentioned before I need to add lbfgs-b,
orthant wise for L1 handling and few variants of line search to lbfgs...

2. For the spark pull request, what's the best way to get your branch
dbtsai-lbfgs ?

On my github spark mirror I can make a branch called debasish-lbfgs and
merge your code to it ?

I need sparse support to the logistic regression classifier using lbfgs
solve and therefore I will need Xiangrui's branch as well...


On Sun, Mar 2, 2014 at 12:14 AM, DB Tsai <> wrote:

> Hi Deb,
> The PR is here
> Hi Evan,
> I think we need to refactor the optimization methods and also the way
> we write algorithms. For example, if I want to use the new
> optimization method in  LogisticRegression.scala, I need to implement
> LogisticRegressionWithLBFGS class and object which are mostly
> identical to LogisticRegressionWithSGD. I'll open a JIRA for this.
> I just submit the LBFGS PR ,
> and it depends on a bug fix in another PR
> Any comment and feedback is welcome.
> Thanks.
> Sincerely,
> DB Tsai
> Machine Learning Engineer
> Alpine Data Labs
> --------------------------------------
> Web:

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message