spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiangrui Meng (JIRA)" <>
Subject [jira] [Commented] (SPARK-4022) Replace colt dependency (LGPL) with commons-math
Date Tue, 21 Oct 2014 01:10:33 GMT


Xiangrui Meng commented on SPARK-4022:

[~srowen] We use its random number generators and the stat.Probability package in core and
mllib. It would be great if you can work on this JIRA. There are couple places we need to

1) sampling
2) chi-sq tests
3) random forests
4) some unit tests

We also need to shade the commons-math3 jar because hadoop depends on it. Fortunately, commons-math3
doesn't have any run-time deps.

> Replace colt dependency (LGPL) with commons-math
> ------------------------------------------------
>                 Key: SPARK-4022
>                 URL:
>             Project: Spark
>          Issue Type: Bug
>          Components: MLlib, Spark Core
>            Reporter: Patrick Wendell
>            Priority: Critical
> The colt library we use is LGPL-licensed:
> We need to swap this out for commons-math. It is also a very old library that hasn't
been updated since 2004.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message