spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Holden Karau <>
Subject Re: which one spark ml or spark mllib
Date Tue, 19 Jul 2016 17:03:27 GMT
So Spark ML is going to be the actively developed Machine Learning library
going forward, however back in Spark 1.5 it was still relatively new and an
experimental component so not all of the the save/load support implemented
for the same models. That being said for 2.0 ML doesn't have PMML export
yet (although there is a 3rd party library to help with that ). I'd encourage you to try and see if
you can upgrade work with Spark ML going forward - but if your stuck at
1.5.X some of what you need is going to only be available in Spark MLlib.
(You could also write your own model export by hand in Spark ML but thats a
lot of work).

On Tue, Jul 19, 2016 at 2:55 AM, pseudo oduesp <>

> HI,
> i don't have any idea why we have to library  ML and mlib
> ml you can use it with data frame and mllib with rdd but ml have some
> lakes like:
> save model most important if you want create web api with score
> my question why we don't have all features in MLlib on ML ?
> ( i use pyspark 1.5.0  because entreise restrict  of all a)

Cell : 425-233-8271

View raw message