spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Charles Earl <charles.ce...@gmail.com>
Subject Re: Status of MLLib exporting models to PMML
Date Tue, 18 Nov 2014 15:18:26 GMT
Yes,
The case is convincing for PMML with Oryx. I will also investigate
parameter server.
Cheers,
Charles

On Tuesday, November 18, 2014, Sean Owen <sowen@cloudera.com> wrote:

> I'm just using PMML. I haven't hit any limitation of its
> expressiveness, for the model types is supports. I don't think there
> is a point in defining a new format for models, excepting that PMML
> can get very big. Still, just compressing the XML gets it down to a
> manageable size for just about any realistic model.*
>
> I can imagine some kind of translation from PMML-in-XML to
> PMML-in-something-else that is more compact. I've not seen anyone do
> this.
>
> * there still aren't formats for factored matrices and probably won't
> ever quite be, since they're just too large for a file format.
>
> On Tue, Nov 18, 2014 at 5:34 AM, Manish Amde <manish9ue@gmail.com
> <javascript:;>> wrote:
> > Hi Charles,
> >
> > I am not aware of other storage formats. Perhaps Sean or Sandy can
> elaborate
> > more given their experience with Oryx.
> >
> > There is work by Smola et al at Google that talks about large scale model
> > update and deployment.
> >
> https://www.usenix.org/conference/osdi14/technical-sessions/presentation/li_mu
> >
> > -Manish
> >
>


-- 
- Charles

Mime
View raw message