spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <>
Subject [jira] [Commented] (SPARK-1406) PMML model evaluation support via MLib
Date Wed, 09 Apr 2014 20:39:14 GMT


Sean Owen commented on SPARK-1406:

Yes I understand transformations can be described in PMML. Do you mean parsing a transformation
described in PMML and implementing the transformation? Yes that goes hand in hand with supporting
import of a model in general.

I would merely suggest this is a step that comes after several others in order of priority,
- implementing feature transformations in the abstract in the code base, separately from the
idea of PMML
- implementing some form of model import via JPMML
- implementing more functional in the Model classes to give a reason to want to import an
external model into MLlib

... and to me this is less useful at this point than export too. I say this because the power
of MLlib/Spark right now is perceived to be model building, making it more producer than consumer
at this stage.

> PMML model evaluation support via MLib
> --------------------------------------
>                 Key: SPARK-1406
>                 URL:
>             Project: Spark
>          Issue Type: New Feature
>          Components: MLlib
>            Reporter: Thomas Darimont
> It would be useful if spark would provide support the evaluation of PMML models (
> This would allow to use analytical models that were created with a statistical modeling
tool like R, SAS, SPSS, etc. with Spark (MLib) which would perform the actual model evaluation
for a given input tuple. The PMML model would then just contain the "parameterization" of
an analytical model.
> Other projects like JPMML-Evaluator do a similar thing.

This message was sent by Atlassian JIRA

View raw message