spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Karthikeyan Muthukumar <mkarthiksw...@gmail.com>
Subject Workflow layer for Spark
Date Fri, 13 Mar 2015 15:46:21 GMT
Hi,
We are building a machine learning platform based on ML-Lib in Spark. We
would be using Scala for the development.
We need a thin workflow layer where we can easily configure the different
actions to be done, configuration for the actions (like load-data,
clean-data, split-data etc), and the order in which the actions are to be
executed. We will implement the actions themselves in Scala.
Is there any open source library that could be used as the think workflow
layer here?
Thanks & Regards
MK

Mime
View raw message