spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jayant Shekhar <>
Subject Re: Oryx + Spark mllib
Date Sun, 19 Oct 2014 20:14:19 GMT
Hi Deb,

Do check out

It does integrate with Spark. Sean has put in quite a bit of neat details
on the page about the architecture. It has all the things you are thinking


On Sat, Oct 18, 2014 at 8:49 AM, Debasish Das <>

> Hi,
> Is someone working on a project on integrating Oryx model serving layer
> with Spark ? Models will be built using either Streaming data / Batch data
> in HDFS and cross validated with mllib APIs but the model serving layer
> will give API endpoints like Oryx
> and read the models may be from hdfs/impala/SparkSQL
> One of the requirement is that the API layer should be scalable and
> requests grow we should be able to add more nodes...using play
> and akka clustering module...
> If there is a ongoing project on github please point to it...
> Is there a plan of adding model serving and experimentation layer to mllib
> ?
> Thanks.
> Deb

View raw message