samoa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gianmarco De Francisci Morales <g...@apache.org>
Subject Re: Samoa and Beam
Date Thu, 09 Aug 2018 09:37:10 GMT
Thanks Austin,
Please do let us know what you come up with.
We'll be happy to help if you need.

Cheers,

-- Gianmarco

On Fri, Aug 3, 2018 at 11:09 PM, Austin Bennett <whatwouldaustindo@gmail.com
> wrote:

> Hi Gianmarco,
>
> I've only been speaking with a very small subset of Beam community, so do
> not purport to represent overall.  There is a strong interest in ML by many
> and certainly by me.  No specific 'project' at the moment -- just
> enthusiasm from bits of ideas from varied exposures that tell me that the
> two ideas/communities could do well together.
>
> I am a user of Beam (as far as developing it, have only contributed a small
> bug fix up through now) though ML is an area I'd like to see more of
> (though, my runners/DPSE are largely Spark and DataFlow on GCP which aren't
> covered by Samoa) and it seems Beam helps address compute, so working with
> it frees to focus on the development of Streaming/ML algs.  It actually
> isn't 100% clear to me - at this point - how this will all work, so I have
> plenty of HW to do.
>
> Given what I'm hearing, the best course of action seems to be for me to
> just start hacking around on something that can leverage Beam and address
> ML Algs.  It doesn't sound like that is an issue from the perspective of
> animosity for stepping on your territory, or something like that.  Should
> that gain a bit of traction, I will then look forward to figuring out
> whether that might serve to bring the Beam and Samoa communities together
> (also, in the meantime would let me get more up to speed with both, and
> help me appreciate how difficult these problems really are).  I do have
> some dev cycles to devote to this at the moment, so will aim to explore
> further and see what can be built.  Will certainly be in touch with
> updates!
>
> Cheers,
> Austin
>
>
> On Fri, Aug 3, 2018 at 10:38 AM, Gianmarco De Francisci Morales <
> gdfm@apache.org> wrote:
>
> > Dear Austin,
> >
> > Thanks for your message.
> > Indeed, we considered Beam at a certain point, but the project was still
> > very young and it was not clear where it was headed.
> > We could definitely re-consider it now that it has gained more traction.
> > Are you starting to consider having Machine Learning algorithms inside
> > Beam?
> > We would be very happy to hear your thoughts and know a bit more about
> the
> > project.
> >
> > Regarding SAMOA, all the main developers currently do not have much time
> to
> > work on it, but we hope this might change in the next few months.
> >
> > Cheers,
> >
> >
> >
> > -- Gianmarco
> >
> > On Wed, Aug 1, 2018 at 8:35 PM, Austin Bennett <
> > whatwouldaustindo@gmail.com>
> > wrote:
> >
> > > Hi Samoa Dev,
> > >
> > > It has struck some of us in the Apache Beam (https://beam.apache.org)
> > > community
> > > that we have complimentary if not overlapping projects in many
> respects.
> > > We were discussing yesterday that Beam is trying to handle the ability
> to
> > > be cross DPSEe (SAMOA term), though more generally handle the compute
> on
> > > top of a number of 'runners' (beam term).  Many of us have strong ML
> > > interests, and around Streaming ML.
> > >
> > > We were starting to brainstorm around how these projects could play
> well
> > > together.  Prior to implementing things, the thought was to reach out
> to
> > > learn of Samoa dev's thoughts.  It doesn't look like there are ongoing
> > > project updates, and haven't seen code pushed in awhile.
> > >
> > > Has anyone in the Samoa community thought much on this?  Are people
> > > following this mailing list?
> > >
> > > Thanks,
> > > Austin
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message