mahout-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ahmed Radwan <ah...@cloudera.com>
Subject Re: Re:Mahout compatibility with GraphLab
Date Thu, 01 Sep 2011 22:16:45 GMT
I'll definitly encourage this integration. The architecture document at:
https://issues.apache.org/jira/secure/attachment/12486023/MapReduce_NextGen_Architecture.pdf
captures
a lot of details.

Best Regards
Ahmed

On Thu, Sep 1, 2011 at 10:39 AM, Josh Patterson <josh@cloudera.com> wrote:

> From the Cloudera side, there is also Ahmed Radwan, who I'm sure would
> answer questions you may have.
>
> JP
>
> On Thu, Sep 1, 2011 at 1:39 PM, Josh Patterson <josh@cloudera.com> wrote:
> > This feature seems to be principly driven by a few folks @ Yahoo. Arun
> > Murthy seems to be quite involved.
> >
> > Hama is also getting into the MRv2 game:
> > https://issues.apache.org/jira/browse/HAMA-431
> >
> > Quick presentation on the framework by Sharad Agarwal (Yahoo):
> >
> https://issues.apache.org/jira/secure/attachment/12485267/hadoop_contributors_meet_07_01_2011.pdf
> >
> > Seems to be a considerably more native/clean approach than managing a
> > bunch of C++ to Java wrappers, imho. I'd really like to see a lot of
> > frameworks on Hadoop; could have a language like Pig that then
> > compiled down not only to different ML techniques, but also execute
> > them on the proper framework in MRv2 as well.
> >
> > JP
> >
> > On Thu, Sep 1, 2011 at 1:12 PM, Danny Bickson <danny.bickson@gmail.com>
> wrote:
> >> This is definitely a very interesting option to integrate both projects.
> I
> >> will forward this to my
> >> collaborators - specifically, Joey Gonzalez was recently an Intern at
> Yahoo!
> >> and looked at similar directions.
> >> I will try to learn the technical details better to see how this
> >> interoperability works.
> >> Who is working on this project in case we need more details?
> >>
> >> Thanks,
> >>
> >> Danny Bickson
> >>
> >> On Thu, Sep 1, 2011 at 7:26 PM, Josh Patterson <josh@cloudera.com>
> wrote:
> >>
> >>> Danny,
> >>> (Only tangentially understanding the internals of GraphLab) --- is
> >>> there any interest in having this framework run as a first class
> >>> citizen on hadoop (beside MR) similar to:
> >>>
> >>> MPI on hadoop
> >>> https://issues.apache.org/jira/browse/MAPREDUCE-2911
> >>>
> >>> via the new MRv2 framework? I think that would be a really interesting
> >>> way to get GraphLab to work with Mahout as I see MRv2 as enabling a
> >>> lot more functionality in Mahout as we move forward.
> >>>
> >>> Thoughts?
> >>>
> >>> JP
> >>>
> >>>
> >>
> >
> >
> >
> > --
> > Twitter: @jpatanooga
> > Solution Architect @ Cloudera
> > hadoop: http://www.cloudera.com
> >
>
>
>
> --
> Twitter: @jpatanooga
> Solution Architect @ Cloudera
> hadoop: http://www.cloudera.com
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message