hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun C Murthy <...@hortonworks.com>
Subject Re: Hello Fellow members!!
Date Mon, 03 Oct 2011 02:36:00 GMT

 Welcome to Hadoop!

 Apache Hadoop is volunteer driven, so we are excited to have folks join us.

 Hadoop (core) has two main components: Storage (HDFS) and processing (MapReduce).

 You can choose to contribute to either or both depending on your interest.

 Currently, in MapReduce, we are working on what we call 'NextGen Hadoop MapReduce' to scale
better and support other paradigms than MapReduce.

 If that interests you, here are some links: 
 Original JIRA: https://issues.apache.org/jira/browse/MAPREDUCE-279
 Architecture doc. (slightly dated): MapReduce_NextGen_Architecture.pdf
 Docs for setting up cluster for dev: http://people.apache.org/~acmurthy/yarn/SingleCluster.html
 Writing new apps (usually non-MR): http://people.apache.org/~acmurthy/yarn/WritingYarnApplications.html

 Usually, the best way to learn the system is to start by documenting it while you start to
understand it. This way you quickly ramp up your contributions to the project while helping
 The above links from my homepage are generated from docs which are checked-in to the project.
You are welcome enhance them or add new ones. (They should be replaced by docs on the hadoop.apache.org
site once we make a release out of hadoop-0.23, I'm hosting them as an interim)

 Then, of course, you can look at open jiras:

 Good luck!


On Oct 2, 2011, at 3:11 AM, Deepak Sharma wrote:

> Hi
> I have been following this group for long time now.Reason being i want to
> shift my career path to Big Data development area.
> Now i got ample time to focus on this , so want to actively learn and
> participate here with Hadoop Framework.
> Please let me know what should be the starting point and the path ahead.
> Hope someone will reply on this thread ASAP.I can also devote time on a
> project if anyone is willing to take any volunteer on any kind of Big Data
> projects.
> Thanks
> -- 
> Deepak Sharma

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message