hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dani Rayan <dani.ra...@gmail.com>
Subject Re: is there any tool that facilitate the import of data to hbase
Date Thu, 03 Feb 2011 22:17:41 GMT
Hey,

Flume: http://archive.cloudera.com/cdh/3/flume/UserGuide.html has a HBase
sink.
Flume is similar to Scribe, but has more to it.

Original Jira: https://issues.cloudera.org/browse/FLUME-6
Branch: https://github.com/cloudera/flume/tree/hbase

-Thanks,
Dani.
http://www.cc.gatech.edu/~iar3/

On Thu, Feb 3, 2011 at 5:11 PM, arvind@cloudera.com <arvind@cloudera.com>wrote:

> On Thu, Feb 3, 2011 at 1:56 PM, Weishung Chung <weishung@gmail.com> wrote:
>
> > About Sqoop, could I import the data specifically into HBase ?
> >
>
> Yes - Sqoop supports direct imports from external databases into HBase.
> More
> details can be found in Sqoop documentation available
> here<
> http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html#_importing_data_into_hbase
> >
> .
>
> Arvind
>
>
> > I know I could write a program to read from mysql and use HBase API to
> > write
> > to HBase.
> >
> > On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <weishung@gmail.com>
> wrote:
> >
> > > thank you for the clarification :) I am reading about sqoop now...
> > >
> > >
> > > On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <markkerzner@gmail.com
> > >wrote:
> > >
> > >> scribe is a tool for log aggregation, at face value, not mysql
> > >>
> > >> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <weishung@gmail.com>
> > >> wrote:
> > >>
> > >> > Thank you for all the quick response. This really helps me along.
> How
> > >> about
> > >> > facebook's scribe?
> > >> >
> > >> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <markkerzner@gmail.com
> >
> > >> > wrote:
> > >> >
> > >> > > Overview:
> > >> > >
> > >> > >
> > >> >
> > >>
> >
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> > >> > >
> > >> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <ryanobjc@gmail.com>
> > >> wrote:
> > >> > >
> > >> > > > ImportTSV?
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> > >> > > >
> > >> > > > Also writing a job to read from JDBC and write to hbase
isnt too
> > bad
> > >> > > > if your schema isnt too insanely complex.
> > >> > > >
> > >> > > > -ryan
> > >> > > >
> > >> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <
> buttler1@llnl.gov
> > >
> > >> > > wrote:
> > >> > > > > Sqoop?
> > >> > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > >> > > > >
> > >> > > > > -----Original Message-----
> > >> > > > > From: Weishung Chung [mailto:weishung@gmail.com]
> > >> > > > > Sent: Thursday, February 03, 2011 1:18 PM
> > >> > > > > To: user@hbase.apache.org
> > >> > > > > Subject: is there any tool that facilitate the import
of data
> to
> > >> > hbase
> > >> > > > >
> > >> > > > > I am looking for tool that allows me to import data
from mysql
> > to
> > >> > > hbase.
> > >> > > > Any
> > >> > > > > suggestion?
> > >> > > > > Thank you :)
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message