hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Samir Ahmic <ahmic.sa...@gmail.com>
Subject Re: Copying data from one Hbase cluster to Another Hbase cluster
Date Fri, 14 Feb 2014 09:11:17 GMT
Hi Vimal,

I have few options how to move data from one hbase cluster to another:

   1. You can use org.apache.hadoop.hbase.mapreduce.Export tool to export
   tables to HDFS and then you can use hadoop distcp to move data to another
   cluster. When data is place on second cluster you can use
   org.apache.hadoop.hbase.mapreduce.Import tool to import tables. Please
    look at http://hbase.apache.org/book.html#export.
   2. Second option is to us CopyTable tool, please look at:
   3. Third option is to enable hbase Snapshots,  create table snapshots,
   and then use ExportSnapshot tool to move them to second cluster. When
   snapshots are on second cluster you can clone tables from snapshots. Please
   look: http://hbase.apache.org/book.html#ops.snapshots

I was using 1 and 3 for moving data between clusters and i in my case 3 was
better solution.


On Fri, Feb 14, 2014 at 8:33 AM, Vimal Jain <vkjk89@gmail.com> wrote:

> Hi,
> I have Hbase and Hadoop setup in pseudo distributed mode in production.
> Now i am planning to move from pseudo distributed mode to fully distributed
> mode ( 2 node cluster).
> My existing Hbase and Hadoop version are 1.1.2  and  0.94.7.
> And i am planning to have full distributed mode with Hbase version 0.94.16
> and Hadoop version ( either 1.X or 2.X , not yet decided ).
> What are different ways to copy data from existing setup ( pseudo
> distributed mode ) to this new setup ( 2 node fully distributed mode).
> Please help.
> --
> Thanks and Regards,
> Vimal Jain

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message