sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From shengjie min <kelvin....@gmail.com>
Subject sqoop free form query import to HBase
Date Thu, 08 Aug 2013 03:27:25 GMT
Hi Guys,

I've got sqoop table import to HBase working as below:

1. sqoop import --connect jdbc:mysql://${mysql-server-address}/test -username root -password
admin --table Student --hbase-create-table --hbase-table student --column-family i

Next step, I am trying to get free form query working as well, someow, the sqoop command below
I tried doesn't work as expected, nothing has been imported from source table to the target
HBase table.

2. sqoop import --connect jdbc:mysql://${mysql-server-address}/test -username root -password
admin --query 'SELECT id, name from Student where $CONDITIONS' --split-by Student.id --hbase-create-table
--hbase-table student --column-family i

Is there anything I am missing from the 2nd sqoop command? The document is very limited in
terms of HBase import.

here is the log from command 2 if it helps:

13/08/06 21:15:43 INFO db.DataDrivenDBInputFormat: BoundingValsQuery: SELECT MIN(t1.id), MAX(t1.id)
FROM (SELECT * from Student where  (1 = 1) ) AS t1
13/08/06 21:15:46 INFO mapred.JobClient: Running job: job_201308061021_0025
13/08/06 21:15:47 INFO mapred.JobClient:  map 0% reduce 0%
13/08/06 21:19:08 INFO mapred.JobClient:  map 75% reduce 0%
13/08/06 21:19:09 INFO mapred.JobClient:  map 100% reduce 0%
13/08/06 21:19:12 INFO mapred.JobClient: Job complete: job_201308061021_0025
13/08/06 21:19:12 INFO mapred.JobClient: Counters: 17
13/08/06 21:19:12 INFO mapred.JobClient:   Job Counters
13/08/06 21:19:12 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=212866
13/08/06 21:19:12 INFO mapred.JobClient:     Total time spent by all reduces waiting after
reserving slots (ms)=0
13/08/06 21:19:13 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving
slots (ms)=0
13/08/06 21:19:13 INFO mapred.JobClient:     Launched map tasks=4
13/08/06 21:19:13 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=0
13/08/06 21:19:13 INFO mapred.JobClient:   File Output Format Counters
13/08/06 21:19:13 INFO mapred.JobClient:     Bytes Written=0
13/08/06 21:19:13 INFO mapred.JobClient:   FileSystemCounters
13/08/06 21:19:13 INFO mapred.JobClient:     HDFS_BYTES_READ=441
13/08/06 21:19:13 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=362752
13/08/06 21:19:13 INFO mapred.JobClient:   File Input Format Counters
13/08/06 21:19:13 INFO mapred.JobClient:     Bytes Read=0
13/08/06 21:19:13 INFO mapred.JobClient:   Map-Reduce Framework
13/08/06 21:19:13 INFO mapred.JobClient:     Map input records=4
13/08/06 21:19:13 INFO mapred.JobClient:     Physical memory (bytes) snapshot=428892160
13/08/06 21:19:13 INFO mapred.JobClient:     Spilled Records=0
13/08/06 21:19:13 INFO mapred.JobClient:     CPU time spent (ms)=7730
13/08/06 21:19:13 INFO mapred.JobClient:     Total committed heap usage (bytes)=312672256
13/08/06 21:19:13 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=5353742336
13/08/06 21:19:13 INFO mapred.JobClient:     Map output records=4
13/08/06 21:19:13 INFO mapred.JobClient:     SPLIT_RAW_BYTES=441
13/08/06 21:19:13 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 213.1239 seconds (0
bytes/sec)
13/08/06 21:19:13 INFO mapreduce.ImportJobBase: Retrieved 4 records.

Shengjie
Mime
View raw message