From user-return-44410-apmail-hbase-user-archive=hbase.apache.org@hbase.apache.org Tue Jul 29 06:53:18 2014 Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 41F1D11FFD for ; Tue, 29 Jul 2014 06:53:18 +0000 (UTC) Received: (qmail 73302 invoked by uid 500); 29 Jul 2014 06:53:16 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 73231 invoked by uid 500); 29 Jul 2014 06:53:16 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 73219 invoked by uid 99); 29 Jul 2014 06:53:15 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Jul 2014 06:53:15 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jianshi.huang@gmail.com designates 209.85.220.171 as permitted sender) Received: from [209.85.220.171] (HELO mail-vc0-f171.google.com) (209.85.220.171) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Jul 2014 06:53:13 +0000 Received: by mail-vc0-f171.google.com with SMTP id hq11so12913237vcb.30 for ; Mon, 28 Jul 2014 23:52:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=LaauFu8/t9OB0I6bUoeq4v3ZOufy2gqNsR7WmdobJ6A=; b=AqrOhZI4XZ5xKw+rsyR1jALvwKWNgL0xIWoyUaGhjAlSSEXTSjAqDbMXMmxr5sPyuV s8BfcftA0Fz5mtRF6hUTCx9dtoaIRb//y4sYwEbLJPDE9hHlnjAyHjBOTXzPgL0MFNa2 ehkafDXFHhrnogDqpeiws43cgEJ0SAfCGzH9hQ4YdPXdNrUmSFTrATEgC3OxZQzmp7Jh fhBOhg8QwDZ6OHP9urMDnfAVjRuCwfVDUxdayVaFPa3kquWfVsVa0N4UpPgIUjqwBcY3 L2m+zb+gv3nlGgpsSzKThxfmoVK1xW5AxeMFA44Y9+2oPnntO8ki+E7RKTE0wP7NMg5w 5DiA== X-Received: by 10.52.82.166 with SMTP id j6mr97356vdy.87.1406616768658; Mon, 28 Jul 2014 23:52:48 -0700 (PDT) MIME-Version: 1.0 Received: by 10.220.2.10 with HTTP; Mon, 28 Jul 2014 23:52:28 -0700 (PDT) In-Reply-To: References: From: Jianshi Huang Date: Tue, 29 Jul 2014 14:52:28 +0800 Message-ID: Subject: Re: Completebulkload with namespace option? To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=001a1136ac4cd4c53304ff4f7c64 X-Virus-Checked: Checked by ClamAV on apache.org --001a1136ac4cd4c53304ff4f7c64 Content-Type: text/plain; charset=UTF-8 I see why, looking at the source code of LoadIncrementalHFiles.java, it seems the temporary path created for splitting will contain ':', The error part should be this: String uniqueName = getUniqueName(table.getName()); HColumnDescriptor familyDesc = table.getTableDescriptor().getFamily(item.family); Path botOut = new Path(tmpDir, uniqueName + ".bottom"); Path topOut = new Path(tmpDir, uniqueName + ".top"); splitStoreFile(getConf(), hfilePath, familyDesc, splitKey, botOut, topOut); uniqueName will be "namespce:table" so new Path will fail. A bug right? Jianshi On Tue, Jul 29, 2014 at 2:42 PM, Jianshi Huang wrote: > I'm using hbase 0.98 with HDP 2.1. > > > On Tue, Jul 29, 2014 at 2:39 PM, Jianshi Huang > wrote: > >> I'm using completebulkload to load 500GB of data to a table >> (presplitted). However, it reports the following errors: >> >> Looks like completebulkload didn't recognize the namespace part >> (namespace:table). >> >> Is there an option to do it? I can't find one in Google... >> >> Exception in thread "main" 14/07/28 23:32:19 INFO >> mapreduce.LoadIncrementalHFiles: Trying to load >> hfile=hdfs://xxx/vertices/PROP/f5cbf0965ff44cb8bdabd038e66485c3 >> first=dc595cfe#cust#1812199228741466242 >> last=dc68cedc#cust#2251647837553603393 >> java.lang.reflect.InvocationTargetException >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at org.apache.hadoop.hbase.mapreduce.Driver.main(Driver.java:54) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at org.apache.hadoop.util.RunJar.main(RunJar.java:212) >> Caused by: java.lang.IllegalStateException: >> java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative >> path in absolute URI: grapple:vertices,37.bottom >> at >> org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.groupOrSplitPhase(LoadIncrementalHFiles.java:421) >> at >> org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:291) >> at >> org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.run(LoadIncrementalHFiles.java:825) >> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) >> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) >> at >> org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.main(LoadIncrementalHFiles.java:831) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at >> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72) >> at >> org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:145) >> at >> org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:153) >> ... 10 more >> Caused by: java.lang.IllegalArgumentException: >> java.net.URISyntaxException: Relative path in absolute URI: >> grapple:vertices,37.bottom >> at org.apache.hadoop.fs.Path.initialize(Path.java:206) >> at org.apache.hadoop.fs.Path.(Path.java:172) >> at org.apache.hadoop.fs.Path.(Path.java:94) >> at >> org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.splitStoreFile(LoadIncrementalHFiles.java:450) >> at >> org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.groupOrSplit(LoadIncrementalHFiles.java:516) >> at >> org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$2.call(LoadIncrementalHFiles.java:400) >> at >> org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$2.call(LoadIncrementalHFiles.java:398) >> at java.util.concurrent.FutureTask.run(FutureTask.java:262) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >> at java.lang.Thread.run(Thread.java:724) >> Caused by: java.net.URISyntaxException: Relative path in absolute URI: >> grapple:vertices,37.bottom >> at java.net.URI.checkPath(URI.java:1804) >> at java.net.URI.(URI.java:752) >> at org.apache.hadoop.fs.Path.initialize(Path.java:203) >> ... 10 more >> >> -- >> Jianshi Huang >> >> LinkedIn: jianshi >> Twitter: @jshuang >> Github & Blog: http://huangjs.github.com/ >> > > > > -- > Jianshi Huang > > LinkedIn: jianshi > Twitter: @jshuang > Github & Blog: http://huangjs.github.com/ > -- Jianshi Huang LinkedIn: jianshi Twitter: @jshuang Github & Blog: http://huangjs.github.com/ --001a1136ac4cd4c53304ff4f7c64--