hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gautham Acharya <gauth...@alleninstitute.org>
Subject RE: Import TSV - too many args/columns
Date Wed, 16 Oct 2019 18:27:07 GMT
Searched, didn't find any results.

Hacking ImportTSV isn't really an option, as we're using a managed Hbase instance on AWS EMR.

-----Original Message-----
From: Stack [mailto:stack@duboce.net] 
Sent: Wednesday, October 16, 2019 11:25 AM
To: Hbase-User <user@hbase.apache.org>
Subject: Re: Import TSV - too many args/columns

CAUTION: This email originated from outside the Allen Institute. Please do not click links
or open attachments unless you've validated the sender and know the content is safe.
________________________________

You've tried search net for how others deal with arg list too long? You might have to hack
on the importtsv script?
S

On Tue, Oct 15, 2019 at 2:41 PM Gautham Acharya <gauthama@alleninstitute.org>
wrote:

> I'm trying to use the ImportTSV utility to generate HFiles and move 
> them into an instance using the CompleteBulkLoad tool.
>
>
>
> Right now an error I'm running into is that the arg list is too long -  
> I have over 50,000 columns to specify in my CS, and the bash shell 
> throws an error. Is there an easy way around this? Piping the 
> arguments does not seem to work either.
>
>
>
> --gautham
>
Mime
View raw message