hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stack <st...@duboce.net>
Subject Re: Import TSV - too many args/columns
Date Thu, 17 Oct 2019 17:42:54 GMT
What is the error? I think I know what it is but dump it in here please.

You can't run your own importtsv instead of theirs?

S

On Wed, Oct 16, 2019 at 11:51 AM Gautham Acharya <
gauthama@alleninstitute.org> wrote:

> Searched, didn't find any results.
>
> Hacking ImportTSV isn't really an option, as we're using a managed Hbase
> instance on AWS EMR.
>
> -----Original Message-----
> From: Stack [mailto:stack@duboce.net]
> Sent: Wednesday, October 16, 2019 11:25 AM
> To: Hbase-User <user@hbase.apache.org>
> Subject: Re: Import TSV - too many args/columns
>
> CAUTION: This email originated from outside the Allen Institute. Please do
> not click links or open attachments unless you've validated the sender and
> know the content is safe.
> ________________________________
>
> You've tried search net for how others deal with arg list too long? You
> might have to hack on the importtsv script?
> S
>
> On Tue, Oct 15, 2019 at 2:41 PM Gautham Acharya <
> gauthama@alleninstitute.org>
> wrote:
>
> > I'm trying to use the ImportTSV utility to generate HFiles and move
> > them into an instance using the CompleteBulkLoad tool.
> >
> >
> >
> > Right now an error I'm running into is that the arg list is too long -
> > I have over 50,000 columns to specify in my CS, and the bash shell
> > throws an error. Is there an easy way around this? Piping the
> > arguments does not seem to work either.
> >
> >
> >
> > --gautham
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message