hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stack <st...@duboce.net>
Subject Re: Import TSV - too many args/columns
Date Mon, 21 Oct 2019 15:54:49 GMT
On Thu, Oct 17, 2019 at 10:57 AM Gautham Acharya <
gauthama@alleninstitute.org> wrote:

> The error is simply:
> -bash: too many arguments
>
>
You've took a look around to see how others have solved this issue?

There is no magic here. It is the simple bin/hbase bash script passing the
cmd line to the ImportTsv MR java application.

Thanks,
S



> -----Original Message-----
> From: Stack [mailto:stack@duboce.net]
> Sent: Thursday, October 17, 2019 10:43 AM
> To: Hbase-User <user@hbase.apache.org>
> Subject: Re: Import TSV - too many args/columns
>
> CAUTION: This email originated from outside the Allen Institute. Please do
> not click links or open attachments unless you've validated the sender and
> know the content is safe.
> ________________________________
>
> What is the error? I think I know what it is but dump it in here please.
>
> You can't run your own importtsv instead of theirs?
>
> S
>
> On Wed, Oct 16, 2019 at 11:51 AM Gautham Acharya <
> gauthama@alleninstitute.org> wrote:
>
> > Searched, didn't find any results.
> >
> > Hacking ImportTSV isn't really an option, as we're using a managed
> > Hbase instance on AWS EMR.
> >
> > -----Original Message-----
> > From: Stack [mailto:stack@duboce.net]
> > Sent: Wednesday, October 16, 2019 11:25 AM
> > To: Hbase-User <user@hbase.apache.org>
> > Subject: Re: Import TSV - too many args/columns
> >
> > CAUTION: This email originated from outside the Allen Institute.
> > Please do not click links or open attachments unless you've validated
> > the sender and know the content is safe.
> > ________________________________
> >
> > You've tried search net for how others deal with arg list too long?
> > You might have to hack on the importtsv script?
> > S
> >
> > On Tue, Oct 15, 2019 at 2:41 PM Gautham Acharya <
> > gauthama@alleninstitute.org>
> > wrote:
> >
> > > I'm trying to use the ImportTSV utility to generate HFiles and move
> > > them into an instance using the CompleteBulkLoad tool.
> > >
> > >
> > >
> > > Right now an error I'm running into is that the arg list is too long
> > > - I have over 50,000 columns to specify in my CS, and the bash shell
> > > throws an error. Is there an easy way around this? Piping the
> > > arguments does not seem to work either.
> > >
> > >
> > >
> > > --gautham
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message