hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Weichen YE <yeweichen2...@gmail.com>
Subject Re: testCacheMultiThreadedSingleKey producing "unable to create new native thread" in 0.98 branch?
Date Sun, 28 Sep 2014 01:41:21 GMT
if you have larger test, it is better to change the limit configuration for
your hbase and hdfs user.
 Like for example:

# cat /etc/security/limits.d/hbase.conf

hbase - nofile  32768
hbase - memlock unlimited


# cat /etc/security/limits.d/hdfs.conf

hdfs   - nofile 32768
hdfs   - nproc  65536

2014-09-28 5:06 GMT+08:00 Stephen Boesch <javadba@gmail.com>:

> Thanks Ted. Spot on.  I am running the small and medium tests now - and it
> has well passed the point of the threads issue.
>
> 2014-09-27 13:41 GMT-07:00 Ted Yu <yuzhihong@gmail.com>:
>
> > Have you looked at 15.9.2.4. under
> > http://hbase.apache.org/book.html#trouble.rs.runtime ?
> >
> > Cheers
> >
> > On Sat, Sep 27, 2014 at 1:22 PM, Stephen Boesch <javadba@gmail.com>
> wrote:
> >
> > > This is my first attempt to run the unit tests on the 0.98.X branch:
> and
> > > the failures I see are:
> > >
> > > Running org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache
> > > Tests run: 8, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 204.045
> > sec
> > > <<< FAILURE!
> > >
> > > Tests in error:
> > >   testCacheMultiThreadedSingleKey[0: blockSize=8\u002C192\u002C
> > >
> >
> bucketSizes=null](org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache):
> > > unable to create new native thread
> > >   testCacheMultiThreadedSingleKey[1: blockSize=16\u002C384\u002C
> > > bucketSizes=[I@3f253efb
> > > ](org.apache.hadoop.hbase.io.hfile.bucket.TestBucketCache):
> > > unable to create new native thread
> > >
> > >
> > > My test env:  CentOS 6.5      version="0.98.6-SNAPSHOT"   VM with 3
> cores
> > > and 9GB RAM
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message