hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ramkrishna vasudevan <ramkrishna.s.vasude...@gmail.com>
Subject Re: Regionservers consuming too much ram in HDP 2.6.
Date Thu, 07 Dec 2017 06:28:34 GMT
I don have any idea now from this. Seems to be an interesting case since
none of the users have reported such an issue. I need to try out this to
ascertain what is really happening.

Can you paste your hbase-env.sh details and the hbase-site.xml just to be
sure there is nothing overriding the configs?

Regards
Ram


On Wed, Dec 6, 2017 at 5:41 PM, Lalit Jadhav <lalit.jadhav@nciportal.com>
wrote:

> Are you sure the 16G taken up in the RAM is due to the region server?
> :Yes
>
> Are you having any other cache configuration like  bucket cache?
> :No
>
> Are you allocating any Direct_memory for the region servers?
> :No
>
> So when does this raise to 16G happen - is it after the regions are created
> or even before them i.e just when you start the region server?
> : Even before regions are created.
>
> Which version of hbase is it?
> 1.1.2
>
> On Dec 6, 2017 4:02 PM, "ramkrishna vasudevan" <
> ramkrishna.s.vasudevan@gmail.com> wrote:
>
> > Few more questions,
> > Are you sure the 16G taken up in the RAM is due to the region server? Are
> > you having any other cache configuration like  bucket cache?
> > Are you allocating any Direct_memory for the region servers?
> >
> > So when does this raise to 16G happen - is it after the regions are
> created
> > or even before them i.e just when you start the region server? Which
> > version of hbase is it?
> >
> > Regards
> > Ram
> >
> > On Wed, Dec 6, 2017 at 3:57 PM, Lalit Jadhav <lalit.jadhav@nciportal.com
> >
> > wrote:
> >
> > > Hi Ramkrishna,
> > >
> > > Thanks for reply,
> > > Right now I am not performing any operation on HBase(it is idle),
> Still,
> > > utilization is 16GB. But when I shut down them, It frees this memory.
> > >
> > > On Wed, Dec 6, 2017 at 2:41 PM, ramkrishna vasudevan <
> > > ramkrishna.s.vasudevan@gmail.com> wrote:
> > >
> > > > Hi Lalith
> > > >
> > > > Seems you have configured very minimum heap space.
> > > > So when you say RAM size is increasing  what are the operations that
> > you
> > > > are performing when the memory increases. I can see heap is only 1G
> but
> > > > still your  memory is 16G.Are you sure that 16G is only due to Region
> > > > servers? Are you having heavy writes or reads during that time.
> > > >
> > > > Regards
> > > > Ram
> > > >
> > > > On Wed, Dec 6, 2017 at 2:31 PM, Lalit Jadhav <
> > lalit.jadhav@nciportal.com
> > > >
> > > > wrote:
> > > >
> > > > > Adding More info,
> > > > >
> > > > > Regions per region server : 13-15 Regions per RS
> > > > >
> > > > > memory region server is taking : 16GB
> > > > >
> > > > > Memstore size : 64 MB
> > > > >
> > > > > configured heap for Master : 1 GB
> > > > >
> > > > > configured heap for RegionServer : 1 GB
> > > > >
> > > > > On Tue, Dec 5, 2017 at 5:40 PM, Lalit Jadhav <
> > > lalit.jadhav@nciportal.com
> > > > >
> > > > > wrote:
> > > > >
> > > > > > Hello All,
> > > > > >
> > > > > > When we do any operations on the database(HBase), RegionServers
> are
> > > > > taking
> > > > > > too much ram and not releases until we restart them. Is there
any
> > > > > parameter
> > > > > > or property to release ram or to restrict RegionServers to take
> > this
> > > > much
> > > > > > of memory? Help will be appreciated.
> > > > > >
> > > > > > --
> > > > > > Regards,
> > > > > > Lalit Jadhav
> > > > > > Network Component Private Limited.
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Regards,
> > > > > Lalit Jadhav
> > > > > Network Component Private Limited.
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Regards,
> > > Lalit Jadhav
> > > Network Component Private Limited.
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message