hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "meirav.malka" <meirav.ma...@gmail.com>
Subject Re: HBase top activity
Date Wed, 09 Jan 2019 19:54:08 GMT
Thanks for the replies.I understand the difficulty in tracking distributed scans.Meanwhile
I found that "responseTooSlow" queries, do get written to log. The entry contains scan details(table,
start and endrowkey, response size and processing time)So I was thinking to lower the threshold
so that most queries get logged, and then ingesting the log to elasticsearch with logstash.
The other option is Trace log level..which is bad?

Sent from my Samsung Galaxy smartphone.
-------- Original message --------From: Wei-Chiu Chuang <weichiu@cloudera.com.INVALID>
Date: 1/9/19  14:38  (GMT+02:00) To: user@hbase.apache.org Subject: Re: HBase top activity

FWIW, Andrew proposed a htop utility:
https://issues.apache.org/jira/browse/HBASE-11062

On Wed, Jan 9, 2019 at 4:36 AM Wellington Chevreuil <
wellington.chevreuil@gmail.com> wrote:

> I don't think it is possible to track individual scans resources usage,
> current available JMX metrics are an aggregation of all request types
> (scanNext, append, get, delete) per regions level at individual RSes, and
> these are basically counts on the number of those requests. Resources usage
> are measured at RS process level, so that also adds a challenge to account
> those for individual scans. Sure, you could break those down by looking at
> each thread usage with some monitoring tool such as VisualVM, but then you
> would still need to map each RPC handler to an specific scan, and depending
> on how large the result, a single scan would be addressed by different
> handlers every time it calls "next" fetch another batch of results it's
> iterating through.
>
> Em seg, 7 de jan de 2019 às 14:27, shicheng31604@gmail.com <
> shicheng31604@gmail.com> escreveu:
>
> > Maybe  coprocessor can  help you in some way.
> >
> >
> >
> > shicheng31604@gmail.com
> >
> > From: Meirav Malka
> > Date: 2019-01-07 19:22
> > To: Hbase User Group; dev
> > Subject: HBase top activity
> > Hi,
> >
> > Does anyone know i there's a way to get the current operations running
> in a
> > HBase cluster?
> > We want to be able to detect the running scans, their execution time,
> > number of executions,cpu, memory and io.(as can be found in Oracle
> > database)
> > Is there any tracking of this data in HBase?
> >
> > Thanks
> >
>
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message