hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stack <st...@duboce.net>
Subject Re: How to improve HBase read performance.
Date Wed, 23 May 2018 16:33:51 GMT
On Wed, May 16, 2018 at 7:30 PM, Kang Minwoo <minwoo.kang@outlook.com>
wrote:

> Here is information.
>
> store about 5 billion a day.
>


5B logs a day?



> size of each log is about 4k.
>

You store a single log into a single cell?



> compression by snappy.
>
>
The log in the hbase cell is compressed or you have enabled compression on
the hbase column family?


What is your test environment like? Is it a single server? How are you
running your compare?

Thanks,
M




> Best regards,
> Minwoo Kang
>
> ________________________________________
> 보낸 사람: Ted Yu <yuzhihong@gmail.com>
> 보낸 날짜: 2018년 5월 17일 목요일 00:01
> 받는 사람: user@hbase.apache.org
> 제목: Re: How to improve HBase read performance.
>
> bq. store a lot of logs in HBase
>
> Kang:
> Can you tell us a bit more about how you store (and access) the log(s) -
> size of each log, whether log is encoded in hbase ?
>
> ORC is columnar format while hbase uses different format.
>
> Thanks
>
> On Wed, May 16, 2018 at 6:41 AM, Marcell Ortutay <mortutay@23andme.com>
> wrote:
>
> > This ticket: https://issues.apache.org/jira/browse/HBASE-20459 was fixed
> > in
> > the latest version of HBase, upgrading to latest may help with
> performance
> >
> > On Wed, May 16, 2018 at 3:55 AM, Kang Minwoo <minwoo.kang@outlook.com>
> > wrote:
> >
> > > Hi, Users.
> > >
> > > I store a lot of logs in HBase.
> > > However, the reading speed of the log is too slow compared to the Hive
> > ORC
> > > file.
> > > I know that HBase is slow compared to the Hive ORC file.
> > > The problem is that it is too slow.
> > > HBase is about 6 times slower.
> > >
> > > Is there a good way to speed up HBase's reading speed?
> > > Should I put a lot of servers?
> > >
> > > I am using HBase 1.2.6.
> > >
> > > Best regards,
> > > Minwoo Kang
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message