hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Put related Region server connection
Date Fri, 03 Oct 2014 21:23:44 GMT
bq. recommendation to how many open connections per region server at a time?

This depends on the number of handlers you configure per region server.

bq. that means 1000 x 100 open connections at any given moment?

If each of your processes talks to 100 region servers simultaneously.

Cheers

On Thu, Oct 2, 2014 at 10:58 AM, Vrushali C <vrushali@ymail.com> wrote:

> Thanks Ted!
>
> So in my design, if I have a 1000  processes running (say each runs for an
> hour or so ) who may be doing their puts every other minute to a hbase
> cluster of 100 region servers then that means 1000 x 100 open connections
> at any given moment?
>
> Is this going to be a terrible way to do it? Should I be grouping them
> together somehow, like maybe these 1000 processes send their puts to say
> some other 5 processes who then send it to hbase ?
>
> Also, is there any recommendation to how many open connections per region
> server at a time?
>
> thanks
> Vrushali
>
>
>
>
>   On Thursday, October 2, 2014 10:43 AM, Ted Yu <yuzhihong@gmail.com>
> wrote:
>
>
> bq. is it established when an HTable object is instantiated
>
> The above is true.
> Take a look at 9.3.1.1. under
> http://hbase.apache.org/book.html#client.connections
>
> bq. only when the HTable is closed?
>
> There is ref counting for the connection associated with the HTable. When
> the ref count reaches 0, the connection would be closed.
>
> On Thu, Oct 2, 2014 at 10:33 AM, Vrushali C <vrushali@ymail.com> wrote:
>
> >
> >
> > I had a question about connections to region servers and their lifetime
> in
> > the context of doing a Put (say a single put).
> >
> > Is a network connection established to a region server when the Put is
> > being executed? Or is it established when an HTable object is
> instantiated?
> > Is that connection to the RegionServer closed after the Put is done or
> only
> > when the HTable is closed?
> >
> > thanks
> > Vrushali
> >
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message