hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Slava Gorelik" <slava.gore...@gmail.com>
Subject Re: Regionserver fails to serve region
Date Wed, 05 Nov 2008 11:23:33 GMT
Hi Michael.
Second part of the logs (will be 3 parts, due to mailing list limit).


On Tue, Nov 4, 2008 at 11:31 PM, stack <stack@duboce.net> wrote:

> Slava Gorelik wrote:
>
>> One more regarding the blockCache, how changes in store files (as i
>> understand those are MapFiles) are reflected on client side cache. If we
>> are
>> talking about more than one client that doing a changes ? If each client
>> has
>> different part of the MapFile ? or something else ?
>>
>>
>
> The block cache cache is over in the server. Its a cache for store files
> which never change once written.  Did I say client-side cache?  I should
> have been more clear.  The client in this case is the regionserver itself.
> The cache is so the regionserver saves on its trips over the network
> visiting datanodes.
> St.Ack
>
>
>
>  Best Regards.
>>
>> On Tue, Nov 4, 2008 at 11:10 PM, Slava Gorelik <slava.gorelik@gmail.com
>> >wrote:
>>
>>
>>
>>> I can try to reproduce it again, but before this i would like to send you
>>> a
>>> logs.
>>> Best Regards.
>>>
>>>
>>> On Tue, Nov 4, 2008 at 10:05 PM, stack <stack@duboce.net> wrote:
>>>
>>>
>>>
>>>> Then we should try and figure if there is an issue in the balancer, or
>>>> maybe there is something missing if we are not doing a big upload in a
>>>> manner that balances the upload across HDFS?
>>>> St.Ack
>>>>
>>>> Slava Gorelik wrote:
>>>>
>>>>
>>>>
>>>>> Sure, i'll arrange logs tomorrow.About balancer, to wait when the
>>>>> massive
>>>>> work is finished is good in testing environment but in production it's
>>>>> not
>>>>> relevant :-)
>>>>>
>>>>> Best Regards.
>>>>>
>>>>> On Tue, Nov 4, 2008 at 9:48 PM, stack <stack@duboce.net> wrote:
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>> Slava Gorelik wrote:
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>> Hi.Regarding the failure of new block creation - i failed to
run
>>>>>>> hbase
>>>>>>> till
>>>>>>> i reformatted HDFS again.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>> I'd be interested in the logs.
>>>>>>
>>>>>>  I just wandering if hadoop re balancing is necessary? Will it balance
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>> itself
>>>>>>> ? As i understand hadoop balancer is moving data between data
nodes,
>>>>>>> but
>>>>>>> in
>>>>>>> my case this is during massive (8 clients just adding a records
-
>>>>>>> about
>>>>>>> 400
>>>>>>> requests for all region servers - 6). So, is it good idea to
run
>>>>>>> balancer during heavy load ?
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>> I don't have sufficient experience running the balancer.  Perhaps
wait
>>>>>> till
>>>>>> upload is done, then run it?
>>>>>>
>>>>>> St.Ack
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>
>>
>
>

Mime
View raw message