hama-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ηλίας Καπουράνης <ikapo...@csd.auth.gr>
Subject Re: Groomservers IPC server port range
Date Thu, 06 Feb 2014 10:31:29 GMT
Another error came up! Now it starts zookeepers but loses the 
connection. Specifically:

attempt_201402061212_0001_000004_0: 14/02/06 12:12:58 INFO ipc.Server: 
Starting Socket Reader #1 for port 49564
attempt_201402061212_0001_000004_0: 14/02/06 12:12:58 INFO ipc.Server: 
IPC Server Responder: starting
attempt_201402061212_0001_000004_0: 14/02/06 12:12:58 INFO ipc.Server: 
IPC Server listener on 49564: starting
attempt_201402061212_0001_000004_0: 14/02/06 12:12:58 INFO 
message.HadoopMessageManagerImpl:  BSPPeer address:host port:49564
attempt_201402061212_0001_000004_0: 14/02/06 12:12:58 INFO ipc.Server: 
IPC Server handler 0 on 49564: starting
attempt_201402061212_0001_000004_0: 14/02/06 12:12:59 INFO 
sync.ZKSyncClient: Initializing ZK Sync Client
attempt_201402061212_0001_000004_0: 14/02/06 12:12:59 INFO 
sync.ZooKeeperSyncClientImpl: Start connecting to Zookeeper! At 
host/address:49564
attempt_201402061212_0001_000004_0: 14/02/06 12:12:59 ERROR 
sync.ZooKeeperSyncClientImpl: 
org.apache.zookeeper.KeeperException$ConnectionLossException: 
KeeperErrorCode = ConnectionLoss for /bsp/job_201402061212_0001/peers
attempt_201402061212_0001_000004_0: 14/02/06 12:13:02 ERROR 
sync.ZKSyncClient: Error checking zk path 
/bsp/job_201402061212_0001/peers/host:49564
attempt_201402061212_0001_000004_0: 
org.apache.zookeeper.KeeperException$ConnectionLossException: 
KeeperErrorCode = ConnectionLoss for 
/bsp/job_201402061212_0001/peers/host:49564


So I think that the problem again is the port restriction. The 49564 
port is randomly selected again. I tried seting it at the zookeeper 
quorum servers like host:port1:port2 but still it chooses randomly. Is 
there any way to "standarize" it like with groomserver?




Στις 6/2/2014 10:24 πμ, ο/η Ηλίας Καπουράνης έγραψε:
>
> Thanks a lot Edward! I will try it and let you know if something comes 
> up!
>
> Have a nice day!
>
>
> Στις 6/2/2014 7:15 πμ, ο/η Edward J. Yoon έγραψε:
>> Again,
>>
>> You can specify the report server port by setting
>> "bsp.groom.report.address" property like below:
>>
>> <property>
>> <name>bsp.groom.report.address</name>
>> <value>127.0.0.1:5001</value>
>> </property>
>>
>> Default value was 127.0.0.1:0. (random port).
>>
>>
>>
>> On Thu, Feb 6, 2014 at 2:09 PM, Edward J. Yoon 
>> <edwardyoon@apache.org> wrote:
>>> Oh, .. thanks.
>>>
>>> The GroomServer.taskReportServer seems uses random port. I'll make it
>>> configurable.
>>>
>>> On Wed, Feb 5, 2014 at 10:13 PM, Ηλίας Καπουράνης 
>>> <ikapoura@csd.auth.gr> wrote:
>>>> Hey,
>>>>
>>>> So what the IPC Server stands for and it gets random ports? I ve 
>>>> seen 39865
>>>> and 52765. What is the deal with it?
>>>>
>>>>
>>>> Στις 5/2/2014 2:53 μμ, ο/η Edward J. Yoon έγραψε:
>>>>
>>>>> Hi,
>>>>>
>>>>> a Hama cluster uses ports "bsp.master.port" 40000 and
>>>>> "bsp.groom.rpc.port" 50000 to communicate among the cluster nodes.
>>>>>
>>>>> And the default peer port is 61000. If you set 3 for the maximum
>>>>> number of tasks per node, each task uses ports from 61000 to 61003 to
>>>>> transfer messages between bsp tasks.
>>>>>
>>>>> On Wed, Feb 5, 2014 at 9:11 PM, Ηλίας Καπουράνης 
>>>>> <ikapoura@csd.auth.gr>
>>>>> wrote:
>>>>>> Hello there,
>>>>>>
>>>>>> I am trying to setup Hama in a cluster with really strict port
>>>>>> permissions
>>>>>> and I get across the error at every GroomServer:
>>>>>> "There is a problem in establishing link with BSPMaster."
>>>>>>
>>>>>> - Do you know what is the range of ports that every GroomServers
IPC
>>>>>> Server
>>>>>> gets when started?
>>>>>> - Is there a way to limit this range to new user values?
>>>>>>
>>>>>> Thank you.
>>>>>
>>>>>
>>>
>>>
>>> -- 
>>> Best Regards, Edward J. Yoon
>>> @eddieyoon
>>
>>
>


Mime
View raw message