giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Edunov (JIRA)" <>
Subject [jira] [Commented] (GIRAPH-882) List of zookeeper connection strings is trimmed by Hadoop counters.
Date Wed, 29 Jun 2016 17:43:17 GMT


Sergey Edunov commented on GIRAPH-882:

Hi Donngjin, 

Are you available for chat sometime this week? I'm trying to figure out how this diff relates
to GIRAPH-1068. There we removed an option to start multiple zookeepers from the giraph itself.
It is still possible to connect to external zookeeper quorum though. 
To understand what needs to be done here, can you explain your use case? If I understand correctly,
here you create 5 zookeeper instances from the Giraph job. What is the reason, and why don't
you use single zookeper?  

> List of zookeeper connection strings is trimmed by Hadoop counters.
> -------------------------------------------------------------------
>                 Key: GIRAPH-882
>                 URL:
>             Project: Giraph
>          Issue Type: Bug
>          Components: zookeeper
>    Affects Versions: 1.1.0, 1.2.0
>            Reporter: Lukas Nalezenec
>         Attachments: GIRAPH-882-rev2.patch, GIRAPH-882-rev3.patch, GIRAPH-882.patch,
> We are running job with quorum of 3 zookeepers. Each serves has got long name (
Connection strings are stored to Hadoop Counters (for example:,,
but since name of counter is limited to ~63 character the connection string is trimmed (,,turin).
> 14/03/18 23:44:41 INFO zookeeper.ZooKeeper: Client
> 14/03/18 23:44:41 INFO zookeeper.ZooKeeper: Initiating client connection,,,turin
> Exception in thread "main" turin
> 	at Method)
> 	at$1.lookupAllHostAddr(
> 	at
> 	at
> 	at
> 	at
> 	at org.apache.zookeeper.client.StaticHostProvider.<init>(
> 	at org.apache.zookeeper.ZooKeeper.<init>(
> 	at org.apache.zookeeper.ZooKeeper.<init>(
> 	at org.apache.giraph.zk.ZooKeeperExt.<init>(
> 	at org.apache.giraph.job.JobProgressTracker.<init>(
> 	at

This message was sent by Atlassian JIRA

View raw message