crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chao Shi (JIRA)" <>
Subject [jira] [Created] (CRUNCH-245) hbase.zookeeper.quorum is overriden by hbase-default.xml
Date Fri, 02 Aug 2013 06:21:48 GMT
Chao Shi created CRUNCH-245:

             Summary: hbase.zookeeper.quorum is overriden by hbase-default.xml
                 Key: CRUNCH-245
             Project: Crunch
          Issue Type: Bug
          Components: IO
            Reporter: Chao Shi
            Assignee: Chao Shi

I'm using crunch-hbase on a small cluster with 4 nodes. The job complains cannot talk to ZK
at *localhost*. In fact, I specify hbase.zookeeper.quorum programmatically, but it seems it
is not passed to the job (as observed in JT's webpage).

After some investigation, I found the cause is the following code. I have no idea why addHBaseResources
is called here. Anybody knows? After comment it out, the job can read data from HBase.

  public void configureSource(Job job, int inputId) throws IOException {
    Configuration conf = job.getConfiguration();
    if (inputId == -1) {
    } else {
      Path dummy = new Path("/hbase/" + table);
      CrunchInputs.addInputPath(job, dummy, inputBundle, inputId);

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message