Hello. I am a developer who is working with hadoop 2.5.1.
I tried to build crunch 0.11.0 with hbase 0.99.0, but it failed with
following messages:
[ERROR]
/home/dongjinleekr/workspace/hadoop/crunch/crunch-hbase/src/main/java/org/apache/crunch/io/hbase/HFileInputFormat.java:[133,32]
error: cannot find symbol
[ERROR]
location: class KeyValue
/home/dongjinleekr/workspace/hadoop/crunch/crunch-hbase/src/main/java/org/apache/crunch/io/hbase/HFileInputFormat.java:[146,33]
error: incompatible types
[ERROR] required: KeyValue
found: Cell
/home/dongjinleekr/workspace/hadoop/crunch/crunch-hbase/src/main/java/org/apache/crunch/io/hbase/HFileReaderFactory.java:[60,37]
error: incompatible types
[ERROR] required: KeyValue
found: Cell
/home/dongjinleekr/workspace/hadoop/crunch/crunch-hbase/src/main/java/org/apache/crunch/io/hbase/HFileReaderFactory.java:[73,36]
error: incompatible types
[ERROR] required: KeyValue
found: Cell
/home/dongjinleekr/workspace/hadoop/crunch/crunch-hbase/src/main/java/org/apache/crunch/io/hbase/HFileUtils.java:[422,28]
error: cannot find symbol
[INFO] 5 errors
I found that this problem occurs by following issue:
https://issues.apache.org/jira/browse/HBASE-11805 By this update, KeyValue
class was replaced with Cell interface. It seems to have been fixed.
If there is any problem, I would like to take the work. However, I have one
question: Is there any plan to apply conditional compilation to Crunch,
like Giraph? It uses maven munge plugin to achieve this[^1]. If there is, I
think munge plugin and symbols should be applied first.
Any guidance would be truly appreciated.
Thanks in advance.
[^1]: I already fixed giraph's compilation error problem, which occurs with
hadoop 2.5.x. (https://issues.apache.org/jira/browse/GIRAPH-947)
--
*Dongjin Lee*
*Oracle Server Technologies Group.So interested in massive-scale machine
learning.facebook: www.facebook.com/dongjin.lee.kr
<http://www.facebook.com/dongjin.lee.kr>linkedin:
kr.linkedin.com/in/dongjinleekr
<http://kr.linkedin.com/in/dongjinleekr>github:
<http://goog_969573159>github.com/dongjinleekr
<http://github.com/dongjinleekr>twitter: www.twitter.com/dongjinleekr
<http://www.twitter.com/dongjinleekr>*
|