giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Edunov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-1094) Fix TestHBaseRootMarkerVertextFormat.testHBaseInputOutput
Date Wed, 14 Sep 2016 17:28:20 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15490985#comment-15490985
] 

Sergey Edunov commented on GIRAPH-1094:
---------------------------------------

According to hbase docs, hadoop 1x is only compatible with Hbase 0.94:
https://hbase.apache.org/book.html#hadoop

And hbase 0.94 is not compatible with our version of guava. 

Seems like we need to update hbase, but that will also mean we need to remove hbase support
from hadoop_1 profile. 
I'm not sure how many users of hadoop_1 we have and how many of them care about hbase. 
This issue has been blocking the release for quite a while now, so I'll make an upgrade and
remove support for hbase in hadoop_1 profile if there are no explicit objections by the end
of this week. 


> Fix TestHBaseRootMarkerVertextFormat.testHBaseInputOutput
> ---------------------------------------------------------
>
>                 Key: GIRAPH-1094
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-1094
>             Project: Giraph
>          Issue Type: Bug
>    Affects Versions: 1.2.0
>            Reporter: Sergey Edunov
>            Assignee: Roman Shaposhnik
>
> This test case seems to fail because of a missing dependency. 
> 16/07/13 22:31:50 ERROR master.MasterFileSystem: bootstrap
> org.apache.hadoop.hbase.DroppedSnapshotException: region: -ROOT-,,0
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1684)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1552)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1047)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:995)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:960)
> 	at org.apache.hadoop.hbase.master.MasterFileSystem.bootstrap(MasterFileSystem.java:523)
> 	at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:463)
> 	at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:148)
> 	at org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:133)
> 	at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:573)
> 	at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:432)
> 	at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NoClassDefFoundError: com/google/common/io/NullOutputStream
> 	at org.apache.hadoop.hbase.io.hfile.HFileWriterV2.close(HFileWriterV2.java:375)
> 	at org.apache.hadoop.hbase.regionserver.StoreFile$Writer.close(StoreFile.java:1330)
> 	at org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:913)
> 	at org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:794)
> 	at org.apache.hadoop.hbase.regionserver.Store$StoreFlusherImpl.flushCache(Store.java:2429)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1659)
> Full log can be found here:
> https://builds.apache.org/job/Giraph-1.2/5/MVN_PROFILE=hadoop_1,jdk=JDK%201.7%20(latest),label=ubuntu/testReport/junit/org.apache.giraph.io.hbase/TestHBaseRootMarkerVertextFormat/testHBaseInputOutput/



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message