gora-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Henry Saputra <henry.sapu...@gmail.com>
Subject File access error stack about DFS directory from running unit tests
Date Sun, 29 Sep 2013 00:05:23 GMT
Hi Guys,

I am seeing some file access error in the console log when running the
unit tests, I assume this is coming from MapReduce test case:

Starting DataNode 0 with dfs.data.dir:
/home/hsaputra/open/gora/trunk/gora-core/target/test-data/dfs/data/data1,/home/hsaputra/open/gora/trunk/gora-core/target/test-data/dfs/data/data2
13/09/27 23:28:03 WARN impl.MetricsSystemImpl: Metrics system not
started: Cannot locate configuration: tried
hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
13/09/27 23:28:04 WARN datanode.DataNode: Invalid directory in
dfs.data.dir: Incorrect permission for
/home/hsaputra/open/gora/trunk/gora-core/target/test-data/dfs/data/data1,
expected: rwxr-xr-x, while actual: rwxrwxr-x
13/09/27 23:28:04 WARN datanode.DataNode: Invalid directory in
dfs.data.dir: Incorrect permission for
/home/hsaputra/open/gora/trunk/gora-core/target/test-data/dfs/data/data2,
expected: rwxr-xr-x, while actual: rwxrwxr-x
13/09/27 23:28:04 ERROR datanode.DataNode: All directories in
dfs.data.dir are invalid.
12910 [main] ERROR
org.apache.gora.mapreduce.DataStoreMapReduceTestBase - Hadoop Test
Case set up failed
java.lang.NullPointerException
  at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:422)
    at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:280)
      at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
        at org.apache.hadoop.mapred.HadoopTestCase.setUp(HadoopTestCase.java:148)
          at org.apache.gora.mapreduce.DataStoreMapReduceTestBase.setUp(DataStoreMapReduceTestBase.java:61)
            at junit.framework.TestCase.runBare(TestCase.java:132)
              at junit.framework.TestResult$1.protect(TestResult.java:110)
                at junit.framework.TestResult.runProtected(TestResult.java:128)
                  at junit.framework.TestResult.run(TestResult.java:113)
                    at junit.framework.TestCase.run(TestCase.java:124)
                      at junit.framework.TestSuite.runTest(TestSuite.java:243)
                        at junit.framework.TestSuite.run(TestSuite.java:238)


Anyone know where do we set conf for the mapreduce test case and where
does Gora create the dfs.data.dir directory for the DFS to setup?

- Henry

Mime
View raw message