gora-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Udesh Liyanaarachchi <la.udesh1...@gmail.com>
Subject Re: File access error stack about DFS directory from running unit tests
Date Fri, 04 Oct 2013 04:59:30 GMT
Hi Henry ,

Yes I had this issue in Ubuntu 11.10 ,
I couldn't find a work around , what I did was simply run the maven
commands with high privilege mode.
Might be a issue with the Hadoop Job permission.

Regards,
Udesh


On Thu, Oct 3, 2013 at 9:17 AM, Henry Saputra <henry.saputra@gmail.com>wrote:

> Thanks Lewis
>
> I did not have time to repro today but was repro pretty easily the
> last time. The funny thing is that the final test report shows not
> fail and the sample app tutorial app works fine too.
>
> I am just curious about why the file permission error shows up from
> map reduce test.
>
> - Henry
>
> On Wed, Oct 2, 2013 at 5:24 PM, Lewis John Mcgibbney
> <lewis.mcgibbney@gmail.com> wrote:
> > Hi Henry,
> >
> > Are you still getting this?
> > IIRC Udesh was having a similar problem whilst running the tests locally.
> > This became a major problem for him.
> > I on the other hand could not reproduce this at the time.
> > I can't look in to it until next week.... which is not much help I agree.
> > Anyone else out there that can help here?
> >
> > On Mon, Sep 30, 2013 at 1:52 PM, <dev-digest-help@gora.apache.org>
> wrote:
> >
> >>
> >>
> >> Hi Guys,
> >>
> >> I am seeing some file access error in the console log when running the
> >> unit tests, I assume this is coming from MapReduce test case:
> >>
> >> Starting DataNode 0 with dfs.data.dir:
> >>
> >>
> /home/hsaputra/open/gora/trunk/gora-core/target/test-data/dfs/data/data1,/home/hsaputra/open/gora/trunk/gora-core/target/test-data/dfs/data/data2
> >> ...
> >>
> > snip
> >
> >
> >> 13/09/27 23:28:04 ERROR datanode.DataNode: All directories in
> >> dfs.data.dir are invalid.
> >> 12910 [main] ERROR
> >> org.apache.gora.mapreduce.DataStoreMapReduceTestBase - Hadoop Test
> >> Case set up failed
> >> java.lang.NullPointerException
> >>
> >>
> >> Anyone know where do we set conf for the mapreduce test case and where
> >> does Gora create the dfs.data.dir directory for the DFS to setup?
> >>
> >>
>



-- 
*
**Udesh Liyanaarachchi*
B.sc. Eng (Undergraduate)
Department of Computer Science & Engineering
University Of Moratuwa
Sri Lanka.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message