gora-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Adhish Singla <adhish.sin...@research.iiit.ac.in>
Subject Re: Need Urgent Help with Giraph-Gora
Date Tue, 03 Oct 2017 15:28:18 GMT
Hi,

I was able to resolve the issue by adding the resources to the JAR itself. Now, I am stuck
at writing the gora-hbase-mapping.xml since my avro schema uses a nested records i.e. one
record stores another record. Kindly help me with the same.

I would like to contribute to update giraph to use the latest version of gora once I am able
to cover up with my coming deadline.

Thanks for the help.
Regards,
Adhish

----- Original Message -----
From: "lewis john mcgibbney" <lewismc@apache.org>
To: "rmarroquin" <rmarroquin@apache.org>, user@gora.apache.org
Sent: Tuesday, October 3, 2017 8:42:34 PM
Subject: Re: Need Urgent Help with Giraph-Gora

Hi Adhish,
If I were you I would just make sure the resource files are included within
the generated JAR. This way they will always be on the class path.
Can you point me to the code which is attempting to load the resource
files? Is this in Gora or Giraph?
Additionally as I stated before, make sure you are using the most recent
version of Gora and try, if you can to make the Gora update in Giraph as
well.
Lewis

On Mon, Oct 2, 2017 at 2:42 AM Adhish Singla <
adhish.singla@research.iiit.ac.in> wrote:

> Hi,
>
> As mentioned in : http://gora.apache.org/current/gora-conf.html
>
> I put the gora.properties in $HADOOP_CONF_DIR which is in the CLASSPATH,
> still the code is not able to find the file.
>
> I also tried to put the file on all the machines on the same path, still
> the same error happens.
>
> It is also not able to detect gora-hbase-mapping.xml (same way as
> gora.properties)
>
> Kindly help me with the same.
>
> Thanks,
> Adhish
>
> ----- Original Message -----
> From: "Adhish Singla" <adhish.singla@research.iiit.ac.in>
> To: "rmarroquin" <rmarroquin@apache.org>
> Cc: "Gora User" <user@gora.apache.org>
> Sent: Saturday, September 30, 2017 3:57:46 PM
> Subject: Re: Need Urgent Help with Giraph-Gora
>
> Hi Renato,
>
> Reference to :
> https://github.com/renato2099/giraph-gora/blob/master/giraph-gora/executeCompile.sh
>
> Doesn't look the files you have mentioned are on HDFS. And the only issue
> I am facing is that the code is not able to find any of the files mentioned
> under "-files" option.
>
> Regards,
> Adhish
>
> ----- Original Message -----
> From: "rmarroquin" <rmarroquin@apache.org>
> To: "Adhish Singla" <adhish.singla@research.iiit.ac.in>
> Cc: "Gora User" <user@gora.apache.org>
> Sent: Saturday, September 30, 2017 12:51:21 AM
> Subject: Re: Need Urgent Help with Giraph-Gora
>
> Hey Adhish,
>
> Just let us know how you do, and if we can continue helping you.
> I copied the mailing list just because other people might also be able to
> help :)
>
>
> Best,
>
> Renato M.
>
> 2017-09-29 17:59 GMT+02:00 Renato MarroquĂ­n Mogrovejo <
> rmarroquin@apache.org
> >:
>
> > Hi Adhish,
> >
> >
> > The files are supposed to be specified by:
> >
> >  -files hdfs://host:fs_port/user/testfile.txt
> >
> > Did you try that? And as I said you could also just put the files locally
> > in all machines (in the same location) which I think it was what you were
> > doing originally.
> > The warning is just because Gora doesn't find the files.
> >
> >
> > Best,
> >
> > Renato M.
> >
> >
> > 2017-09-29 16:48 GMT+02:00 Adhish Singla <adhish.singla@research.iiit.
> > ac.in>:
> >
> >> And it also mentions this :
> >>
> >> WARN  [main] store.DataStoreFactory
> (DataStoreFactory.java:createProps(91))
> >> - gora.properties not found, properties will be empty.
> >>
> >> ----- Original Message -----
> >> From: "Adhish Singla" <adhish.singla@research.iiit.ac.in>
> >> To: "rmarroquin" <rmarroquin@apache.org>
> >> Sent: Friday, September 29, 2017 8:16:07 PM
> >> Subject: Re: Need Urgent Help with Giraph-Gora
> >>
> >> I am using HDFS and I tried by shifting the files to HDFS. You can check
> >> the updated file.
> >>
> >> org.apache.gora.util.GoraException: java.lang.RuntimeException:
> >> java.net.MalformedURLException
> >>         at org.apache.gora.store.DataStoreFactory.createDataStore(DataS
> >> toreFactory.java:169)
> >>         at org.apache.gora.store.DataStoreFactory.createDataStore(DataS
> >> toreFactory.java:120)
> >>         at org.apache.giraph.io.gora.utils.GoraUtils.createDataStore(
> >> GoraUtils.java:63)
> >>         at org.apache.giraph.io.gora.utils.GoraUtils.createSpecificData
> >> Store(GoraUtils.java:87)
> >>         at org.apache.giraph.io.gora.GoraVertexInputFormat.createDataSt
> >> ore(GoraVertexInputFormat.java:189)
> >>         at org.apache.giraph.io.gora.GoraVertexInputFormat.checkInputSp
> >> ecs(GoraVertexInputFormat.java:118)
> >>         at org.apache.giraph.io.internal.WrappedVertexInputFormat.check
> >> InputSpecs(WrappedVertexInputFormat.java:66)
> >>         at org.apache.giraph.graph.GraphTaskManager.checkInput(GraphTas
> >> kManager.java:173)
> >>         at org.apache.giraph.graph.GraphTaskManager.setup(GraphTaskMana
> >> ger.java:210)
> >>         at org.apache.giraph.yarn.GiraphYarnTask.run(GiraphYarnTask.
> >> java:91)
> >>         at org.apache.giraph.yarn.GiraphYarnTask.main(GiraphYarnTask.
> >> java:183)
> >> Caused by: java.lang.RuntimeException: java.net.MalformedURLException
> >>         at org.apache.gora.hbase.store.HBaseStore.initialize(HBaseStore
> >> .java:133)
> >>         at org.apache.gora.store.DataStoreFactory.initializeDataStore(D
> >> ataStoreFactory.java:104)
> >>         at org.apache.gora.store.DataStoreFactory.createDataStore(DataS
> >> toreFactory.java:163)
> >>         ... 10 more
> >> Caused by: java.net.MalformedURLException
> >>         at java.net.URL.<init>(URL.java:619)
> >>         at java.net.URL.<init>(URL.java:482)
> >>         at java.net.URL.<init>(URL.java:431)
> >>         at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.set
> >> upCurrentEntity(XMLEntityManager.java:616)
> >>         at com.sun.org.apache.xerces.internal.impl.XMLVersionDetector.d
> >> etermineDocVersion(XMLVersionDetector.java:189)
> >>         at com.sun.org.apache.xerces.internal.parsers.XML11Configuratio
> >> n.parse(XML11Configuration.java:812)
> >>         at com.sun.org.apache.xerces.internal.parsers.XML11Configuratio
> >> n.parse(XML11Configuration.java:777)
> >>         at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(
> >> XMLParser.java:141)
> >>         at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser
> >> .parse(AbstractSAXParser.java:1213)
> >>         at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSA
> >> XParser.parse(SAXParserImpl.java:648)
> >>         at org.jdom.input.SAXBuilder.build(SAXBuilder.java:518)
> >>         at org.jdom.input.SAXBuilder.build(SAXBuilder.java:865)
> >>         at org.apache.gora.hbase.store.HBaseStore.readMapping(HBaseStor
> >> e.java:730)
> >>         at org.apache.gora.hbase.store.HBaseStore.initialize(HBaseStore
> >> .java:116)
> >>         ... 12 more
> >> Caused by: java.lang.NullPointerException
> >>         at java.net.URL.<init>(URL.java:524)
> >>         ... 25 more
> >>
> >> This is the complete error trace that i get.
> >>
> >> Regards,
> >> Adhish
> >>
> >>
> >> ----- Original Message -----
> >> From: "rmarroquin" <rmarroquin@apache.org>
> >> To: "Adhish Singla" <adhish.singla@research.iiit.ac.in>
> >> Sent: Friday, September 29, 2017 6:30:01 PM
> >> Subject: Re: Need Urgent Help with Giraph-Gora
> >>
> >> Hi Adhish,
> >>
> >> Could you please post the actual error you are seeing? Are you sure that
> >> the files are inside HDFS?
> >> Take a look at this:
> >> https://hadoop.apache.org/docs/r1.2.1/streaming.html#Making+
> >> Files+Available+to+Tasks
> >>
> >> The other thing you can try is just putting the files in all machines in
> >> the same location if you are not using HDFS.
> >> Hope it helps,
> >>
> >> Renato M.
> >>
> >> 2017-09-29 12:14 GMT+02:00 Adhish Singla <adhish.singla@research.iiit.a
> >> c.in>
> >> :
> >>
> >> > Hi,
> >> >
> >> > I am a Giraph User and need some help with setting Giraph-Gora on AWS
> >> EMR.
> >> > I have attached the script using which i try to run the code. But the
> >> code
> >> > is not able to detect the files mentioned in "-files" option.
> >> >
> >> > Kindly help me with the same.
> >> >
> >> > Thanks and regards,
> >> > Adhish
> >>
> >
> >
>
-- 
http://home.apache.org/~lewismc/
@hectorMcSpector
http://www.linkedin.com/in/lmcgibbney

Mime
View raw message