nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lewis john mcgibbney <lewis.mcgibb...@gmail.com>
Subject Re: Unresolved dependencies org.apache.gora#gora-hbase;0.1: not found in Nutch trunk
Date Tue, 09 Aug 2011 14:49:43 GMT
Hi Kirby,

I was aware that this had been a concern for sometime and was unfamiliar
with the process for nightly builds with trunk and dependencies resulting in
the Nutch trunk build consistently failing.

I thought it was to do with [1], however we still seem to be having major
problems with this.

I manually built trunk yesterday and successfully located both of the
following
org.apache.gora#gora-core;0.2-incubating
org.apache.gora#gora-sql;0.2-incubating

The two dependences above broke the latest hudson nightly build.

Can someone explain what is wrong and why we now can't build, I am
interested to find out where I could help to get this sorted out.

[1] https://issues.apache.org/jira/browse/GORA-35

On Mon, Aug 8, 2011 at 9:35 PM, Kirby Bohling <kirby.bohling@gmail.com>wrote:

> Grumble, Grumble.  (adding dev@nutch, as that is more than likely
> where this discussion really belongs)...
>
> It'd be really nice if folks could just follow the commands in the
> nightly build, and get a build pushed out.  I've pointed this out
> previously, and was told this would be fixed "shortly" (right after
> GORA-0.1 finally got released, but not published in public maven repo,
> which as far as I know, it still isn't published, but I stopped
> checking on it).
>
> As it happens, yesterday was the 1 year anniversary of the last
> successful Hudson/Jenkins build...  If that actually worked, we could
> point people towards it as a useful recipe for how to get a build
> working off trunk.  I haven't been following Nutch too closely, but it
> always strikes me as really odd, that there's a nightly build and it
> doesn't bother anybody that it fails all the time (and that there
> isn't a nightly build for the stable branches).
>
> Kirby
>
>
> On Mon, Aug 8, 2011 at 3:05 PM, lewis john mcgibbney
> <lewis.mcgibbney@gmail.com> wrote:
> > Perfect Markus thank you
> >
> > runtime:
> >    [mkdir] Created dir: /home/lewis/ASF/trunk/runtime
> >    [mkdir] Created dir: /home/lewis/ASF/trunk/runtime/local
> >    [mkdir] Created dir: /home/lewis/ASF/trunk/runtime/deploy
> >     [copy] Copying 1 file to /home/lewis/ASF/trunk/runtime/deploy
> >     [copy] Copying 1 file to /home/lewis/ASF/trunk/runtime/deploy/bin
> >     [copy] Copying 1 file to /home/lewis/ASF/trunk/runtime/local/lib
> >     [copy] Copying 1 file to
> /home/lewis/ASF/trunk/runtime/local/lib/native
> >     [copy] Copying 23 files to /home/lewis/ASF/trunk/runtime/local/conf
> >     [copy] Copying 1 file to /home/lewis/ASF/trunk/runtime/local/bin
> >     [copy] Copying 57 files to /home/lewis/ASF/trunk/runtime/local/lib
> >     [copy] Copying 97 files to
> /home/lewis/ASF/trunk/runtime/local/plugins
> >
> > BUILD SUCCESSFUL
> > Total time: 2 minutes 10 seconds
> >
> > For the record, as of writing, with the most recent builds of Gora and
> Nutch
> > e.g. Trunk in both cases, and if HBase it to be used as a data store the
> > configuration needs to be the following
> >
> > <!--
> >       Uncomment this to use HBase as Gora backend. Then manually add
> > hbase-0.20.6 jar to the lib directory.
> > -->
> >
> >       <dependency org="org.apache.gora" name="gora-hbase"
> > rev="0.1-incubating" conf="*->compile">
> >       <exclude org="com.sun.jdmk"/>
> >       <exclude org="com.sun.jmx"/>
> >       <exclude org="javax.jms"/>
> >       </dependency>
> >
> > I will add a bit on this to the wiki.
> >
> > Thank you Markus.
> >
> > On Mon, Aug 8, 2011 at 11:46 AM, Markus Jelsma
> > <markus.jelsma@openindex.io>wrote:
> >
> >> Gora trunk is not on 0.1 as Nutch' ivy points to. Use the correct
> version
> >> of
> >> Gora trunk in Nutch' ivy conf will fix this.
> >>
> >> > Hi,
> >> >
> >> > Working with a fresh svn co of Nutch trunk (co today) and Gora trunk
> >> (also
> >> > co today) I get the following error when trying to compile Nutch
> having
> >> > successfully compiled Gora.
> >> >
> >> > [ivy:resolve]     ==== local: tried
> >> > [ivy:resolve]
> >> > /home/lewis/.ivy2/local/org.apache.gora/gora-hbase/0.1/ivys/ivy.xml
> >> > [ivy:resolve]       -- artifact
> >> > org.apache.gora#gora-hbase;0.1!gora-hbase.jar:
> >> > [ivy:resolve]
> >> >
> >>
> /home/lewis/.ivy2/local/org.apache.gora/gora-hbase/0.1/jars/gora-hbase.jar
> >> > [ivy:resolve]         ::::::::::::::::::::::::::::::::::::::::::::::
> >> > [ivy:resolve]         ::          UNRESOLVED DEPENDENCIES         ::
> >> > [ivy:resolve]         ::::::::::::::::::::::::::::::::::::::::::::::
> >> > [ivy:resolve]         :: org.apache.gora#gora-hbase;0.1: not found
> >> > [ivy:resolve]         ::::::::::::::::::::::::::::::::::::::::::::::
> >> > [ivy:resolve] :::: ERRORS
> >> > [ivy:resolve]     unknown resolver maven2-local
> >> > [ivy:resolve]     unknown resolver maven2-local
> >> > [ivy:resolve]     unknown resolver maven2-local
> >> > [ivy:resolve]     unknown resolver maven2-local
> >> > [ivy:resolve]     unknown resolver maven2-local
> >> > [ivy:resolve]     unknown resolver maven2-local
> >> > [ivy:resolve]     unknown resolver maven2-local
> >> > [ivy:resolve]     unknown resolver maven2-local
> >> > [ivy:resolve]
> >> > [ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
> >> >
> >> > BUILD FAILED
> >> > /home/lewis/ASF/trunk/build.xml:458: impossible to resolve
> dependencies:
> >> >     resolve failed - see output for details
> >> >
> >> > Total time: 1 minute 32 seconds
> >> >
> >> > I am aware that can be attributed to the fact that there is no maven
> >> > artefact for automatic download therefore we need to add hbase jar
> file
> >> to
> >> > $NUTCH_HOME/lib before build. Even when this has been done I am
> getting
> >> the
> >> > above error.
> >> >
> >> > Any ideas please? I haven't had this problem in the past and sitting
> >> > puzzling here.
> >> >
> >> > Thank you
> >>
> >
> >
> >
> > --
> > *Lewis*
> >
>



-- 
*Lewis*

Mime
View raw message