The Jenkins seems to have had a reboot (or something of this nature) around Christmas. I need to be honest and say that I don't know the source of the problem.
Saying that, Hadoop (and other technologies) can also be a funny bugger sometimes when it comes to security, proxy, inet addresses. We've witnessed this a good few times over in Gora where HBase/Hadoop servers fail to initiate due to intermittent proxy settings/problems... I don't know enough about the code to provide a definitive answer.
For the time being, I am happy to progress with integrating tests and minor tickets into Nutch, however I think we really ought to sort the source or this stack trace regardless of the fact it is on Jenkins.
Maybe we should head over to hadoop general?
I thought I would let this thread stew a while before pouncing on it again.
These test cases pass on my machine (i guess on yours' too). Had it been related to Hadoop API then tests must fail everywhere. What is different about the setup where the nightly builds are executed ?
Thanks,Tejas PatilOn Mon, Jan 7, 2013 at 3:24 PM, Lewis John Mcgibbney <email@example.com> wrote:
An update to this issue then...
The failing tests indicate an addition (security?) feature which makes the tests fail on Jenkins as it results in the following stack traces for the following tests
Same every time.
Currently I am not sure how we can work around this, however I suspect that we need to use some other aspect of the Hadoop API in all calls to obtain socket addresses from servers.
Any ideas?java.net.UnknownHostException: -s: -s at java.net.InetAddress.getLocalHost(InetAddress.java:1354) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:912) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1136) at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:912) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:886) at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1323) at org.apache.nutch.crawl.Generator.generate(Generator.java:551) at org.apache.nutch.crawl.Generator.generate(Generator.java:465) at org.apache.nutch.crawl.TestGenerator.generateFetchlist(TestGenerator.java:313) at org.apache.nutch.crawl.TestGenerator.testFilter(TestGenerator.java:259)