spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rapelly Kartheek <kartheek.m...@gmail.com>
Subject Re: UnknownhostException : home
Date Mon, 19 Jan 2015 10:08:23 GMT
Yeah....... I made that mistake in spark/conf/spark-defaults.conf for
setting:  spark.eventLog.dir.
Now it works....

Thank you
Karthik


On Mon, Jan 19, 2015 at 3:29 PM, Sean Owen <sowen@cloudera.com> wrote:

> Sorry, to be clear, you need to write "hdfs:///home/...". Note three
> slashes; there is an empty host between the 2nd and 3rd. This is true
> of most URI schemes with a host.
>
> On Mon, Jan 19, 2015 at 9:56 AM, Rapelly Kartheek
> <kartheek.mbms@gmail.com> wrote:
> > Yes yes.. hadoop/etc/hadoop/hdfs-site.xml file has the path like:
> > "hdfs://home/..."
> >
> > On Mon, Jan 19, 2015 at 3:21 PM, Sean Owen <sowen@cloudera.com> wrote:
> >>
> >> I bet somewhere you have a path like "hdfs://home/..." which would
> >> suggest that 'home' is a hostname, when I imagine you mean it as a
> >> root directory.
> >>
> >> On Mon, Jan 19, 2015 at 9:33 AM, Rapelly Kartheek
> >> <kartheek.mbms@gmail.com> wrote:
> >> > Hi,
> >> >
> >> > I get the following exception when I run my application:
> >> >
> >> > karthik@karthik:~/spark-1.2.0$ ./bin/spark-submit --class
> >> > org.apache.spark.examples.SimpleApp001 --deploy-mode client --master
> >> > spark://karthik:7077
> $SPARK_HOME/examples/*/scala-*/spark-examples-*.jar
> >> >>out1.txt
> >> > log4j:WARN No such property [target] in org.apache.log4j.FileAppender.
> >> > Exception in thread "main" java.lang.IllegalArgumentException:
> >> > java.net.UnknownHostException: home
> >> >     at
> >> >
> >> >
> org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:377)
> >> >     at
> >> >
> >> >
> org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:237)
> >> >     at
> >> >
> >> >
> org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:141)
> >> >     at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:569)
> >> >     at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:512)
> >> >     at
> >> >
> >> >
> org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:142)
> >> >     at
> >> > org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2316)
> >> >     at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:366)
> >> >     at org.apache.spark.util.FileLogger.<init>(FileLogger.scala:90)
> >> >     at
> >> >
> >> >
> org.apache.spark.scheduler.EventLoggingListener.<init>(EventLoggingListener.scala:63)
> >> >     at org.apache.spark.SparkContext.<init>(SparkContext.scala:352)
> >> >     at
> >> > org.apache.spark.examples.SimpleApp001$.main(SimpleApp001.scala:13)
> >> >     at org.apache.spark.examples.SimpleApp001.main(SimpleApp001.scala)
> >> >     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >> >     at
> >> >
> >> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> >> >     at
> >> >
> >> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >> >     at java.lang.reflect.Method.invoke(Method.java:606)
> >> >     at
> >> > org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:358)
> >> >     at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75)
> >> >     at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> >> > Caused by: java.net.UnknownHostException: home
> >> >     ... 20 more
> >> >
> >> >
> >> > I couldn't trace the cause of this exception. Any help in this regard?
> >> >
> >> > Thanks
> >
> >
>

Mime
View raw message