spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Owen <so...@cloudera.com>
Subject Re: UnknownhostException : home
Date Mon, 19 Jan 2015 09:59:42 GMT
Sorry, to be clear, you need to write "hdfs:///home/...". Note three
slashes; there is an empty host between the 2nd and 3rd. This is true
of most URI schemes with a host.

On Mon, Jan 19, 2015 at 9:56 AM, Rapelly Kartheek
<kartheek.mbms@gmail.com> wrote:
> Yes yes.. hadoop/etc/hadoop/hdfs-site.xml file has the path like:
> "hdfs://home/..."
>
> On Mon, Jan 19, 2015 at 3:21 PM, Sean Owen <sowen@cloudera.com> wrote:
>>
>> I bet somewhere you have a path like "hdfs://home/..." which would
>> suggest that 'home' is a hostname, when I imagine you mean it as a
>> root directory.
>>
>> On Mon, Jan 19, 2015 at 9:33 AM, Rapelly Kartheek
>> <kartheek.mbms@gmail.com> wrote:
>> > Hi,
>> >
>> > I get the following exception when I run my application:
>> >
>> > karthik@karthik:~/spark-1.2.0$ ./bin/spark-submit --class
>> > org.apache.spark.examples.SimpleApp001 --deploy-mode client --master
>> > spark://karthik:7077 $SPARK_HOME/examples/*/scala-*/spark-examples-*.jar
>> >>out1.txt
>> > log4j:WARN No such property [target] in org.apache.log4j.FileAppender.
>> > Exception in thread "main" java.lang.IllegalArgumentException:
>> > java.net.UnknownHostException: home
>> >     at
>> >
>> > org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:377)
>> >     at
>> >
>> > org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:237)
>> >     at
>> >
>> > org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:141)
>> >     at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:569)
>> >     at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:512)
>> >     at
>> >
>> > org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:142)
>> >     at
>> > org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2316)
>> >     at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:366)
>> >     at org.apache.spark.util.FileLogger.<init>(FileLogger.scala:90)
>> >     at
>> >
>> > org.apache.spark.scheduler.EventLoggingListener.<init>(EventLoggingListener.scala:63)
>> >     at org.apache.spark.SparkContext.<init>(SparkContext.scala:352)
>> >     at
>> > org.apache.spark.examples.SimpleApp001$.main(SimpleApp001.scala:13)
>> >     at org.apache.spark.examples.SimpleApp001.main(SimpleApp001.scala)
>> >     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >     at
>> >
>> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>> >     at
>> >
>> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> >     at java.lang.reflect.Method.invoke(Method.java:606)
>> >     at
>> > org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:358)
>> >     at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75)
>> >     at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
>> > Caused by: java.net.UnknownHostException: home
>> >     ... 20 more
>> >
>> >
>> > I couldn't trace the cause of this exception. Any help in this regard?
>> >
>> > Thanks
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message