spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sourav Mazumder <sourav.mazumde...@gmail.com>
Subject Creating RDD using swebhdfs with truststore
Date Sat, 03 Sep 2016 21:31:34 GMT
Hi,

I am trying to create a RDD by using swebhdfs to a remote hadoop cluster
which is protected by Knox and uses SSL.

The code looks like this -

sc.textFile("swebhdfs:/host:port/gateway/default/webhdfs/v1/<file-path>").count.

I'm passing the truststore and trustorepassword through extra java options
while starting the spark shell as -

spark-shell --conf
"spark.executor.extraJavaOptions=-Djavax.net.ssl.trustStore=truststor.jks
-Djavax.net.ssl.trustStorePassword=<password>" --conf
"spark.driver.extraJavaOptions=-Djavax.net.ssl.trustStore=truststore.jks
-Djavax.net.ssl.trustStorePassword=<password>"

But I'm always getting the error that -

Name: javax.net.ssl.SSLHandshakeException
Message: Remote host closed connection during handshake

Am I passing the truststore and truststore password in right way ?

Regards,

Sourav

Mime
View raw message