Hi,

I am trying to create a RDD by using swebhdfs to a remote hadoop cluster which is protected by Knox and uses SSL.

The code looks like this -

sc.textFile("swebhdfs:/host:port/gateway/default/webhdfs/v1/<file-path>").count.

I'm passing the truststore and trustorepassword through extra java options while starting the spark shell as -

spark-shell --conf "spark.executor.extraJavaOptions=-Djavax.net.ssl.trustStore=truststor.jks -Djavax.net.ssl.trustStorePassword=<password>" --conf "spark.driver.extraJavaOptions=-Djavax.net.ssl.trustStore=truststore.jks -Djavax.net.ssl.trustStorePassword=<password>"

But I'm always getting the error that -

Name: javax.net.ssl.SSLHandshakeException
Message: Remote host closed connection during handshake

Am I passing the truststore and truststore password in right way ?

Regards,

Sourav