spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Reth RM <reth.ik...@gmail.com>
Subject Exception: JDK-8154035 using Whole text files api
Date Wed, 05 Jul 2017 19:46:38 GMT
Hi,

   Using sc.wholeTextFiles to read warc file (example file here
<http://www.lemurproject.org/clueweb09/sampleFiles.php>). Spark reporting
an error with stack trace pasted here : https://pastebin.com/qfmM2eKk

Looks like its same as bug reported here:
https://bugs.openjdk.java.net/browse/JDK-8154035
Thoughts?

And could you please suggest work around solutions other than reading those
files(warc) using java FileInputStream apis?


Thanks.

Mime
View raw message