spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jeff saremi <>
Subject Re: Multiple Sources found for csv
Date Tue, 12 Sep 2017 22:44:41 GMT
sorry just found this which answers my question:


Spark 2.0 CSV Error<>
I am upgrading to spark 2 from 1.6 and am having an issue reading in CSV files. In spark 1.6
I would have something like this to read in a CSV file. val df ="com.databricks...

From: jeff saremi <>
Sent: Tuesday, September 12, 2017 3:38:00 PM
Subject: Multiple Sources found for csv

I have this line which works in the spark interactive console but it fails in Intellij

Using Spark 2.1.1 in both cases:

Exception in thread "main" java.lang.RuntimeException: Multiple sources found for csv (org.apache.spark.sql.execution.datasources.csv.CSVFileFormat,
com.databricks.spark.csv.DefaultSource15), please specify the fully qualified class name.


val ie8df ="mode","dropmalformed").option("sep",

View raw message