spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Cannot Import Package (spark-csv)
Date Mon, 03 Aug 2015 04:06:43 GMT
I tried the following command on master branch:
bin/spark-shell --packages com.databricks:spark-csv_2.10:1.0.3 --jars
../spark-csv_2.10-1.0.3.jar --master local

I didn't reproduce the error with your command.

FYI

On Sun, Aug 2, 2015 at 8:57 PM, Bill Chambers <
wchambers@ischool.berkeley.edu> wrote:

> Sure the commands are:
>
> scala> val df =
> sqlContext.read.format("com.databricks.spark.csv").option("header",
> "true").load("cars.csv")
>
> and get the following error:
>
> java.lang.RuntimeException: Failed to load class for data source:
> com.databricks.spark.csv
>   at scala.sys.package$.error(package.scala:27)
>   at
> org.apache.spark.sql.sources.ResolvedDataSource$.lookupDataSource(ddl.scala:220)
>   at org.apache.spark.sql.sources.ResolvedDataSource$.apply(ddl.scala:233)
>   at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:114)
>   at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:104)
>   ... 49 elided
>
> On Sun, Aug 2, 2015 at 8:56 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>
>> The command you ran and the error you got were not visible.
>>
>> Mind sending them again ?
>>
>> Cheers
>>
>> On Sun, Aug 2, 2015 at 8:33 PM, billchambers <
>> wchambers@ischool.berkeley.edu> wrote:
>>
>>> I am trying to import the spark csv package while using the scala spark
>>> shell. Spark 1.4.1, Scala 2.11
>>>
>>> I am starting the shell with:
>>>
>>> bin/spark-shell --packages com.databricks:spark-csv_2.11:1.1.0 --jars
>>> ../sjars/spark-csv_2.11-1.1.0.jar --master local
>>>
>>>
>>> I then try and run
>>>
>>>
>>>
>>> and get the following error:
>>>
>>>
>>>
>>> What am i doing wrong?
>>>
>>>
>>>
>>> --
>>> View this message in context:
>>> http://apache-spark-user-list.1001560.n3.nabble.com/Cannot-Import-Package-spark-csv-tp24109.html
>>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>>> For additional commands, e-mail: user-help@spark.apache.org
>>>
>>>
>>
>
>
> --
> Bill Chambers
> http://billchambers.me/
> Email <wchambers@ischool.berkeley.edu> | LinkedIn
> <http://linkedin.com/in/wachambers> | Twitter
> <https://twitter.com/b_a_chambers> | Github <https://github.com/anabranch>
>

Mime
View raw message