spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tal Grynbaum <tal.grynb...@gmail.com>
Subject Re: difference between package and jar Option in Spark
Date Mon, 05 Sep 2016 04:12:19 GMT
You need to download all the dependencies of that jar as well

On Mon, Sep 5, 2016, 06:59 Divya Gehlot <divya.htconex@gmail.com> wrote:

> Hi,
> I am using spark-csv to parse my input files .
> If I use --package option it works fine but if I download
> <https://mvnrepository.com/artifact/com.databricks/spark-csv_2.10/1.4.0>
> the jar and use --jars option
> Its throwing Class not found exception.
>
>
> Thanks,
> Divya
>
> On 1 September 2016 at 17:26, Sean Owen <sowen@cloudera.com> wrote:
>
>> --jars includes a local JAR file in the application's classpath.
>> --package references Maven coordinates of a dependency and retrieves
>> and includes all of those JAR files, and includes them in the app
>> classpath.
>>
>> On Thu, Sep 1, 2016 at 10:24 AM, Divya Gehlot <divya.htconex@gmail.com>
>> wrote:
>> > Hi,
>> >
>> > Would like to know the difference between the --package and --jars
>> option in
>> > Spark .
>> >
>> >
>> >
>> > Thanks,
>> > Divya
>>
>
>

Mime
View raw message