spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jerry <jerry.c...@gmail.com>
Subject Re: What am I missing that's preventing javac from finding the libraries (CLASSPATH is setup...)?
Date Tue, 18 Aug 2015 18:21:45 GMT
So from what I understand, those usually pull dependencies for a given
project? I'm able to run the spark shell so I'd assume I have everything.
What am I missing from the big picture and what directory do I run maven on?

Thanks,
        Jerry

On Tue, Aug 18, 2015 at 11:15 AM, Ted Yu <yuzhihong@gmail.com> wrote:

> Normally people would establish maven project with Spark dependencies or,
> use sbt.
>
> Can you go with either approach ?
>
> Cheers
>
> On Tue, Aug 18, 2015 at 10:28 AM, Jerry <jerry.comp@gmail.com> wrote:
>
>> Hello,
>>
>> So I setup Spark to run on my local machine to see if I can reproduce the
>> issue I'm having with data frames, but I'm running into issues with the
>> compiler.
>>
>> Here's what I got:
>>
>> $ echo $CLASSPATH
>>
>> /usr/lib/jvm/java-6-oracle/lib:/home/adminz/dev/spark/spark-1.4.1/lib/spark-assembly-1.4.1-hadoop2.6.0.jar
>>
>>
>> javac Test.java
>> Test.java:1: package org.apache.spark.sql.api.java does not exist
>> import org.apache.spark.sql.api.java.*;
>> ^
>> Test.java:6: package org.apache.spark.sql does not exist
>> import org.apache.spark.sql.*;
>> ^
>> Test.java:7: package org.apache.spark.sql.hive does not exist
>> import org.apache.spark.sql.hive.*;
>> ....
>>
>>
>> Let me know what I'm doing wrong.
>>
>> Thanks,
>>         Jerry
>>
>
>

Mime
View raw message