spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Akhil Das <ak...@sigmoidanalytics.com>
Subject Re: Can's create Kafka stream in spark shell
Date Tue, 14 Oct 2014 07:05:07 GMT
Just make sure you have the same version of spark-streaming-kafka
<http://mvnrepository.com/artifact/org.apache.spark/spark-streaming-kafka_2.10>
jar and spark in your classpath.

Thanks
Best Regards

On Tue, Oct 14, 2014 at 9:02 AM, Gary Zhao <garyzhao@gmail.com> wrote:

> Hello
>
> I'm trying to connect kafka in spark shell, but failed as below. Could you
> take a look what I missed.
>
> scala>  val kafkaStream = KafkaUtils.createStream(ssc,
> "test-vip.snc1:2181", "test_spark", Map("user-test"->1))
> error: bad symbolic reference. A signature in KafkaUtils.class refers to
> term serializer
> in value kafka which is not available.
> It may be completely missing from the current classpath, or the version on
> the classpath might be incompatible with the version used when compiling
> KafkaUtils.class.
>
> Thanks
> Gary
>

Mime
View raw message