kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eduardo Costa Alfaia <e.costaalf...@unibs.it>
Subject KafkaWordCount
Date Fri, 30 Jan 2015 18:58:56 GMT
Hi Guys,

I would like to put in the kafkawordcount scala code the kafka parameter:  val kafkaParams
= Map(“fetch.message.max.bytes” -> “4000000”). I’ve put this variable like this

val KafkaDStreams = (1 to numStreams) map {_ =>                                       
                                                                                         
                 
        KafkaUtils.createStream(ssc, kafkaParams, zkQuorum, group, topicpMap).map(_._2)


However I’ve gotten these erros:

 (jssc: org.apache.spark.streaming.api.java.JavaStreamingContext,zkQuorum: String,groupId:
String,topics: jav                                                         a.util.Map[String,Integer],storageLevel:
org.apache.spark.storage.StorageLevel)org.apache.spark.streaming.api.java.Jav            
                                               aPairReceiverInputDStream[String,String] <and>
                                                                                         
                                          
[error]   (ssc: org.apache.spark.streaming.StreamingContext,zkQuorum: String,groupId: String,topics:
scala.collection.                                                             
immutable.Map[String,Int],storageLevel: org.apache.spark.storage.StorageLevel)org.apache.spark.streaming.dstream.Recei
                                                            
verInputDStream[(String, String)]    

Thanks
-- 
Informativa sulla Privacy: http://www.unibs.it/node/8155

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message