spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Akhil Das <ak...@sigmoidanalytics.com>
Subject Re: KafkaUtils and specifying a specific partition
Date Fri, 13 Mar 2015 06:40:52 GMT
Here's a simple consumer which does that
https://github.com/dibbhatt/kafka-spark-consumer/

Thanks
Best Regards

On Thu, Mar 12, 2015 at 10:28 PM, ColinMc <colin.mcqueen@shiftenergy.com>
wrote:

> Hi,
>
> How do you use KafkaUtils to specify a specific partition? I'm writing
> customer Marathon jobs where a customer is given 1 partition in a topic in
> Kafka. The job will get the partition from our database for that customer
> and use that to get the messages for that customer.
>
> I misinterpreted KafkaUtils when creating the stream and didn't know that
> it
> was the number of partitions per topic in the map.
>
> If KafkaUtils doesn't support this, is there another Spark API call for
> Kafka that supports this?
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/KafkaUtils-and-specifying-a-specific-partition-tp22018.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>

Mime
View raw message