kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Damian Guy <damian....@gmail.com>
Subject Re: kafka 0.10.1 ProcessorTopologyTestDriver issue with .map and .groupByKey.count
Date Thu, 24 Nov 2016 12:41:42 GMT
Hi Hamid,

Out of interest - what are the results if you use KStreamTestDriver?

Thanks,
Damian

On Thu, 24 Nov 2016 at 12:05 Hamidreza Afzali <
hamidreza.afzali@hivestreaming.com> wrote:

> The map() returns non-null keys and values and produces the following
> stream:
>
> [KSTREAM-MAP-0000000001]: A , 1
> [KSTREAM-MAP-0000000001]: A , 2
> [KSTREAM-MAP-0000000001]: B , 3
>
> The issue arises when the combination of map() and groupByKey().count() is
> used with ProcessorTopologyTestDriver.
>
> I have tried the topology on a local Kafka and got the expected result:
>
> input: <"A-1", 1>, <"A-2", 2>, <"B-1", 3>
> result: <"A":2>, <"B":1>.
>
>
> Thanks,
> Hamid
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message