storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias J. Sax" <mj...@apache.org>
Subject Re: Storm writes sequentially numbers in kafka-topic
Date Fri, 10 Feb 2017 19:10:33 GMT
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

This question got cross posted on SO:
http://stackoverflow.com/questions/42143838/apache-storm-writes-sequenti
ally-numbers-in-kafka-topic



On 2/10/17 1:39 AM, Gutwein, Sebastian wrote:
> Hi,
> 
> I want to do some performance tests with kafka and storm. In my 
> word-count-test a sequentially number is arriving in the 
> "output"-topic:
> 
> uLK 1 1352 GaE 1 1353 IGF 1 1354 DtJ 2 1355 MVy 1 ...
> 
> It should be look like:
> 
> uLK 1 GaE 1 IGF 1 DtJ 2 MVy 1 ...
> 
> I used the official word-count example of the 
> strom-starter-projekt. My storm-topology looks like follows:
> 
> builder.setSpout("kafkaSpoutPerfTest", kafkaSpout, 1);
> 
> builder.setBolt("split", new SplitSentence(), 
> paralellismHint).shuffleGrouping("kafkaSpoutPerfTest"); 
> builder.setBolt("count", new WordCount(), 
> paralellismHint).fieldsGrouping("split", new Fields("message"));
> 
> Properties props =3D new Properties(); 
> props.put("bootstrap.servers", "localhost:9092");
> props.put("acks", "0"); 
> props.put("key.serializer","org.apache.kafka.common.serialization.Stri
ngSerializer");
>
>
> 
props.put("value.serializer","org.apache.kafka.common.serialization.Stri
ngSerializer");
> 
> KafkaBolt kafkaBolt =3D new KafkaBolt() 
> .withProducerProperties(props) .withTopicSelector(new 
> DefaultTopicSelector("output"));
> 
> builder.setBolt("kafkaBoltOutput", kafkaBolt, 
> 1).shuffleGrouping("count");
> 
> What am I doing wrong? Has somewone a clue? Thanks!
> 
> 
> Regards, S. Gutwein
> 
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org

iQIYBAEBCgAGBQJYnhApAAoJELz8Z8hxAGOiU2UP4JTc4OfL5mFH4WCc2H7GyaXr
23PI8zC2EplkXFFzW4WHvu5Q+Fv2KDdc3kkKFCXwSDwbKo1PMCWqjBezZaOcmxjs
zisu+cYOnfrUiuCZks3dc4KCPson8L/hMwPb2i/t5z6krSZGYgidpTt8EOoQjFky
bS2jSkiz5EipDdywEjawdtfM3i6Zt4MIUNaxnxLhm5cWJEXQi7QqKBlMr5HvRhqO
mksaBStnD9EdBOCaPT/AD+xtSxoRAnXNvk+TlHRuF3S3mSmyRY/qOieUu7NLYT3m
JWc4J/hz82oUAMCboJsykxBtYDgQ4OXPVAs7esrZU0AYGHymlEIPd0XUmzpneXCG
LyWJYeR0GieG1Z11mEGuoDDMZwdaJ0Ch8J/qmqoVbUurhhxLbphg6vKRxFJKVHmu
8bcWm84e9tGTTxLCYv5L+UQ+sUKLW/ekHn3gSuN/aJcsazlvoK/b1A6XfkkNz/hX
XtgSVsQPL3LSV5QgSHsXQUKYZqgRSum5/NK0bJljMNOV+Lk7I4JY2sJcGbYs9j8H
bCUrq7O6mDXaDfCsYqAoF3+GLZmOFaUlgBzxisnTKEfQ4kbVfMMjRByEN3wiaNDm
/A5rdg9mj/Ph/LbE/QCC/XMPkdoUNVWkvZr8zxrCaRhcjF8n02a4t22JD1TxCTMw
XhmSB56DXyguk9A=
=nHjC
-----END PGP SIGNATURE-----

Mime
View raw message