kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From BYEONG-GI KIM <bg...@bluedigm.com>
Subject Re: Kafka 0.9 producer doesn't work
Date Thu, 21 Jan 2016 03:54:41 GMT
Yes, I opened the kafka-server/zookeeper ports of firewalld.

And I finally noticed what was wrong; I didn't set "advertised.host.name"
property in config/server.properties file... It should be set to the IP of
the VM where the kafka server and zookeeper is running. After I put the IP
of the VM in the property the source code worked very well from my host.

Anyway, thanks indeed for a lot of helps!

Best regards

Kim

2016-01-21 11:48 GMT+09:00 Steve Tian <steve.cs.tian@gmail.com>:

> Have you checked the firewall setting on vm/host?
>
>
> On Thu, Jan 21, 2016, 10:29 AM BYEONG-GI KIM <bgkim@bluedigm.com> wrote:
>
>> Hello.
>>
>> I packaged it to an executable jar file and executed it on the VM, and
>> yes, it was successfully worked.
>>
>> I'm really confuse why it didn't work on my Windows10 environment where
>> is on the host environment and worked well on the VM environment... It is
>> weird indeed.
>>
>> Best regards
>>
>> Kim
>>
>> 2016-01-20 18:14 GMT+09:00 Steve Tian <steve.cs.tian@gmail.com>:
>>
>>> Your code works in my environment.  Are you able to run your producer
>>> code inside your vm?  You can also debug via changing the log level to
>>> DEGUG/TRACE.
>>>
>>> Cheers, Steve
>>>
>>>
>>> On Wed, Jan 20, 2016, 4:30 PM BYEONG-GI KIM <bgkim@bluedigm.com> wrote:
>>>
>>>> Sure, I started consumer before starting and sending messages from
>>>> producer, and my broker version, if you mean the kafka version, is 0.9.0.
>>>>
>>>> Best regards
>>>>
>>>> Kim
>>>>
>>>> 2016-01-20 17:28 GMT+09:00 Steve Tian <steve.cs.tian@gmail.com>:
>>>>
>>>>> Did you start your consumer before sending message?  Broker version?
>>>>>
>>>>> Cheers, Steve
>>>>>
>>>>> On Wed, Jan 20, 2016, 3:57 PM BYEONG-GI KIM <bgkim@bluedigm.com>
>>>>> wrote:
>>>>>
>>>>> > Hello.
>>>>> >
>>>>> > I set up the Kafka testbed environment on my VirtualBox, which
>>>>> simply has a
>>>>> > Kafka broker.
>>>>> >
>>>>> > I tested the simple consumer & producer scripts, aka
>>>>> > kafka-console-consumer.sh and bin/kafka-console-producer.sh
>>>>> respectively,
>>>>> > and both of them worked fine. I could see the output from the
>>>>> consumer side
>>>>> > whenever typing any words on the producer.
>>>>> >
>>>>> > After that, I moved to test a simple java kafka producer/consumer.
I
>>>>> copied
>>>>> > and pasted the example source code for producer from
>>>>> >
>>>>> >
>>>>> http://kafka.apache.org/090/javadoc/index.html?org/apache/kafka/clients/producer/KafkaProducer.html
>>>>> > ,
>>>>> > and yeah, unfortunately, it seems not working well; no output was
>>>>> printed
>>>>> > by the above consumer script. There was even no error log on Eclipse.
>>>>> >
>>>>> > I really don't know what the problem is... I think that the
>>>>> properties for
>>>>> > both zookeeper and kafka seems fine, since the example scripts
>>>>> worked well,
>>>>> > at least.
>>>>> >
>>>>> > I attached my tested source code:
>>>>> >
>>>>> ======================================================================
>>>>> >  import java.util.Properties;
>>>>> >
>>>>> > import org.apache.kafka.clients.producer.KafkaProducer;
>>>>> > import org.apache.kafka.clients.producer.Producer;
>>>>> > import org.apache.kafka.clients.producer.ProducerRecord;
>>>>> > import org.apache.kafka.common.KafkaException;
>>>>> > import org.apache.kafka.common.errors.TimeoutException;
>>>>> >
>>>>> > public class ProducerExample {
>>>>> > public static void main(String[] args) throws Exception,
>>>>> TimeoutException,
>>>>> > KafkaException {
>>>>> > Properties props = new Properties();
>>>>> > props.put("bootstrap.servers", "10.10.0.40:9092");
>>>>> > props.put("acks", "all");
>>>>> > props.put("retries", 0);
>>>>> > props.put("batch.size", 16384);
>>>>> > // props.put("linger.ms", 1);
>>>>> > props.put("buffer.memory", 33554432);
>>>>> > props.put("key.serializer",
>>>>> > "org.apache.kafka.common.serialization.StringSerializer");
>>>>> > props.put("value.serializer",
>>>>> > "org.apache.kafka.common.serialization.StringSerializer");
>>>>> >
>>>>> > Producer<String, String> producer = new KafkaProducer<String,
>>>>> > String>(props);
>>>>> >
>>>>> > try {
>>>>> > for (int i = 0; i < 10; i++) {
>>>>> > producer.send(new ProducerRecord<String, String>("test", 0,
>>>>> > Integer.toString(i), Integer.toString(i)));
>>>>> > }
>>>>> > } catch (TimeoutException te) {
>>>>> > System.out.println(te.getStackTrace());
>>>>> > te.getStackTrace();
>>>>> > } catch (Exception ke) {
>>>>> > System.out.println(ke.getStackTrace());
>>>>> > ke.getStackTrace();
>>>>> > }
>>>>> >
>>>>> > producer.close();
>>>>> > }
>>>>> > }
>>>>> >
>>>>> ======================================================================
>>>>> >
>>>>> > Any advice would really be helpful. Thanks in advance.
>>>>> >
>>>>> > Best regards
>>>>> >
>>>>> > Kim
>>>>> >
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> (주)비디 클라우드사업부 와이즈본부 클라우드기술팀 선임
>>>>
>>>
>>
>>
>> --
>> (주)비디 클라우드사업부 와이즈본부 클라우드기술팀 선임
>>
>


-- 
(주)비디 클라우드사업부 와이즈본부 클라우드기술팀 선임

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message