flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Metzger (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-12410) KafkaTopicPartition cannot be used as a POJO type because not all fields are valid POJO fields
Date Wed, 08 May 2019 07:12:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-12410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16835384#comment-16835384
] 

Robert Metzger commented on FLINK-12410:
----------------------------------------

Are you sure that you want to serialize a KafkaTopicPartition type to the topic?
If so, I would recommend not relying on internal classes of Flink to do so.

I've changed the priority of the ticket until we've fully understood the issue.

> KafkaTopicPartition cannot be used as a POJO type because not all fields are valid POJO
fields
> ----------------------------------------------------------------------------------------------
>
>                 Key: FLINK-12410
>                 URL: https://issues.apache.org/jira/browse/FLINK-12410
>             Project: Flink
>          Issue Type: Bug
>          Components: Connectors / Kafka
>    Affects Versions: 1.8.0
>            Reporter: Chethan U
>            Priority: Blocker
>
> While Pushing data to Kafka Topic using Pojo, there is an error: "INFO org.apache.flink.api.java.typeutils.TypeExtractor
- Class class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition cannot
be used as a POJO type because not all fields are valid POJO fields, and must be processed
as GenericType"
> {code:java}
> // code placeholder
> 09:18:27,633 INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
does not contain a setter for field topic
> 09:18:27,634 INFO org.apache.flink.api.java.typeutils.TypeExtractor - Class class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed
as GenericType. Please read the Flink documentation on "Data Types & Serialization" for
details of the effect on performance.
> 09:18:27,633 INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
does not contain a setter for field topic
> 09:18:27,635 INFO org.apache.flink.api.java.typeutils.TypeExtractor - Class class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed
as GenericType. Please read the Flink documentation on "Data Types & Serialization" for
details of the effect on performance.
> 09:18:27,635 INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
does not contain a setter for field topic
> 09:18:27,636 INFO org.apache.flink.api.java.typeutils.TypeExtractor - Class class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed
as GenericType. Please read the Flink documentation on "Data Types & Serialization" for
details of the effect on performance.
> 09:18:27,639 INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
does not contain a setter for field topic
> 09:18:27,642 INFO org.apache.flink.api.java.typeutils.TypeExtractor - Class class org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartition
cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed
as GenericType. Please read the Flink documentation on "Data Types & Serialization" for
details of the effect on performance.
> 09:18:27,654 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase
- No restore state for FlinkKafkaConsumer.
> 09:18:27,655 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase
- No restore state for FlinkKafkaConsumer.
> 09:18:27,655 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase
- No restore state for FlinkKafkaConsumer.
> 09:18:27,654 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase
- No restore state for FlinkKafkaConsumer.
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message