flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Timo Walther (Jira)" <j...@apache.org>
Subject [jira] [Closed] (FLINK-12979) Sending data to kafka with CsvRowSerializationSchema always adding a "\n", "\r","\r\n" at the end of the message
Date Wed, 16 Oct 2019 14:47:00 GMT

     [ https://issues.apache.org/jira/browse/FLINK-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Timo Walther closed FLINK-12979.
--------------------------------
    Fix Version/s: 1.10.0
       Resolution: Fixed

Fixed in 1.10.0: ff249bce3dd4ef61518fb1e647e31e8f85640b61

> Sending data to kafka with CsvRowSerializationSchema always adding a "\n", "\r","\r\n"
at the end of the message
> ----------------------------------------------------------------------------------------------------------------
>
>                 Key: FLINK-12979
>                 URL: https://issues.apache.org/jira/browse/FLINK-12979
>             Project: Flink
>          Issue Type: Bug
>          Components: API / Type Serialization System
>    Affects Versions: 1.8.0, 1.8.1, 1.8.2, 1.9.0, 2.0.0
>            Reporter: chaiyongqiang
>            Assignee: Hugo Da Cruz Louro
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.10.0
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> When sending data to kafka using CsvRowSerializationSchema, the CsvRowSerializationSchema#serialize
method helps generating value for KafkaRecord,  which will call  CsvEncoder#endRow and in
which  a _cfgLineSeparator will be added at the end of KafkaRecord.value.
> But For  CsvRowSerializationSchema#Builder , when you calling the mothod setLineDelimiter
only "\n","\r","\r\n" could be used as the parameter.  
> It's not friendly when you want to send a message "123,pingpong,21:00" to kafka but kafka
receives a message  "123,pingpong,21:00\r\n".
> I'm not sure about the reason for limitting the lineDelimiter to "\n","\r","\r\n" ?
In previous version and jackson-databind, there's no limits on lineDelimiter. 
> But at least it should let the application developer to set LineDelimiter with "".



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message