flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Timo Walther (Jira)" <j...@apache.org>
Subject [jira] [Closed] (FLINK-16277) StreamTableEnvironment.toAppendStream fails with Decimal types
Date Tue, 25 May 2021 07:37:00 GMT

     [ https://issues.apache.org/jira/browse/FLINK-16277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Timo Walther closed FLINK-16277.
--------------------------------
    Resolution: Fixed

Fixed as part of FLIP-136 in FLINK-21934.

> StreamTableEnvironment.toAppendStream fails with Decimal types
> --------------------------------------------------------------
>
>                 Key: FLINK-16277
>                 URL: https://issues.apache.org/jira/browse/FLINK-16277
>             Project: Flink
>          Issue Type: Bug
>          Components: Table SQL / API
>    Affects Versions: 1.10.0
>            Reporter: Benoît Paris
>            Priority: Minor
>              Labels: auto-deprioritized-major
>         Attachments: DecimalType 38 18 Logical - stacktrace.txt, flink-test-schema-update.zip
>
>
> The following fails when there is a Decimal type in the underlying TableSource:
>  
> {code:java}
> DataStream<Row> appendStream = tEnv.toAppendStream(
>   asTable,
>   asTable.getSchema().toRowType()
> );{code}
> Yielding the following error:
>  
> ValidationException: Type ROW<`y` DECIMAL(38, 18)> of table field 'payload' does
not match with the physical type ROW<`y` LEGACY('DECIMAL', 'DECIMAL')> of the 'payload'
field of the TableSource return type
> ----
>  
> Remarks:
>  * toAppendStream is not ready for the new type system, does not accept the new DataTypes
>  * The LegacyTypeInformationType transition type hinders things. Replacing it with the
new DataTypes.DECIMAL type makes things work.
>  * flink-json is not ready for the new type system, does not give the new DataTypes
>  
> Workaround: reprocess TypeConversions.fromLegacyInfoToDataType's output to replace LegacyTypeInformationType
types when they are of DECIMAL typeroot with the new types.
>  
> Included is reproduction and workaround (activated by line 127) code, with java + pom
+ stacktrace files.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message