flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Metzger (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-11915) DataInputViewStream skip returns wrong value
Date Thu, 14 Mar 2019 13:34:00 GMT

     [ https://issues.apache.org/jira/browse/FLINK-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Robert Metzger updated FLINK-11915:
-----------------------------------
    Component/s: Formats (JSON, Avro, Parquet, ORC, SequenceFile)

> DataInputViewStream skip returns wrong value
> --------------------------------------------
>
>                 Key: FLINK-11915
>                 URL: https://issues.apache.org/jira/browse/FLINK-11915
>             Project: Flink
>          Issue Type: Bug
>          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Runtime / Operators
>            Reporter: Andrew Prudhomme
>            Priority: Minor
>
> The flink-core:org.apache.flink.api.java.typeutils.runtime.DataInputViewStream overrides
the InputSteam skip function. This function should be returning the actual number of bytes
skipped, but there is a bug which makes it return a lower value.
> The fix should be something simple like:
> {code:java}
> -  return n - counter - inputView.skipBytes((int) counter);
> +  return n - (counter - inputView.skipBytes((int) counter));
> {code}
> For context, I ran into this when trying to decode an Avro record where the writer schema
had fields not present in the reader schema. The decoder would attempt to skip the unneeded
data in the stream, but would throw an EOFException because the return value was wrong.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message