flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "mingleizhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-3387) Replace all ByteArrayOutputStream and DataOutputStream use in State Backends by DataOutputSerializer
Date Mon, 12 Jun 2017 08:33:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16046328#comment-16046328
] 

mingleizhang commented on FLINK-3387:
-------------------------------------

I checked the class {{HeapListState}} currently still use {{ByteArrayOutputStream}} as it's
serializer. Not VERY sure about the {{SavepointSerializer}} interface and it's concret implementation
classes {{SavepointV0Serializer}} , {{SavepointV1Serializer}} and {{SavepointV2Serializer}}
whether belongs to state backends or not. I guess it should be though. [~srichter] [~StephanEwen].
Could you take a look at them and check if I have missing about those stuff which still use
{{ByteArrayOutputStream}} or {{DataOutputStream}}. It would be great helpful and thanks to
you both.

> Replace all ByteArrayOutputStream and DataOutputStream use in State Backends by DataOutputSerializer
> ----------------------------------------------------------------------------------------------------
>
>                 Key: FLINK-3387
>                 URL: https://issues.apache.org/jira/browse/FLINK-3387
>             Project: Flink
>          Issue Type: Bug
>          Components: State Backends, Checkpointing
>    Affects Versions: 1.0.0
>            Reporter: Stephan Ewen
>            Assignee: Subhobrata Dey
>
> Currently, the {{byte[]}} to object conversion and vice versa is always done by creating
new byte array streams and Data Input/Output streams. That is pretty wasteful, we can optimize
this with Flink's own classes:
>   - {{DataInputSerializer}}
>   - {{DataOutputSerializer}}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message