flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephan Ewen (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-3084) File State Backend should not write very small state into files
Date Thu, 26 Nov 2015 16:23:11 GMT
Stephan Ewen created FLINK-3084:
-----------------------------------

             Summary: File State Backend should not write very small state into files
                 Key: FLINK-3084
                 URL: https://issues.apache.org/jira/browse/FLINK-3084
             Project: Flink
          Issue Type: Improvement
          Components: Streaming
    Affects Versions: 0.10.0
            Reporter: Stephan Ewen
            Assignee: Stephan Ewen
             Fix For: 1.0.0


Currently, the {{FsStateBackend}} writes all state into files. Some state (like Kafka Offsets)
is so small that it adds unnecessary overhead, and sometimes the checkpointed file handles
are larger than the actual state.

Small state (below a certain threshold, say 1 KB) should not be stored in files, but directly
in the state handles.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message