flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] Myasuka commented on issue #7281: [FLINK-11107][state] Avoid memory stateBackend to create arbitrary folders under HA path when no checkpoint path configured
Date Fri, 14 Dec 2018 04:22:07 GMT
Myasuka commented on issue #7281: [FLINK-11107][state] Avoid memory stateBackend to create
arbitrary folders under HA path when no checkpoint path configured
URL: https://github.com/apache/flink/pull/7281#issuecomment-447208854
 
 
   @klion26 Hmm, I think it's not the same thing, even you could clean up checkpoint directories
after job finished/failed in time, you cannot avoid running jobs to create so many directories
(one operator with one memory state-backend, and one state-backend would create an unique
directory). If several really big jobs are running, which created too many sub-directories
under HA storage directory, new submitted job might also cannot create those new sub-directories.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message