flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] wenlong88 commented on issue #6684: [FLINK-10205] Batch Job: InputSplit Fault tolerant for DataSource…
Date Wed, 17 Oct 2018 08:00:22 GMT
wenlong88 commented on issue #6684:     [FLINK-10205] Batch Job: InputSplit Fault tolerant
for DataSource…
URL: https://github.com/apache/flink/pull/6684#issuecomment-430529308
 
 
   A real use case: we implements a source function of infinite stream job which use input
format to initialize input splits (so that we can just visit the meta data of storage once)
and assign input split to every task. the input split will never finish and we need to make
sure that all of task process the same number of input split for load balance.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message