flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [flink] zhuzhurk opened a new pull request #8158: [FLINK-12131][runtime] Adjust IntermediateResult/IntermediateResultPartition status properly…
Date Fri, 12 Apr 2019 09:58:19 GMT
zhuzhurk opened a new pull request #8158: [FLINK-12131][runtime] Adjust IntermediateResult/IntermediateResultPartition
status properly…
URL: https://github.com/apache/flink/pull/8158
 
 
   … on ExecutionVertex reset
   
   ## What is the purpose of the change
   
   *This pull request fixes issue that IntermediateResult/IntermediateResultPartition status
is not properly set region failover, which may lead to unexpected scheduling behaviors and
global failovers. More details can be found in the JIRA.*
   
   
   ## Brief change log
   
     - *The ExecutionJobVertex does not reset IntermediateResult directly, but asks its ExecutionVertex(es)
to reset their IntermediateResultPartitions*
     - *Resetting a BLOCKING IntermediateResultPartitions increases the numberOfRunningProducers
of IntermediateResult if the partition is finished*
   
   
   ## Verifying this change
   
   
   This change added tests and can be verified as follows:
   
     - *Refined existing cases in IntermediateResultPartitionTest to verify the resetting
is working as expected*
     - *Added one test case in FailoverRegionTest to verify that the status are correct after
region failovers*
   
   ## Does this pull request potentially affect one of the following parts:
   
     - Dependencies (does it add or upgrade a dependency): (no)
     - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: (no)
     - The serializers: (no)
     - The runtime per-record code paths (performance sensitive): (no)
     - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing,
Yarn/Mesos, ZooKeeper: (yes)
     - The S3 file system connector: (no)
   
   ## Documentation
   
     - Does this pull request introduce a new feature? (no)
     - If yes, how is the feature documented? (not documented)
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message