flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ryantaocer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-12229) Implement Lazy Scheduling Strategy
Date Sun, 05 May 2019 06:24:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-12229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833241#comment-16833241

ryantaocer commented on FLINK-12229:

Maybe we could introduce a new scheduling trigger {{PROGRESS}} the percentage of which the
input result partitions have finished to schedule each downstream consumer task. This {{PROGRESS}}
parameterĀ is of rangeĀ 0~1, and 0 corrresponds to current {{ANY}} and 1 corresponds to current
{{ALL}} respectively. In practice, it can be configured to about 1 saying 0.8 to balance the
speedup advantage and possible resource deadlock.

> Implement Lazy Scheduling Strategy
> ----------------------------------
>                 Key: FLINK-12229
>                 URL: https://issues.apache.org/jira/browse/FLINK-12229
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Runtime / Coordination
>            Reporter: Gary Yao
>            Assignee: BoWang
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
> Implement a {{SchedulingStrategy}} that covers the functionality of {{ScheduleMode.LAZY_FROM_SOURCES}},
i.e., vertices are scheduled when all the input data are available.
> Acceptance Criteria:
>  * New strategy is tested in isolation using test implementations (i.e., without having
to submit a job)

This message was sent by Atlassian JIRA

View raw message