flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ryantaocer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-12229) Implement Lazy Scheduling Strategy
Date Sun, 05 May 2019 06:24:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-12229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833241#comment-16833241
] 

ryantaocer commented on FLINK-12229:
------------------------------------

Maybe we could introduce a new scheduling trigger {{PROGRESS}} the percentage of which the
input result partitions have finished to schedule each downstream consumer task. This {{PROGRESS}}
parameterĀ is of rangeĀ 0~1, and 0 corrresponds to current {{ANY}} and 1 corresponds to current
{{ALL}} respectively. In practice, it can be configured to about 1 saying 0.8 to balance the
speedup advantage and possible resource deadlock.

> Implement Lazy Scheduling Strategy
> ----------------------------------
>
>                 Key: FLINK-12229
>                 URL: https://issues.apache.org/jira/browse/FLINK-12229
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Runtime / Coordination
>            Reporter: Gary Yao
>            Assignee: BoWang
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Implement a {{SchedulingStrategy}} that covers the functionality of {{ScheduleMode.LAZY_FROM_SOURCES}},
i.e., vertices are scheduled when all the input data are available.
> Acceptance Criteria:
>  * New strategy is tested in isolation using test implementations (i.e., without having
to submit a job)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message