beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ismaël Mejía (JIRA) <j...@apache.org>
Subject [jira] [Updated] (BEAM-2085) Transforms could give hints to runners on resource requirements
Date Wed, 31 Jan 2018 08:33:00 GMT

     [ https://issues.apache.org/jira/browse/BEAM-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ismaël Mejía updated BEAM-2085:
-------------------------------
    Summary: Transforms could give hints to runners on resource requirements  (was: DoFn could
give hints to runners on resource requirements)

> Transforms could give hints to runners on resource requirements
> ---------------------------------------------------------------
>
>                 Key: BEAM-2085
>                 URL: https://issues.apache.org/jira/browse/BEAM-2085
>             Project: Beam
>          Issue Type: Improvement
>          Components: beam-model, runner-core, sdk-java-core
>    Affects Versions: Not applicable
>            Reporter: Ismaël Mejía
>            Assignee: Ismaël Mejía
>            Priority: Major
>
> As discussed in BEAM-673 runners can allocate workers to accomplish their work in a better
way if they can take into account some hints from the transforms, e.g. a source can hint data
locality and with this information the runner can allocate the workers in an better way, this
can also be the case with a particular transform that can suggest to the runner to be executed
in a worker with a specific resource, e.g. GPU.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message