mxnet-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anand J (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MXNET-1294) Priority-based parameter propagation for improved data parallel training throughput
Date Thu, 10 Jan 2019 22:17:00 GMT

     [ https://issues.apache.org/jira/browse/MXNET-1294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Anand J updated MXNET-1294:
---------------------------
    Description: 
This improvement is based on the ideas proposed in this SysML 2019 paper: [https://anandj.in/wp-content/uploads/sysml.pdf]

The key idea is, in a data parallel training scenario, synchronize parameters of each layer
as packets of finer granularity based on its priority (defined by the layer index). This way
of parameter synchronization provides better network utilization and thus improve the training
throughput.

  was:This improvement is based on the ideas proposed in this SysML 2019 paper: https://anandj.in/wp-content/uploads/sysml.pdf


> Priority-based parameter propagation for improved data parallel training throughput
> -----------------------------------------------------------------------------------
>
>                 Key: MXNET-1294
>                 URL: https://issues.apache.org/jira/browse/MXNET-1294
>             Project: Apache MXNet
>          Issue Type: Improvement
>          Components: Apache MXNet Backend
>            Reporter: Anand J
>            Priority: Major
>
> This improvement is based on the ideas proposed in this SysML 2019 paper: [https://anandj.in/wp-content/uploads/sysml.pdf]
> The key idea is, in a data parallel training scenario, synchronize parameters of each
layer as packets of finer granularity based on its priority (defined by the layer index).
This way of parameter synchronization provides better network utilization and thus improve
the training throughput.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org


Mime
View raw message