mxnet-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Denisa Roberts (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MXNET-1274) Add a test for SGLD optimizer
Date Wed, 02 Jan 2019 22:09:00 GMT

     [ https://issues.apache.org/jira/browse/MXNET-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Denisa Roberts updated MXNET-1274:
----------------------------------
    Description: 
The SGLD optimizer adds random Gaussian noise to the weights updates. If no seed is set, every
update of the optimizer will produce different noise. In cases where you would like to be
able to replicate the updates (research studies, tests), setting a seed to control the noise
generation is useful. 

 

Test is added for the SGLD optimizer considering the noise replication.

 

  was:
The SGLD optimizer adds random Gaussian noise to the weights updates. If no seed is set, every
update of the optimizer will produce different noise. In cases where you would like to be
able to replicate the updates (research studies, tests), setting a seed to control the noise
generation is useful. 

 

Test is added for the SGLD optimizer considering the noise replication.

 

A comment is added to the SGLD docstring about noise replication.


> Add a test for SGLD optimizer
> -----------------------------
>
>                 Key: MXNET-1274
>                 URL: https://issues.apache.org/jira/browse/MXNET-1274
>             Project: Apache MXNet
>          Issue Type: Improvement
>            Reporter: Denisa Roberts
>            Priority: Minor
>          Time Spent: 1h 50m
>  Remaining Estimate: 0h
>
> The SGLD optimizer adds random Gaussian noise to the weights updates. If no seed is set,
every update of the optimizer will produce different noise. In cases where you would like
to be able to replicate the updates (research studies, tests), setting a seed to control the
noise generation is useful. 
>  
> Test is added for the SGLD optimizer considering the noise replication.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org


Mime
View raw message