mxnet-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Da Zheng (JIRA)" <>
Subject [jira] [Created] (MXNET-910) Multithreading inference.
Date Fri, 07 Sep 2018 17:42:00 GMT
Da Zheng created MXNET-910:

             Summary: Multithreading inference.
                 Key: MXNET-910
             Project: Apache MXNet
          Issue Type: Improvement
            Reporter: Da Zheng

MXNet Executor isn't thread-safe and thus the predictor is also not thread-safe. However,
there is a use case that we want to parallel inference of the same model with multiple threads.
In this case, we need to create multiple executors that share the same weight arrays. The
current C predict API doesn't support this. As such, we add a new API to create multiple predictors
for parallel inference and show the use of this new API in the example of image classification.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message