-
Notifications
You must be signed in to change notification settings - Fork 4.3k
CNTK Evaluate Multiple Models
IMPORTANT! Before reading further you may want to get familiar with the naming scheme of CNTK Shared Library files.
##Overview
The CNTK evaluation library (Cntk.Eval
and its .Net wrapper Cntk.Eval.Wrapper
in Windows and libCntk.Eval
in Linux) enables programmatic evaluation of a CNTK model, using a single thread for evaluation. In other words, multiple-concurrent evaluations of a single model instance are not supported.
However, it is possible to load multiple instances of a model and evaluate each model with a single thread. This enables multiple models to be evaluated in parallel, yet each model with a single thread.
##Example
Refer to the EvaluateMultipleModels
method in the CSEvalClient program for an example of a possible implementation for evaluating multiple models concurrently.