Skip to content

Commit

Permalink
Update training_rules.adoc
Browse files Browse the repository at this point in the history
  • Loading branch information
petermattson authored Jun 4, 2020
1 parent c02c78c commit b4db551
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion training_rules.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -240,7 +240,7 @@ OPEN: The benchmark implementation may use a different model.
CLOSED: Each of the current frameworks has a graph that describes the operations performed during the forward propagation of training. The frameworks automatically infer and execute the corresponding back-propagation computations from this graph. Benchmark implementations must use the same graph as the reference implementation.

=== Weight and Bias Initialization
CLOSED: Weights and biases must be initialized using the same constant or random value distribution as the reference implementation. For a benchmark that starts from pretrained weights, the weights should be initialized either directly from the provided weights, via a conversion process to convert from the provided weights into an alternate format, or via a training procedure that is demonstrated to produce statistically identical weights as those provided.
CLOSED: Weights and biases must be initialized using the same constant or random value distribution as the reference implementation, unless a pre-trained set of weights, such as a checkpoint or backbone, is used by the reference.

OPEN: Weights and biases must be initialized using a consistent constant or random value distribution.

Expand Down

0 comments on commit b4db551

Please sign in to comment.