AttributeError: 'module' object has no attribute 'SumSquare'

[kohillyang]

When I tried to use sync Batchnorm (only one gpu beacuse I failed to use multi-gpu by DataParallelCriterion ), I failed because it tells me "AttributeError: 'module' object has no attribute 'SumSquare'"

  File "/data1/zyx/yks/sources/gluon-cv/gluoncv/utils/parallel.py", line 53, in __call__
  File "/data1/zyx/yks/sources/incubator-mxnet/python/mxnet/gluon/block.py", line 414, in __call__
    return self.forward(*args)
  File "/data1/zyx/yks/sources/incubator-mxnet/python/mxnet/gluon/block.py", line 620, in forward
    return self._call_cached_op(x, *args)
  File "/data1/zyx/yks/sources/incubator-mxnet/python/mxnet/gluon/block.py", line 525, in _call_cached_op
    self._build_cache(*args)
  File "/data1/zyx/yks/sources/incubator-mxnet/python/mxnet/gluon/block.py", line 481, in _build_cache
    inputs, out = self._get_graph(*args)
  File "/data1/zyx/yks/sources/incubator-mxnet/python/mxnet/gluon/block.py", line 473, in _get_graph
    out = self.hybrid_forward(symbol, *grouped_inputs, **params)  # pylint: disable=no-value-for-parameter
  File "/data1/zyx/yks/resnet38w/models/drn_gcn.py", line 97, in hybrid_forward
    fm0 = self.layer0(x)  # 256
  File "/data1/zyx/yks/sources/incubator-mxnet/python/mxnet/gluon/block.py", line 414, in __call__
    return self.forward(*args)
  File "/data1/zyx/yks/sources/incubator-mxnet/python/mxnet/gluon/block.py", line 637, in forward
    return self.hybrid_forward(symbol, x, *args, **params)
  File "/data1/zyx/yks/sources/incubator-mxnet/python/mxnet/gluon/nn/basic_layers.py", line 117, in hybrid_forward
    x = block(x)
  File "/data1/zyx/yks/sources/incubator-mxnet/python/mxnet/gluon/block.py", line 414, in __call__
    return self.forward(*args)
  File "/data1/zyx/yks/sources/incubator-mxnet/python/mxnet/gluon/block.py", line 637, in forward
    return self.hybrid_forward(symbol, x, *args, **params)
  File "/data1/zyx/yks/sources/gluon-cv/gluoncv/model_zoo/syncbn.py", line 117, in hybrid_forward
AttributeError: 'module' object has no attribute 'SumSquare'

And here's the code for training:

            with ag.record():
                outputs =  net(data)
                losses = criterion(outputs,target,mask)
                mx.nd.waitall()
                ag.backward(losses)

[zhanghang1989]

If you would like to try Sync BatchNorm, please follow the instruction here https://github.com/zhanghang1989/MXNet-Gluon-SyncBN to compile a different branch of MXNet

[zhanghang1989]

The Synchronized Batch Normalization will be available shortly. Currently in PR apache/mxnet#11502