How to train on more than one gpus?

[minglii1998]

Even if I set the CUDA_VISIBLE_DEVICES as 0,1,2,3 , still this code can only run on the first gpu.
I added the nn.DataParallel function by myself, but here comes AssertionError when testing.
Thus I wonder if this model can be trained on two or mare gpus naturally, or it just because my wrong operation.
Thanks a lot.

[Wang-Tianwei]

Sorry, I haven't tried multi-gpu training. But it seems to be a common issue...