Task: Classification
Dataset: Fation MNIST
- Relu
- Tanh
- Sigmoid
- ELU
Activation function | Optimizer | Accuracy on test set | Loss |
---|---|---|---|
Relu | SGD | 0.87 | 0.33 |
Tanh | SGD | 0.65 | 0.83 |
ELU | SGD | 0.87 | 0.36 |
Sigmoid | SGD | 0.77 | 0.63 |
- Adam
- Nadam
- RMSprop
Activation function | Optimizer | Accuracy on test set | Loss |
---|---|---|---|
Relu | SGD | 0.86 | 0.33 |
Relu | Adam | 0.87 | 0.51 |
Relu | RMSprop | 0.87 | 0.67 |
Relu | Nadam | 0.84 | 0.52 |