Skip to content

smohammadi96/Neural_network_project

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 

Repository files navigation

Neural_network_project

Task: Classification

Dataset: Fation MNIST

Experiment 1: Change activation function

  • Relu

Relu

  • Tanh

Tanh

  • Sigmoid

Sigmoid

  • ELU

ELU

Activation function Optimizer Accuracy on test set Loss
Relu SGD 0.87 0.33
Tanh SGD 0.65 0.83
ELU SGD 0.87 0.36
Sigmoid SGD 0.77 0.63

Experiment 2: change Optimizer

  • Adam

adam

  • Nadam

nadam

  • RMSprop

rmsprop

Activation function Optimizer Accuracy on test set Loss
Relu SGD 0.86 0.33
Relu Adam 0.87 0.51
Relu RMSprop 0.87 0.67
Relu Nadam 0.84 0.52

Experiment 3: change layers and neurons number

layers

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published