Skip to content

Commit

Permalink
some cleanup (#2503)
Browse files Browse the repository at this point in the history
* cleanup

* fix doctest

add tests

finish RNNCell

RNN rework

LSTMCell

LSTM

more work

gru

extended testing

runtests
  • Loading branch information
CarloLucibello committed Oct 21, 2024
1 parent 0360155 commit ac766de
Show file tree
Hide file tree
Showing 15 changed files with 961 additions and 686 deletions.
4 changes: 2 additions & 2 deletions docs/src/tutorials/logistic_regression.md
Original file line number Diff line number Diff line change
Expand Up @@ -140,8 +140,8 @@ Note, all the `flux_*` variables in this tutorial would be general, that is, the
julia> flux_model = Chain(Dense(4 => 3), softmax)
Chain(
Dense(4 => 3), # 15 parameters
NNlib.softmax,
)
softmax,
)
```

A [`Dense(4 => 3)`](@ref Dense) layer denotes a layer with four inputs (four features in every data point) and three outputs (three classes or labels). This layer is the same as the mathematical model defined by us above. Under the hood, Flux too calculates the output using the same expression, but we don't have to initialize the parameters ourselves this time, instead Flux does it for us.
Expand Down
1 change: 1 addition & 0 deletions src/Flux.jl
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,7 @@ Optimisers.base(dx::Zygote.Grads) = error("Optimisers.jl cannot be used with Zyg

export Chain, Dense, Embedding, EmbeddingBag,
Maxout, SkipConnection, Parallel, PairwiseFusion,
RNNCell, LSTMCell, GRUCell, GRUv3Cell,
RNN, LSTM, GRU, GRUv3,
SamePad, Conv, CrossCor, ConvTranspose, DepthwiseConv,
AdaptiveMaxPool, AdaptiveMeanPool, GlobalMaxPool, GlobalMeanPool, MaxPool, MeanPool,
Expand Down
Loading

0 comments on commit ac766de

Please sign in to comment.