Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Version 0.2.1 #106

Merged
merged 69 commits into from
Aug 13, 2024
Merged

Version 0.2.1 #106

merged 69 commits into from
Aug 13, 2024

Conversation

AnFreTh
Copy link
Collaborator

@AnFreTh AnFreTh commented Aug 13, 2024

  • Adapting Embedding Layers
  • Adapting AB matrices in Mamba
  • More hyperparameters for all models
  • score functinoality for sklearn base classes
  • Adjusting Readme to published paper
  • Include results in markdown
  • Including TabulaRNN
  • Including MambaTab

AnFreTh and others added 30 commits July 15, 2024 10:44
@AnFreTh
adapt configs to better default models
823763b
@AnFreTh
include ReGLU activation
3004241
@AnFreTh
include ReGLU in Ft-Transformer
a9f5e4c
@AnFreTh
include cls token at end of sequence
c3d4c01
@AnFreTh
include ReGLU in TabTransformer
fcb17c1
@AnFreTh
remove unecessary code
5f0608c
@AnFreTh
Merge pull request #75 from basf/models
e16ba03 
Models
@AnFreTh
add build_model and get_num_params methods
e7ca3a2
@AnFreTh
Merge pull request #78 from basf/models
3f482fa 
add build_model and get_num_params methods
@AnFreTh
add learnable ple encodings
dc4c313
@AnFreTh
add rotary embeddings and attention_net utils
f6aa9ac
@AnFreTh
add mambatab, rotaryft and rnn configs
04101f9
@AnFreTh
adapt mambatab config to paper hparams
fe40c47
@AnFreTh
include RNN and MambaTab
30d35e4
@AnFreTh
add mambatab, rnn, rotery and basisexpandFT to init
21b0afb
@AnFreTh
include basemodel basisexpansion
8b19f92
@AnFreTh
adding util embedding alyer for decluttering
bad3db6
@AnFreTh
adapted embedding layer for when no cat features
a2c3e71
@AnFreTh
adapted mambular, FT and TabTransformer for new embedding layer class
5f15d5f
@AnFreTh
included possible embeddings into MLP and ResNet
fa8cc00
@AnFreTh
adapted configs of models
6efc326
@AnFreTh
adapt documentation to new configs
ae0bf97
@AnFreTh
add missing line in MLP
6be79d1
@AnFreTh
added seq len to emebedding layer
3d840b9
@AnFreTh
added shuffling embeddings before being passed to mamba blocks
ae84257
@AnFreTh
shuffle embeddings option in config
e1f5c40
@AnFreTh
shuffling along second axis
8af86a2
@AnFreTh
add .built attr to model classed
2029700
@AnFreTh
delete expansion
c7459c4
@AnFreTh
delete basis expansion
96e9449
AnFreTh and others added 29 commits July 26, 2024 11:00
@AnFreTh
add embedding layer and delete unused models
283a10b
@AnFreTh
Merge branch 'develop' into layer_improvement
19b760c
@AnFreTh
Merge pull request #90 from basf/layer_improvement
56801dd 
Layer improvement
@AnFreTh
adding AB layernorm and weight decay to Mamba
22dad68
@AnFreTh
Merge pull request #97 from basf/AB_layer
0d4442a 
adding AB layernorm and weight decay to Mamba
@AnFreTh
adjust names of matrices
7c2d343
@AnFreTh
Merge pull request #98 from basf/AB_layer
8933cf7 
adjust names of matrices
@AnFreTh
adding one-hot encoding to embedding_layer
029c6d8
@AnFreTh
adding option to one-hot encode cat features in embedding layer
d413fd8
@AnFreTh
adjusting configs
07164f5
@AnFreTh
renaming sklearn class attributes
71cc68e
@AnFreTh
adjusting class attribute in lightning wrapper
53b77c5
@AnFreTh
adjusting config docstrings
4f6b088
@AnFreTh
adjusting docstrings for documentation
71f35e6
@AnFreTh
Merge pull request #99 from basf/minor_fix
e6b90dc 
Minor fix
@AnFreTh
adjusting docstrings for true defaults
5703d3b
@AnFreTh
Merge pull request #100 from basf/fastfix
a996e6e 
adjusting docstrings for true defaults
@AnFreTh
adding score function to lss models
16e18f4
@AnFreTh
Merge pull request #101 from basf/lss_crossval
91ab62c 
adding score function to lss models
@AnFreTh
include tabularRNN
43d2758
@AnFreTh
Merge pull request #102 from basf/rnn_branch
330c1a0 
include tabularRNN
@AnFreTh
adapt readme and include citation
08a8797
@AnFreTh
adjust readme with results
545af38
@AnFreTh
remove colored text in readme
bd690bc
@AnFreTh
Merge pull request #103 from basf/doc-adaption
2c653be 
Doc adaption
@AnFreTh
new version
a0775af
@AnFreTh
Merge pull request #104 from basf/version_adaption
6949f26 
new version
@AnFreTh
deleting old paper.pdf
f466b80
@AnFreTh
Merge pull request #105 from basf/version_adaption
a383411 
deleting old paper.pdf
@AnFreTh AnFreTh merged commit dad9a12 into master Aug 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@AnFreTh