Code

Version 0.2.1#106

Code

Merged

AnFreTh merged 69 commits intomasterbasf/mamba-tabular:masterfrom developbasf/mamba-tabular:developCopy head branch name to clipboardAug 13, 2024

+2,801-862

Commits

Commits on Jul 15, 2024

• adapt configs to better default models

  AnFreTh

  committed
  823763b

• include ReGLU activation

  AnFreTh

  committed
  3004241

• include ReGLU in Ft-Transformer

  AnFreTh

  committed
  a9f5e4c

• include cls token at end of sequence

  AnFreTh

  committed
  c3d4c01

• include ReGLU in TabTransformer

  AnFreTh

  committed
  fcb17c1

• remove unecessary code

  AnFreTh

  committed
  5f0608c

• Merge pull request #75 from basf/models

  Show description for e16ba03
  AnFreTh

  authored
  e16ba03

• add build_model and get_num_params methods

  AnFreTh

  committed
  e7ca3a2

• Merge pull request #78 from basf/models

  Show description for 3f482fa
  AnFreTh

  authored
  3f482fa

• add learnable ple encodings

  AnFreTh

  committed
  dc4c313

• add rotary embeddings and attention_net utils

  AnFreTh

  committed
  f6aa9ac

• add mambatab, rotaryft and rnn configs

  AnFreTh

  committed
  04101f9

• adapt mambatab config to paper hparams

  AnFreTh

  committed
  fe40c47

• include RNN and MambaTab

  AnFreTh

  committed
  30d35e4

• add mambatab, rnn, rotery and basisexpandFT to init

  AnFreTh

  committed
  21b0afb

• include basemodel basisexpansion

  AnFreTh

  committed
  8b19f92

• adding util embedding alyer for decluttering

  AnFreTh

  committed
  bad3db6

• adapted embedding layer for when no cat features

  AnFreTh

  committed
  a2c3e71

• adapted mambular, FT and TabTransformer for new embedding layer class

  AnFreTh

  committed
  5f15d5f

• included possible embeddings into MLP and ResNet

  AnFreTh

  committed
  fa8cc00

• adapted configs of models

  AnFreTh

  committed
  6efc326

• adapt documentation to new configs

  AnFreTh

  committed
  ae0bf97

• add missing line in MLP

  AnFreTh

  committed
  6be79d1

Commits on Jul 16, 2024

• added seq len to emebedding layer

  AnFreTh

  committed
  3d840b9

• added shuffling embeddings before being passed to mamba blocks

  AnFreTh

  committed
  ae84257

• shuffle embeddings option in config

  AnFreTh

  committed
  e1f5c40

• shuffling along second axis

  AnFreTh

  committed
  8af86a2

• add .built attr to model classed

  AnFreTh

  committed
  2029700

Commits on Jul 17, 2024

• delete expansion

  AnFreTh

  committed
  c7459c4

• delete basis expansion

  AnFreTh

  committed
  96e9449

• delete self.paper attribute from mambatab

  AnFreTh

  committed
  864d4f0

• adapt build model func

  AnFreTh

  committed
  d636b28

• adapt build_method

  AnFreTh

  committed
  5a5a7cd

Commits on Jul 25, 2024

• fix label shape for lss regression

  AnFreTh

  committed
  b246d5c

• Merge pull request #83 from basf/lss_fix

  Show description for 6da2cf8
  AnFreTh

  authored
  6da2cf8

• self.model.parameters instead of self.parameters in optimizer

  AnFreTh

  committed
  257acfb

• depth=2 for summary and self.trainer attribute

  AnFreTh

  committed
  be1879d

• Merge pull request #84 from basf/trainer_fix

  Show description for b16af74
  AnFreTh

  authored
  b16af74

• fixed set and get_params functinoality

  AnFreTh

  committed
  bd941d2

• Merge pull request #85 from basf/param_fix

  Show description for cc92798
  AnFreTh

  authored
  cc92798

Commits on Jul 26, 2024

• add embedding layer and delete unused models

  AnFreTh

  committed
  283a10b

• Merge branch 'develop' into layer_improvement

  AnFreTh

  authored
  19b760c

• Merge pull request #90 from basf/layer_improvement

  Show description for 56801dd
  AnFreTh

  authored
  56801dd

Commits on Aug 2, 2024

• adding AB layernorm and weight decay to Mamba

  AnFreTh

  committed
  22dad68

• Merge pull request #97 from basf/AB_layer

  Show description for 0d4442a
  AnFreTh

  authored
  0d4442a

• adjust names of matrices

  AnFreTh

  committed
  7c2d343

• Merge pull request #98 from basf/AB_layer

  Show description for 8933cf7
  AnFreTh

  authored
  8933cf7

Commits on Aug 5, 2024

• adding one-hot encoding to embedding_layer

  AnFreTh

  committed
  029c6d8

• adding option to one-hot encode cat features in embedding layer

  AnFreTh

  committed
  d413fd8

• adjusting configs

  AnFreTh

  committed
  07164f5

• renaming sklearn class attributes

  AnFreTh

  committed
  71cc68e

• adjusting class attribute in lightning wrapper

  AnFreTh

  committed
  53b77c5

• adjusting config docstrings

  AnFreTh

  committed
  4f6b088

• adjusting docstrings for documentation

  AnFreTh

  committed
  71f35e6

• Merge pull request #99 from basf/minor_fix

  Show description for e6b90dc
  AnFreTh

  authored
  e6b90dc

• adjusting docstrings for true defaults

  AnFreTh

  committed
  5703d3b

• Merge pull request #100 from basf/fastfix

  Show description for a996e6e
  AnFreTh

  authored
  a996e6e

• adding score function to lss models

  AnFreTh

  committed
  16e18f4

• Merge pull request #101 from basf/lss_crossval

  Show description for 91ab62c
  AnFreTh

  authored
  91ab62c

Commits on Aug 12, 2024

• include tabularRNN

  AnFreTh

  committed
  43d2758

• Merge pull request #102 from basf/rnn_branch

  Show description for 330c1a0
  AnFreTh

  authored
  330c1a0

Commits on Aug 13, 2024

• adapt readme and include citation

  AnFreTh

  committed
  08a8797

• adjust readme with results

  AnFreTh

  committed
  545af38

• remove colored text in readme

  AnFreTh

  committed
  bd690bc

• Merge pull request #103 from basf/doc-adaption

  Show description for 2c653be
  AnFreTh

  authored
  2c653be

• new version

  AnFreTh

  committed
  a0775af

• Merge pull request #104 from basf/version_adaption

  Show description for 6949f26
  AnFreTh

  authored
  6949f26

• deleting old paper.pdf

  AnFreTh

  committed
  f466b80

• Merge pull request #105 from basf/version_adaption

  Show description for a383411
  AnFreTh

  authored
  a383411