Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Include new models and major restructuring in util layers #154

Merged
merged 20 commits into from
Nov 11, 2024
Merged

Conversation

AnFreTh
Copy link
Collaborator

@AnFreTh AnFreTh commented Nov 11, 2024

This pull request includes several significant updates to the Mambular package, including additions to the README, new custom training examples, enhancements to the normalization layer, and new batch ensemble layers. The most important changes are summarized below:

New Models included.

  • Added new models TabM, NODE, and BatchTabRNN.

Documentation Enhancements:

  • Added descriptions for new models TabM, NODE, and BatchTabRNN in the README.md file.
  • Introduced a section on custom training in the README.md, providing an example of how to implement a custom training loop using mambular.base_models.

Code Enhancements:

  • Added support for None normalization layer in the get_norm_fn function.

New Features:

  • Implemented LinearBatchEnsembleLayer and RNNBatchEnsembleLayer classes in mambular/arch_utils/layer_utils/batch_ensemble_layer.py to support batch ensembling for linear and RNN layers.

Refactoring:

  • Refactored the EmbeddingLayer class in mambular/arch_utils/layer_utils/embedding_layer.py to use a configuration object for initialization, simplifying the constructor and making it more flexible. [1] [2]
  • Improved the forward method of the EmbeddingLayer class by adding comments for clarity and restructuring the code for better readability. [1] [2] [3] [4] [5]

@AnFreTh AnFreTh merged commit 9a236a5 into develop Nov 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant