layer-normalization

Here are 18 public repositories matching this topic...

zzw922cn / Automatic_Speech_Recognition

End-to-end Automatic Speech Recognition for Madarian and English in Tensorflow

audio deep-learning tensorflow paper end-to-end evaluation cnn lstm speech-recognition rnn automatic-speech-recognition feature-vector data-preprocessing phonemes timit-dataset layer-normalization rnn-encoder-decoder chinese-speech-recognition

Updated Mar 24, 2023
Python

pbhatia243 / tf-layer-norm

Star

TensorFlow implementation of normalizations such as Layer Normalization, HyperNetworks.

tensorflow hyper-networks layer-normalization

Updated Oct 4, 2016
Python

TatevKaren / BabyGPT-Build_GPT_From_Scratch

Star

BabyGPT: Build Your Own GPT Large Language Model from Scratch Pre-Training Generative Transformer Models: Building GPT from Scratch with a Step-by-Step Guide to Generative AI in PyTorch and Python

python transformers pytorch neural-networks gpt layer-normalization attention-is-all-you-need multi-head-self-attention gpt-3 dropout-layers residual-connections large-language-models llms llm-training

Updated Dec 5, 2023
Python

tech-srl / layer_norm_expressivity_role

Star

Code for the paper "On the Expressivity Role of LayerNorm in Transformers' Attention" (Findings of ACL'2023)

transformers attention layer-normalization layernorm

Updated Sep 27, 2024
Python

CyberZHG / torch-layer-normalization

Star

Layer normalization in PyTorch

pytorch regularization normalization layer-normalization

Updated Jun 6, 2020
Python

exe1023 / LSTM_LN

Star

lstm with layer normalization

pytorch lstm layer-normalization

Updated Mar 12, 2021
Python

venusdev85 / Speech-Recognition

Star

End-to-end Automatic Speech Recognition for Madarian and English in Tensorflow

audio deep-learning tensorflow end-to-end cnn lstm speech-recognition rnn feature-vector data-processing phonemes timit-dataset layer-normalization rnn-encoder-decoder

Updated Mar 29, 2018
Python

jacobdeasy / flexible-ehr

Star

Time-Sensitive Deep Learning for ICU Outcome Prediction Without Variable Selection or Cleaning.

deep-learning reproducible-research pytorch recurrent-neural-networks embeddings lstm supervised-learning classification mimic-iii layer-normalization mortality-prediction

Updated Jul 6, 2020
Python

ujjax / fast-slow-lstm

Star

Fast-Slow Recurrent Neural Networks

nlp lstm layer-normalization nips-2017 fast-slow-lstm

Updated Jan 31, 2018
Python

pedroosodrac / Paper-to-Code

Star

Paper to Code automates the incorporation of research paper concepts into practical code using OpenAI's GPT models, bridging theory and implementation.

python tensorflow requests mnist openai layer-normalization cyclical-learning-rates gpt-3