Code

add flax whisper implementation#20479

Code

Merged

sgugger merged 125 commits intohuggingface:mainhuggingface/transformers:mainfrom andyehrenberg:flax_whisperandyehrenberg/transformers:flax_whisperCopy head branch name to clipboardFeb 20, 2023

+2,742-14

Commits

Commits on Nov 28, 2022

• add flax whisper implementation

  andyehrenberg

  committed
  7d3b6ef

• rever change to setup

  andyehrenberg

  committed
  a9bed4c

• remove unused imports

  andyehrenberg

  committed
  0312993

Commits on Nov 29, 2022

• revert generation changes

  andyehrenberg

  committed
  c71fe4f

• flax whisper docs

  andyehrenberg

  committed
  828d800

Commits on Dec 1, 2022

• docs

  andyehrenberg

  committed
  baafb1c

• Merge branch 'huggingface:main' into flax_whisper

  andyehrenberg

  authored
  7dba8b5

• import order

  andyehrenberg

  committed
  2da5a58

• Merge branch 'flax_whisper' of github.com:andyehrenberg/transformers into flax_whisper

  andyehrenberg

  committed
  5ee9c1f

• import sorting

  andyehrenberg

  committed
  00f695f

• isort

  andyehrenberg

  committed
  0ecc03b

• add dummy objects

  andyehrenberg

  committed
  f66a005

• doc formatting

  andyehrenberg

  committed
  175f344

• formatting

  andyehrenberg

  committed
  3329e6c

• remove trailing whitespaces

  andyehrenberg

  committed
  c05089b

• fix flax whisper docs

  andyehrenberg

  committed
  7551181

• Merge branch 'huggingface:main' into flax_whisper

  andyehrenberg

  authored
  153f2cb

Commits on Dec 2, 2022

• add generation logic to unlock flax whisper

  andyehrenberg

  committed
  e255a97

• Merge branch 'flax_whisper' of github.com:andyehrenberg/transformers into flax_whisper

  andyehrenberg

  committed
  f8009d7

• remove scans

  andyehrenberg

  committed
  d003074

• give credits to Flax Bart implementation

  andyehrenberg

  committed
  ba8a358

• remove unused imports

  andyehrenberg

  committed
  9f4578d

• add license

  andyehrenberg

  committed
  be33fbd

• remove assert

  andyehrenberg

  committed
  8b1338b

• more credits to Bart

  andyehrenberg

  committed
  c567f79

• fix style

  andyehrenberg

  committed
  fbe4e25

• formatting

  andyehrenberg

  committed
  cde5afd

• support left padding

  andyehrenberg

  committed
  6aeb8c8

Commits on Dec 5, 2022

• add flax whisper generation test

  andyehrenberg

  committed
  ec9ca19

Commits on Dec 6, 2022

• Merge branch 'huggingface:main' into flax_whisper

  andyehrenberg

  authored
  8bce923

Commits on Dec 7, 2022

• remove copied from comments whenever not a full copy

  andyehrenberg

  committed
  3f902f6

• fix docstrings for logits processors

  andyehrenberg

  committed
  3fd0a7c

• revert change to FlaxForceTokensLogitsProcessor

  andyehrenberg

  committed
  abc14a1

• revert doc changes

  andyehrenberg

  committed
  d784a23

• improve generation docs

  andyehrenberg

  committed
  3dd8282

• reorganize

  andyehrenberg

  committed
  77fce32

• formatting

  andyehrenberg

  committed
  fefefde

• cleanup docs

  andyehrenberg

  committed
  04ad651

• add tests

  andyehrenberg

  committed
  14e19c0

• handle empty list case

  andyehrenberg

  committed
  cf67b38

Commits on Dec 8, 2022

• fix forced decoder ids in flax tests

  andyehrenberg

  committed
  3de7509

Commits on Dec 9, 2022

• Merge branch 'huggingface:main' into flax_whisper

  andyehrenberg

  authored
  1077588

Commits on Dec 12, 2022

• add flax whisper to inits

  andyehrenberg

  committed
  5e2256a

• Merge branch 'flax_whisper' of github.com:andyehrenberg/transformers into flax_whisper

  andyehrenberg

  committed
  ada32b8

• upate dummy objects

  andyehrenberg

  committed
  669db4e

• docs for FlaxAutoModelForSpeechSeq2Seq

  andyehrenberg

  committed
  bea6cf0

Commits on Dec 14, 2022

• fix decoder_position_ids computation in pretrained model decode/__call__ fns

  andyehrenberg

  committed
  e4270b4

Commits on Dec 15, 2022

• add Copied from statements as necessary

  andyehrenberg

  committed
  135b634

Commits on Dec 16, 2022

• compute position_ids only in __call__ and decode methods of pretrained model subclasses

  andyehrenberg

  committed
  21fe767

• improve readabilityof compute positional embeddings

  andyehrenberg

  committed
  a901674

• check dimensionality of input_features instead of hidden_states

  andyehrenberg

  committed
  f8d4686

• copied from statement for init_cache

  andyehrenberg

  committed
  b407611

• formatting

  andyehrenberg

  committed
  8e78c86

• fix copies

  andyehrenberg

  committed
  810358c

• fix copies

  andyehrenberg

  committed
  b06a6ba

Commits on Dec 21, 2022

• pass attention mask to encoder layers

  andyehrenberg

  committed
  45efd60

• fix decoder module outputs

  andyehrenberg

  committed
  718f53b

Commits on Dec 22, 2022

• set dtype

  Show description for 07a24a8
  

  andyehrenberg

  and

  sanchit-gandhi

  authored
  07a24a8

• smaller flax model for whisper test

  andyehrenberg

  committed
  43c4ed8

• Merge branch 'flax_whisper' of github.com:andyehrenberg/transformers into flax_whisper

  andyehrenberg

  committed
  ecaac58

Commits on Dec 31, 2022

• Update src/transformers/generation/flax_utils.py

  Show description for 7b35907
  

  andyehrenberg

  and

  sgugger

  authored
  7b35907

• Update src/transformers/models/whisper/modeling_flax_whisper.py

  Show description for 8a4d990
  

  andyehrenberg

  and

  sgugger

  authored
  8a4d990

• Update tests/models/whisper/test_modeling_flax_whisper.py

  Show description for 17c22fe
  

  andyehrenberg

  and

  sgugger

  authored
  17c22fe

• cleanup

  Show description for 8c021ae
  

  andyehrenberg

  and

  sgugger

  authored
  8c021ae

• Update src/transformers/models/whisper/modeling_flax_whisper.py

  Show description for 2aed9af
  

  andyehrenberg

  and

  sgugger

  authored
  2aed9af

• bias cleanup

  andyehrenberg

  committed
  64da8fa

• Merge branch 'flax_whisper' of github.com:andyehrenberg/transformers into flax_whisper

  andyehrenberg

  committed
  6fc7404

• doc fix

  andyehrenberg

  committed
  618f85b

Commits on Jan 2, 2023

• align style for force tokens processor

  andyehrenberg

  committed
  8b56bf4

Commits on Jan 3, 2023

• readability

  andyehrenberg

  committed
  209834d

• fix input shape in tests

  andyehrenberg

  committed
  fac30a0

• revert FlaxGenerationMixin docstring

  andyehrenberg

  committed
  aa87c98

• formatting

  andyehrenberg

  committed
  23af05b

• fix tests

  andyehrenberg

  committed
  b8086b6

• fix imports

  andyehrenberg

  committed
  acef3e0

• consistent encoder hidden states

  andyehrenberg

  committed
  da1df33

• consistent hidden states

  andyehrenberg

  committed
  4cdba95

• input shapes

  andyehrenberg

  committed
  dd7473b

• typo

  andyehrenberg

  committed
  c5621f7

• partial class trick

  andyehrenberg

  committed
  46aec12

• partial class for input shape

  andyehrenberg

  committed
  a003616

• base_class with correct input shape

  andyehrenberg

  committed
  a9604a5

• partial base classes

  andyehrenberg

  committed
  5120afe

• match by name

  andyehrenberg

  committed
  c6b1ae4

Commits on Jan 4, 2023

• set main_input_name

  andyehrenberg

  committed
  4c239fc

• compare on names

  andyehrenberg

  committed
  279ceb6

Commits on Jan 9, 2023

• Merge branch 'main' into flax_whisper

  andyehrenberg

  authored
  b81630e

• formatting

  andyehrenberg

  committed
  797fab1

• remove unused import

  andyehrenberg

  committed
  f3173d8

Commits on Jan 10, 2023

• safer position ids computation

  andyehrenberg

  committed
  b4696ca

• safer position id computation

  andyehrenberg

  committed
  1c11ca6

Commits on Jan 18, 2023

• Update src/transformers/models/whisper/modeling_flax_whisper.py

  Show description for c128fd8
  

  andyehrenberg

  and

  sanchit-gandhi

  authored
  c128fd8

• Update src/transformers/models/whisper/modeling_flax_whisper.py

  Show description for 2ae5b08
  

  andyehrenberg

  and

  sanchit-gandhi

  authored
  2ae5b08

• remove identical inherited tests

  andyehrenberg

  committed
  48583bd

• Merge branch 'flax_whisper' of github.com:andyehrenberg/transformers into flax_whisper

  andyehrenberg

  committed
  c93232f

• fix prompt ids in tests

  andyehrenberg

  committed
  1c18f61

• use generation config

  andyehrenberg

  committed
  c3b1d34

• use jnp array

  andyehrenberg

  committed
  bf15d5f

• better var names

  andyehrenberg

  committed
  c5fc14b

• more explicit bias use

  andyehrenberg

  committed
  161cb8a

• Merge branch 'main' into flax_whisper

  andyehrenberg

  authored
  d9cedb9

• import transformers

  andyehrenberg

  committed
  bb9d0af

• formatting

  andyehrenberg

  committed
  f1d90d2

• test formatting

  andyehrenberg

  committed
  733ae2b

• remove unused imports

  andyehrenberg

  committed
  6295691

• remove unused imports

  andyehrenberg

  committed
  902555e

• formatting

  andyehrenberg

  committed
  cba4942

• isort

  andyehrenberg

  committed
  0173945

• docs

  andyehrenberg

  committed
  48640e5

Commits on Jan 26, 2023

• fix ln orders for encoder hidden states

  andyehrenberg

  committed
  1daee2b

Commits on Feb 3, 2023

• Merge branch 'main' into flax_whisper

  andyehrenberg

  authored
  fdb0a61

• whisper unique generation stuff

  andyehrenberg

  committed
  632c4be

• Merge branch 'flax_whisper' of github.com:andyehrenberg/transformers into flax_whisper

  andyehrenberg

  committed
  95403d6

• flake

  andyehrenberg

  committed
  c5c3ac1

• use finfo for attention bias

  andyehrenberg

  committed
  907905f

• docs

  andyehrenberg

  committed
  9dbcda8

Commits on Feb 14, 2023

• Update src/transformers/generation/flax_utils.py

  Show description for d36cd2c
  

  andyehrenberg

  and

  ArthurZucker

  authored
  d36cd2c

• docs

  andyehrenberg

  committed
  ab01cfc

• add timestamp flax test

  andyehrenberg

  committed
  62d172a

• jit for timestamps

  andyehrenberg

  committed
  455b8bf

• formatting

  andyehrenberg

  committed
  89658d0

Commits on Feb 15, 2023

• clean up timestamps processor

  andyehrenberg

  committed
  a75fd03

• formatting

  andyehrenberg

  committed
  758d56c

Commits on Feb 17, 2023

• remove if_true

  andyehrenberg

  committed
  f9ac652

• cleanup

  andyehrenberg

  committed
  94a526e