Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added latest version of timestamp rule to whisper, Added layer normalization models #1356

Merged
merged 8 commits into from
Jan 10, 2024

Conversation

kyakuno
Copy link
Collaborator

@kyakuno kyakuno commented Dec 29, 2023

whisperの最新の下記の実装を取り込み。

  • timestampが単調増加になるように制約
  • transformerの最新版だとdisable_ailia_tokenizerが動かなくなっているので公式に合わせてtiktokenに変更
  • suppress_blankがデフォルトで有効になっていたので修正

下記の修正を実施。

  • copy blob data APIを使用する条件ailia SDK 1.2.15以上の判定式が間違っていたので修正(メジャーバージョンが2になると使用されなくなる)
  • MeanVarianceNormalizationを使ったoptモデルおよびopt2モデルにepsilonの精度問題があったのでLayerNormalizationを使用したopt3モデルを追加(ailia SDK 1.2.16の判定で使用)

#1355

@kyakuno kyakuno changed the title Added latest version of timestamp rule [WIP] Added latest version of timestamp rule to whisper Dec 29, 2023
@kyakuno kyakuno changed the title [WIP] Added latest version of timestamp rule to whisper [WIP] Added latest version of timestamp rule to whisper, Added layer normalization models Jan 6, 2024
@kyakuno kyakuno changed the title [WIP] Added latest version of timestamp rule to whisper, Added layer normalization models Added latest version of timestamp rule to whisper, Added layer normalization models Jan 9, 2024
@kyakuno kyakuno merged commit db05ca1 into master Jan 10, 2024
@kyakuno kyakuno deleted the whisper_timestamp branch January 10, 2024 08:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant