-
Notifications
You must be signed in to change notification settings - Fork 123
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[feature] add support for gemini-dfresnet (#291)
* [feature] add support for gemini-dfresnet * fix lint errors * add warmup of 6 epochs to config * add warmup of 6 epochs to config * add the results of gemini-df-resnet * update the link for gemini models
- Loading branch information
1 parent
0593804
commit a3a046e
Showing
7 changed files
with
371 additions
and
13 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,81 @@ | ||
| ### train configuraton | ||
|
|
||
| exp_dir: exp/Gemini_DF_ResNet114-TSTP-emb256-fbank80-num_frms200-aug0.6-spTrue-saFalse-ArcMargin-AdamW-epoch165 | ||
| gpus: "[0,1]" | ||
| num_avg: 2 | ||
| enable_amp: False # whether enable automatic mixed precision training | ||
|
|
||
| seed: 42 | ||
| num_epochs: 165 | ||
| save_epoch_interval: 5 # save model every 5 epochs | ||
| log_batch_interval: 100 # log every 100 batchs | ||
|
|
||
| dataloader_args: | ||
| batch_size: 128 | ||
| num_workers: 8 | ||
| pin_memory: False | ||
| prefetch_factor: 8 | ||
| drop_last: True | ||
|
|
||
| dataset_args: | ||
| # the sample number which will be traversed within one epoch, if the value equals to 0, | ||
| # the utterance number in the dataset will be used as the sample_num_per_epoch. | ||
| sample_num_per_epoch: 0 | ||
| shuffle: True | ||
| shuffle_args: | ||
| shuffle_size: 2500 | ||
| filter: True | ||
| filter_args: | ||
| min_num_frames: 100 | ||
| max_num_frames: 800 | ||
| resample_rate: 16000 | ||
| speed_perturb: True | ||
| num_frms: 200 | ||
| aug_prob: 0.6 # prob to add reverb & noise aug per sample | ||
| fbank_args: | ||
| num_mel_bins: 80 | ||
| frame_shift: 10 | ||
| frame_length: 25 | ||
| dither: 1.0 | ||
| spec_aug: False | ||
| spec_aug_args: | ||
| num_t_mask: 1 | ||
| num_f_mask: 1 | ||
| max_t: 10 | ||
| max_f: 8 | ||
| prob: 0.6 | ||
|
|
||
| model: Gemini_DF_ResNet114 # Gemini_DF_ResNet60 Gemini_DF_ResNet114 GemGemini_DF_ResNet183 Gemini_DF_ResNet237 | ||
| model_init: null | ||
| model_args: | ||
| feat_dim: 80 | ||
| embed_dim: 256 | ||
| pooling_func: "TSTP" # TSTP, ASTP, MQMHASTP | ||
| two_emb_layer: False | ||
| projection_args: | ||
| project_type: "arc_margin" # add_margin, arc_margin, sphere, sphereface2, softmax, arc_margin_intertopk_subcenter | ||
| scale: 32.0 | ||
| easy_margin: False | ||
|
|
||
| margin_scheduler: MarginScheduler | ||
| margin_update: | ||
| initial_margin: 0.2 | ||
| final_margin: 0.2 | ||
| increase_start_epoch: 20 | ||
| fix_start_epoch: 40 | ||
| update_margin: False | ||
| increase_type: "exp" # exp, linear | ||
|
|
||
| loss: CrossEntropyLoss | ||
| loss_args: {} | ||
|
|
||
| optimizer: AdamW | ||
| optimizer_args: | ||
| weight_decay: 0.05 | ||
|
|
||
| scheduler: ExponentialDecrease | ||
| scheduler_args: | ||
| initial_lr: 0.000125 | ||
| final_lr: 0.000001 | ||
| warm_up_epoch: 6 | ||
| warm_from_zero: False |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,91 @@ | ||
| ### Large margin fine-tuning configuration | ||
| # | ||
| # The large margin fine-tuning operation is often used in speaker | ||
| # verification challenge system to further improve the performance. | ||
| # In this fine-tuning stage, large margin and longer segment will | ||
| # be used. | ||
|
|
||
| exp_dir: exp/Gemini_DF_ResNet114-TSTP-emb256-fbank80-num_frms200-aug0.6-spTrue-saFalse-ArcMargin-AdamW-epoch165-LM | ||
| gpus: "[0,1]" | ||
| num_avg: 1 | ||
| enable_amp: False # whether enable automatic mixed precision training | ||
| do_lm: True | ||
|
|
||
| seed: 42 | ||
| num_epochs: 5 | ||
| save_epoch_interval: 1 # save model per epoch | ||
| log_batch_interval: 100 # log every 100 batchs | ||
|
|
||
| dataloader_args: | ||
| batch_size: 32 | ||
| num_workers: 8 | ||
| pin_memory: False | ||
| prefetch_factor: 8 | ||
| drop_last: True | ||
|
|
||
| dataset_args: | ||
| # the sample number which will be traversed within one epoch, if the value equals to 0, | ||
| # the utterance number in the dataset will be used as the sample_num_per_epoch. | ||
| sample_num_per_epoch: 0 | ||
| shuffle: True | ||
| shuffle_args: | ||
| shuffle_size: 2500 | ||
| filter: True | ||
| filter_args: | ||
| min_num_frames: 100 | ||
| max_num_frames: 800 | ||
| resample_rate: 16000 | ||
| speed_perturb: True | ||
| num_frms: 600 | ||
| aug_prob: 0.6 # prob to add reverb & noise aug per sample | ||
| fbank_args: | ||
| num_mel_bins: 80 | ||
| frame_shift: 10 | ||
| frame_length: 25 | ||
| dither: 1.0 | ||
| spec_aug: False | ||
| spec_aug_args: | ||
| num_t_mask: 1 | ||
| num_f_mask: 1 | ||
| max_t: 10 | ||
| max_f: 8 | ||
| prob: 0.6 | ||
|
|
||
| model: Gemini_DF_ResNet114 # ResNet18, ResNet34, ResNet50, ResNet101, ResNet152 | ||
| model_init: null | ||
| model_args: | ||
| feat_dim: 80 | ||
| embed_dim: 256 | ||
| pooling_func: "TSTP" # TSTP, ASTP, MQMHASTP | ||
| two_emb_layer: False | ||
| projection_args: | ||
| project_type: "arc_margin" # add_margin, arc_margin, sphere, softmax, arc_margin_intertopk_subcenter | ||
| scale: 32.0 | ||
| easy_margin: False | ||
|
|
||
| margin_scheduler: MarginScheduler | ||
| margin_update: | ||
| initial_margin: 0.5 | ||
| final_margin: 0.5 | ||
| increase_start_epoch: 1 | ||
| fix_start_epoch: 1 | ||
| update_margin: True | ||
| increase_type: "exp" # exp, linear | ||
|
|
||
| loss: CrossEntropyLoss | ||
| loss_args: {} | ||
|
|
||
| optimizer: SGD | ||
| optimizer_args: | ||
| momentum: 0.9 | ||
| nesterov: True | ||
| weight_decay: 0.0001 | ||
|
|
||
| scheduler: ExponentialDecrease | ||
| scheduler_args: | ||
| initial_lr: 1.0e-4 | ||
| final_lr: 2.5e-5 | ||
| warm_up_epoch: 1 | ||
| warm_from_zero: True | ||
|
|
||
|
|
Oops, something went wrong.