Skip to content

Commit

Permalink
CTC example: updated trainer parameters to save tokenizer (huggingfac…
Browse files Browse the repository at this point in the history
…e#23243)

trainer parameters changed to save tokenizer in addition to feature_extractor
  • Loading branch information
MKhalusova authored and gojiteji committed Jun 5, 2023
1 parent 7369d2e commit 85bd8bf
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -705,7 +705,7 @@ def compute_metrics(pred):
compute_metrics=compute_metrics,
train_dataset=vectorized_datasets["train"] if training_args.do_train else None,
eval_dataset=vectorized_datasets["eval"] if training_args.do_eval else None,
tokenizer=feature_extractor,
tokenizer=processor,
)

# 8. Finally, we can start training
Expand Down

0 comments on commit 85bd8bf

Please sign in to comment.