support remove_input_padding for BertForSequenceClassification models #1834
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Related issue: #1755
Content:
build.py
script, e.g., the original script doen't have a input model dir parameter, and will init the model with random weights, which is not intuitive.input_ids, input_lengths, token_type_ids, position_ids, max_input_length
, I add a standalonerun_remove_input_padding.py
demo script, and show how to build them with onlyinput_ids
andtoken_type_ids
.I only implemented and tested this for
BertForSequenceClassification
but not other BERT models yet, please feel free to do further work on this :)