refactor: remove redundant if-condition and improve type correctness for convert_tokens_to_ids
#34030
Merged
ArthurZucker merged 2 commits intohuggingface:mainfrom winstxnhdw:mainOct 24, 2024
+4-7
convert_tokens_to_ids
#34030