Added implementation for SuppressTokensFilter

[jkrukowski]

• added implementation for SuppressTokensFilter
• added tests

If this PR looks good, I can try to implement other filters 🫡

[ZachNagengast]

Awesome contribution! Reviewing this shortly

[ZachNagengast]

This looks great @jkrukowski just a couple small notes, will run through the full tests as well.

[ZachNagengast]

Updates look good, everything is passing, well done!

[ZachNagengast]

Would love to see your take on the other filters if you're up for it! I'm going to be looking at word-level timestamps next on my side FYI, so we'll definitely need timestamp filtering i.e. ApplyTimestampRules equivalent for us, but keep in mind some of this logic we pulled into the SegmentSeeking protocol.

[jkrukowski]

Would love to see your take on the other filters if you're up for it! I'm going to be looking at word-level timestamps next on my side FYI, so we'll definitely need timestamp filtering i.e. ApplyTimestampRules equivalent for us, but keep in mind some of this logic we pulled into the SegmentSeeking protocol.

sure, happy to do it. Will try to find some time this or next week

[jkrukowski]

Would love to see your take on the other filters if you're up for it! I'm going to be looking at word-level timestamps next on my side FYI, so we'll definitely need timestamp filtering i.e. ApplyTimestampRules equivalent for us, but keep in mind some of this logic we pulled into the SegmentSeeking protocol.

hi @ZachNagengast, not sure if it's a good place to ask but you mentioned that some of this logic was pulled into SegmentSeeking protocol. Can you please elaborate a bit more? (I'm looking into implementing TimestampRulesFilter based on ApplyTimestampRules)