Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
bugfix: fix the sliding window iteration bound for SWA in batch prefi…
…ll operators (#563) The iteration bound for sliding window in batch prefill kernels is wrong, this PR fixes the issue. Note that this bug do not influence kernel accuracy, but might harm kernel performance under some circumstance.
- Loading branch information