-
Notifications
You must be signed in to change notification settings - Fork 11.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SLP] Initial vectorization of non-power-of-2 ops. #77790
Commits on Jan 31, 2024
-
[SLP] Initial vectorization of non-power-of-2 ops.
This patch enables vectorization for non-power-of-2 VFs. Initially only VFs where adding 1 makes the VF a power-of-of-2, i.e. we can still make relatively effective use of the vectors. It relies on the existing target cost-models to return accurate costs for non-power-of-2 vectors. I checked mostly AArch64 and X86 and there the costs seem reasonable for the costs I checked, although I expect there will be a need to refine both the cost-models and lowering to make most effective use of non-power-of-2 SLP vectorization. Note that re-ordering and shuffling is not implemented for nodes requiring padding yet to keep the initial implementation simpler. The feature is guarded by a new flag, off by defaul for now.
Configuration menu - View commit details
-
Copy full SHA for 252567a - Browse repository at this point
Copy the full SHA 252567aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0bb957b - Browse repository at this point
Copy the full SHA 0bb957bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 84cf9b9 - Browse repository at this point
Copy the full SHA 84cf9b9View commit details
Commits on Feb 1, 2024
-
!fixup Add fixme to processBuildVector
also use {} instead of (empty) ResueShuffleIndices.
Configuration menu - View commit details
-
Copy full SHA for 552b8aa - Browse repository at this point
Copy the full SHA 552b8aaView commit details
Commits on Feb 2, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 0ee85a3 - Browse repository at this point
Copy the full SHA 0ee85a3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4bb53dd - Browse repository at this point
Copy the full SHA 4bb53ddView commit details
Commits on Feb 13, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 627c30b - Browse repository at this point
Copy the full SHA 627c30bView commit details -
Configuration menu - View commit details
-
Copy full SHA for cabbe05 - Browse repository at this point
Copy the full SHA cabbe05View commit details -
Configuration menu - View commit details
-
Copy full SHA for f30c753 - Browse repository at this point
Copy the full SHA f30c753View commit details -
Configuration menu - View commit details
-
Copy full SHA for f15ddd9 - Browse repository at this point
Copy the full SHA f15ddd9View commit details
Commits on Feb 21, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 82efe8a - Browse repository at this point
Copy the full SHA 82efe8aView commit details
Commits on Feb 22, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 35fc0f9 - Browse repository at this point
Copy the full SHA 35fc0f9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5cd569b - Browse repository at this point
Copy the full SHA 5cd569bView commit details
Commits on Feb 23, 2024
-
[SLP] Collect candidate VFs in vector in vectorizeStores (NFC).
This is in preparation for llvm#77790 and makes it easy to add other, non-power-of-2 VFs for processing.
Configuration menu - View commit details
-
Copy full SHA for e189eec - Browse repository at this point
Copy the full SHA e189eecView commit details -
Configuration menu - View commit details
-
Copy full SHA for e0b403a - Browse repository at this point
Copy the full SHA e0b403aView commit details -
Configuration menu - View commit details
-
Copy full SHA for b6dac7b - Browse repository at this point
Copy the full SHA b6dac7bView commit details
Commits on Feb 28, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 13db21f - Browse repository at this point
Copy the full SHA 13db21fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8e7339a - Browse repository at this point
Copy the full SHA 8e7339aView commit details -
[SLP] Exit early if MaxVF < MinVF (NFCI).
Exit early if MaxVF < MinVF. In that case, the loop body below will never get entered. Note that this adjusts the condition from MaxVF <= MinVF. If MaxVF == MinVF, vectorization may still be feasible (and the loop below gets entered).
Configuration menu - View commit details
-
Copy full SHA for 3eacfa6 - Browse repository at this point
Copy the full SHA 3eacfa6View commit details -
Merge remote-tracking branch 'origin/users/fhahn/slp-early-exit' into…
… users/fhahn/slp-store-vfs-in-vector
Configuration menu - View commit details
-
Copy full SHA for 0d62c2c - Browse repository at this point
Copy the full SHA 0d62c2cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8b6b0e8 - Browse repository at this point
Copy the full SHA 8b6b0e8View commit details
Commits on Mar 1, 2024
-
Merge remote-tracking branch 'origin/users/fhahn/slp-store-vfs-in-vec…
…tor' into slp-vec3 llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp
Configuration menu - View commit details
-
Copy full SHA for 454acf8 - Browse repository at this point
Copy the full SHA 454acf8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1576b0a - Browse repository at this point
Copy the full SHA 1576b0aView commit details -
Merge remote-tracking branch 'origin/users/fhahn/slp-store-vfs-in-vec…
…tor' into slp-vec3
Configuration menu - View commit details
-
Copy full SHA for d733a61 - Browse repository at this point
Copy the full SHA d733a61View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4d8c47d - Browse repository at this point
Copy the full SHA 4d8c47dView commit details
Commits on Mar 4, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 0103a25 - Browse repository at this point
Copy the full SHA 0103a25View commit details
Commits on Mar 6, 2024
-
Configuration menu - View commit details
-
Copy full SHA for de3a7e8 - Browse repository at this point
Copy the full SHA de3a7e8View commit details -
Configuration menu - View commit details
-
Copy full SHA for fb1c7be - Browse repository at this point
Copy the full SHA fb1c7beView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4c1197a - Browse repository at this point
Copy the full SHA 4c1197aView commit details
Commits on Mar 8, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 6757ddf - Browse repository at this point
Copy the full SHA 6757ddfView commit details -
Configuration menu - View commit details
-
Copy full SHA for 210210f - Browse repository at this point
Copy the full SHA 210210fView commit details
Commits on Mar 19, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 47df498 - Browse repository at this point
Copy the full SHA 47df498View commit details -
Configuration menu - View commit details
-
Copy full SHA for 981a3d4 - Browse repository at this point
Copy the full SHA 981a3d4View commit details
Commits on Mar 25, 2024
-
Configuration menu - View commit details
-
Copy full SHA for a0155f1 - Browse repository at this point
Copy the full SHA a0155f1View commit details
Commits on Apr 2, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 6e4996a - Browse repository at this point
Copy the full SHA 6e4996aView commit details
Commits on Apr 4, 2024
-
Configuration menu - View commit details
-
Copy full SHA for cded768 - Browse repository at this point
Copy the full SHA cded768View commit details -
Configuration menu - View commit details
-
Copy full SHA for c52b68c - Browse repository at this point
Copy the full SHA c52b68cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8d1b5d4 - Browse repository at this point
Copy the full SHA 8d1b5d4View commit details
Commits on Apr 5, 2024
-
Configuration menu - View commit details
-
Copy full SHA for db8bb3f - Browse repository at this point
Copy the full SHA db8bb3fView commit details -
Configuration menu - View commit details
-
Copy full SHA for b7ccdd4 - Browse repository at this point
Copy the full SHA b7ccdd4View commit details
Commits on Apr 9, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 8c9627d - Browse repository at this point
Copy the full SHA 8c9627dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3919ee6 - Browse repository at this point
Copy the full SHA 3919ee6View commit details
Commits on Apr 13, 2024
-
Configuration menu - View commit details
-
Copy full SHA for ad67f18 - Browse repository at this point
Copy the full SHA ad67f18View commit details