Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SLP] Initial vectorization of non-power-of-2 ops. #77790

Merged
merged 43 commits into from
Apr 13, 2024
Merged

Commits on Jan 31, 2024

  1. [SLP] Initial vectorization of non-power-of-2 ops.

    This patch enables vectorization for non-power-of-2 VFs. Initially only
    VFs where adding 1 makes the VF a power-of-of-2, i.e. we can still make
    relatively effective use of the vectors.
    
    It relies on the existing target cost-models to return accurate costs for
    non-power-of-2 vectors. I checked mostly AArch64 and X86 and
    there the costs seem reasonable for the costs I checked, although
    I expect there will be a need to refine both the cost-models and lowering
    to make most effective use of non-power-of-2 SLP vectorization.
    
    Note that re-ordering and shuffling is not implemented for nodes
    requiring padding yet to keep the initial implementation simpler.
    
    The feature is guarded by a new flag, off by defaul for now.
    fhahn committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    252567a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0bb957b View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    84cf9b9 View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2024

  1. !fixup Add fixme to processBuildVector

    also use {} instead of (empty) ResueShuffleIndices.
    fhahn committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    552b8aa View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2024

  1. Configuration menu
    Copy the full SHA
    0ee85a3 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4bb53dd View commit details
    Browse the repository at this point in the history

Commits on Feb 13, 2024

  1. Configuration menu
    Copy the full SHA
    627c30b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    cabbe05 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    f30c753 View commit details
    Browse the repository at this point in the history
  4. !fixup also update odd_store.ll

    fhahn committed Feb 13, 2024
    Configuration menu
    Copy the full SHA
    f15ddd9 View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2024

  1. Configuration menu
    Copy the full SHA
    82efe8a View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2024

  1. Configuration menu
    Copy the full SHA
    35fc0f9 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    5cd569b View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2024

  1. [SLP] Collect candidate VFs in vector in vectorizeStores (NFC).

    This is in preparation for
    llvm#77790 and makes it easy to add
    other, non-power-of-2 VFs for processing.
    fhahn committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    e189eec View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e0b403a View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    b6dac7b View commit details
    Browse the repository at this point in the history

Commits on Feb 28, 2024

  1. Configuration menu
    Copy the full SHA
    13db21f View commit details
    Browse the repository at this point in the history
  2. [SLP] Exit early .

    fhahn committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    8e7339a View commit details
    Browse the repository at this point in the history
  3. [SLP] Exit early if MaxVF < MinVF (NFCI).

    Exit early if MaxVF < MinVF. In that case, the loop body below will
    never get entered. Note that this adjusts the condition from MaxVF <=
    MinVF. If MaxVF == MinVF, vectorization may still be feasible (and the
    loop below gets entered).
    fhahn committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    3eacfa6 View commit details
    Browse the repository at this point in the history
  4. Merge remote-tracking branch 'origin/users/fhahn/slp-early-exit' into…

    … users/fhahn/slp-store-vfs-in-vector
    fhahn committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    0d62c2c View commit details
    Browse the repository at this point in the history
  5. !fixup use for_each.

    fhahn committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    8b6b0e8 View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2024

  1. Merge remote-tracking branch 'origin/users/fhahn/slp-store-vfs-in-vec…

    …tor' into slp-vec3
    
    	llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp
    fhahn committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    454acf8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    1576b0a View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    d733a61 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    4d8c47d View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2024

  1. Configuration menu
    Copy the full SHA
    0103a25 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2024

  1. Configuration menu
    Copy the full SHA
    de3a7e8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    fb1c7be View commit details
    Browse the repository at this point in the history
  3. !fixup fix formatting

    fhahn committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    4c1197a View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2024

  1. Configuration menu
    Copy the full SHA
    6757ddf View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    210210f View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2024

  1. Configuration menu
    Copy the full SHA
    47df498 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    981a3d4 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2024

  1. Configuration menu
    Copy the full SHA
    a0155f1 View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2024

  1. Configuration menu
    Copy the full SHA
    6e4996a View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2024

  1. Configuration menu
    Copy the full SHA
    cded768 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c52b68c View commit details
    Browse the repository at this point in the history
  3. !fixup remove newline

    fhahn committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    8d1b5d4 View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2024

  1. Configuration menu
    Copy the full SHA
    db8bb3f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b7ccdd4 View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. Configuration menu
    Copy the full SHA
    8c9627d View commit details
    Browse the repository at this point in the history
  2. !fixup add assert

    fhahn committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    3919ee6 View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2024

  1. Configuration menu
    Copy the full SHA
    ad67f18 View commit details
    Browse the repository at this point in the history