Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-40095: [C++][Parquet] Remove AVX512 variants of BYTE_STREAM_SPLIT encoding #40127

Merged
merged 1 commit into from
Feb 19, 2024

Conversation

pitrou
Copy link
Member

@pitrou pitrou commented Feb 19, 2024

Two reasons:

…SPLIT encoding

Two reasons:
* the SSE2 and AVX2 variants are already fast enough (on the order of 10 GB/s)
* the AVX512 variants do not seem faster, and can even be slower, on tested Intel machines
@pitrou pitrou requested a review from wgtmac as a code owner February 19, 2024 09:35
@pitrou pitrou requested a review from cyb70289 February 19, 2024 09:36
Copy link

⚠️ GitHub issue #40095 has been automatically assigned in GitHub to PR creator.

@github-actions github-actions bot added awaiting committer review Awaiting committer review and removed awaiting review Awaiting review labels Feb 19, 2024
@pitrou pitrou merged commit ca67ec2 into apache:main Feb 19, 2024
31 of 35 checks passed
@pitrou pitrou removed the awaiting committer review Awaiting committer review label Feb 19, 2024
@pitrou pitrou deleted the gh40095-bss-avx512 branch February 19, 2024 10:38
Copy link

After merging your PR, Conbench analyzed the 5 benchmarking runs that have been run so far on merge-commit ca67ec2.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 5 possible false positives for unstable benchmarks that are known to sometimes produce them.

zanmato1984 pushed a commit to zanmato1984/arrow that referenced this pull request Feb 28, 2024
…SPLIT encoding (apache#40127)

Two reasons:
* the SSE2 and AVX2 variants are already fast enough (on the order of 10 GB/s)
* the AVX512 variants do not seem faster, and can even be slower, on tested Intel machines

* Closes: apache#40095

Authored-by: Antoine Pitrou <antoine@python.org>
Signed-off-by: Antoine Pitrou <antoine@python.org>
thisisnic pushed a commit to thisisnic/arrow that referenced this pull request Mar 8, 2024
…SPLIT encoding (apache#40127)

Two reasons:
* the SSE2 and AVX2 variants are already fast enough (on the order of 10 GB/s)
* the AVX512 variants do not seem faster, and can even be slower, on tested Intel machines

* Closes: apache#40095

Authored-by: Antoine Pitrou <antoine@python.org>
Signed-off-by: Antoine Pitrou <antoine@python.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[C++][Parquet] Remove AVX512 variants of BYTE_STREAM_SPLIT encoding
3 participants