Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA] support split join condition for broadcast hash join into AST and non-AST #9759

Open
winningsix opened this issue Nov 16, 2023 · 1 comment · Fixed by #9760
Open

[FEA] support split join condition for broadcast hash join into AST and non-AST #9759

winningsix opened this issue Nov 16, 2023 · 1 comment · Fixed by #9760
Assignees
@winningsix
Labels
feature request New feature or request

Comments

@winningsix
Copy link
Collaborator

For broadcast hash join, if broadcast hash join contains some conditions non AST-able, we should split it following into some project nodes when we can.
@winningsix winningsix added feature request New feature or request ? - Needs Triage Need team to review and classify labels Nov 16, 2023
This was referenced Nov 16, 2023
Open
Merged
@revans2
Copy link
Collaborator

revans2 commented Nov 17, 2023

Why just broadcast? Why not make it generic for all of the joins that can use AST?

@sameerz sameerz removed the ? - Needs Triage Need team to review and classify label Nov 21, 2023
@winningsix winningsix reopened this Dec 25, 2023
@sameerz sameerz mentioned this issue Jan 23, 2024
Closed
@revans2 revans2 mentioned this issue Jul 23, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@winningsix winningsix

Labels
feature request New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Support split broadcast join condition into ast and non-ast [databricks] winningsix/spark-rapids
3 participants
@winningsix @revans2 @sameerz