Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-32201][SQL] More general skew join pattern matching #29021

Closed
wants to merge 15 commits into from
Closed

[SPARK-32201][SQL] More general skew join pattern matching #29021

wants to merge 15 commits into from

Commits on Jul 7, 2020

  1. [SPARK-32201][SQL] More general skew join pattern matching

    @LantaoJin
    LantaoJin committed Jul 7, 2020
    Configuration menu
    Copy the full SHA
    479d56b View commit details
    Browse the repository at this point in the history

  2. remove the println

    @LantaoJin
    LantaoJin committed Jul 7, 2020
    Configuration menu
    Copy the full SHA
    947927a View commit details
    Browse the repository at this point in the history

  3. cannot split if AggExec in one side

    @LantaoJin
    LantaoJin committed Jul 7, 2020
    Configuration menu
    Copy the full SHA
    607eb08 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2020

  1. add more agg exec

    @LantaoJin
    LantaoJin committed Jul 8, 2020
    Configuration menu
    Copy the full SHA
    80bef0d View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2020

  1. Add a new parititioning CoalescedHashPartitioning

    @LantaoJin
    LantaoJin committed Jul 10, 2020
    Configuration menu
    Copy the full SHA
    dd09e70 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2020

  1. fix ut

    @LantaoJin
    LantaoJin committed Jul 11, 2020
    Configuration menu
    Copy the full SHA
    76dc3ea View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2020

  1. more general canSplitXSide

    @LantaoJin
    LantaoJin committed Jul 15, 2020
    Configuration menu
    Copy the full SHA
    7465bfa View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2020

  1. fix ut

    @LantaoJin
    LantaoJin committed Jul 16, 2020
    Configuration menu
    Copy the full SHA
    0950e9a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into SPARK-32201

    @LantaoJin
    LantaoJin authored Jul 16, 2020
    Configuration menu
    Copy the full SHA
    42a52a1 View commit details
    Browse the repository at this point in the history

  3. add another skew test case

    @LantaoJin
    LantaoJin committed Jul 16, 2020
    Configuration menu
    Copy the full SHA
    973d87e View commit details
    Browse the repository at this point in the history

  4. canUseLocalShuffleReader should consider skew optimization

    @LantaoJin
    LantaoJin committed Jul 16, 2020
    Configuration menu
    Copy the full SHA
    d65a210 View commit details
    Browse the repository at this point in the history

  5. fix ut

    @LantaoJin
    LantaoJin committed Jul 16, 2020
    Configuration menu
    Copy the full SHA
    6f7dbc2 View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2020

  1. approach 2: remove 'CoalescedHashPartitioning' and refine code

    @LantaoJin
    LantaoJin committed Jul 20, 2020
    Configuration menu
    Copy the full SHA
    aa3af93 View commit details
    Browse the repository at this point in the history

  2. remove dead code

    @LantaoJin
    LantaoJin committed Jul 20, 2020
    Configuration menu
    Copy the full SHA
    3cd411f View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2020

  1. Merge remote-tracking branch 'upstream/master' into SPARK-32201

    @LantaoJin
    LantaoJin committed Jul 21, 2020
    Configuration menu
    Copy the full SHA
    5bed68c View commit details
    Browse the repository at this point in the history