Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-47210][SQL] Addition of implicit casting without indeterminate support #45383

Closed
wants to merge 80 commits into from
Closed

[SPARK-47210][SQL] Addition of implicit casting without indeterminate support #45383

wants to merge 80 commits into from

Commits on Mar 5, 2024

  1. Implicit casting on collated expressions

    @mihailom-db
    mihailom-db committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    b34544a View commit details
    Browse the repository at this point in the history

  2. Fix doc files

    @mihailom-db
    mihailom-db committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    fdbfa44 View commit details
    Browse the repository at this point in the history

  3. Fix contains, startWith, endWith tests

    @mihailom-db
    mihailom-db committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    ce9b027 View commit details
    Browse the repository at this point in the history

  4. Fix imports

    @mihailom-db
    mihailom-db committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    e537190 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2024

  1. Fix docs and incorporate changes

    @mihailom-db
    mihailom-db committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    b5a79c1 View commit details
    Browse the repository at this point in the history

  2. Fix tests in CollationSuite

    @mihailom-db
    mihailom-db committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    8321d0c View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2024

  1. Add test and incorporate changes

    @mihailom-db
    mihailom-db committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    d178233 View commit details
    Browse the repository at this point in the history

  2. Fix godlen files

    @mihailom-db
    mihailom-db committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    a4b9be7 View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2024

  1. Incorporate StringType in findWiderCommonType

    @mihailom-db
    mihailom-db committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    a6e7662 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into SPARK-47210

    @mihailom-db
    mihailom-db authored Mar 8, 2024
    Configuration menu
    Copy the full SHA
    e1d7ad5 View commit details
    Browse the repository at this point in the history

Commits on Mar 11, 2024

  1. Fix ArrayType(StringType, _) casting in findWiderCommonType

    @mihailom-db
    mihailom-db committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    b3b1356 View commit details
    Browse the repository at this point in the history

  2. Fix type mismatch error

    @mihailom-db
    mihailom-db committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    7773d13 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'apache:master' into SPARK-47210

    @mihailom-db
    mihailom-db authored Mar 11, 2024
    Configuration menu
    Copy the full SHA
    198a728 View commit details
    Browse the repository at this point in the history

  4. Incorporate changes and fix errors

    @mihailom-db
    mihailom-db committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    255b1ab View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2024

  1. Merge branch 'master' into SPARK-47210

    @mihailom-db
    mihailom-db authored Mar 12, 2024
    Configuration menu
    Copy the full SHA
    9ce417f View commit details
    Browse the repository at this point in the history

  2. Fix errors

    @mihailom-db
    mihailom-db committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    50f3aa2 View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2024

  1. Rework casting

    @mihailom-db
    mihailom-db committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    ca0c84d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into SPARK-47210

    @mihailom-db
    mihailom-db authored Mar 13, 2024
    Configuration menu
    Copy the full SHA
    880a1b1 View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2024

  1. Fix failing tests

    @mihailom-db
    mihailom-db committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    56d6c7c View commit details
    Browse the repository at this point in the history

  2. Fix array cast errors

    @mihailom-db
    mihailom-db committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    94e5259 View commit details
    Browse the repository at this point in the history

  3. Fix additional errors

    @mihailom-db
    mihailom-db committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    ccb52ba View commit details
    Browse the repository at this point in the history

Commits on Mar 17, 2024

  1. Fix explicit collation search

    @mihailom-db
    mihailom-db committed Mar 17, 2024
    Configuration menu
    Copy the full SHA
    9b1387b View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2024

  1. Fix scala style errors

    @mihailom-db
    mihailom-db committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    c9974e1 View commit details
    Browse the repository at this point in the history

  2. Add support for ImplicitCastInputTypes

    @mihailom-db
    mihailom-db committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    fca9a65 View commit details
    Browse the repository at this point in the history

  3. Fix accidental change in license header

    @mihailom-db
    mihailom-db committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    660d664 View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2024

  1. Fix null casting

    @mihailom-db
    mihailom-db committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    c8edd93 View commit details
    Browse the repository at this point in the history

  2. Fix failing tests

    @mihailom-db
    mihailom-db committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    a91490b View commit details
    Browse the repository at this point in the history

  3. Move implicit casting when strings present

    @mihailom-db
    mihailom-db committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    49a8d61 View commit details
    Browse the repository at this point in the history

  4. Fix unintentional changes

    @mihailom-db
    mihailom-db committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    4c4cd84 View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2024

  1. improve types.py

    @mihailom-db
    mihailom-db committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    66122a6 View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2024

  1. Refactor code

    @mihailom-db
    mihailom-db committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    50f46e4 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into SPARK-47210

    @mihailom-db
    mihailom-db authored Mar 21, 2024
    Configuration menu
    Copy the full SHA
    cc86a87 View commit details
    Browse the repository at this point in the history

  3. Fix imports and failing tests

    @mihailom-db
    mihailom-db committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    c01e80c View commit details
    Browse the repository at this point in the history

  4. Disable casting of StructTypes

    @mihailom-db
    mihailom-db committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    cc797a2 View commit details
    Browse the repository at this point in the history

  5. Fix imports

    @mihailom-db
    mihailom-db committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    5d001ee View commit details
    Browse the repository at this point in the history

  6. Fix concat tests

    @mihailom-db
    mihailom-db committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    c68fc7d View commit details
    Browse the repository at this point in the history

  7. Fix unnecessary repetition

    @mihailom-db
    mihailom-db committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    1c926ab View commit details
    Browse the repository at this point in the history

  8. Remove Elt test

    @mihailom-db
    mihailom-db committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    dec39bf View commit details
    Browse the repository at this point in the history

  9. Remove tests for Repeat

    @mihailom-db
    mihailom-db committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    e808446 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'master' into SPARK-47210

    @mihailom-db
    mihailom-db authored Mar 21, 2024
    Configuration menu
    Copy the full SHA
    ca1a23a View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2024

  1. Merge branch 'apache:master' into SPARK-47210

    @mihailom-db
    mihailom-db authored Mar 22, 2024
    Configuration menu
    Copy the full SHA
    116931c View commit details
    Browse the repository at this point in the history

  2. Fix failing tests

    @mihailom-db
    mihailom-db committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    af487a2 View commit details
    Browse the repository at this point in the history

  3. Fix nullability for StringType->StringType

    @mihailom-db
    mihailom-db committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    4ba7055 View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2024

  1. Improve comments and switch tests from E2E to unit tests

    @mihailom-db
    mihailom-db committed Mar 24, 2024
    Configuration menu
    Copy the full SHA
    e490e42 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2024

  1. Add new tests and remove compatibility test

    @mihailom-db
    mihailom-db committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    00e88e7 View commit details
    Browse the repository at this point in the history

  2. Fix conflict resolution mistake

    @mihailom-db
    mihailom-db committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    85b4d16 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'apache:master' into SPARK-47210

    @mihailom-db
    mihailom-db authored Mar 25, 2024
    Configuration menu
    Copy the full SHA
    30f7225 View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2024

  1. Add indeterminate collation tests

    @mihailom-db
    mihailom-db committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    e89a354 View commit details
    Browse the repository at this point in the history

  2. Fix test

    @mihailom-db
    mihailom-db committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    788dc06 View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2024

  1. Block Alias on Indeterminate

    @mihailom-db
    mihailom-db committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    75c0140 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2024

  1. Merge remote-tracking branch 'upstream/master' into SPARK-47210 

    # Conflicts:
#	common/unsafe/src/main/java/org/apache/spark/sql/catalyst/util/CollationFactory.java
#	python/pyspark/sql/tests/test_types.py
#	sql/api/src/main/scala/org/apache/spark/sql/types/StringType.scala
#	sql/core/src/test/scala/org/apache/spark/sql/CollationStringExpressionsSuite.scala
    @mihailom-db
    mihailom-db committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    2918413 View commit details
    Browse the repository at this point in the history

  2. Remove introduction of indeterminate collation

    @mihailom-db
    mihailom-db committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    f6ed55a View commit details
    Browse the repository at this point in the history

  3. Fix import problem

    @mihailom-db
    mihailom-db committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    98960c0 View commit details
    Browse the repository at this point in the history

  4. Fix failing tests

    @mihailom-db
    mihailom-db committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    de623c8 View commit details
    Browse the repository at this point in the history

  5. Fix pyspark error

    @mihailom-db
    mihailom-db committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    a92b4e1 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'apache:master' into SPARK-47210

    @mihailom-db
    mihailom-db authored Mar 28, 2024
    Configuration menu
    Copy the full SHA
    f7f3011 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2024

  1. Fix errors

    @mihailom-db
    mihailom-db committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    f67808e View commit details
    Browse the repository at this point in the history

  2. Fix schema error

    @mihailom-db
    mihailom-db committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    815ce42 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'upstream/master' into SPARK-47210

    @mihailom-db
    mihailom-db committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    7fca38a View commit details
    Browse the repository at this point in the history

  4. Fix collated tests

    @mihailom-db
    mihailom-db committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    b19b0eb View commit details
    Browse the repository at this point in the history

  5. Add isExplicit flag

    @mihailom-db
    mihailom-db committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    a111f03 View commit details
    Browse the repository at this point in the history

  6. Fix import error

    @mihailom-db
    mihailom-db committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    55bdd9b View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2024

  1. Fix imports in TypeCoercion

    @mihailom-db
    mihailom-db committed Mar 31, 2024
    Configuration menu
    Copy the full SHA
    a7228be View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2024

  1. Merge remote-tracking branch 'upstream/master' into SPARK-47210

    @mihailom-db
    mihailom-db committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    27a72c6 View commit details
    Browse the repository at this point in the history

  2. Add support for explicit propagation in arrays

    @mihailom-db
    mihailom-db committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    18ada04 View commit details
    Browse the repository at this point in the history

  3. Fix tests to follow recent changes

    @mihailom-db
    mihailom-db committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    38670af View commit details
    Browse the repository at this point in the history

  4. Incorporate changes

    @mihailom-db
    mihailom-db committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    01d891e View commit details
    Browse the repository at this point in the history

  5. Fix error

    @mihailom-db
    mihailom-db committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    c5daf86 View commit details
    Browse the repository at this point in the history

  6. Change var to val in StringType

    @mihailom-db
    mihailom-db committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    9ac5678 View commit details
    Browse the repository at this point in the history

  7. Fix import style

    @mihailom-db
    mihailom-db committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    0f1757d View commit details
    Browse the repository at this point in the history

  8. Revert explicit flag addition

    @mihailom-db
    mihailom-db committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    506c8c0 View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2024

  1. Narrow down expressions casting

    @mihailom-db
    mihailom-db committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    f743cf8 View commit details
    Browse the repository at this point in the history

  2. Incorporate minor changes

    @mihailom-db
    mihailom-db committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    4f8fe1d View commit details
    Browse the repository at this point in the history

  3. Incorporate changes

    @mihailom-db
    mihailom-db committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    52bf4dc View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2024

  1. Special case expressions

    @mihailom-db
    mihailom-db committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    7cbeafe View commit details
    Browse the repository at this point in the history

  2. Return new line

    @mihailom-db
    mihailom-db committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    3e92e92 View commit details
    Browse the repository at this point in the history

  3. Remove indentation cosmetic

    @mihailom-db
    mihailom-db committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    b23e106 View commit details
    Browse the repository at this point in the history

  4. Add more cosmetic changes

    @mihailom-db
    mihailom-db committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    880ebed View commit details
    Browse the repository at this point in the history

  5. Incorporate changes

    @mihailom-db
    mihailom-db committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    f96ecd9 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'apache:master' into SPARK-47210

    @mihailom-db
    mihailom-db authored Apr 3, 2024
    Configuration menu
    Copy the full SHA
    e1e0cf4 View commit details
    Browse the repository at this point in the history