Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Type mapping rewriting for JDBC integration #505

Merged
merged 24 commits into from
Dec 14, 2023
Merged

Type mapping rewriting for JDBC integration #505

merged 24 commits into from
Dec 14, 2023

Commits on Nov 13, 2023

  1. Refactor JDBC test files and enhance readJdbc.kt for better Dataframe… 

    … creation
    @zaleslaw
    zaleslaw committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    ffa01fa View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2023

  1. Updated test cases for JDBC connection and enhanced the logic for rea… 

    …ding JDBC connections in readJdbc.kt.

In this commit, the ports in the JDBC URLs in imdbTest.kt file were modified to ensure correct connection to database servers. A new URL constant was added to facilitate reading tables with schema.

A new test case was added for better testing of reading tables with schemas.

In readJdbc.kt, the logic for fetching and converting data from the ResultSet was revised for better dataframe creation.
    @zaleslaw
    zaleslaw committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    f5d0eca View commit details
    Browse the repository at this point in the history

  2. Updated: Removed method convertDataFromResultSet from DbType class

    @zaleslaw
    zaleslaw committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    5a6c1fd View commit details
    Browse the repository at this point in the history

  3. Add catalogue and limit parameters to readAllSqlTables"

    @zaleslaw
    zaleslaw committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    71705b9 View commit details
    Browse the repository at this point in the history

  4. Update DbType methods and Postgres tests.

    @zaleslaw
    zaleslaw committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    5c882c3 View commit details
    Browse the repository at this point in the history

  5. Handle null values in DataFrame filtering and mark code for removal

    @zaleslaw
    zaleslaw committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    cc152c7 View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2023

  1. Removed redundant DataFrame read methods in readJdbc.kt

    @zaleslaw
    zaleslaw committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    0e7f503 View commit details
    Browse the repository at this point in the history

  2. Changes include handling potential duplication of column names in SQL… 

    … queries
    @zaleslaw
    zaleslaw committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    56395c2 View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2023

  1. Added support for empty tables

    @zaleslaw
    zaleslaw committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    dddbf30 View commit details
    Browse the repository at this point in the history

  2. Refactor type conversions for better handling of unsupported SQL types

    @zaleslaw
    zaleslaw committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    58d23c9 View commit details
    Browse the repository at this point in the history

  3. Fixed the test with new types generation

    @zaleslaw
    zaleslaw committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    cf7c040 View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2023

  1. Merge branch '0.12.1' into fix-jdbc-integration

    @zaleslaw
    zaleslaw authored Nov 27, 2023
    Configuration menu
    Copy the full SHA
    6e92bb2 View commit details
    Browse the repository at this point in the history

  2. Added simple Test for JSON column handling

    @zaleslaw
    zaleslaw committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    55344f2 View commit details
    Browse the repository at this point in the history

  3. disabled integration tests

    @zaleslaw
    zaleslaw committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    6495f30 View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2023

  1. Ensure non-nullability of "amount" in Sale, refactor SQL to KType map… 

    …ping
    @zaleslaw
    zaleslaw committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    2a7f1fd View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2023

  1. Fix nullability check in readJdbc.kt

    @zaleslaw
    zaleslaw committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    5d94ac0 View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2023

  1. Improve the handling of nullability of database columns when creating… 

    … DataFrame.
    @zaleslaw
    zaleslaw committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    32b1d5a View commit details
    Browse the repository at this point in the history

  2. Updated tests for an imdb database

    @zaleslaw
    zaleslaw committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    fb21cf4 View commit details
    Browse the repository at this point in the history

  3. Updated tests for an mysql/mariadb database

    @zaleslaw
    zaleslaw committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    32da39d View commit details
    Browse the repository at this point in the history

  4. Updated tests for a postgresql database

    @zaleslaw
    zaleslaw committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    de19f6d View commit details
    Browse the repository at this point in the history

  5. Updated tests for a sqlite database

    @zaleslaw
    zaleslaw committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    9e64d4a View commit details
    Browse the repository at this point in the history

  6. Updated tests for a sqlite database

    @zaleslaw
    zaleslaw committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    af3ff88 View commit details
    Browse the repository at this point in the history

  7. Formatted

    @zaleslaw
    zaleslaw committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    2361a76 View commit details
    Browse the repository at this point in the history

  8. Formattedd

    @zaleslaw
    zaleslaw committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    fd73a08 View commit details
    Browse the repository at this point in the history