Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(pyspark): add catalog support to pyspark #9042

Merged
merged 3 commits into from
Apr 25, 2024

Conversation

gforsyth
Copy link
Member

@gforsyth gforsyth commented Apr 23, 2024

Resolves #9038

Adds support for specifying the catalog in various pyspark calls.

BREAKING CHANGE: Arguments to create_database, drop_database, and
get_schema are now keyword-only except for the name args. Calls to
these functions that have relied on positional argument ordering need to
be updated.

BREAKING CHANGE: Arguments to `create_database`, `drop_database`, and
`get_schema` are now keyword-only except for the `name` args.  Calls to
these functions that have relied on positional argument ordering need to
be updated.
no catalog support for this version so they return empty
Copy link
Member

@cpcloud cpcloud left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome, thanks!

@cpcloud cpcloud added this to the 9.0 milestone Apr 25, 2024
@cpcloud cpcloud added feature Features or general enhancements pyspark The Apache PySpark backend labels Apr 25, 2024
@cpcloud cpcloud merged commit 2c1a58e into ibis-project:main Apr 25, 2024
86 checks passed
@gforsyth gforsyth deleted the pyspark_catalog branch April 25, 2024 13:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature Features or general enhancements pyspark The Apache PySpark backend
Projects
None yet
Development

Successfully merging this pull request may close these issues.

feat: add catalog & database support to create_table
2 participants