Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG]: UsedTable incorrectly sets is_read for spark.range(10).saveAsTable("a.b") #2893

Closed
1 task done
nfx opened this issue Oct 9, 2024 · 1 comment · Fixed by #2940
Closed
1 task done

[BUG]: UsedTable incorrectly sets is_read for spark.range(10).saveAsTable("a.b") #2893

nfx opened this issue Oct 9, 2024 · 1 comment · Fixed by #2940
Assignees
@ericvergnaud
Labels
internal this pull request won't appear in release notes

Comments

@nfx
Copy link
Collaborator

nfx commented Oct 9, 2024

Is there an existing issue for this?

  • I have searched the existing issues

Current Behavior

spark.range(10).saveAsTable("a.b") presents table a.b with is_read=True and it has to be false

Expected Behavior

No response

Steps To Reproduce

No response

Cloud

AWS

Operating System

macOS

Version

latest via Databricks CLI

Relevant log output

No response
@nfx nfx added bug internal this pull request won't appear in release notes labels Oct 9, 2024
@ericvergnaud ericvergnaud self-assigned this Oct 11, 2024
@ericvergnaud
Copy link
Contributor

Not really a bug, as stated in #2772 this requires a dedicated PR

@ericvergnaud ericvergnaud mentioned this issue Oct 11, 2024
Merged
1 task
@nfx nfx closed this as completed in #2940 Oct 11, 2024
nfx added a commit that referenced this issue Oct 11, 2024
@ericvergnaud @nfx
Set UsedTable.is_read/is_write for spark calls (#2940)
e55a399 
## Changes
Current code does not populate `is_read` or `is_write` for spark calls.
This PR fixes the issue.

### Linked issues
Resolves #2893 

### Functionality
None

### Tests
- [x] updated unit tests

---------

Co-authored-by: Eric Vergnaud <eric.vergnaud@databricks.com>
Co-authored-by: Serge Smertin <259697+nfx@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ericvergnaud ericvergnaud

Labels
internal this pull request won't appear in release notes
Projects
UCX (weekly) - DO NOT USE THIS BOARD
Archived in project
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Set UsedTable.is_read/is_write for spark calls databrickslabs/ucx
2 participants
@nfx @ericvergnaud