Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow Spark SQL as a dialect #968

Merged
merged 30 commits into from
Dec 24, 2023
+1,858 −11
Merged

Allow Spark SQL as a dialect #968

Show file tree
Hide file tree
Changes from 8 commits
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
6da5cc5
add basic spark support to library
gilandose Dec 18, 2023
280b646
adding tests
gilandose Dec 18, 2023
145ae6a
formatting
gilandose Dec 18, 2023
7cd9e61
add spark connection
gilandose Dec 18, 2023
0f6a328
add spark connection
gilandose Dec 18, 2023
0b7e3bf
fixed test and formating
gilandose Dec 18, 2023
e60f0ea
added docs
gilandose Dec 19, 2023
c4acca1
exclude execution
gilandose Dec 19, 2023
96846d4
documentation updates
gilandose Dec 19, 2023
c0723d7
adjust doc string for close
gilandose Dec 19, 2023
3de5f61
add generic
gilandose Dec 19, 2023
0b968dc
integrated better with existing functionality
gilandose Dec 19, 2023
e6a25a7
finishing integration tests
gilandose Dec 20, 2023
a971600
pass config and alias correctly
gilandose Dec 20, 2023
a64b2a3
fixed issue with backticks and also implemented fake cursor
gilandose Dec 20, 2023
0a9b4de
change configuration name
gilandose Dec 20, 2023
189e4a0
fix env variable error integration tests CI
gilandose Dec 20, 2023
dc5e208
fixing lint errors
gilandose Dec 20, 2023
a4ef89b
change log formating
gilandose Dec 20, 2023
45e7b6c
metadata ipynb
gilandose Dec 20, 2023
96173de
addressing comments
gilandose Dec 21, 2023
df5925e
update changelog
gilandose Dec 21, 2023
27dca2b
changelog
gilandose Dec 21, 2023
998b7d8
Merge remote-tracking branch 'upstream/master'
gilandose Dec 21, 2023
743dee8
fix row count
gilandose Dec 21, 2023
ac20efd
spelling
gilandose Dec 21, 2023
7bf2b5b
spelling
gilandose Dec 21, 2023
36aaa10
remove pypark dev dependency
gilandose Dec 21, 2023
db024fb
review comments
gilandose Dec 23, 2023
cfb5431
missed readStream in connection.py
gilandose Dec 24, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions doc/_toc.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,7 @@ parts:
- file: integrations/duckdb-native
- file: integrations/compatibility
- file: integrations/chdb
- file: integrations/spark

- caption: API Reference
chapters:
Expand Down
1 change: 1 addition & 0 deletions doc/conf.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,7 @@
"integrations/oracle.ipynb",
"integrations/snowflake.ipynb",
"integrations/redshift.ipynb",
"integrations/spark.ipynb",
]
nb_execution_in_temp = True
nb_execution_show_tb = True
Expand Down
Loading
Loading