Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

docs: Add initial version of ecosystem page in user guide #13779

Closed
wants to merge 14 commits into from
Closed

docs: Add initial version of ecosystem page in user guide #13779

wants to merge 14 commits into from

Conversation

r-brink
Copy link
Contributor

@r-brink r-brink commented Jan 17, 2024

Related to this issue: #13778

@github-actions github-actions bot added documentation Improvements or additions to documentation python Related to Python Polars rust Related to Rust Polars labels Jan 17, 2024
ritchie46
ritchie46 reviewed Jan 17, 2024
View reviewed changes
docs/user-guide/ecosystem.md Outdated

#### [Apache Arrow](https://arrow.apache.org/)

Apache Arrow enables zero-copy reads of data, meaning that data can be directly accessed in its in-memory format without the need for copying or serialisation. This greatly enhances performance, especially when sharing data between different processes or systems. Using Apache Arrow, Polars is compatible with a wide range of libraries that also make use of Apache Arrow, like Pandas and Pyspark.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is only possible within the same process without copying. It is true that there is no serializatin if two differen processes share arrow memory.

This greatly enhances performance

I would mostly say that it enhances performance when integrating with different tools.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, I'll update in the next iteration

docs/user-guide/ecosystem.md

#### [Matplotlib](https://matplotlib.org/)

Matplotlib is a comprehensive library for creating static, animated, and interactive visualizations in Python. Matplotlib makes easy things easy and hard things possible.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How does polars interact with matplotlib?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is a pending PR for a page about data visualisations from @braaannigan . My idea is to link to that page or show the plots on this page. I have opened an issue to open the discussion. That is also why this PR is in draft

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@r-brink I'll try to get my PR fixed in the next couple of days

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@braaannigan that would be great. I will update the PR with links to the section on your visualisation page!

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@r-brink Hopefully can get this merged soon #13052

stinodego and others added 13 commits January 22, 2024 11:19
@stinodego @r-brink
fix: Raise error instead of panic when joining on wildcard/nth (pola-…
9452499 
…rs#13742)
@reswqa @r-brink
fix: Fix the non-null test of transpose (pola-rs#13783)
516b76d
@orlp @r-brink
fix: do not read data for zero-length compressed buffer (pola-rs#13791)
80cd51e
@reswqa @r-brink
feat: Add nulls_last for list/array.sort (pola-rs#13795)
303674c
@stinodego @r-brink
depr(python): Deprecate default delimiter value for str.concat (pol…
ecda888 
…a-rs#13690)
@langestefan @stinodego @r-brink
docs: Fix typo in deprecation message of with_row_count (pola-rs#13793
11a3ebd 
)

Co-authored-by: Stijn de Gooijer <stijndegooijer@gmail.com>
@reswqa @stinodego @r-brink
feat: Impl count_matches for array namespace (pola-rs#13675)
12b8cc4 
Co-authored-by: Stijn de Gooijer <stijndegooijer@gmail.com>
@stinodego @r-brink
release(python): Python Polars 0.20.5 (pola-rs#13798)
1df65ee
@alexander-beedie @stinodego @r-brink
fix(python): validate operator arithmetic with None, fix Series e…
6647e9c 
…dge-case (pola-rs#13780)

Co-authored-by: Stijn de Gooijer <stijn@degooijer.io>
@reswqa @r-brink
perf: optimize arr.sum for inner non-null bool (pola-rs#13800)
d6504a5
@alexander-beedie @r-brink
feat(python): allow ftp URLs, improve URL check (pola-rs#13781)
25e59b7
@r-brink
small changes based on feedback
bcbdfe6
@r-brink
add lancedb and small tweaks
e9dcc6d
@r-brink r-brink closed this Jan 22, 2024
@r-brink r-brink deleted the guide-ecosystem branch January 22, 2024 10:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@braaannigan braaannigan braaannigan left review comments

@ritchie46 ritchie46 ritchie46 left review comments

@c-peters c-peters Awaiting requested review from c-peters c-peters will be requested when the pull request is marked ready for review c-peters is a code owner

@alexander-beedie alexander-beedie Awaiting requested review from alexander-beedie alexander-beedie will be requested when the pull request is marked ready for review alexander-beedie is a code owner

@MarcoGorelli MarcoGorelli Awaiting requested review from MarcoGorelli MarcoGorelli will be requested when the pull request is marked ready for review MarcoGorelli is a code owner

@reswqa reswqa Awaiting requested review from reswqa reswqa will be requested when the pull request is marked ready for review reswqa is a code owner

@orlp orlp Awaiting requested review from orlp orlp will be requested when the pull request is marked ready for review orlp is a code owner

Assignees
No one assigned
Labels
documentation Improvements or additions to documentation python Related to Python Polars rust Related to Rust Polars
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
8 participants
@r-brink @ritchie46 @braaannigan @stinodego @reswqa @orlp @langestefan @alexander-beedie