Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PERF: NDArrayBackedExtensionArray in cython #40840

Merged
merged 8 commits into from
Apr 14, 2021

Conversation

jbrockmendel
Copy link
Member

This is a reboot of #40054, implements NDArrayBacked in a new arrays.pyx rather than in lib.pyx. The perf benefits have improved since #40054, as there is now the prospect of implementing a NDArrayBackedExtensionBlock in cython which will appreciably improve constructor and slicing performance.

@jreback jreback added Internals Related to non-user accessible pandas implementation Performance Memory or execution speed performance labels Apr 14, 2021
@jreback jreback added this to the 1.3 milestone Apr 14, 2021
obj = cls._simple_new(arr, arr.dtype)

# for foo in [arr, dta, obj]: ...

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice, reproducible benchmarks!

@jreback jreback merged commit 0363f84 into pandas-dev:master Apr 14, 2021
@jbrockmendel jbrockmendel deleted the perf-ndarray-backed-4 branch April 14, 2021 14:10
yeshsurya pushed a commit to yeshsurya/pandas that referenced this pull request Apr 21, 2021
yeshsurya pushed a commit to yeshsurya/pandas that referenced this pull request May 6, 2021
JulianWgs pushed a commit to JulianWgs/pandas that referenced this pull request Jul 3, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Internals Related to non-user accessible pandas implementation Performance Memory or execution speed performance
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants