-
Notifications
You must be signed in to change notification settings - Fork 653
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Implement numpy autowrapping in remote context #1834
Implement numpy autowrapping in remote context #1834
Conversation
Codecov Report
@@ Coverage Diff @@
## master #1834 +/- ##
==========================================
- Coverage 83.58% 83.56% -0.02%
==========================================
Files 79 80 +1
Lines 8558 8636 +78
==========================================
+ Hits 7153 7217 +64
- Misses 1405 1419 +14
Continue to review full report at Codecov.
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I agree with @anmyachev about docstrings. We also need a documentation page for how this works, so it will be good to add a new issue for it (for next release).
The implementation looks good to me.
@vnlitvinov LGTM! Let's wait CI result. |
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
…ke ndarray Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
611cd4b
to
e7d9a2f
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @vnlitvinov LGTM!
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
What do these changes do?
This replaces
numpy
module whenever a user code executesimport numpy
with a special class that returns different things in local and remote contexts.It also registers special reducers (support for pickling), as, when trying to pickle an object from "local" numpy when "remote" is activated leads to
TypeError: different class
without special reducer.Note that access to
numpy
is always local formodin.*
andpandas.*
packages, as NumPy is used internally there and is not needed to be proxied to the remote.flake8 modin
black --check modin
git commit -s