Enable running remote Ray on spawned cluster #1818
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Added sample mortgage runner Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
…dray Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
…_pandas Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
…attributes for remote objects Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
…to proxies Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
… properly Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Added helper for declaring dual-nature classes with transparet proxies Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
…dual-nature Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
…sing this info Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Add dual-nature class for DataFrameGroupBy Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Also prepare remote IO engine earlier Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
…y place Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
5 tasks
anmyachev
reviewed
Jul 27, 2020
anmyachev
reviewed
Jul 27, 2020
|
anmyachev
reviewed
Jul 27, 2020
anmyachev
reviewed
Jul 27, 2020
anmyachev
reviewed
Jul 27, 2020
anmyachev
reviewed
Jul 27, 2020
anmyachev
reviewed
Jul 27, 2020
|
|
anmyachev
requested changes
Jul 27, 2020
devin-petersohn
requested changes
Jul 27, 2020
Codecov Report
@@ Coverage Diff @@
## master #1818 +/- ##
==========================================
+ Coverage 78.25% 83.22% +4.97%
==========================================
Files 77 79 +2
Lines 8287 8537 +250
==========================================
+ Hits 6485 7105 +620
+ Misses 1802 1432 -370
Continue to review full report at Codecov.
|
Co-authored-by: Devin Petersohn <devin-petersohn@users.noreply.github.com> Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
vnlitvinov
force-pushed
the
ray-of-light-in-the-clouds
branch
from
5efdbdc
to
8869c61
Compare
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
devin-petersohn
approved these changes
Jul 28, 2020
There was a problem hiding this comment.
🎉 Thanks @vnlitvinov, LGTM!
Waiting to merge for @anmyachev review
aregm
pushed a commit
to aregm/modin
that referenced
this pull request
Sep 16, 2020
…ed cluster (modin-project#1818) For details see modin-project#1818 Co-authored-by: Devin Petersohn <devin-petersohn@users.noreply.github.com> Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What do these changes do?
This enables the story of scaling out Modin on cloud-based clusters.
Mortgage benchmark from https://github.com/intel-go/omniscripts/ could now be run using provided runner.
flake8 modinblack --check modingit commit -sNote: this is a replacement for #1750