Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sync #1 #2

Merged
merged 120 commits into from
Sep 16, 2020
Merged

Sync #1 #2

merged 120 commits into from
Sep 16, 2020

Conversation

aregm
Copy link
Owner

@aregm aregm commented Sep 16, 2020

What do these changes do?

  • commit message follows format outlined here
  • passes flake8 modin
  • passes black --check modin
  • signed commit with git commit -s
  • Resolves #?
  • tests added and passing

devin-petersohn and others added 30 commits July 21, 2020 09:23
@devin-petersohn @gshimansky @anmyachev
Move logic of sort_values into the query compiler (#1754)
b92fce1 
* Move logic of `sort_values` into the query compiler

Signed-off-by: Devin Petersohn <devin.petersohn@gmail.com>

* Remove dead code

Signed-off-by: Devin Petersohn <devin.petersohn@gmail.com>

* Add back `"kind"` parameter

Signed-off-by: Devin Petersohn <devin.petersohn@gmail.com>

* Added a test for bug #1743

This test runs inplace sort of dataframe that has non-numerical index

Signed-off-by: Gregory Shimansky <gregory.shimansky@intel.com>

* Apply suggestions from code review

Co-authored-by: anmyachev <45976948+anmyachev@users.noreply.github.com>

Co-authored-by: Gregory Shimansky <gregory.shimansky@intel.com>
Co-authored-by: anmyachev <45976948+anmyachev@users.noreply.github.com>
@devin-petersohn
Improve performance of slice indexing (#1753)
c1aba38 
* Improves performance of slice indexing

* Resolves #1752

Signed-off-by: Devin Petersohn <devin.petersohn@gmail.com>

* Fix issue

Signed-off-by: Devin Petersohn <devin.petersohn@gmail.com>

* Fix Series cases

Signed-off-by: Devin Petersohn <devin.petersohn@gmail.com>
@dchigarev
[FIX] Fix #1683 - losing index names in pd.concat (#1684)
51c3803 
Signed-off-by: Dmitry Chigarev <dmitry.chigarev@intel.com>
@devin-petersohn
TEST-#1759: Add commitlint check on pull requests (#1760)
5c1dff6 
Signed-off-by: Devin Petersohn <devin.petersohn@gmail.com>
@amyskov
REFACTOR-#1741: Use low-level api for kurt function implementation wi…
37b7d2c 
…th defined level parameter (#1719)

Signed-off-by: Alexander Myskov <alexander.myskov@intel.com>
@dchigarev
[FIX] Fix of inconsistent indices #1726 #1731 #1732 #1734 (#1727)
bc9055a
@anmyachev @vnlitvinov
FEAT-#1781: implement ClusterError.__str__ (#1782)
731816d 
Co-authored-by: Vasily Litvinov <45396231+vnlitvinov@users.noreply.github.com>
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@prutskov
FEAT-#1194 #1283 #1138: Add Series.rolling, DataFrame.rolling
77a2994 
functionality to enable rolling window operations

Signed-off-by: Alexey Prutskov <alexey.prutskov@intel.com>
@YarShev
REFACTOR-#1763: Move logic of merge (#1764)
8658f09 
into the query compiler

Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
@YarShev
TEST-#1785: Change size of commit message header (#1786)
49f462c 
Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
@devin-petersohn
FIX-#1775: Fix support for callable in loc/iloc (#1776)
86e1a4e 
Signed-off-by: Devin Petersohn <devin.petersohn@gmail.com>
@devin-petersohn
FEAT-#1598: Update iterator implemetion to iloc (#1599)
21b515b 
Co-authored-by: Dmitry Chigarev <62142979+dchigarev@users.noreply.github.com>

Signed-off-by: Devin Petersohn <devin.petersohn@gmail.com>
@devin-petersohn
FIX-#1556: Fix support for nested assignment with loc/iloc (#1788)
8472cf1 
Signed-off-by: Devin Petersohn <devin.petersohn@gmail.com>
@dchigarev
FEAT-#1205: melt implementation (#1689)
cf695b3 
Signed-off-by: Dmitry Chigarev <dmitry.chigarev@intel.com>
@devin-petersohn
FIX-#1610: Fix support for loc with MultiIndex parameter (#1789)
0711223 
Signed-off-by: Devin Petersohn <devin.petersohn@gmail.com>
@devin-petersohn
FIX-#1700: Fix metadata for concat and mask when axis=1 (#1797)
3ef84f7 
Signed-off-by: Devin Petersohn <devin.petersohn@gmail.com>
@devin-petersohn
FIX-#1774: Fix unlimited column printing for smaller dataframes (#1799)
1604c5f 
Signed-off-by: Devin Petersohn <devin.petersohn@gmail.com>
@devin-petersohn
FIX-#1705: Fix visual bug with repr on smaller dataframes (#1798)
a8fc4f3 
Signed-off-by: Devin Petersohn <devin.petersohn@gmail.com>
@devin-petersohn
FIX-#1467: Fix support for cummax and cummin across int and float (#1800
184d1c5 
)

Signed-off-by: Devin Petersohn <devin.petersohn@gmail.com>
@devin-petersohn
FIX-#1631: Fix support for dictionary in pd.concat (#1795)
a47c928 
Signed-off-by: Devin Petersohn <devin.petersohn@gmail.com>
@devin-petersohn
TEST-#1119: Re-enable skipped Windows tests for DataFrame.prod (#1801)
d8a9972 
Signed-off-by: Devin Petersohn <devin.petersohn@gmail.com>
@devin-petersohn
Revert "TEST-#1119: Re-enable skipped Windows tests for `DataFrame.pr…
aaa79ed 
…od`" (#1813)

This reverts commit d8a9972.
@ikedaosushi
DOCS-#1809 missing links in the architecture page (#1810)
dcff8da
@vnlitvinov
TEST-#1779: Limit object store to 1GB during CI tests (#1744)
53f38a4 
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
@vnlitvinov
FIX-#1803: Change the order of execution engine change callbacks (#1805)
a08c0c8 
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
@vnlitvinov
FIX-#1807: Fix passing zone in rayscale, add ability to override image (
cac75c0 
#1808)

Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
@dchigarev
FIX-#1457: Series.reset_index considering 'name' fix (#1820)
4213f2e 
Signed-off-by: Dmitry Chigarev <dmitry.chigarev@intel.com>
@dchigarev
FIX-#1459: 'to_pandas' of nested objects added (#1828)
a95ddf9 
Signed-off-by: Dmitry Chigarev <dmitry.chigarev@intel.com>
@anmyachev
FIX-1708: Don't sort indexes in Series functions with level parameter (…
f43a70a 
…#1830)

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@vnlitvinov
FEAT-#1701: Enable running Modin via remote Ray on spawned cluster (#…
a2c68d6 
…1818)

For details see #1818

Co-authored-by: Devin Petersohn <devin-petersohn@users.noreply.github.com>

Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
ienkovich and others added 29 commits September 4, 2020 16:40
@ienkovich
REFACTOR-#2009: avoid index access in is_scalar calls (#2010)
1cf36e3 
Signed-off-by: ienkovich <ilya.enkovich@intel.com>
@amyskov
FIX-#1284: Series.searchsorted (#1668)
ac85a49 
Signed-off-by: Alexander Myskov <alexander.myskov@intel.com>
@itamarst
FEAT-#1222: Implement DataFrame.asof() without Pandas fallback (#1989)
0768600 
Signed-off-by: Itamar Turner-Trauring <itamar@itamarst.org>
@dchigarev
FEAT-#1523: 'nrows' support to 'read_csv' added (#1894)
c7e947b 
Signed-off-by: Dmitry Chigarev <dmitry.chigarev@intel.com>
@anmyachev
DOCS-#2015: update supported docs (#2016)
333e32c 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@anmyachev
TEST-2022: speed up prepare-cache job (#2023)
2f658e0 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@anmyachev
TEST-#2024: remove test_dataframe.py (#2025)
51edadb 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@anmyachev
TEST-#2020: decrease parallel tests on Ubuntu (#2021)
7d6eef9 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@anmyachev
TEST-#2030: speed up cache; decrease parallel jobs in push.yml (#2031)
03fe0d6 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@anmyachev
TEST-#2028: speed up window tests (#2029)
3a6dc67 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@anmyachev
TEST-#2026: speed up test_join_sort.py (#2027)
3ea0edb 
* TEST-#2026: speed up test_join_sort.py

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>

* TEST-#2026: Update modin/pandas/test/dataframe/test_join_sort.py

Co-authored-by: Dmitry Chigarev <62142979+dchigarev@users.noreply.github.com>

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@prutskov
FIX-#1959 #1987: Fix duplicated and drop_duplicates functions (#1994
8265b71 
)

Signed-off-by: Alexey Prutskov <alexey.prutskov@intel.com>
@anmyachev
TEST-#2037: speed up test_binary with refactor dataframe.py (#2038)
a9c6e50 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@anmyachev
TEST-#2044: speed up iter tests (#2045)
9325ee5 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@anmyachev
TEST-#2042: speed up udf tests (#2043)
0c0b6f6 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@anmyachev
TEST-#2033: speed up test_series.py (#2034)
b370489 
* TEST-#2033: speed up test_series.py

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>

* TEST-#2033: fix kurtosis test

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>

* TEST-#2033: refactor test for #1953

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@anmyachev
TEST-#2039: speed up default tests (#2040)
06cc5a4 
* TEST-#2039: speed up default tests

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>

* TEST-#2039: refactor some resample tests

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>

* TEST-#2039: fix test_resampler

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@anmyachev
TEST-#2050: decrease number of parallel jobs on windows Ci (#2051)
6489e7a 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@anton-malakhov
Conda recipe for Modin (#1986)
1108730 
Signed-off-by: Anton Malakhov <Anton.Malakhov@intel.com>
@ienkovich
REFACTOR-#2011: move default_to_pandas in groupby to backend (#2041)
9c03512 
Signed-off-by: ienkovich <ilya.enkovich@intel.com>
@YarShev
FEAT-#1285: Add sem implementation for Series and DataFrame (#2048
dd27013 
)

Signed-off-by: Igoshev, Yaroslav <yaroslav.igoshev@intel.com>
@dchigarev
FIX-#2054: Moved non-dependent on modin.DataFrame utils to modin/util…
6140c81 
…s.py (#2055)

Signed-off-by: Dmitry Chigarev <dmitry.chigarev@intel.com>
@anmyachev
TEST-#1891: use conda instead of pip (#2056)
847d4a3 
* TEST-#1891: use conda instead of pip

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>

* TEST-#1891: remove source ctivate modin

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>

* TEST-#1891: pin some dev tools

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@anmyachev
FIX-#2052: fix spawning of remote cluster (#2053)
0f54983 
* Fix spawning of remote cluster for Ray 0.8.7
* Update dependencies
* Change Teamcity Dockerfile to fully use conda for setting up environment

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@vnlitvinov
FEAT-#2058: Improve how remote factories are defined (#2060)
2ca3f34 
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
@amyskov
FIX-#1918: fix core dumped issue (#2000)
df725d2 
Signed-off-by: Alexander Myskov <alexander.myskov@intel.com>
@prutskov
FIX-#1386: Fix read_csv for incorrect csv data (#2076)
d308c58 
Signed-off-by: Alexey Prutskov <alexey.prutskov@intel.com>
@ienkovich
REFACTOR-#2035: move getitem_array to the backend (#2036)
51ed0ae 
Signed-off-by: ienkovich <ilya.enkovich@intel.com>
@heuermh
REFACTOR-#2083: Rename LISCENSE_HEADER to LICENSE_HEADER. (#2082)
c955d50 
Signed-off-by: Michael L Heuer <heuermh@acm.org>
@aregm aregm merged commit 40aa690 into aregm:master Sep 16, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.