Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement numpy autowrapping in remote context #1834

Merged

Conversation

vnlitvinov
Copy link
Collaborator

What do these changes do?

This replaces numpy module whenever a user code executes import numpy with a special class that returns different things in local and remote contexts.
It also registers special reducers (support for pickling), as, when trying to pickle an object from "local" numpy when "remote" is activated leads to TypeError: different class without special reducer.

Note that access to numpy is always local for modin.* and pandas.* packages, as NumPy is used internally there and is not needed to be proxied to the remote.

@vnlitvinov vnlitvinov added this to the 0.8.0 milestone Jul 28, 2020
@codecov
Copy link

codecov bot commented Jul 28, 2020

Codecov Report

Merging #1834 into master will decrease coverage by 0.01%.
The diff coverage is 82.05%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #1834      +/-   ##
==========================================
- Coverage   83.58%   83.56%   -0.02%     
==========================================
  Files          79       80       +1     
  Lines        8558     8636      +78     
==========================================
+ Hits         7153     7217      +64     
- Misses       1405     1419      +14     
Impacted Files Coverage Δ
modin/data_management/factories.py 74.31% <0.00%> (-0.69%) ⬇️
modin/experimental/pandas/numpy_wrap.py 82.89% <82.89%> (ø)
modin/experimental/pandas/__init__.py 100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 02977df...e7d9a2f. Read the comment docs.

@modin-bot
Copy link

modin-bot commented Jul 28, 2020

TeamCity Python test results bot

Tests PASSed

Tests Logs
============================= test session starts ==============================
platform linux -- Python 3.7.7, pytest-6.0.0, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: openfiles-0.5.0, remotedata-0.3.2, cov-2.10.0, custom-exit-code-0.3.0, forked-1.3.0, testmon-1.0.2, xdist-1.34.0
collected 94 items

modin/pandas/test/test_io.py .................sX..........s............. [ 45%]
....s..............s..s.X.....s.................ss.                      [100%]

----------- coverage: platform linux, python 3.7.7-final-0 -----------
Name                                                               Stmts   Miss  Cover
--------------------------------------------------------------------------------------
modin/__init__.py                                                     76     38    50%
modin/_version.py                                                    272    172    37%
modin/apply_license_header.py                                         19     19     0%
modin/backends/__init__.py                                             0      0   100%
modin/backends/base/__init__.py                                        0      0   100%
modin/backends/base/query_compiler.py                                130      1    99%
modin/backends/pandas/__init__.py                                      0      0   100%
modin/backends/pandas/parsers.py                                     207    175    15%
modin/backends/pandas/query_compiler.py                              845    505    40%
modin/data_management/__init__.py                                      0      0   100%
modin/data_management/dispatcher.py                                   78     16    79%
modin/data_management/factories.py                                   109     48    56%
modin/data_management/functions/__init__.py                            7      0   100%
modin/data_management/functions/binary_function.py                    21     14    33%
modin/data_management/functions/foldfunction.py                        6      1    83%
modin/data_management/functions/function.py                            6      1    83%
modin/data_management/functions/groupby_function.py                   50     44    12%
modin/data_management/functions/mapfunction.py                         6      1    83%
modin/data_management/functions/mapreducefunction.py                   9      2    78%
modin/data_management/functions/reductionfunction.py                   6      1    83%
modin/data_management/utils.py                                        32     12    62%
modin/engines/__init__.py                                              0      0   100%
modin/engines/base/__init__.py                                         0      0   100%
modin/engines/base/frame/__init__.py                                   0      0   100%
modin/engines/base/frame/axis_partition.py                            45     20    56%
modin/engines/base/frame/data.py                                     522    339    35%
modin/engines/base/frame/partition.py                                  1      0   100%
modin/engines/base/frame/partition_manager.py                        184    106    42%
modin/engines/base/io/__init__.py                                     12      0   100%
modin/engines/base/io/column_stores/__init__.py                        0      0   100%
modin/engines/base/io/column_stores/column_store_reader.py            40     29    28%
modin/engines/base/io/column_stores/feather_reader.py                  9      5    44%
modin/engines/base/io/column_stores/hdf_reader.py                      3      0   100%
modin/engines/base/io/column_stores/parquet_reader.py                 34     29    15%
modin/engines/base/io/file_reader.py                                  85     66    22%
modin/engines/base/io/io.py                                          110      6    95%
modin/engines/base/io/sql/__init__.py                                  0      0   100%
modin/engines/base/io/sql/sql_reader.py                               39     31    21%
modin/engines/base/io/text/__init__.py                                 0      0   100%
modin/engines/base/io/text/csv_reader.py                             112    105     6%
modin/engines/base/io/text/excel_reader.py                           106     97     8%
modin/engines/base/io/text/fwf_reader.py                             115    108     6%
modin/engines/base/io/text/json_reader.py                             50     43    14%
modin/engines/base/io/text/text_file_reader.py                        34     24    29%
modin/engines/base/series/__init__.py                                  0      0   100%
modin/engines/dask/__init__.py                                         0      0   100%
modin/engines/dask/pandas_on_dask/__init__.py                          0      0   100%
modin/engines/dask/pandas_on_dask/frame/__init__.py                    0      0   100%
modin/engines/dask/pandas_on_dask/frame/axis_partition.py             27     27     0%
modin/engines/dask/pandas_on_dask/frame/data.py                       15     15     0%
modin/engines/dask/pandas_on_dask/frame/partition.py                  75     75     0%
modin/engines/dask/pandas_on_dask/frame/partition_manager.py          44     44     0%
modin/engines/dask/pandas_on_dask/io.py                               17     17     0%
modin/engines/dask/pandas_on_dask/series/__init__.py                   0      0   100%
modin/engines/dask/task_wrapper.py                                     9      9     0%
modin/engines/python/__init__.py                                       0      0   100%
modin/engines/python/pandas_on_python/__init__.py                      0      0   100%
modin/engines/python/pandas_on_python/frame/__init__.py                0      0   100%
modin/engines/python/pandas_on_python/frame/axis_partition.py         14      0   100%
modin/engines/python/pandas_on_python/frame/data.py                    4      0   100%
modin/engines/python/pandas_on_python/frame/partition.py              65      6    91%
modin/engines/python/pandas_on_python/frame/partition_manager.py       7      0   100%
modin/engines/python/pandas_on_python/io.py                            6      0   100%
modin/engines/python/pandas_on_python/series/__init__.py               0      0   100%
modin/engines/ray/__init__.py                                          0      0   100%
modin/engines/ray/generic/__init__.py                                  0      0   100%
modin/engines/ray/generic/frame/__init__.py                            0      0   100%
modin/engines/ray/generic/frame/partition_manager.py                  10     10     0%
modin/engines/ray/generic/io.py                                       14     14     0%
modin/engines/ray/generic/series/__init__.py                           0      0   100%
modin/engines/ray/pandas_on_ray/__init__.py                            0      0   100%
modin/engines/ray/pandas_on_ray/frame/__init__.py                      0      0   100%
modin/engines/ray/pandas_on_ray/frame/axis_partition.py               22     22     0%
modin/engines/ray/pandas_on_ray/frame/data.py                         11     11     0%
modin/engines/ray/pandas_on_ray/frame/partition.py                    86     86     0%
modin/engines/ray/pandas_on_ray/frame/partition_manager.py            43     43     0%
modin/engines/ray/pandas_on_ray/io.py                                 18     18     0%
modin/engines/ray/pandas_on_ray/series/__init__.py                     0      0   100%
modin/engines/ray/task_wrapper.py                                      7      7     0%
modin/engines/ray/utils.py                                            26     26     0%
modin/error_message.py                                                27      8    70%
modin/experimental/__init__.py                                         0      0   100%
modin/experimental/cloud/__init__.py                                   6      6     0%
modin/experimental/cloud/base.py                                      36     36     0%
modin/experimental/cloud/cluster.py                                   92     92     0%
modin/experimental/cloud/connection.py                                99     99     0%
modin/experimental/cloud/meta_magic.py                                54     54     0%
modin/experimental/cloud/rayscale.py                                 113    113     0%
modin/experimental/cloud/rpyc_proxy.py                               167    167     0%
modin/experimental/engines/__init__.py                                 0      0   100%
modin/experimental/engines/pandas_on_ray/__init__.py                   0      0   100%
modin/experimental/engines/pandas_on_ray/io_exp.py                    38     38     0%
modin/experimental/engines/pandas_on_ray/sql.py                       66     66     0%
modin/experimental/pandas/__init__.py                                  7      7     0%
modin/experimental/pandas/io_exp.py                                    7      7     0%
modin/experimental/pandas/numpy_wrap.py                               76     76     0%
modin/pandas/__init__.py                                              51     20    61%
modin/pandas/base.py                                                1222    922    25%
modin/pandas/concat.py                                                61     51    16%
modin/pandas/dataframe.py                                            866    658    24%
modin/pandas/datetimes.py                                              7      3    57%
modin/pandas/general.py                                               53     35    34%
modin/pandas/groupby.py                                              295    203    31%
modin/pandas/indexing.py                                             213    213     0%
modin/pandas/io.py                                                   147     11    93%
modin/pandas/iterator.py                                              15      9    40%
modin/pandas/reshape.py                                               30     20    33%
modin/pandas/series.py                                               946    619    35%
modin/pandas/utils.py                                                 42      5    88%
--------------------------------------------------------------------------------------
TOTAL                                                               8636   6026    30%


=========== 84 passed, 8 skipped, 2 xpassed, 146 warnings in 45.45s ============
Closing remaining open files:test_write_modin.hdf...donetest_write_pandas.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.7.7, pytest-6.0.0, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: openfiles-0.5.0, remotedata-0.3.2, cov-2.10.0, custom-exit-code-0.3.0, forked-1.3.0, testmon-1.0.2, xdist-1.34.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
gw0 [19232] / gw1 [19232] / gw2 [19232] / gw3 [19232] / gw4 [19232] / gw5 [19232] / gw6 [19232] / gw7 [19232] / gw8 [19232] / gw9 [19232] / gw10 [19232] / gw11 [19232] / gw12 [19232] / gw13 [19232] / gw14 [19232] / gw15 [19232] / gw16 [19232] / gw17 [19232] / gw18 [19232] / gw19 [19232] / gw20 [19232] / gw21 [19232] / gw22 [19232] / gw23 [19232] / gw24 [19232] / gw25 [19232] / gw26 [19232] / gw27 [19232] / gw28 [19232] / gw29 [19232] / gw30 [19232] / gw31 [19232] / gw32 [19232] / gw33 [19232] / gw34 [19232] / gw35 [19232] / gw36 [19232] / gw37 [19232] / gw38 [19232] / gw39 [19232] / gw40 [19232] / gw41 [19232] / gw42 [19232] / gw43 [19232] / gw44 [19232] / gw45 [19232] / gw46 [19232] / gw47 [19232]

........................................................................ [  0%]
........................................................................ [  0%]
.......................................................................... [  1%]
......................................................................... [  1%]
........................................................................ [  1%]
........................................................................ [  2%]
........................................................................ [  2%]
........................................................................ [  2%]
.......................................................................s.. [  3%]
......................................................................... [  3%]
........................................................................x........ [  4%]
................s........x.X............X......................X...Xx.... [  4%]
....X............s.....x.X.xX..........X............x......x..X..XX...... [  4%]
......X....x........x.....X.X.XX............X.x.....X..X...X...X.......XX... [  5%]
.x...X..x.X....X..x.XX.......X.....X.x..x........XXX.XxX.XX....X......... [  5%]
X.x..X...X.XX..X.X...XX..XXX..........XX.X....X.XXX.XXXX..X.XX........X..X [  6%]
X....XX.X.XXX.X..X...XX........XX.X.X...XXX.XX..XX...X.X.X....X.X.X..X.. [  6%]
X.XX...X...XX.X..X..X...X.X...XX........XX.X.X..X....X.X...XX........... [  6%]
.Xx.X..X...X......X.....X.....Xx..X.X.....X......X......X....X.XX.X.X... [  7%]
................X.....X..XxX.X.x.................X.....X..X.x.X.X...X... [  7%]
.X............X...x.XX...X.X.X.x.....X........XX....X..xX.XX.x.X..X.x... [  7%]
..X.........X...x..X...XX.XXx..X.X.X......X...x....X..x....X...X..XX..X.X.. [  8%]
XX......X....x...XX...XX..X.X.X..xXX.....X.XX...x..Xx.x.X...XX.x..XX.X.. [  8%]
.X..XXX.......XX..xx...X.xXXX....XXxXXX.X...X...X.X........XXxX...X.XX.XX [  9%]
..X.X.XXX.X.XX.X.X...........X.XX...XXXXXX..XX.XXX..X..X.X.X.X........... [  9%]
X.XX..XXXXX...XX.XXX...X..XX.X.X...........X.XXX.XXXXX.X.X...X.X.....XX.X. [  9%]
...X.......X.X.X..XX.X...XX....X.....X.X.X....X..X....X...X...X......XX. [ 10%]
........X...X....X...X.X.....X...X.....XX....................xX.X.X..... [ 10%]
.Xx........X.......X...........Xx..X.X.....Xx......X.X........X.......X... [ 10%]
XX..X.X......X.......X........X.X......X....X..X.X......X......X.....x....XX. [ 11%]
x....X....X...X.......X....X.....x...XX.X....x.X..X.X..........X.....X....X [ 11%]
X...X.X..X.....XX.....X.x...........X.X.....X...X....X.....X.X...X...... [ 12%]
.......X....X..X......xX..X..xX......X............X....X........X.Xx.X.. [ 12%]
X.Xx....X............x.X.....X..X...X.X......X....x.XX........XX..XXx... [ 12%]
.....X.......XXX..x............XX.X...X..X...X..X..X..........X........x. [ 13%]
.X...XX.X...X...XX.X.........X.X........X...........XX.x..XX.XX...........X [ 13%]
...X...........X.X..XX...X.x......x..X....X.X...x.......X.....X.xX...... [ 14%]
....X...............X...................X.....X......x...X.x.x.X........ [ 14%]
........X.................Xx....................X....x.................. [ 14%]
.......XX........X......................X...x......xXx....X...........X. [ 15%]
..xX.X......X.....X.......X............x.X.X............xx.......X...X.. [ 15%]
...........X....X.......X............................................x... [ 15%]
..X.......x...............X...x...................X.....x.X..x..x....... [ 16%]
....X.................Xx......XXx................X.....X...X............ [ 16%]
X...X...X...........X.......X....X...X.......................X.......... [ 17%]
....x.......................X............X..........X........X.......X.. [ 17%]
...................X........................X.........................X..... [ 17%]
............................................................................ [ 18%]
.......................................................................... [ 18%]
.s...................................................................... [ 18%]
........................................................................ [ 19%]
........x............................................................... [ 19%]
........................................................................ [ 20%]
........................................................................ [ 20%]
........................................................................ [ 20%]
........................................................................ [ 21%]
........................................................................ [ 21%]
........................................................................ [ 22%]
........x.......x........................................................ [ 22%]
.................................................s....................... [ 22%]
......................................................................... [ 23%]
............x.....................x..................s.................. [ 23%]
................x........................................................ [ 23%]
......................................................................... [ 24%]
..............................................................................s... [ 24%]
..............................s................................s........... [ 25%]
......s......................X...s...........................s.......... [ 25%]
......................................................................... [ 25%]
.......................................................................... [ 26%]
........................................................................ [ 26%]
........................................................................ [ 26%]
........................................................................ [ 27%]
.......................................................................... [ 27%]
........................................................................ [ 28%]
........................................................................ [ 28%]
.............................................................................. [ 28%]
........................................................................ [ 29%]
........................................................................ [ 29%]
........................................................................ [ 29%]
........................................................................ [ 30%]
........................................................................ [ 30%]
........................................................................ [ 31%]
........................................................................ [ 31%]
.......................................................................... [ 31%]
........................................................................... [ 32%]
.......................................................................... [ 32%]
........................................................................... [ 33%]
........................................................................ [ 33%]
........................................................................ [ 33%]
......................................................................... [ 34%]
......................................................................... [ 34%]
...................X.......X...........X......X........X...........X.... [ 34%]
........................................................................ [ 35%]
........................................................................ [ 35%]
........................................................................ [ 36%]
........................................................................ [ 36%]
........................................................................ [ 36%]
......................................................................... [ 37%]
........................................................................ [ 37%]
........................................................................ [ 37%]
........................................................................ [ 38%]
........................................................................ [ 38%]
......................................................................... [ 39%]
........................................................................ [ 39%]
........................................................................ [ 39%]
........................................................................ [ 40%]
........................................................................ [ 40%]
........................................................................ [ 40%]
........................................................................ [ 41%]
........................................................................ [ 41%]
........................................................................ [ 42%]
........................................................................ [ 42%]
........................................................................ [ 42%]
.......................................................................... [ 43%]
........................................................................ [ 43%]
........................................................................ [ 43%]
........................................................................ [ 44%]
........................................................................ [ 44%]
........................................................................ [ 45%]
........................................................................ [ 45%]
........................................................................ [ 45%]
........................................................................ [ 46%]
......................................................................... [ 46%]
........................................................................ [ 46%]
........................................................................ [ 47%]
........................................................................ [ 47%]
.......................................sss.sss.s.ss.ss.s................ [ 48%]
........................................................................ [ 48%]
........................................................................ [ 48%]
........................................................................ [ 49%]
........................................................................ [ 49%]
........................................................................ [ 49%]
........................................................................ [ 50%]
........................................................................ [ 50%]
........................................................................ [ 51%]
......................................................................... [ 51%]
........................................................................ [ 51%]
........................................................................ [ 52%]
......................................................................... [ 52%]
........................................................................ [ 52%]
........................................................................ [ 53%]
........................................................................ [ 53%]
........................................................................ [ 54%]
......................................................................... [ 54%]
........................................................................ [ 54%]
........................................................................ [ 55%]
........................................................................ [ 55%]
........................................................................ [ 55%]
........................................................................ [ 56%]
........................................................................ [ 56%]
........................................................................ [ 57%]
........................................................................ [ 57%]
........................................................................ [ 57%]
.......................................................................... [ 58%]
........................................................................ [ 58%]
........................................................................ [ 58%]
........................................................................ [ 59%]
........................................................................ [ 59%]
........................................................................ [ 60%]
........................................................................ [ 60%]
......................................................................... [ 60%]
........................................................................ [ 61%]
........................................................................ [ 61%]
........................................................................ [ 61%]
........................................................................ [ 62%]
........................................................................ [ 62%]
........................................................................ [ 63%]
........................................................................ [ 63%]
........................................................................ [ 63%]
........................................................................ [ 64%]
......................................................................... [ 64%]
......................................................................... [ 64%]
........................................................................ [ 65%]
........................................................................ [ 65%]
........................................................................ [ 66%]
........................................................................ [ 66%]
......................................................................... [ 66%]
......................................................................... [ 67%]
........................................................................ [ 67%]
........................................................................ [ 67%]
........................................................................ [ 68%]
........................................................................ [ 68%]
........................................................................ [ 69%]
........................................................................ [ 69%]
........................................................................ [ 69%]
........................................................................ [ 70%]
........................................................................ [ 70%]
.......................................................................... [ 70%]
........................................................................ [ 71%]
........................................................................ [ 71%]
........................................................................ [ 72%]
........................................................................ [ 72%]
........................................................................ [ 72%]
........................................................................ [ 73%]
........................................................................ [ 73%]
........................................................................ [ 73%]
......................................................................... [ 74%]
......................................................................... [ 74%]
........................................................................ [ 75%]
........................................................................ [ 75%]
.......................................................................... [ 75%]
........................................................................ [ 76%]
........................................................................ [ 76%]
........................................................................ [ 76%]
......................................................................... [ 77%]
........................................................................ [ 77%]
........................................................................ [ 78%]
........................................................................ [ 78%]
........................................................................ [ 78%]
........................................................................ [ 79%]
........................................................................ [ 79%]
........................................................................ [ 79%]
......................................................................... [ 80%]
........................................................................ [ 80%]
........................................................................ [ 81%]
........................................................................ [ 81%]
........................................................................ [ 81%]
........................................................................ [ 82%]
........................................................................ [ 82%]
........................................................................ [ 82%]
........................................................................ [ 83%]
........................................................................ [ 83%]
........................................................................ [ 84%]
......................................................................... [ 84%]
........................................................................ [ 84%]
........................................................................ [ 85%]
........................................................................ [ 85%]
......................................................................................... [ 85%]
........................................................................ [ 86%]
......................................................................... [ 86%]
........................................................................ [ 87%]
........................................................................ [ 87%]
........................................................................ [ 87%]
........................................................................ [ 88%]
........................................................................ [ 88%]
........................................................................ [ 89%]
........................................................................ [ 89%]
........................................................................ [ 89%]
.......s.ssss.s.........................................X.......X.x..... [ 90%]
.....xx..s.....x...........X............................................ [ 90%]
........................................................................ [ 90%]
........................................................................ [ 91%]
........................................................................ [ 91%]
........................................................................ [ 92%]
........................................................................ [ 92%]
........................................................................ [ 92%]
........................................................................ [ 93%]
.............X.......................................................... [ 93%]
........................................................................ [ 93%]
........................................................................ [ 94%]
........................................................................ [ 94%]
........................................................................ [ 95%]
........................................................................ [ 95%]
.........xx....x.x......x..................................x.......x.x.. [ 95%]
........................................................................ [ 96%]
........................................................................ [ 96%]
........................................................................ [ 96%]
........................................................................ [ 97%]
........................................................................ [ 97%]
........................................................................ [ 98%]
........................................................................ [ 98%]
........................................................................ [ 98%]
........................................................................ [ 99%]
........................................................................ [ 99%]
........................................................................ [ 99%]
.............                                                            [100%]

----------- coverage: platform linux, python 3.7.7-final-0 -----------
Name                                                               Stmts   Miss  Cover
--------------------------------------------------------------------------------------
modin/__init__.py                                                     76     38    50%
modin/_version.py                                                    272    172    37%
modin/apply_license_header.py                                         19     19     0%
modin/backends/__init__.py                                             0      0   100%
modin/backends/base/__init__.py                                        0      0   100%
modin/backends/base/query_compiler.py                                130      0   100%
modin/backends/pandas/__init__.py                                      0      0   100%
modin/backends/pandas/parsers.py                                     207    171    17%
modin/backends/pandas/query_compiler.py                              845     29    97%
modin/data_management/__init__.py                                      0      0   100%
modin/data_management/dispatcher.py                                   78     16    79%
modin/data_management/factories.py                                   109     48    56%
modin/data_management/functions/__init__.py                            7      0   100%
modin/data_management/functions/binary_function.py                    21      0   100%
modin/data_management/functions/foldfunction.py                        6      0   100%
modin/data_management/functions/function.py                            6      1    83%
modin/data_management/functions/groupby_function.py                   50      4    92%
modin/data_management/functions/mapfunction.py                         6      0   100%
modin/data_management/functions/mapreducefunction.py                   9      0   100%
modin/data_management/functions/reductionfunction.py                   6      0   100%
modin/data_management/utils.py                                        32      0   100%
modin/engines/__init__.py                                              0      0   100%
modin/engines/base/__init__.py                                         0      0   100%
modin/engines/base/frame/__init__.py                                   0      0   100%
modin/engines/base/frame/axis_partition.py                            45     10    78%
modin/engines/base/frame/data.py                                     522     34    93%
modin/engines/base/frame/partition.py                                  1      0   100%
modin/engines/base/frame/partition_manager.py                        184     21    89%
modin/engines/base/io/__init__.py                                     12      0   100%
modin/engines/base/io/column_stores/__init__.py                        0      0   100%
modin/engines/base/io/column_stores/column_store_reader.py            40     29    28%
modin/engines/base/io/column_stores/feather_reader.py                  9      5    44%
modin/engines/base/io/column_stores/hdf_reader.py                      3      0   100%
modin/engines/base/io/column_stores/parquet_reader.py                 34     29    15%
modin/engines/base/io/file_reader.py                                  85     66    22%
modin/engines/base/io/io.py                                          110      6    95%
modin/engines/base/io/sql/__init__.py                                  0      0   100%
modin/engines/base/io/sql/sql_reader.py                               39     31    21%
modin/engines/base/io/text/__init__.py                                 0      0   100%
modin/engines/base/io/text/csv_reader.py                             112    105     6%
modin/engines/base/io/text/excel_reader.py                           106     97     8%
modin/engines/base/io/text/fwf_reader.py                             115    108     6%
modin/engines/base/io/text/json_reader.py                             50     43    14%
modin/engines/base/io/text/text_file_reader.py                        34     24    29%
modin/engines/base/series/__init__.py                                  0      0   100%
modin/engines/dask/__init__.py                                         0      0   100%
modin/engines/dask/pandas_on_dask/__init__.py                          0      0   100%
modin/engines/dask/pandas_on_dask/frame/__init__.py                    0      0   100%
modin/engines/dask/pandas_on_dask/frame/axis_partition.py             27     27     0%
modin/engines/dask/pandas_on_dask/frame/data.py                       15     15     0%
modin/engines/dask/pandas_on_dask/frame/partition.py                  75     75     0%
modin/engines/dask/pandas_on_dask/frame/partition_manager.py          44     44     0%
modin/engines/dask/pandas_on_dask/io.py                               17     17     0%
modin/engines/dask/pandas_on_dask/series/__init__.py                   0      0   100%
modin/engines/dask/task_wrapper.py                                     9      9     0%
modin/engines/python/__init__.py                                       0      0   100%
modin/engines/python/pandas_on_python/__init__.py                      0      0   100%
modin/engines/python/pandas_on_python/frame/__init__.py                0      0   100%
modin/engines/python/pandas_on_python/frame/axis_partition.py         14      0   100%
modin/engines/python/pandas_on_python/frame/data.py                    4      0   100%
modin/engines/python/pandas_on_python/frame/partition.py              65      4    94%
modin/engines/python/pandas_on_python/frame/partition_manager.py       7      0   100%
modin/engines/python/pandas_on_python/io.py                            6      0   100%
modin/engines/python/pandas_on_python/series/__init__.py               0      0   100%
modin/engines/ray/__init__.py                                          0      0   100%
modin/engines/ray/generic/__init__.py                                  0      0   100%
modin/engines/ray/generic/frame/__init__.py                            0      0   100%
modin/engines/ray/generic/frame/partition_manager.py                  10     10     0%
modin/engines/ray/generic/io.py                                       14     14     0%
modin/engines/ray/generic/series/__init__.py                           0      0   100%
modin/engines/ray/pandas_on_ray/__init__.py                            0      0   100%
modin/engines/ray/pandas_on_ray/frame/__init__.py                      0      0   100%
modin/engines/ray/pandas_on_ray/frame/axis_partition.py               22     22     0%
modin/engines/ray/pandas_on_ray/frame/data.py                         11     11     0%
modin/engines/ray/pandas_on_ray/frame/partition.py                    86     86     0%
modin/engines/ray/pandas_on_ray/frame/partition_manager.py            43     43     0%
modin/engines/ray/pandas_on_ray/io.py                                 18     18     0%
modin/engines/ray/pandas_on_ray/series/__init__.py                     0      0   100%
modin/engines/ray/task_wrapper.py                                      7      7     0%
modin/engines/ray/utils.py                                            26     26     0%
modin/error_message.py                                                27      2    93%
modin/experimental/__init__.py                                         0      0   100%
modin/experimental/cloud/__init__.py                                   6      6     0%
modin/experimental/cloud/base.py                                      36     36     0%
modin/experimental/cloud/cluster.py                                   92     92     0%
modin/experimental/cloud/connection.py                                99     99     0%
modin/experimental/cloud/meta_magic.py                                54     54     0%
modin/experimental/cloud/rayscale.py                                 113    113     0%
modin/experimental/cloud/rpyc_proxy.py                               167    167     0%
modin/experimental/engines/__init__.py                                 0      0   100%
modin/experimental/engines/pandas_on_ray/__init__.py                   0      0   100%
modin/experimental/engines/pandas_on_ray/io_exp.py                    38     38     0%
modin/experimental/engines/pandas_on_ray/sql.py                       66     66     0%
modin/experimental/pandas/__init__.py                                  7      7     0%
modin/experimental/pandas/io_exp.py                                    7      7     0%
modin/experimental/pandas/numpy_wrap.py                               76     76     0%
modin/pandas/__init__.py                                              51     20    61%
modin/pandas/base.py                                                1222     54    96%
modin/pandas/concat.py                                                61      5    92%
modin/pandas/dataframe.py                                            866     98    89%
modin/pandas/datetimes.py                                              7      0   100%
modin/pandas/general.py                                               53      3    94%
modin/pandas/groupby.py                                              295     40    86%
modin/pandas/indexing.py                                             213     33    85%
modin/pandas/io.py                                                   147     11    93%
modin/pandas/iterator.py                                              15      0   100%
modin/pandas/reshape.py                                               30      0   100%
modin/pandas/series.py                                               946     56    94%
modin/pandas/utils.py                                                 42      3    93%
--------------------------------------------------------------------------------------
TOTAL                                                               8636   2620    70%

= 18582 passed, 31 skipped, 104 xfailed, 515 xpassed, 33013 warnings in 859.07s (0:14:19) =

TOTAL                                                               8636   2620    70%

= 18582 passed, 31 skipped, 104 xfailed, 515 xpassed, 33013 warnings in 859.07s (0:14:19) =

@modin-bot
Copy link

modin-bot commented Jul 28, 2020

TeamCity Ray test results bot

Tests PASSed

Tests Logs
============================= test session starts ==============================
platform linux -- Python 3.7.7, pytest-6.0.0, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: openfiles-0.5.0, remotedata-0.3.2, cov-2.10.0, custom-exit-code-0.3.0, forked-1.3.0, testmon-1.0.2, xdist-1.34.0
collected 94 items

modin/pandas/test/test_io.py .................sx..........s............. [ 45%]
...................s..s.X.....s.................ss.                      [100%]

----------- coverage: platform linux, python 3.7.7-final-0 -----------
Name                                                               Stmts   Miss  Cover
--------------------------------------------------------------------------------------
modin/__init__.py                                                     76     38    50%
modin/_version.py                                                    272    172    37%
modin/apply_license_header.py                                         19     19     0%
modin/backends/__init__.py                                             0      0   100%
modin/backends/base/__init__.py                                        0      0   100%
modin/backends/base/query_compiler.py                                130      1    99%
modin/backends/pandas/__init__.py                                      0      0   100%
modin/backends/pandas/parsers.py                                     207    119    43%
modin/backends/pandas/query_compiler.py                              845    504    40%
modin/data_management/__init__.py                                      0      0   100%
modin/data_management/dispatcher.py                                   78     16    79%
modin/data_management/factories.py                                   109     48    56%
modin/data_management/functions/__init__.py                            7      0   100%
modin/data_management/functions/binary_function.py                    21     14    33%
modin/data_management/functions/foldfunction.py                        6      1    83%
modin/data_management/functions/function.py                            6      1    83%
modin/data_management/functions/groupby_function.py                   50     44    12%
modin/data_management/functions/mapfunction.py                         6      1    83%
modin/data_management/functions/mapreducefunction.py                   9      2    78%
modin/data_management/functions/reductionfunction.py                   6      1    83%
modin/data_management/utils.py                                        32     14    56%
modin/engines/__init__.py                                              0      0   100%
modin/engines/base/__init__.py                                         0      0   100%
modin/engines/base/frame/__init__.py                                   0      0   100%
modin/engines/base/frame/axis_partition.py                            45     31    31%
modin/engines/base/frame/data.py                                     522    268    49%
modin/engines/base/frame/partition.py                                  1      0   100%
modin/engines/base/frame/partition_manager.py                        184     95    48%
modin/engines/base/io/__init__.py                                     12      0   100%
modin/engines/base/io/column_stores/__init__.py                        0      0   100%
modin/engines/base/io/column_stores/column_store_reader.py            40      0   100%
modin/engines/base/io/column_stores/feather_reader.py                  9      0   100%
modin/engines/base/io/column_stores/hdf_reader.py                      3      0   100%
modin/engines/base/io/column_stores/parquet_reader.py                 34      1    97%
modin/engines/base/io/file_reader.py                                  85      7    92%
modin/engines/base/io/io.py                                          110     45    59%
modin/engines/base/io/sql/__init__.py                                  0      0   100%
modin/engines/base/io/sql/sql_reader.py                               39      1    97%
modin/engines/base/io/text/__init__.py                                 0      0   100%
modin/engines/base/io/text/csv_reader.py                             112      4    96%
modin/engines/base/io/text/excel_reader.py                           106      9    92%
modin/engines/base/io/text/fwf_reader.py                             115     16    86%
modin/engines/base/io/text/json_reader.py                             50      2    96%
modin/engines/base/io/text/text_file_reader.py                        34      1    97%
modin/engines/base/series/__init__.py                                  0      0   100%
modin/engines/dask/__init__.py                                         0      0   100%
modin/engines/dask/pandas_on_dask/__init__.py                          0      0   100%
modin/engines/dask/pandas_on_dask/frame/__init__.py                    0      0   100%
modin/engines/dask/pandas_on_dask/frame/axis_partition.py             27     27     0%
modin/engines/dask/pandas_on_dask/frame/data.py                       15     15     0%
modin/engines/dask/pandas_on_dask/frame/partition.py                  75     75     0%
modin/engines/dask/pandas_on_dask/frame/partition_manager.py          44     44     0%
modin/engines/dask/pandas_on_dask/io.py                               17     17     0%
modin/engines/dask/pandas_on_dask/series/__init__.py                   0      0   100%
modin/engines/dask/task_wrapper.py                                     9      9     0%
modin/engines/python/__init__.py                                       0      0   100%
modin/engines/python/pandas_on_python/__init__.py                      0      0   100%
modin/engines/python/pandas_on_python/frame/__init__.py                0      0   100%
modin/engines/python/pandas_on_python/frame/axis_partition.py         14     14     0%
modin/engines/python/pandas_on_python/frame/data.py                    4      4     0%
modin/engines/python/pandas_on_python/frame/partition.py              65     65     0%
modin/engines/python/pandas_on_python/frame/partition_manager.py       7      7     0%
modin/engines/python/pandas_on_python/io.py                            6      6     0%
modin/engines/python/pandas_on_python/series/__init__.py               0      0   100%
modin/engines/ray/__init__.py                                          0      0   100%
modin/engines/ray/generic/__init__.py                                  0      0   100%
modin/engines/ray/generic/frame/__init__.py                            0      0   100%
modin/engines/ray/generic/frame/partition_manager.py                  10      5    50%
modin/engines/ray/generic/io.py                                       14      3    79%
modin/engines/ray/generic/series/__init__.py                           0      0   100%
modin/engines/ray/pandas_on_ray/__init__.py                            0      0   100%
modin/engines/ray/pandas_on_ray/frame/__init__.py                      0      0   100%
modin/engines/ray/pandas_on_ray/frame/axis_partition.py               22      1    95%
modin/engines/ray/pandas_on_ray/frame/data.py                         11      3    73%
modin/engines/ray/pandas_on_ray/frame/partition.py                    86     13    85%
modin/engines/ray/pandas_on_ray/frame/partition_manager.py            43     21    51%
modin/engines/ray/pandas_on_ray/io.py                                 18      0   100%
modin/engines/ray/pandas_on_ray/series/__init__.py                     0      0   100%
modin/engines/ray/task_wrapper.py                                      7      0   100%
modin/engines/ray/utils.py                                            26      8    69%
modin/error_message.py                                                27      7    74%
modin/experimental/__init__.py                                         0      0   100%
modin/experimental/cloud/__init__.py                                   6      6     0%
modin/experimental/cloud/base.py                                      36     36     0%
modin/experimental/cloud/cluster.py                                   92     92     0%
modin/experimental/cloud/connection.py                                99     99     0%
modin/experimental/cloud/meta_magic.py                                54     54     0%
modin/experimental/cloud/rayscale.py                                 113    113     0%
modin/experimental/cloud/rpyc_proxy.py                               167    167     0%
modin/experimental/engines/__init__.py                                 0      0   100%
modin/experimental/engines/pandas_on_ray/__init__.py                   0      0   100%
modin/experimental/engines/pandas_on_ray/io_exp.py                    38     38     0%
modin/experimental/engines/pandas_on_ray/sql.py                       66     66     0%
modin/experimental/pandas/__init__.py                                  7      7     0%
modin/experimental/pandas/io_exp.py                                    7      7     0%
modin/experimental/pandas/numpy_wrap.py                               76     76     0%
modin/pandas/__init__.py                                              51     17    67%
modin/pandas/base.py                                                1222    922    25%
modin/pandas/concat.py                                                61     51    16%
modin/pandas/dataframe.py                                            866    658    24%
modin/pandas/datetimes.py                                              7      3    57%
modin/pandas/general.py                                               53     35    34%
modin/pandas/groupby.py                                              295    203    31%
modin/pandas/indexing.py                                             213    213     0%
modin/pandas/io.py                                                   147     11    93%
modin/pandas/iterator.py                                              15      9    40%
modin/pandas/reshape.py                                               30     20    33%
modin/pandas/series.py                                               946    619    35%
modin/pandas/utils.py                                                 42      5    88%
--------------------------------------------------------------------------------------
TOTAL                                                               8636   5346    38%


= 85 passed, 7 skipped, 1 xfailed, 1 xpassed, 102 warnings in 60.58s (0:01:00) =
Closing remaining open files:test_write_pandas.hdf...donetest_write_modin.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.7.7, pytest-6.0.0, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: openfiles-0.5.0, remotedata-0.3.2, cov-2.10.0, custom-exit-code-0.3.0, forked-1.3.0, testmon-1.0.2, xdist-1.34.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
gw0 [19232] / gw1 [19232] / gw2 [19232] / gw3 [19232] / gw4 [19232] / gw5 [19232] / gw6 [19232] / gw7 [19232] / gw8 [19232] / gw9 [19232] / gw10 [19232] / gw11 [19232] / gw12 [19232] / gw13 [19232] / gw14 [19232] / gw15 [19232] / gw16 [19232] / gw17 [19232] / gw18 [19232] / gw19 [19232] / gw20 [19232] / gw21 [19232] / gw22 [19232] / gw23 [19232] / gw24 [19232] / gw25 [19232] / gw26 [19232] / gw27 [19232] / gw28 [19232] / gw29 [19232] / gw30 [19232] / gw31 [19232] / gw32 [19232] / gw33 [19232] / gw34 [19232] / gw35 [19232] / gw36 [19232] / gw37 [19232] / gw38 [19232] / gw39 [19232] / gw40 [19232] / gw41 [19232] / gw42 [19232] / gw43 [19232] / gw44 [19232] / gw45 [19232] / gw46 [19232] / gw47 [19232]

........................................................................ [  0%]
........................................................................ [  0%]
......................................................................... [  1%]
........................................................................ [  1%]
........................................................................ [  1%]
........................................................................ [  2%]
............s........................................................... [  2%]
........................................................................ [  2%]
........................................................................ [  3%]
........................................................................ [  3%]
s...s.................................................X....X....X.x..... [  4%]
X.X.....X.....x..............................x.......x.................. [  4%]
x.x...xX.....XX..X..X.XX..x..XX.....X..XXX....X..X...XX....X.X..X....... [  4%]
.....X.........Xx.......................x.xX.X......................x.x. [  5%]
X..XX...X.X.X..X.X.XXXx.XXX.x.X.XXX.X.XXX...X..XX..XX.X..X.x..XXX.X...X. [  5%]
.X....X......X..X........XX.......................X.......X......X....X. [  5%]
....X....X.X.X.X..X.XXX..X.....X..X.XX...X.XX...X.X.XX..X....XXX........ [  6%]
.X...........X.......................X.........X.XX................X..XX [  6%]
X..X.....XX.....X.....X....X...XX........X.......X....X........X.X..X.X. [  7%]
...X....X.X.....XXX.XX.X.....X...X.......X.......X.....X.X..X..X...XX..X [  7%]
.....XX..........X....XX.X..............XX..X..X........X...X...X....X.XX.. [  7%]
....X.X......X..XX.....X....X......X..XX....X...XX...X...XX.X.XXx..X..X.X [  8%]
X.X.XX..X......X.X.X.x..X.x....X...X......X.............xx.....X......X.. [  8%]
....X.......xX......X....X.X......X...X.X.X..XX..X..X.X.X.X.X...X........X [  9%]
.........................X............X............X.X.....Xx.X...X.X.X. [  9%]
X.X.x...XX.....x.x......X.x....X..X.....X....X.XxXXXX.x...X.X...x.x..... [  9%]
.X............xx..XXX...XxX.XX....x..X...x.X.xx.X......X.X..X...XX...X.. [ 10%]
.................X..X.X.....X.XX........X......................X........ [ 10%]
..X...X.X.....x....X.X.......x............x....x.......................X. [ 10%]
.........X........................X........x..........x.X..x......X...Xx [ 11%]
...........X....X...X.X.X....X.X.x.X.X..X.X.............x..X..X......X.x [ 11%]
.X......X.........X....X.X.......XX....XX.X.X.X.......XXX........X.....X [ 12%]
......X.X.......X..............X................X......X.....X.........X [ 12%]
........X.......X.......X....X.....x.......X....X...........Xx....X..... [ 12%]
.X...x....XX..X............X........X.............x...............X...... [ 13%]
.xXx.....X............x.X.X.....X........x....X...........X.....X......x [ 13%]
X.X.........X...........X...X...........X..X.....X....X.X...X........X.. [ 13%]
XX...........xXX.X.X.....X...X...X.X......X..X....X.X..X..X.x.....X..... [ 14%]
.X...X...........X........X..X...Xx........X......X.............X....... [ 14%]
X....X......X....x...X..........x....x.......X.......X...........X...... [ 15%]
............X....X..........X......X..........x...X.....X...X...X....... [ 15%]
............x.........X.........X.x..X....X............X..x....X...x.... [ 15%]
...XX..X..XX.....X....X....X.......X........X.X.X.......XX..X........... [ 16%]
X.X...X.....X..X.....X..X...X.X.......X..X.....X..X..X.X..X............. [ 16%]
X......X.....XX........X........XX.....X........X................X....X. [ 16%]
.........x............X.............x..X.....x.X..........X............. [ 17%]
X........X......x....X............x.......X................X.........X.. [ 17%]
.......X.....XxX.........X....X......x.........X................x.xX..... [ 18%]
xx.............x..Xx..X..........X...................................... [ 18%]
..........X............X...................X..X..................X...... [ 18%]
............X..................X.X................x...............X....x [ 19%]
.............X.........................X....X.....X..........X.X........ [ 19%]
X.....X............X.............X.......x.X....................XX....... [ 19%]
....X..............X.......................................X............ [ 20%]
...X.........X..X.....x...X.X..............X.............X.........x..... [ 20%]
.....s....................X.........................X...............X... [ 21%]
..X.........X.................X..............................X.......... [ 21%]
......X........X............X.............X.............X.......X....... [ 21%]
........................................................................ [ 22%]
........................................................................ [ 22%]
........................................................................ [ 22%]
......................................................s................. [ 23%]
........................................................................ [ 23%]
........................................................................ [ 24%]
........................................................................ [ 24%]
........................................................................ [ 24%]
......................................................................... [ 25%]
........................................................................ [ 25%]
......................................................................... [ 25%]
......................................................................... [ 26%]
........................................................................ [ 26%]
.....................................................................x.. [ 27%]
.............................................s.......................... [ 27%]
........................x............................................... [ 27%]
......x................................................................. [ 28%]
.........................x........................x..................... [ 28%]
........................................................................ [ 28%]
........................................................................ [ 29%]
........................................................................ [ 29%]
......................................................................... [ 30%]
........................................................................ [ 30%]
........................................................................ [ 30%]
........................................................................ [ 31%]
........................................................................ [ 31%]
........................................................................ [ 31%]
................................X........X...........X..............X.... [ 32%]
......X........X........................................................ [ 32%]
........................................................................ [ 33%]
........................................................................ [ 33%]
........................................................................ [ 33%]
........................................................................ [ 34%]
......................................................................... [ 34%]
........................................................................ [ 34%]
........................................................................ [ 35%]
........................................................................ [ 35%]
......................................................................X. [ 36%]
........................................................................ [ 36%]
........................................................................ [ 36%]
........................................................................ [ 37%]
........................................................................ [ 37%]
........................................................................ [ 37%]
........................................................................ [ 38%]
........................................................................ [ 38%]
........................................................................ [ 39%]
........................................................................ [ 39%]
........................................................................ [ 39%]
........................................................................ [ 40%]
........................................................................ [ 40%]
........................................................................ [ 40%]
........................................................................ [ 41%]
........................................................................ [ 41%]
........................................................................ [ 42%]
........................................................................ [ 42%]
........................................................................ [ 42%]
........................................................................ [ 43%]
........................................................................ [ 43%]
........................................................................ [ 43%]
........................................................................ [ 44%]
........................................................................ [ 44%]
.....sssss.sssssssssssss................................................ [ 45%]
......................................................................... [ 45%]
........................................................................ [ 45%]
........................................................................ [ 46%]
........................................................................ [ 46%]
........................................................................ [ 46%]
........................................................................ [ 47%]
........................................................................ [ 47%]
........................................................................ [ 48%]
........................................................................ [ 48%]
........................................................................ [ 48%]
........................................................................ [ 49%]
........................................................................ [ 49%]
........................................................................ [ 49%]
........................................................................ [ 50%]
........................................................................ [ 50%]
........................................................................ [ 51%]
........................................................................ [ 51%]
........................................................................ [ 51%]
........................................................................ [ 52%]
......................................................................... [ 52%]
........................................................................ [ 52%]
........................................................................ [ 53%]
........................................................................ [ 53%]
........................................................................ [ 54%]
........................................................................ [ 54%]
........................................................................ [ 54%]
........................................................................ [ 55%]
........................................................................ [ 55%]
........................................................................ [ 55%]
......................................................................... [ 56%]
........................................................................ [ 56%]
........................................................................ [ 57%]
........................................................................ [ 57%]
........................................................................ [ 57%]
........................................................................ [ 58%]
........................................................................ [ 58%]
........................................................................ [ 58%]
........................................................................ [ 59%]
........................................................................ [ 59%]
......................................................................... [ 60%]
........................................................................ [ 60%]
......................................................................... [ 60%]
........................................................................ [ 61%]
........................................................................ [ 61%]
........................................................................ [ 61%]
........................................................................ [ 62%]
........................................................................ [ 62%]
........................................................................ [ 63%]
........................................................................ [ 63%]
......................................................................... [ 63%]
........................................................................ [ 64%]
........................................................................ [ 64%]
........................................................................ [ 64%]
........................................................................ [ 65%]
........................................................................ [ 65%]
........................................................................ [ 66%]
.......................................................................... [ 66%]
........................................................................ [ 66%]
......................................................................... [ 67%]
........................................................................ [ 67%]
........................................................................ [ 67%]
........................................................................ [ 68%]
........................................................................ [ 68%]
........................................................................ [ 69%]
........................................................................ [ 69%]
........................................................................ [ 69%]
........................................................................ [ 70%]
........................................................................ [ 70%]
.......................................................................... [ 70%]
........................................................................ [ 71%]
........................................................................ [ 71%]
........................................................................ [ 72%]
......................................................................... [ 72%]
........................................................................ [ 72%]
........................................................................ [ 73%]
......................................................................... [ 73%]
........................................................................ [ 73%]
........................................................................ [ 74%]
........................................................................ [ 74%]
........................................................................ [ 75%]
........................................................................ [ 75%]
........................................................................ [ 75%]
........................................................................ [ 76%]
........................................................................ [ 76%]
........................................................................ [ 76%]
........................................................................ [ 77%]
........................................................................ [ 77%]
........................................................................ [ 78%]
........................................................................ [ 78%]
........................................................................ [ 78%]
......................................................................... [ 79%]
........................................................................ [ 79%]
........................................................................ [ 79%]
......................................................................... [ 80%]
........................................................................ [ 80%]
........................................................................ [ 81%]
......................................................................... [ 81%]
......................................................................... [ 81%]
........................................................................ [ 82%]
........................................................................ [ 82%]
........................................................................ [ 82%]
........................................................................ [ 83%]
........................................................................ [ 83%]
........................................................................ [ 84%]
........................................................................ [ 84%]
......................................................................... [ 84%]
........................................................................ [ 85%]
........................................................................ [ 85%]
......................................................................... [ 85%]
........................................................................ [ 86%]
........................................................................ [ 86%]
........................................................................ [ 87%]
........................................................................ [ 87%]
........................................................................ [ 87%]
........................................................................ [ 88%]
........................................................................ [ 88%]
........................................................................ [ 88%]
........................................................................ [ 89%]
........................................................................ [ 89%]
........................................................................ [ 90%]
....................................................ss.s.s.ss........... [ 90%]
.......................................................................... [ 90%]
.......................................................x.....x......x... [ 91%]
.........x....s........X.........X...................................... [ 91%]
........................................................................ [ 91%]
........................................................................ [ 92%]
........................................................................ [ 92%]
........................................................................ [ 93%]
........................................................................ [ 93%]
....................................................X..X................ [ 93%]
........................................................................ [ 94%]
......................................................................... [ 94%]
........................................................................ [ 94%]
........................................................................ [ 95%]
........................................................................ [ 95%]
........................................................................ [ 96%]
.......................x.x.................x.x.........x................ [ 96%]
........x.......x....................................................... [ 96%]
........................................................................ [ 97%]
......................................................................x. [ 97%]
........................................................................ [ 97%]
........................................................................ [ 98%]
........................................................................ [ 98%]
........................................................................ [ 99%]
........................................................................ [ 99%]
........................................................................ [ 99%]
.......................................                                  [100%]

----------- coverage: platform linux, python 3.7.7-final-0 -----------
Name                                                               Stmts   Miss  Cover
--------------------------------------------------------------------------------------
modin/__init__.py                                                     76     38    50%
modin/_version.py                                                    272    172    37%
modin/apply_license_header.py                                         19     19     0%
modin/backends/__init__.py                                             0      0   100%
modin/backends/base/__init__.py                                        0      0   100%
modin/backends/base/query_compiler.py                                130      0   100%
modin/backends/pandas/__init__.py                                      0      0   100%
modin/backends/pandas/parsers.py                                     207    119    43%
modin/backends/pandas/query_compiler.py                              845    155    82%
modin/data_management/__init__.py                                      0      0   100%
modin/data_management/dispatcher.py                                   78     16    79%
modin/data_management/factories.py                                   109     48    56%
modin/data_management/functions/__init__.py                            7      0   100%
modin/data_management/functions/binary_function.py                    21      0   100%
modin/data_management/functions/foldfunction.py                        6      0   100%
modin/data_management/functions/function.py                            6      1    83%
modin/data_management/functions/groupby_function.py                   50     36    28%
modin/data_management/functions/mapfunction.py                         6      0   100%
modin/data_management/functions/mapreducefunction.py                   9      0   100%
modin/data_management/functions/reductionfunction.py                   6      0   100%
modin/data_management/utils.py                                        32     14    56%
modin/engines/__init__.py                                              0      0   100%
modin/engines/base/__init__.py                                         0      0   100%
modin/engines/base/frame/__init__.py                                   0      0   100%
modin/engines/base/frame/axis_partition.py                            45     30    33%
modin/engines/base/frame/data.py                                     522     42    92%
modin/engines/base/frame/partition.py                                  1      0   100%
modin/engines/base/frame/partition_manager.py                        184     38    79%
modin/engines/base/io/__init__.py                                     12      0   100%
modin/engines/base/io/column_stores/__init__.py                        0      0   100%
modin/engines/base/io/column_stores/column_store_reader.py            40      0   100%
modin/engines/base/io/column_stores/feather_reader.py                  9      0   100%
modin/engines/base/io/column_stores/hdf_reader.py                      3      0   100%
modin/engines/base/io/column_stores/parquet_reader.py                 34      1    97%
modin/engines/base/io/file_reader.py                                  85      7    92%
modin/engines/base/io/io.py                                          110     45    59%
modin/engines/base/io/sql/__init__.py                                  0      0   100%
modin/engines/base/io/sql/sql_reader.py                               39      1    97%
modin/engines/base/io/text/__init__.py                                 0      0   100%
modin/engines/base/io/text/csv_reader.py                             112      2    98%
modin/engines/base/io/text/excel_reader.py                           106      9    92%
modin/engines/base/io/text/fwf_reader.py                             115     16    86%
modin/engines/base/io/text/json_reader.py                             50      2    96%
modin/engines/base/io/text/text_file_reader.py                        34      1    97%
modin/engines/base/series/__init__.py                                  0      0   100%
modin/engines/dask/__init__.py                                         0      0   100%
modin/engines/dask/pandas_on_dask/__init__.py                          0      0   100%
modin/engines/dask/pandas_on_dask/frame/__init__.py                    0      0   100%
modin/engines/dask/pandas_on_dask/frame/axis_partition.py             27     27     0%
modin/engines/dask/pandas_on_dask/frame/data.py                       15     15     0%
modin/engines/dask/pandas_on_dask/frame/partition.py                  75     75     0%
modin/engines/dask/pandas_on_dask/frame/partition_manager.py          44     44     0%
modin/engines/dask/pandas_on_dask/io.py                               17     17     0%
modin/engines/dask/pandas_on_dask/series/__init__.py                   0      0   100%
modin/engines/dask/task_wrapper.py                                     9      9     0%
modin/engines/python/__init__.py                                       0      0   100%
modin/engines/python/pandas_on_python/__init__.py                      0      0   100%
modin/engines/python/pandas_on_python/frame/__init__.py                0      0   100%
modin/engines/python/pandas_on_python/frame/axis_partition.py         14     14     0%
modin/engines/python/pandas_on_python/frame/data.py                    4      4     0%
modin/engines/python/pandas_on_python/frame/partition.py              65     65     0%
modin/engines/python/pandas_on_python/frame/partition_manager.py       7      7     0%
modin/engines/python/pandas_on_python/io.py                            6      6     0%
modin/engines/python/pandas_on_python/series/__init__.py               0      0   100%
modin/engines/ray/__init__.py                                          0      0   100%
modin/engines/ray/generic/__init__.py                                  0      0   100%
modin/engines/ray/generic/frame/__init__.py                            0      0   100%
modin/engines/ray/generic/frame/partition_manager.py                  10      0   100%
modin/engines/ray/generic/io.py                                       14      3    79%
modin/engines/ray/generic/series/__init__.py                           0      0   100%
modin/engines/ray/pandas_on_ray/__init__.py                            0      0   100%
modin/engines/ray/pandas_on_ray/frame/__init__.py                      0      0   100%
modin/engines/ray/pandas_on_ray/frame/axis_partition.py               22      0   100%
modin/engines/ray/pandas_on_ray/frame/data.py                         11      3    73%
modin/engines/ray/pandas_on_ray/frame/partition.py                    86      7    92%
modin/engines/ray/pandas_on_ray/frame/partition_manager.py            43     16    63%
modin/engines/ray/pandas_on_ray/io.py                                 18      0   100%
modin/engines/ray/pandas_on_ray/series/__init__.py                     0      0   100%
modin/engines/ray/task_wrapper.py                                      7      0   100%
modin/engines/ray/utils.py                                            26      1    96%
modin/error_message.py                                                27      2    93%
modin/experimental/__init__.py                                         0      0   100%
modin/experimental/cloud/__init__.py                                   6      6     0%
modin/experimental/cloud/base.py                                      36     36     0%
modin/experimental/cloud/cluster.py                                   92     92     0%
modin/experimental/cloud/connection.py                                99     99     0%
modin/experimental/cloud/meta_magic.py                                54     54     0%
modin/experimental/cloud/rayscale.py                                 113    113     0%
modin/experimental/cloud/rpyc_proxy.py                               167    167     0%
modin/experimental/engines/__init__.py                                 0      0   100%
modin/experimental/engines/pandas_on_ray/__init__.py                   0      0   100%
modin/experimental/engines/pandas_on_ray/io_exp.py                    38     38     0%
modin/experimental/engines/pandas_on_ray/sql.py                       66     66     0%
modin/experimental/pandas/__init__.py                                  7      7     0%
modin/experimental/pandas/io_exp.py                                    7      7     0%
modin/experimental/pandas/numpy_wrap.py                               76     76     0%
modin/pandas/__init__.py                                              51     17    67%
modin/pandas/base.py                                                1222     54    96%
modin/pandas/concat.py                                                61      5    92%
modin/pandas/dataframe.py                                            866     98    89%
modin/pandas/datetimes.py                                              7      0   100%
modin/pandas/general.py                                               53      3    94%
modin/pandas/groupby.py                                              295     40    86%
modin/pandas/indexing.py                                             213     33    85%
modin/pandas/io.py                                                   147     11    93%
modin/pandas/iterator.py                                              15      0   100%
modin/pandas/reshape.py                                               30      0   100%
modin/pandas/series.py                                               946     57    94%
modin/pandas/utils.py                                                 42      3    93%
--------------------------------------------------------------------------------------
TOTAL                                                               8636   2209    74%

= 18582 passed, 31 skipped, 104 xfailed, 515 xpassed, 32992 warnings in 942.41s (0:15:42) =

TOTAL                                                               8636   2209    74%

= 18582 passed, 31 skipped, 104 xfailed, 515 xpassed, 32992 warnings in 942.41s (0:15:42) =

@modin-bot
Copy link

modin-bot commented Jul 28, 2020

TeamCity Dask test results bot

Tests PASSed

Tests Logs
============================= test session starts ==============================
platform linux -- Python 3.7.7, pytest-6.0.0, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: openfiles-0.5.0, remotedata-0.3.2, cov-2.10.0, custom-exit-code-0.3.0, forked-1.3.0, testmon-1.0.2, xdist-1.34.0
collected 94 items

modin/pandas/test/test_io.py .................sx..........s............. [ 45%]
...................s..s.X.....s.................ss.                      [100%]

----------- coverage: platform linux, python 3.7.7-final-0 -----------
Name                                                               Stmts   Miss  Cover
--------------------------------------------------------------------------------------
modin/__init__.py                                                     76     38    50%
modin/_version.py                                                    272    172    37%
modin/apply_license_header.py                                         19     19     0%
modin/backends/__init__.py                                             0      0   100%
modin/backends/base/__init__.py                                        0      0   100%
modin/backends/base/query_compiler.py                                130      1    99%
modin/backends/pandas/__init__.py                                      0      0   100%
modin/backends/pandas/parsers.py                                     207    125    40%
modin/backends/pandas/query_compiler.py                              845    505    40%
modin/data_management/__init__.py                                      0      0   100%
modin/data_management/dispatcher.py                                   78     16    79%
modin/data_management/factories.py                                   109     48    56%
modin/data_management/functions/__init__.py                            7      0   100%
modin/data_management/functions/binary_function.py                    21     14    33%
modin/data_management/functions/foldfunction.py                        6      1    83%
modin/data_management/functions/function.py                            6      1    83%
modin/data_management/functions/groupby_function.py                   50     44    12%
modin/data_management/functions/mapfunction.py                         6      1    83%
modin/data_management/functions/mapreducefunction.py                   9      2    78%
modin/data_management/functions/reductionfunction.py                   6      1    83%
modin/data_management/utils.py                                        32     14    56%
modin/engines/__init__.py                                              0      0   100%
modin/engines/base/__init__.py                                         0      0   100%
modin/engines/base/frame/__init__.py                                   0      0   100%
modin/engines/base/frame/axis_partition.py                            45     31    31%
modin/engines/base/frame/data.py                                     522    285    45%
modin/engines/base/frame/partition.py                                  1      0   100%
modin/engines/base/frame/partition_manager.py                        184     98    47%
modin/engines/base/io/__init__.py                                     12      0   100%
modin/engines/base/io/column_stores/__init__.py                        0      0   100%
modin/engines/base/io/column_stores/column_store_reader.py            40      0   100%
modin/engines/base/io/column_stores/feather_reader.py                  9      0   100%
modin/engines/base/io/column_stores/hdf_reader.py                      3      0   100%
modin/engines/base/io/column_stores/parquet_reader.py                 34      1    97%
modin/engines/base/io/file_reader.py                                  85      7    92%
modin/engines/base/io/io.py                                          110     34    69%
modin/engines/base/io/sql/__init__.py                                  0      0   100%
modin/engines/base/io/sql/sql_reader.py                               39      1    97%
modin/engines/base/io/text/__init__.py                                 0      0   100%
modin/engines/base/io/text/csv_reader.py                             112      4    96%
modin/engines/base/io/text/excel_reader.py                           106      9    92%
modin/engines/base/io/text/fwf_reader.py                             115    108     6%
modin/engines/base/io/text/json_reader.py                             50      2    96%
modin/engines/base/io/text/text_file_reader.py                        34      1    97%
modin/engines/base/series/__init__.py                                  0      0   100%
modin/engines/dask/__init__.py                                         0      0   100%
modin/engines/dask/pandas_on_dask/__init__.py                          0      0   100%
modin/engines/dask/pandas_on_dask/frame/__init__.py                    0      0   100%
modin/engines/dask/pandas_on_dask/frame/axis_partition.py             27      5    81%
modin/engines/dask/pandas_on_dask/frame/data.py                       15      0   100%
modin/engines/dask/pandas_on_dask/frame/partition.py                  75     21    72%
modin/engines/dask/pandas_on_dask/frame/partition_manager.py          44     23    48%
modin/engines/dask/pandas_on_dask/io.py                               17      0   100%
modin/engines/dask/pandas_on_dask/series/__init__.py                   0      0   100%
modin/engines/dask/task_wrapper.py                                     9      0   100%
modin/engines/python/__init__.py                                       0      0   100%
modin/engines/python/pandas_on_python/__init__.py                      0      0   100%
modin/engines/python/pandas_on_python/frame/__init__.py                0      0   100%
modin/engines/python/pandas_on_python/frame/axis_partition.py         14     14     0%
modin/engines/python/pandas_on_python/frame/data.py                    4      4     0%
modin/engines/python/pandas_on_python/frame/partition.py              65     65     0%
modin/engines/python/pandas_on_python/frame/partition_manager.py       7      7     0%
modin/engines/python/pandas_on_python/io.py                            6      6     0%
modin/engines/python/pandas_on_python/series/__init__.py               0      0   100%
modin/engines/ray/__init__.py                                          0      0   100%
modin/engines/ray/generic/__init__.py                                  0      0   100%
modin/engines/ray/generic/frame/__init__.py                            0      0   100%
modin/engines/ray/generic/frame/partition_manager.py                  10     10     0%
modin/engines/ray/generic/io.py                                       14     14     0%
modin/engines/ray/generic/series/__init__.py                           0      0   100%
modin/engines/ray/pandas_on_ray/__init__.py                            0      0   100%
modin/engines/ray/pandas_on_ray/frame/__init__.py                      0      0   100%
modin/engines/ray/pandas_on_ray/frame/axis_partition.py               22     22     0%
modin/engines/ray/pandas_on_ray/frame/data.py                         11     11     0%
modin/engines/ray/pandas_on_ray/frame/partition.py                    86     86     0%
modin/engines/ray/pandas_on_ray/frame/partition_manager.py            43     43     0%
modin/engines/ray/pandas_on_ray/io.py                                 18     18     0%
modin/engines/ray/pandas_on_ray/series/__init__.py                     0      0   100%
modin/engines/ray/task_wrapper.py                                      7      7     0%
modin/engines/ray/utils.py                                            26     26     0%
modin/error_message.py                                                27      7    74%
modin/experimental/__init__.py                                         0      0   100%
modin/experimental/cloud/__init__.py                                   6      6     0%
modin/experimental/cloud/base.py                                      36     36     0%
modin/experimental/cloud/cluster.py                                   92     92     0%
modin/experimental/cloud/connection.py                                99     99     0%
modin/experimental/cloud/meta_magic.py                                54     54     0%
modin/experimental/cloud/rayscale.py                                 113    113     0%
modin/experimental/cloud/rpyc_proxy.py                               167    167     0%
modin/experimental/engines/__init__.py                                 0      0   100%
modin/experimental/engines/pandas_on_ray/__init__.py                   0      0   100%
modin/experimental/engines/pandas_on_ray/io_exp.py                    38     38     0%
modin/experimental/engines/pandas_on_ray/sql.py                       66     66     0%
modin/experimental/pandas/__init__.py                                  7      7     0%
modin/experimental/pandas/io_exp.py                                    7      7     0%
modin/experimental/pandas/numpy_wrap.py                               76     76     0%
modin/pandas/__init__.py                                              51     22    57%
modin/pandas/base.py                                                1222    922    25%
modin/pandas/concat.py                                                61     51    16%
modin/pandas/dataframe.py                                            866    658    24%
modin/pandas/datetimes.py                                              7      3    57%
modin/pandas/general.py                                               53     35    34%
modin/pandas/groupby.py                                              295    203    31%
modin/pandas/indexing.py                                             213    213     0%
modin/pandas/io.py                                                   147     11    93%
modin/pandas/iterator.py                                              15      9    40%
modin/pandas/reshape.py                                               30     20    33%
modin/pandas/series.py                                               946    619    35%
modin/pandas/utils.py                                                 42      5    88%
--------------------------------------------------------------------------------------
TOTAL                                                               8636   5504    36%


= 85 passed, 7 skipped, 1 xfailed, 1 xpassed, 114 warnings in 80.33s (0:01:20) =
Closing remaining open files:test_write_pandas.hdf...donetest_write_modin.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.7.7, pytest-6.0.0, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: openfiles-0.5.0, remotedata-0.3.2, cov-2.10.0, custom-exit-code-0.3.0, forked-1.3.0, testmon-1.0.2, xdist-1.34.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
gw0 [19232] / gw1 [19232] / gw2 [19232] / gw3 [19232] / gw4 [19232] / gw5 [19232] / gw6 [19232] / gw7 [19232] / gw8 [19232] / gw9 [19232] / gw10 [19232] / gw11 [19232] / gw12 [19232] / gw13 [19232] / gw14 [19232] / gw15 [19232] / gw16 [19232] / gw17 [19232] / gw18 [19232] / gw19 [19232] / gw20 [19232] / gw21 [19232] / gw22 [19232] / gw23 [19232] / gw24 [19232] / gw25 [19232] / gw26 [19232] / gw27 [19232] / gw28 [19232] / gw29 [19232] / gw30 [19232] / gw31 [19232] / gw32 [19232] / gw33 [19232] / gw34 [19232] / gw35 [19232] / gw36 [19232] / gw37 [19232] / gw38 [19232] / gw39 [19232] / gw40 [19232] / gw41 [19232] / gw42 [19232] / gw43 [19232] / gw44 [19232] / gw45 [19232] / gw46 [19232] / gw47 [19232]

........................................................................ [  0%]
........................................................................ [  0%]
........................................................................ [  1%]
........................................................................ [  1%]
...........................s............................................ [  1%]
........................................................................ [  2%]
........................................................................ [  2%]
........................................................................ [  2%]
........................................................................ [  3%]
.......................s................................................ [  3%]
x......................x..............................x..............X.. [  4%]
...x....s........x..........X.......X.Xx..X.XX..X..X..X..XX.X....X..X..X [  4%]
..X...X.Xx.X....XX.....x...X.........X..x....x....x..x....X....X.X...X.. [  4%]
..X.x.X....xx...X.........X.X......X..X..x..X...X..XXX.X.....X.XX...XX.. [  5%]
.X.X.X.XXXX.XX...XX..X.X....X..X...X.........XX....X.X...X....X.....X... [  5%]
...X............X......X....XX......XXX......X...........X.........X.X.X [  5%]
...X......X.....X......XXX.....XXX.X..X..X....X...XX.....XXX....X..X..... [  6%]
X........X.........X......X..X........X.........X........X.............. [  6%]
..........................................XX....XX...X.X..X.X...XX....X.. [  7%]
.XX.....X.XX...X...X.X....XX.....X......X.....X......................... [  7%]
.........................x..X.......X....XX......x...XX.....XXX...XXXX.. [  7%]
.xX.....xX.XxX..X.X....X.X..X..xX.Xx.X.x.X....X....X..X....X..X.......XX. [  8%]
........X.XX....XX..X.X..X...X..X......X.X.....X........X.X.......X..... [  8%]
..XXX..X....X..X..X.X.X.X..XX..X....X...X..X.X.X.....XX......xXX...X..XX [  9%]
...X.XX....XXX.....X..X.X....X...x.x.XX...X...x..X....xXX......X.xx..... [  9%]
...X..x...xX......X...x.X...XX....X.x....X....X.....X.X.XxX...Xx.XX..... [  9%]
......X..x......X....XX.XX.X..X.X....XX...X.....X...X.........X....XX.X. [ 10%]
..X....X......X.XX..........X..........X........X....X.......X.......X.. [ 10%]
........................................................X....X....X..XX. [ 10%]
...X...............................................................X.... [ 11%]
....X...xX.x...X.....xX.x...X.....x.....x................X..X........... [ 11%]
....Xx.X...x................X...X.................XX.....XXX...X....XX.. [ 11%]
X.xX......X.....XXX...X...XX.X.X.....X.X.X.XX.X..X...X.............X..... [ 12%]
..............X.X.....x.....X........XX...X.....X....XXX..xxx.X.X...xX.XX [ 12%]
........Xxxx......X.X...Xx......X...................X........X....XxX.X. [ 13%]
.X.......X..X..X...X....XxX....X.X...X.......X.X.......X.........XX..... [ 13%]
...X.X...X..X...X....X.X.XX..x..X.xX..X..X...X.....X.X....X............. [ 13%]
...X..........X........X.X.......X...X.X..X.....X.X..X....X...X.X..X.... [ 14%]
..X..X.X......X........X............X.X..................X.x....X......X [ 14%]
..X.X....x..X..X....X.X...X...X.X.......X.....X...xX.................... [ 15%]
..............x................................x.................x...... [ 15%]
..........X.................x..............X.....x...................... [ 15%]
......X.................X...........X..................x............XX.. [ 16%]
.x.............................X....X.................X................. [ 16%]
............x.........XX....X..X.........x.......x..........X..X...X..... [ 16%]
..X...............XX....X....X..X.....X.............XX......X............ [ 17%]
.....X.............X..X.......................X....x..................X. [ 17%]
......X....................X.x.....X.............X...x....x............... [ 18%]
.x..X........x....X......X..Xx..X..........Xx....X.......X.............. [ 18%]
x...................................X............X.X.............X..X..... [ 18%]
s...X.........X............X........X...X....XX........X...X..X...X..XX.X. [ 19%]
...X.............X.............X.........XX.............X............... [ 19%]
...........X......................X.....X................X.............X [ 19%]
..x................x..........x.......x.x..X............X.X............. [ 20%]
...X........X............XX.....................X.......X............... [ 20%]
.........X............X............X..............................X..X.. [ 21%]
...X.X.......X.X....X...............X................................... [ 21%]
........................................................................ [ 21%]
........................................................................ [ 22%]
........................................................................ [ 22%]
........................................................................ [ 22%]
.....................................s.................................. [ 23%]
........................................................................ [ 23%]
........................................................................ [ 24%]
........................................................................ [ 24%]
........................................................................ [ 24%]
......................................................................... [ 25%]
......................................................................... [ 25%]
........................................................................ [ 25%]
........................................................................ [ 26%]
........................................................................ [ 26%]
...........x............................................................ [ 27%]
.............................x.......................................... [ 27%]
.................s...............................x...................... [ 27%]
........................................................................ [ 28%]
...........x............................................................. [ 28%]
...................................................................x.... [ 28%]
........................................................................ [ 29%]
......................................................................... [ 29%]
...............................X......................................... [ 30%]
........................................................................ [ 30%]
......................................................................... [ 30%]
........................................................................ [ 31%]
........................................................................ [ 31%]
........................................................................ [ 31%]
........................................................................ [ 32%]
........................................................................ [ 32%]
........................................................................ [ 33%]
........................................................................ [ 33%]
........................................................................ [ 33%]
........................................................................ [ 34%]
........................................................................ [ 34%]
........................................................................ [ 34%]
........................................................................ [ 35%]
........................................................................ [ 35%]
........................................................................ [ 36%]
........................................................................ [ 36%]
........................................................................ [ 36%]
........................................................................ [ 37%]
........................................................................ [ 37%]
........................................................................ [ 37%]
.......s.sssss.ssssssssssss............................................. [ 38%]
........................................................................ [ 38%]
........................................................................ [ 39%]
........................................................................ [ 39%]
........................................................................ [ 39%]
........................................................................ [ 40%]
........................................................................ [ 40%]
........................................................................ [ 40%]
........................................................................ [ 41%]
........................................................................ [ 41%]
........................................................................ [ 42%]
........................................................................ [ 42%]
........................................................................ [ 42%]
........................................................................ [ 43%]
........................................................................ [ 43%]
........................................................................ [ 43%]
.......X.......X....X.........X............X.......X.................... [ 44%]
........................................................................ [ 44%]
........................................................................ [ 45%]
........................................................................ [ 45%]
........................................................................ [ 45%]
......................................................................... [ 46%]
........................................................................ [ 46%]
........................................................................ [ 46%]
........................................................................ [ 47%]
........................................................................ [ 47%]
........................................................................ [ 48%]
........................................................................ [ 48%]
........................................................................ [ 48%]
........................................................................ [ 49%]
........................................................................ [ 49%]
........................................................................ [ 49%]
........................................................................ [ 50%]
........................................................................ [ 50%]
........................................................................ [ 51%]
........................................................................ [ 51%]
........................................................................ [ 51%]
........................................................................ [ 52%]
........................................................................ [ 52%]
........................................................................ [ 52%]
........................................................................ [ 53%]
........................................................................ [ 53%]
........................................................................ [ 54%]
......................................................................... [ 54%]
........................................................................ [ 54%]
........................................................................ [ 55%]
........................................................................ [ 55%]
........................................................................ [ 55%]
......................................................................... [ 56%]
........................................................................ [ 56%]
........................................................................ [ 57%]
........................................................................ [ 57%]
........................................................................ [ 57%]
........................................................................ [ 58%]
........................................................................ [ 58%]
........................................................................ [ 58%]
........................................................................ [ 59%]
........................................................................ [ 59%]
........................................................................ [ 60%]
........................................................................ [ 60%]
........................................................................ [ 60%]
........................................................................ [ 61%]
........................................................................ [ 61%]
........................................................................ [ 61%]
........................................................................ [ 62%]
........................................................................ [ 62%]
........................................................................ [ 63%]
........................................................................ [ 63%]
........................................................................ [ 63%]
........................................................................ [ 64%]
........................................................................ [ 64%]
........................................................................ [ 64%]
........................................................................ [ 65%]
........................................................................ [ 65%]
........................................................................ [ 65%]
........................................................................ [ 66%]
........................................................................ [ 66%]
........................................................................ [ 67%]
........................................................................ [ 67%]
........................................................................ [ 67%]
........................................................................ [ 68%]
........................................................................ [ 68%]
........................................................................ [ 68%]
........................................................................ [ 69%]
........................................................................ [ 69%]
........................................................................ [ 70%]
........................................................................ [ 70%]
........................................................................ [ 70%]
........................................................................ [ 71%]
........................................................................ [ 71%]
........................................................................ [ 71%]
........................................................................ [ 72%]
........................................................................ [ 72%]
........................................................................ [ 73%]
........................................................................ [ 73%]
........................................................................ [ 73%]
........................................................................ [ 74%]
........................................................................ [ 74%]
........................................................................ [ 74%]
........................................................................ [ 75%]
........................................................................ [ 75%]
........................................................................ [ 76%]
........................................................................ [ 76%]
........................................................................ [ 76%]
........................................................................ [ 77%]
........................................................................ [ 77%]
........................................................................ [ 77%]
........................................................................ [ 78%]
........................................................................ [ 78%]
........................................................................ [ 79%]
........................................................................ [ 79%]
........................................................................ [ 79%]
........................................................................ [ 80%]
........................................................................ [ 80%]
........................................................................ [ 80%]
........................................................................ [ 81%]
........................................................................ [ 81%]
........................................................................ [ 82%]
........................................................................ [ 82%]
........................................................................ [ 82%]
........................................................................ [ 83%]
........................................................................ [ 83%]
........................................................................ [ 83%]
........................................................................ [ 84%]
........................................................................ [ 84%]
........................................................................ [ 85%]
........................................................................ [ 85%]
........................................................................ [ 85%]
........................................................................ [ 86%]
........................................................................ [ 86%]
........................................................................ [ 86%]
........................................................................ [ 87%]
........................................................................ [ 87%]
........................................................................ [ 88%]
........................................................................ [ 88%]
......................................................................... [ 88%]
........................................................................ [ 89%]
......................................................................... [ 89%]
........................................................................ [ 89%]
........................................................................ [ 90%]
........................................................................ [ 90%]
........................s...s............................................ [ 91%]
........................................................................ [ 91%]
....................................................ssss................ [ 91%]
..X....x.x....s.............................X....X......x.......x....... [ 92%]
........................................................................ [ 92%]
........................................................................ [ 92%]
........................................................................ [ 93%]
........................................................................ [ 93%]
........................................................................ [ 94%]
........................................................................ [ 94%]
........................................................................ [ 94%]
........................................................................ [ 95%]
........................................................................ [ 95%]
........................................................................ [ 95%]
........................................................................ [ 96%]
........................................................................ [ 96%]
..........................................x.x...................x....... [ 97%]
..xx.............x....................x.x............................... [ 97%]
........................................................................ [ 97%]
.....................................................................X.. [ 98%]
........................................................................ [ 98%]
........................................................................ [ 98%]
........................................................................ [ 99%]
........................................................................ [ 99%]
.......................................................                  [100%]

----------- coverage: platform linux, python 3.7.7-final-0 -----------
Name                                                               Stmts   Miss  Cover
--------------------------------------------------------------------------------------
modin/__init__.py                                                     76     38    50%
modin/_version.py                                                    272    172    37%
modin/apply_license_header.py                                         19     19     0%
modin/backends/__init__.py                                             0      0   100%
modin/backends/base/__init__.py                                        0      0   100%
modin/backends/base/query_compiler.py                                130      0   100%
modin/backends/pandas/__init__.py                                      0      0   100%
modin/backends/pandas/parsers.py                                     207    125    40%
modin/backends/pandas/query_compiler.py                              845    151    82%
modin/data_management/__init__.py                                      0      0   100%
modin/data_management/dispatcher.py                                   78     16    79%
modin/data_management/factories.py                                   109     48    56%
modin/data_management/functions/__init__.py                            7      0   100%
modin/data_management/functions/binary_function.py                    21      0   100%
modin/data_management/functions/foldfunction.py                        6      0   100%
modin/data_management/functions/function.py                            6      1    83%
modin/data_management/functions/groupby_function.py                   50     36    28%
modin/data_management/functions/mapfunction.py                         6      0   100%
modin/data_management/functions/mapreducefunction.py                   9      0   100%
modin/data_management/functions/reductionfunction.py                   6      0   100%
modin/data_management/utils.py                                        32     14    56%
modin/engines/__init__.py                                              0      0   100%
modin/engines/base/__init__.py                                         0      0   100%
modin/engines/base/frame/__init__.py                                   0      0   100%
modin/engines/base/frame/axis_partition.py                            45     28    38%
modin/engines/base/frame/data.py                                     522     48    91%
modin/engines/base/frame/partition.py                                  1      0   100%
modin/engines/base/frame/partition_manager.py                        184     31    83%
modin/engines/base/io/__init__.py                                     12      0   100%
modin/engines/base/io/column_stores/__init__.py                        0      0   100%
modin/engines/base/io/column_stores/column_store_reader.py            40      0   100%
modin/engines/base/io/column_stores/feather_reader.py                  9      0   100%
modin/engines/base/io/column_stores/hdf_reader.py                      3      0   100%
modin/engines/base/io/column_stores/parquet_reader.py                 34      1    97%
modin/engines/base/io/file_reader.py                                  85      7    92%
modin/engines/base/io/io.py                                          110     34    69%
modin/engines/base/io/sql/__init__.py                                  0      0   100%
modin/engines/base/io/sql/sql_reader.py                               39      1    97%
modin/engines/base/io/text/__init__.py                                 0      0   100%
modin/engines/base/io/text/csv_reader.py                             112      2    98%
modin/engines/base/io/text/excel_reader.py                           106      9    92%
modin/engines/base/io/text/fwf_reader.py                             115    108     6%
modin/engines/base/io/text/json_reader.py                             50      2    96%
modin/engines/base/io/text/text_file_reader.py                        34      1    97%
modin/engines/base/series/__init__.py                                  0      0   100%
modin/engines/dask/__init__.py                                         0      0   100%
modin/engines/dask/pandas_on_dask/__init__.py                          0      0   100%
modin/engines/dask/pandas_on_dask/frame/__init__.py                    0      0   100%
modin/engines/dask/pandas_on_dask/frame/axis_partition.py             27      1    96%
modin/engines/dask/pandas_on_dask/frame/data.py                       15      0   100%
modin/engines/dask/pandas_on_dask/frame/partition.py                  75     16    79%
modin/engines/dask/pandas_on_dask/frame/partition_manager.py          44     18    59%
modin/engines/dask/pandas_on_dask/io.py                               17      0   100%
modin/engines/dask/pandas_on_dask/series/__init__.py                   0      0   100%
modin/engines/dask/task_wrapper.py                                     9      0   100%
modin/engines/python/__init__.py                                       0      0   100%
modin/engines/python/pandas_on_python/__init__.py                      0      0   100%
modin/engines/python/pandas_on_python/frame/__init__.py                0      0   100%
modin/engines/python/pandas_on_python/frame/axis_partition.py         14     14     0%
modin/engines/python/pandas_on_python/frame/data.py                    4      4     0%
modin/engines/python/pandas_on_python/frame/partition.py              65     65     0%
modin/engines/python/pandas_on_python/frame/partition_manager.py       7      7     0%
modin/engines/python/pandas_on_python/io.py                            6      6     0%
modin/engines/python/pandas_on_python/series/__init__.py               0      0   100%
modin/engines/ray/__init__.py                                          0      0   100%
modin/engines/ray/generic/__init__.py                                  0      0   100%
modin/engines/ray/generic/frame/__init__.py                            0      0   100%
modin/engines/ray/generic/frame/partition_manager.py                  10     10     0%
modin/engines/ray/generic/io.py                                       14     14     0%
modin/engines/ray/generic/series/__init__.py                           0      0   100%
modin/engines/ray/pandas_on_ray/__init__.py                            0      0   100%
modin/engines/ray/pandas_on_ray/frame/__init__.py                      0      0   100%
modin/engines/ray/pandas_on_ray/frame/axis_partition.py               22     22     0%
modin/engines/ray/pandas_on_ray/frame/data.py                         11     11     0%
modin/engines/ray/pandas_on_ray/frame/partition.py                    86     86     0%
modin/engines/ray/pandas_on_ray/frame/partition_manager.py            43     43     0%
modin/engines/ray/pandas_on_ray/io.py                                 18     18     0%
modin/engines/ray/pandas_on_ray/series/__init__.py                     0      0   100%
modin/engines/ray/task_wrapper.py                                      7      7     0%
modin/engines/ray/utils.py                                            26     26     0%
modin/error_message.py                                                27      2    93%
modin/experimental/__init__.py                                         0      0   100%
modin/experimental/cloud/__init__.py                                   6      6     0%
modin/experimental/cloud/base.py                                      36     36     0%
modin/experimental/cloud/cluster.py                                   92     92     0%
modin/experimental/cloud/connection.py                                99     99     0%
modin/experimental/cloud/meta_magic.py                                54     54     0%
modin/experimental/cloud/rayscale.py                                 113    113     0%
modin/experimental/cloud/rpyc_proxy.py                               167    167     0%
modin/experimental/engines/__init__.py                                 0      0   100%
modin/experimental/engines/pandas_on_ray/__init__.py                   0      0   100%
modin/experimental/engines/pandas_on_ray/io_exp.py                    38     38     0%
modin/experimental/engines/pandas_on_ray/sql.py                       66     66     0%
modin/experimental/pandas/__init__.py                                  7      7     0%
modin/experimental/pandas/io_exp.py                                    7      7     0%
modin/experimental/pandas/numpy_wrap.py                               76     76     0%
modin/pandas/__init__.py                                              51     22    57%
modin/pandas/base.py                                                1222     54    96%
modin/pandas/concat.py                                                61      5    92%
modin/pandas/dataframe.py                                            866     98    89%
modin/pandas/datetimes.py                                              7      0   100%
modin/pandas/general.py                                               53      3    94%
modin/pandas/groupby.py                                              295     40    86%
modin/pandas/indexing.py                                             213     33    85%
modin/pandas/io.py                                                   147     11    93%
modin/pandas/iterator.py                                              15      0   100%
modin/pandas/reshape.py                                               30      0   100%
modin/pandas/series.py                                               946     57    94%
modin/pandas/utils.py                                                 42      3    93%
--------------------------------------------------------------------------------------
TOTAL                                                               8636   2349    73%

= 18582 passed, 31 skipped, 104 xfailed, 515 xpassed, 33118 warnings in 1449.23s (0:24:09) =

TOTAL                                                               8636   2349    73%

= 18582 passed, 31 skipped, 104 xfailed, 515 xpassed, 33118 warnings in 1449.23s (0:24:09) =

modin/experimental/pandas/numpy_wrap.py Show resolved Hide resolved
modin/experimental/pandas/numpy_wrap.py Show resolved Hide resolved
modin/experimental/pandas/numpy_wrap.py Outdated Show resolved Hide resolved
modin/experimental/pandas/numpy_wrap.py Show resolved Hide resolved
modin/experimental/pandas/numpy_wrap.py Outdated Show resolved Hide resolved
modin/experimental/pandas/__init__.py Show resolved Hide resolved
Copy link
Collaborator

@devin-petersohn devin-petersohn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree with @anmyachev about docstrings. We also need a documentation page for how this works, so it will be good to add a new issue for it (for next release).

The implementation looks good to me.

modin/experimental/pandas/numpy_wrap.py Show resolved Hide resolved
@anmyachev
Copy link
Collaborator

@vnlitvinov LGTM! Let's wait CI result.

Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
…ke ndarray

Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Copy link
Collaborator

@devin-petersohn devin-petersohn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @vnlitvinov LGTM!

@devin-petersohn devin-petersohn merged commit e25342b into modin-project:master Jul 28, 2020
@vnlitvinov vnlitvinov deleted the magic-numbers-everywhere branch July 28, 2020 21:30
aregm pushed a commit to aregm/modin that referenced this pull request Sep 16, 2020
Signed-off-by: Vasilij Litvinov <vasilij.n.litvinov@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Intercept Numpy automatically in remote context
4 participants