FIX-#1959 #1987: Fix incorrect work of `duplicated` and `drop_duplicates` functions #1994

prutskov · 2020-09-01T12:44:43Z

Fix incorrect work of duplicated and drop_duplicates functions.

Signed-off-by: Alexey Prutskov alexey.prutskov@intel.com

What do these changes do?

commit message follows format outlined here
passes flake8 modin
passes black --check modin
signed commit with git commit -s
Resolves [BUG] drop_duplicates does not drop all duplicates #1959 and Result of function duplicated is incorrect #1987
tests added and passing

modin-bot · 2020-09-01T13:00:28Z

TeamCity Python test results bot

Tests PASSed

Tests Logs

============================= test session starts ==============================
platform linux -- Python 3.7.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: openfiles-0.5.0, remotedata-0.3.2, cov-2.10.1, forked-1.3.0, xdist-2.1.0
collected 113 items

modin/pandas/test/test_io.py .................sX..........s............. [ 38%]
........s...........................s..s.X.....s..................ss..   [100%]

----------- coverage: platform linux, python 3.7.7-final-0 -----------
Coverage XML written to file coverage.xml


=========== 103 passed, 8 skipped, 2 xpassed, 151 warnings in 41.06s ===========
Closing remaining open files:test_write_modin.hdf...donetest_write_pandas.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.7.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: openfiles-0.5.0, remotedata-0.3.2, cov-2.10.1, forked-1.3.0, xdist-2.1.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
gw0 [8223] / gw1 [8223] / gw2 [8223] / gw3 [8223] / gw4 [8223] / gw5 [8223] / gw6 [8223] / gw7 [8223] / gw8 [8223] / gw9 [8223] / gw10 [8223] / gw11 [8223] / gw12 [8223] / gw13 [8223] / gw14 [8223] / gw15 [8223] / gw16 [8223] / gw17 [8223] / gw18 [8223] / gw19 [8223] / gw20 [8223] / gw21 [8223] / gw22 [8223] / gw23 [8223] / gw24 [8223] / gw25 [8223] / gw26 [8223] / gw27 [8223] / gw28 [8223] / gw29 [8223] / gw30 [8223] / gw31 [8223] / gw32 [8223] / gw33 [8223] / gw34 [8223] / gw35 [8223] / gw36 [8223] / gw37 [8223] / gw38 [8223] / gw39 [8223] / gw40 [8223] / gw41 [8223] / gw42 [8223] / gw43 [8223] / gw44 [8223] / gw45 [8223] / gw46 [8223] / gw47 [8223]

........................................................................ [  0%]
........................................................................ [  1%]
........................................................................ [  2%]
........................................................................ [  3%]
........................................................................ [  4%]
..................................................X..........X........X. [  5%]
.....xX.X......X...X.X.........X......X.x..X.......XX...X.........X..... [  6%]
.XX.X...............X...X...XXX...s............X..X.x.X.X..........XX... [  7%]
Xx.X....X.....X.X....x..XX.XX..Xx.XXXX.....XX...X.X...x...X..Xx......... [  7%]
X........X..X..X.XX.X.................X..........X....X...........X..... [  8%]
..........X......X....X.X..xX.......X.......x....X.X.x.x.....X.X....XX.X [  9%]
......XX.X.X...X.X....xX...X.XXXX.X..X..XX.........s........X.....X...X. [ 10%]
..X.XX......X.x....X.X.............X......x..x..X..........XX.......X... [ 11%]
X......XX...XXX...X..XX.....X.........X....X...X...X...x...X..X......... [ 12%]
..X...X.....X...x...x....X......X....X.xs..X....X.X...Xx......X.X.X....x [ 13%]
.........X.........XXX...XXX.X.X.....X............x.X.x...Xs...X.....X.. [ 14%]
...............X..XX..X.X.....xX.......x.....Xx...........X......X..X... [ 14%]
XX........Xx....XX.........x.X..........XX.....x....xX....x..x.......... [ 15%]
...xxX..ssssssssssssssssssssssssssssssssssss...X..X.......X...X...X..... [ 16%]
.X....XX.......Xx...xXX.....x..XX......x.X.X.Xx....sssssssssssssssssssss [ 17%]
ssssssssssssssss.........x....Xsssssssssssssssssssssssssssssssssss...Xs. [ 18%]
.X....X.......x.XX...ssssssssssssssssssssssssssssssssssss.xxx....X.xx..X [ 19%]
...xx.xXX...ssssssssssssssssssssssssssssssssss..sxs.X........X.X......ss [ 20%]
ss...........X................X......X.x...x.XX..x..xX....Xx......XX...x [ 21%]
....x....x...x.XXxX......X........X.xsssssssssssssssssssssssssssssssssss [ 21%]
X.....sssssssssssssssssssssssssssssssssss....XX...X...x.ssssssssssssssss [ 22%]
ssssssssssssssssssss...x..x.........ssss..Xx.......X....sxssssssssss.x.. [ 23%]
X...s....x.X.X.....X...ssss.......xX.....x..ssss...x........x....x..ssss [ 24%]
ssssssssssssssssssssssssssssssss..x....ssss.X..x.sss........Xx........X. [ 25%]
.x.xxx...X...x...............................s.Xsss.X..X...xssss........ [ 26%]
.x.....X.....x..ss.ss.................sssssssssssssssssssssssssssssssss. [ 27%]
sssxssss.....ssss........xX....X...X............x.ssss......XxX......... [ 28%]
.........x.x....sssx......X........xx.x.x.X..........x........X..X.....x [ 28%]
........ssssX.....xXss..sx.....x.x.....X......Xssss....xXsss..X.xX...x.x [ 29%]
ssssX....X.x......x............Xssssxsss.X.......X.......x......xXXx.xx. [ 30%]
.....s..x.X..xX....X..........x......xX.x...xx.....xx.x...........X..X.. [ 31%]
.x...x........x.....x..x.XX.ssss.X..x.....XX.ssss..X...X....X...xx..x..X [ 32%]
.X..........Xssss...x..x.........x...x.x....x...x...xx......X........... [ 33%]
Xx...........ssss..ssss.x.X.....x.....X...xxX.......sss..x.......Xx.X..x [ 34%]
...sss..ssss..........X....x......X...........x.....x..X.x.....X........ [ 35%]
...X.sss............x.xx....X..x.X...x....................X............. [ 35%]
.x...Xx..ssssXx.XX...............x......X.......X...........X.....X..Xx. [ 36%]
.X...........................x..x...........x..................X.......X [ 37%]
..X........x...X....x............x.....ssss...........x............x.... [ 38%]
...XX........x...x....x......................x..Xx..................X... [ 39%]
..x.........X......X...x..x..........X...........X.......X...x.......... [ 40%]
....x...x......X...X.........x.......X..X..............x....X........... [ 41%]
.x...............sssssssssssssssssssssssssssssss.ssss..s.x....X......... [ 42%]
.....X........X.......................x.......ssss...............XX..... [ 42%]
.............X..xX...........X............................X.......ssss.. [ 43%]
...x.............ssss..............X....................sss..X..X......X [ 44%]
....x..................................x.x.............................. [ 45%]
........................X....x..............X......X..........X......... [ 46%]
......X............X.......x.........................................sss [ 47%]
....x.........X..................x.....x...............X................ [ 48%]
...........x...............X......................x..................... [ 49%]
............................X..x............x........................... [ 49%]
.................x.............................Xx.....................xx [ 50%]
...x................................x................x...............x.. [ 51%]
.........................................x.............................. [ 52%]
............x.............s....................x.................x...... [ 53%]
................................x.....x................................. [ 54%]
.X..x...............x...................................XX.............. [ 55%]
.........X...x...................X...................................X.. [ 56%]
..................................X........................x............ [ 56%]
..................x..ssssss................x.................x.......... [ 57%]
.................x..................x...........ss...X.................. [ 58%]
....X...........X.............X..............X................X......... [ 59%]
.....x.................................................................. [ 60%]
........................................................................ [ 61%]
........................................................................ [ 62%]
........................................................................ [ 63%]
........................................................................ [ 63%]
.....x.......................................................s...s...... [ 64%]
......s......s...............s...........x..s.............xX.x.......X.. [ 65%]
.s....x.s.x..xx....x...s....X....s...s...X..X............s.......X...... [ 66%]
.s....s...............s....s.............s.........s..............s....s [ 67%]
.....................s.................................................. [ 68%]
............x................x.........x................................ [ 69%]
......................................................................... [ 70%]
.....................................................................s.. [ 70%]
.....x.......s..........s.......X....xX......x.X.X....X......XX.X.....X. [ 71%]
X..xX..XXx...X...X.......Xx.X...X...XX..X.X.X...XX.XX...x....X..XXX...X. [ 72%]
...X.x.X....XX.X....XX.X...X.....X......X.XXXX.......................... [ 73%]
...X................X.X.......x.......X.X.x............................. [ 74%]
......x..................x.....................x........................ [ 75%]
...........................x............................................ [ 76%]
........................................................................ [ 77%]
........................................................................ [ 77%]
........................................................................ [ 78%]
........................................................................ [ 79%]
........................................................................ [ 80%]
........................................................................ [ 81%]
........................................................................ [ 82%]
......................................................................... [ 83%]
........................................................................ [ 84%]
........................................................................ [ 84%]
........................................................................ [ 85%]
........................................................................ [ 86%]
........................................................................ [ 87%]
........................................................................ [ 88%]
........................................................................ [ 89%]
........................................................................ [ 90%]
........................................................................... [ 91%]
........................................................................ [ 91%]
........................................................................ [ 92%]
........................................................................ [ 93%]
........................................................................ [ 94%]
........................x.x...xx.xx...........................x..x...... [ 95%]
x.....x....x....x.............x.............xx.......................... [ 96%]
.......x................................................................ [ 97%]
........................................................................ [ 98%]
........................................................................ [ 99%]
.......................................................................X [ 99%]
..........                                                               [100%]

----------- coverage: platform linux, python 3.7.7-final-0 -----------
Coverage XML written to file coverage.xml

= 6969 passed, 579 skipped, 268 xfailed, 407 xpassed, 14536 warnings in 123.08s (0:02:03) =
============================= test session starts ==============================
platform linux -- Python 3.7.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: openfiles-0.5.0, remotedata-0.3.2, cov-2.10.1, forked-1.3.0, xdist-2.1.0
collected 113 items

modin/pandas/test/test_io.py .................sX..........s............. [ 38%]
........s...........................s..s.X.....s..................ss..   [100%]

----------- coverage: platform linux, python 3.7.7-final-0 -----------
Coverage XML written to file coverage.xml


=========== 103 passed, 8 skipped, 2 xpassed, 151 warnings in 41.06s ===========
Closing remaining open files:test_write_modin.hdf...donetest_write_pandas.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.7.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: openfiles-0.5.0, remotedata-0.3.2, cov-2.10.1, forked-1.3.0, xdist-2.1.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
gw0 [8223] / gw1 [8223] / gw2 [8223] / gw3 [8223] / gw4 [8223] / gw5 [8223] / gw6 [8223] / gw7 [8223] / gw8 [8223] / gw9 [8223] / gw10 [8223] / gw11 [8223] / gw12 [8223] / gw13 [8223] / gw14 [8223] / gw15 [8223] / gw16 [8223] / gw17 [8223] / gw18 [8223] / gw19 [8223] / gw20 [8223] / gw21 [8223] / gw22 [8223] / gw23 [8223] / gw24 [8223] / gw25 [8223] / gw26 [8223] / gw27 [8223] / gw28 [8223] / gw29 [8223] / gw30 [8223] / gw31 [8223] / gw32 [8223] / gw33 [8223] / gw34 [8223] / gw35 [8223] / gw36 [8223] / gw37 [8223] / gw38 [8223] / gw39 [8223] / gw40 [8223] / gw41 [8223] / gw42 [8223] / gw43 [8223] / gw44 [8223] / gw45 [8223] / gw46 [8223] / gw47 [8223]

........................................................................ [  0%]
........................................................................ [  1%]
........................................................................ [  2%]
........................................................................ [  3%]
........................................................................ [  4%]
..................................................X..........X........X. [  5%]
.....xX.X......X...X.X.........X......X.x..X.......XX...X.........X..... [  6%]
.XX.X...............X...X...XXX...s............X..X.x.X.X..........XX... [  7%]
Xx.X....X.....X.X....x..XX.XX..Xx.XXXX.....XX...X.X...x...X..Xx......... [  7%]
X........X..X..X.XX.X.................X..........X....X...........X..... [  8%]
..........X......X....X.X..xX.......X.......x....X.X.x.x.....X.X....XX.X [  9%]
......XX.X.X...X.X....xX...X.XXXX.X..X..XX.........s........X.....X...X. [ 10%]
..X.XX......X.x....X.X.............X......x..x..X..........XX.......X... [ 11%]
X......XX...XXX...X..XX.....X.........X....X...X...X...x...X..X......... [ 12%]
..X...X.....X...x...x....X......X....X.xs..X....X.X...Xx......X.X.X....x [ 13%]
.........X.........XXX...XXX.X.X.....X............x.X.x...Xs...X.....X.. [ 14%]
...............X..XX..X.X.....xX.......x.....Xx...........X......X..X... [ 14%]
XX........Xx....XX.........x.X..........XX.....x....xX....x..x.......... [ 15%]
...xxX..ssssssssssssssssssssssssssssssssssss...X..X.......X...X...X..... [ 16%]
.X....XX.......Xx...xXX.....x..XX......x.X.X.Xx....sssssssssssssssssssss [ 17%]
ssssssssssssssss.........x....Xsssssssssssssssssssssssssssssssssss...Xs. [ 18%]
.X....X.......x.XX...ssssssssssssssssssssssssssssssssssss.xxx....X.xx..X [ 19%]
...xx.xXX...ssssssssssssssssssssssssssssssssss..sxs.X........X.X......ss [ 20%]
ss...........X................X......X.x...x.XX..x..xX....Xx......XX...x [ 21%]
....x....x...x.XXxX......X........X.xsssssssssssssssssssssssssssssssssss [ 21%]
X.....sssssssssssssssssssssssssssssssssss....XX...X...x.ssssssssssssssss [ 22%]
ssssssssssssssssssss...x..x.........ssss..Xx.......X....sxssssssssss.x.. [ 23%]
X...s....x.X.X.....X...ssss.......xX.....x..ssss...x........x....x..ssss [ 24%]
ssssssssssssssssssssssssssssssss..x....ssss.X..x.sss........Xx........X. [ 25%]
.x.xxx...X...x...............................s.Xsss.X..X...xssss........ [ 26%]
.x.....X.....x..ss.ss.................sssssssssssssssssssssssssssssssss. [ 27%]
sssxssss.....ssss........xX....X...X............x.ssss......XxX......... [ 28%]
.........x.x....sssx......X........xx.x.x.X..........x........X..X.....x [ 28%]
........ssssX.....xXss..sx.....x.x.....X......Xssss....xXsss..X.xX...x.x [ 29%]
ssssX....X.x......x............Xssssxsss.X.......X.......x......xXXx.xx. [ 30%]
.....s..x.X..xX....X..........x......xX.x...xx.....xx.x...........X..X.. [ 31%]
.x...x........x.....x..x.XX.ssss.X..x.....XX.ssss..X...X....X...xx..x..X [ 32%]
.X..........Xssss...x..x.........x...x.x....x...x...xx......X........... [ 33%]
Xx...........ssss..ssss.x.X.....x.....X...xxX.......sss..x.......Xx.X..x [ 34%]
...sss..ssss..........X....x......X...........x.....x..X.x.....X........ [ 35%]
...X.sss............x.xx....X..x.X...x....................X............. [ 35%]
.x...Xx..ssssXx.XX...............x......X.......X...........X.....X..Xx. [ 36%]
.X...........................x..x...........x..................X.......X [ 37%]
..X........x...X....x............x.....ssss...........x............x.... [ 38%]
...XX........x...x....x......................x..Xx..................X... [ 39%]
..x.........X......X...x..x..........X...........X.......X...x.......... [ 40%]
....x...x......X...X.........x.......X..X..............x....X........... [ 41%]
.x...............sssssssssssssssssssssssssssssss.ssss..s.x....X......... [ 42%]
.....X........X.......................x.......ssss...............XX..... [ 42%]
.............X..xX...........X............................X.......ssss.. [ 43%]
...x.............ssss..............X....................sss..X..X......X [ 44%]
....x..................................x.x.............................. [ 45%]
........................X....x..............X......X..........X......... [ 46%]
......X............X.......x.........................................sss [ 47%]
....x.........X..................x.....x...............X................ [ 48%]
...........x...............X......................x..................... [ 49%]
............................X..x............x........................... [ 49%]
.................x.............................Xx.....................xx [ 50%]
...x................................x................x...............x.. [ 51%]
.........................................x.............................. [ 52%]
............x.............s....................x.................x...... [ 53%]
................................x.....x................................. [ 54%]
.X..x...............x...................................XX.............. [ 55%]
.........X...x...................X...................................X.. [ 56%]
..................................X........................x............ [ 56%]
..................x..ssssss................x.................x.......... [ 57%]
.................x..................x...........ss...X.................. [ 58%]
....X...........X.............X..............X................X......... [ 59%]
.....x.................................................................. [ 60%]
........................................................................ [ 61%]
........................................................................ [ 62%]
........................................................................ [ 63%]
........................................................................ [ 63%]
.....x.......................................................s...s...... [ 64%]
......s......s...............s...........x..s.............xX.x.......X.. [ 65%]
.s....x.s.x..xx....x...s....X....s...s...X..X............s.......X...... [ 66%]
.s....s...............s....s.............s.........s..............s....s [ 67%]
.....................s.................................................. [ 68%]
............x................x.........x................................ [ 69%]
......................................................................... [ 70%]
.....................................................................s.. [ 70%]
.....x.......s..........s.......X....xX......x.X.X....X......XX.X.....X. [ 71%]
X..xX..XXx...X...X.......Xx.X...X...XX..X.X.X...XX.XX...x....X..XXX...X. [ 72%]
...X.x.X....XX.X....XX.X...X.....X......X.XXXX.......................... [ 73%]
...X................X.X.......x.......X.X.x............................. [ 74%]
......x..................x.....................x........................ [ 75%]
...........................x............................................ [ 76%]
........................................................................ [ 77%]
........................................................................ [ 77%]
........................................................................ [ 78%]
........................................................................ [ 79%]
........................................................................ [ 80%]
........................................................................ [ 81%]
........................................................................ [ 82%]
......................................................................... [ 83%]
........................................................................ [ 84%]
........................................................................ [ 84%]
........................................................................ [ 85%]
........................................................................ [ 86%]
........................................................................ [ 87%]
........................................................................ [ 88%]
........................................................................ [ 89%]
........................................................................ [ 90%]
........................................................................... [ 91%]
........................................................................ [ 91%]
........................................................................ [ 92%]
........................................................................ [ 93%]
........................................................................ [ 94%]
........................x.x...xx.xx...........................x..x...... [ 95%]
x.....x....x....x.............x.............xx.......................... [ 96%]
.......x................................................................ [ 97%]
........................................................................ [ 98%]
........................................................................ [ 99%]
.......................................................................X [ 99%]
..........                                                               [100%]

----------- coverage: platform linux, python 3.7.7-final-0 -----------
Coverage XML written to file coverage.xml

= 6969 passed, 579 skipped, 268 xfailed, 407 xpassed, 14536 warnings in 123.08s (0:02:03) =

modin-bot · 2020-09-01T13:08:36Z

TeamCity Dask test results bot

Tests PASSed

Tests Logs

============================= test session starts ==============================
platform linux -- Python 3.7.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: openfiles-0.5.0, remotedata-0.3.2, cov-2.10.1, forked-1.3.0, xdist-2.1.0
collected 113 items

modin/pandas/test/test_io.py .................sx..........s............. [ 38%]
....................................s..s.X.....s..................ss..   [100%]

----------- coverage: platform linux, python 3.7.7-final-0 -----------
Coverage XML written to file coverage.xml


= 104 passed, 7 skipped, 1 xfailed, 1 xpassed, 117 warnings in 80.20s (0:01:20) =
Closing remaining open files:test_write_pandas.hdf...donetest_write_modin.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.7.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: openfiles-0.5.0, remotedata-0.3.2, cov-2.10.1, forked-1.3.0, xdist-2.1.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
gw0 [8223] / gw1 [8223] / gw2 [8223] / gw3 [8223] / gw4 [8223] / gw5 [8223] / gw6 [8223] / gw7 [8223] / gw8 [8223] / gw9 [8223] / gw10 [8223] / gw11 [8223] / gw12 [8223] / gw13 [8223] / gw14 [8223] / gw15 [8223] / gw16 [8223] / gw17 [8223] / gw18 [8223] / gw19 [8223] / gw20 [8223] / gw21 [8223] / gw22 [8223] / gw23 [8223] / gw24 [8223] / gw25 [8223] / gw26 [8223] / gw27 [8223] / gw28 [8223] / gw29 [8223] / gw30 [8223] / gw31 [8223] / gw32 [8223] / gw33 [8223] / gw34 [8223] / gw35 [8223] / gw36 [8223] / gw37 [8223] / gw38 [8223] / gw39 [8223] / gw40 [8223] / gw41 [8223] / gw42 [8223] / gw43 [8223] / gw44 [8223] / gw45 [8223] / gw46 [8223] / gw47 [8223]

........................................................................ [  0%]
........................................................................ [  1%]
........................................................................ [  2%]
........................................................................ [  3%]
..........................................................X.....X....... [  4%]
.........X.....X.....XX.....X.X....................X...X.X.XXX....X....X [  5%]
....X..............X......X........X...X...X..X..XX......X......X...X..X [  6%]
..sX........X...X.....XX.X....XX....X.X.........XX.X.....XXX.........X...X [  7%]
......XX.......X..X......X...................X..X..X.X..X..X.X..X....... [  7%]
.........X...........X........X...X.X..xXx.X....X.XX.................... [  8%]
...........X.....XX.X..X.....X..x....X...X...........X......X........... [  9%]
......Xx........X.....x.XX.X........X...............s..X..X.xX....Xs.X.. [ 10%]
....x.X.......x...............Xx.....X...x......x.....XX.....x....x..x.. [ 11%]
X...X.........XXX.x..Xx.......X.....x.....X..X....XX......xX...X..XX.X.. [ 12%]
..Xxx.XX....x......x..............xxX......x.XXxXXX.X..X..x..........XX. [ 13%]
............X.XX..x....Xs.X.ssssX..ssss.s.xsssssssssXs..ss.sssxss.s.ss.s. [ 14%]
ss.ssXsXs.sssssssssssxss.s.ss.ss.XsXssssssXsssss.xsss.ss.sss.sss..ss.x.X [ 14%]
..X.xXx.x....X.........Xx..........X...X.ssX.ssssss.ss.sss.sXs.ss..X..ss [ 15%]
ssssss.sssxsssss.ss.sssssssssXssXsXxsss.sXssss.ssss.sxsXss.ssss.s.ss.sss [ 16%]
Xs.x...xX.......X....xXssss..Xss..ss.ss.s..sssxsssssssssssss.s.sxs.sXssXs [ 17%]
sssssssss.x..........xssssss.sssxsssssssXss.ssxsXsss..ssssssss.ss.ss.ss. [ 18%]
s....ssss...xx...x.X...XX...x.....s.ssXssssssss.ssxs.ss.sssssssssxssssss [ 19%]
sssXssssX.sss...X....X.x..Xx..s.sssXsssssss.ssXssss.ss.sssss.xs.sssXs.ss [ 20%]
.sssssssX.......x..X...X..x.ssssss.Xssss.s..sss.ssssss.sssssssss.ss.ssxs [ 21%]
sss.X...x.....x.X.X....xX...........xxX.........X..x.....x..X...X..Xx.X. [ 21%]
.......X.x...x......X.......x......x...xx.......XXs.Xssx.....x.X...X.... [ 22%]
.XsxssX..............X.ssssXX........Xs.sss...X.X....x............X.X... [ 23%]
..X..........X.....X.........x...x...X..X.......Xss.ss.XX..X......x..... [ 24%]
..x....x.x......x...x..x.....x..x.x.x.XX............x...x.......x....x.. [ 25%]
xXx..x....x....xx.ss.sX.s.xx.......xx..x.x..x.Xxx.x....Xx.............x. [ 26%]
X......XXx....x.....xx.ss.sx.s...X..Xx.X.XX........XX..Xx...x.x.ssXssX.. [ 27%]
X.....ssss.....X.x...........X..X.X...XX....X.....x.......X...x...X...XX [ 28%]
s..Xs.sss.ss.....X.....xXs..x....x.......X.........X..sss.x.........X.... [ 28%]
X........x........X...ss.s.sX..xss...ss..x...........x..........X...X.x.. [ 29%]
..................................s.X........Xx...............x......xx. [ 30%]
..........X....sss.s....x....X..xxs..s.....s....x.X..........xx...X....x [ 31%]
..............X..............xXx........x...........Xx........x........X. [ 32%]
.........x......x.....x.x..X...x....................................Xxx. [ 33%]
......sssx........s......x..X..X...x..ss..x..s.....s...x................ [ 34%]
.................x..X.x.............x.X.......x.......................... [ 35%]
.......x....x........X..xs..s.....s..X.....XX.............X.......x...... [ 35%]
x....................X...........X....Xx.X............X.................. [ 36%]
.................................Xx.........X..x......................... [ 37%]
....X.x...............................X.......x........X................ [ 38%]
X.................................................x.X..........x......... [ 39%]
.........X....................X...............sss..................s..... [ 40%]
....X......X......x..............X...X.................................. [ 41%]
.............................XX..................................x...... [ 42%]
.............x..ssss..................................X..........x...... [ 43%]
...............................x........................................ [ 43%]
...............X.........xx............................................. [ 44%]
............x.X.X..X....x.................................XXX......x.... [ 45%]
...x.........................x......x.........s..sss...ss..........x.... [ 46%]
..X..X.........................X........X.......X...X.........X....X.... [ 47%]
.......................X..X....x..........XX.......X...x.X.............. [ 48%]
.X.X....ssss....X....X............x..............ssss...x....x.......... [ 49%]
.......x..............x..............x...........x...X.....X.x..X....X.. [ 50%]
.....X.....XX.....X..X......x..XX....X..........X.......x.X.X.X.X.....x. [ 50%]
.......X.x...........xs.sss............xs.s.s.s.......................X. [ 51%]
.sss.Xs.ss.........................................................x.... [ 52%]
....................s................................................... [ 53%]
........................................x............................... [ 54%]
.x..................................xs.sss.............................. [ 55%]
...........s............................................................ [ 56%]
...................................x........xx..........x......x........ [ 57%]
..x..............x..X.............X.........X......X.................... [ 57%]
...............x.......X......X..........x.....Xsss.X.ssss.x............ [ 58%]
....x..ssssss.sssssssssss.s.sssssssssssssssss.s......................... [ 59%]
.................................................x.............X........ [ 60%]
...............xsssssssssssss.ss.ssssssssssssssssssssss................. [ 61%]
..............................X....X.................................... [ 62%]
.............................................ss...........s............. [ 63%]
.......................s..x...................s......................... [ 64%]
................s............s.......x.........s.x..x..s.......x......... [ 64%]
....s................s........s.....................s.............s.s... [ 65%]
...........s...........s.................s...s.....s...x...........x.... [ 66%]
....ss.........x.................s.....................s........s........ [ 67%]
....................s........................x.......................... [ 68%]
................x.............x...................x..................... [ 69%]
........................................................................ [ 70%]
.....................................................................X.. [ 71%]
............XX..........X...........X........X..X....X....X...X......... [ 71%]
x.X..XX........X....X.......X......XX.XX...X....X..X....X................ [ 72%]
.X...X.XX...........XX.X......X..X..Xx.................................. [ 73%]
.....X.......X...x..X.................................x...X...X......... [ 74%]
..........................x..x................................x......... [ 75%]
.............x.......................................................... [ 76%]
..............................................x......................... [ 77%]
x...................X................................................... [ 78%]
...x..X..............X...................x.............................. [ 78%]
......X.............X................................X...X.............. [ 79%]
.......X..X......X..X........X..........X............................... [ 80%]
...............................................................X...X...x [ 81%]
...x.................................................................... [ 82%]
........................................................................ [ 83%]
........................................................................ [ 84%]
........................................................................ [ 85%]
........................................................................ [ 86%]
........................................................................ [ 86%]
........................................................................ [ 87%]
........................................................................ [ 88%]
........................................................................ [ 89%]
........................................................................ [ 90%]
........................................................................ [ 91%]
........................................................................ [ 92%]
......................................................................... [ 93%]
........................................................................ [ 93%]
........................................................................ [ 94%]
...............................................x...............x........ [ 95%]
..x.......xxxx.x........x...........xx.....x...x.......xx............... [ 96%]
x....................................................................... [ 97%]
........................................................................ [ 98%]
........................................................................ [ 99%]
......................................................................   [100%]

----------- coverage: platform linux, python 3.7.7-final-0 -----------
Coverage XML written to file coverage.xml

= 6969 passed, 579 skipped, 268 xfailed, 407 xpassed, 14434 warnings in 301.02s (0:05:01) =
============================= test session starts ==============================
platform linux -- Python 3.7.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: openfiles-0.5.0, remotedata-0.3.2, cov-2.10.1, forked-1.3.0, xdist-2.1.0
collected 113 items

modin/pandas/test/test_io.py .................sx..........s............. [ 38%]
....................................s..s.X.....s..................ss..   [100%]

----------- coverage: platform linux, python 3.7.7-final-0 -----------
Coverage XML written to file coverage.xml


= 104 passed, 7 skipped, 1 xfailed, 1 xpassed, 117 warnings in 80.20s (0:01:20) =
Closing remaining open files:test_write_pandas.hdf...donetest_write_modin.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.7.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: openfiles-0.5.0, remotedata-0.3.2, cov-2.10.1, forked-1.3.0, xdist-2.1.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
gw0 [8223] / gw1 [8223] / gw2 [8223] / gw3 [8223] / gw4 [8223] / gw5 [8223] / gw6 [8223] / gw7 [8223] / gw8 [8223] / gw9 [8223] / gw10 [8223] / gw11 [8223] / gw12 [8223] / gw13 [8223] / gw14 [8223] / gw15 [8223] / gw16 [8223] / gw17 [8223] / gw18 [8223] / gw19 [8223] / gw20 [8223] / gw21 [8223] / gw22 [8223] / gw23 [8223] / gw24 [8223] / gw25 [8223] / gw26 [8223] / gw27 [8223] / gw28 [8223] / gw29 [8223] / gw30 [8223] / gw31 [8223] / gw32 [8223] / gw33 [8223] / gw34 [8223] / gw35 [8223] / gw36 [8223] / gw37 [8223] / gw38 [8223] / gw39 [8223] / gw40 [8223] / gw41 [8223] / gw42 [8223] / gw43 [8223] / gw44 [8223] / gw45 [8223] / gw46 [8223] / gw47 [8223]

........................................................................ [  0%]
........................................................................ [  1%]
........................................................................ [  2%]
........................................................................ [  3%]
..........................................................X.....X....... [  4%]
.........X.....X.....XX.....X.X....................X...X.X.XXX....X....X [  5%]
....X..............X......X........X...X...X..X..XX......X......X...X..X [  6%]
..sX........X...X.....XX.X....XX....X.X.........XX.X.....XXX.........X...X [  7%]
......XX.......X..X......X...................X..X..X.X..X..X.X..X....... [  7%]
.........X...........X........X...X.X..xXx.X....X.XX.................... [  8%]
...........X.....XX.X..X.....X..x....X...X...........X......X........... [  9%]
......Xx........X.....x.XX.X........X...............s..X..X.xX....Xs.X.. [ 10%]
....x.X.......x...............Xx.....X...x......x.....XX.....x....x..x.. [ 11%]
X...X.........XXX.x..Xx.......X.....x.....X..X....XX......xX...X..XX.X.. [ 12%]
..Xxx.XX....x......x..............xxX......x.XXxXXX.X..X..x..........XX. [ 13%]
............X.XX..x....Xs.X.ssssX..ssss.s.xsssssssssXs..ss.sssxss.s.ss.s. [ 14%]
ss.ssXsXs.sssssssssssxss.s.ss.ss.XsXssssssXsssss.xsss.ss.sss.sss..ss.x.X [ 14%]
..X.xXx.x....X.........Xx..........X...X.ssX.ssssss.ss.sss.sXs.ss..X..ss [ 15%]
ssssss.sssxsssss.ss.sssssssssXssXsXxsss.sXssss.ssss.sxsXss.ssss.s.ss.sss [ 16%]
Xs.x...xX.......X....xXssss..Xss..ss.ss.s..sssxsssssssssssss.s.sxs.sXssXs [ 17%]
sssssssss.x..........xssssss.sssxsssssssXss.ssxsXsss..ssssssss.ss.ss.ss. [ 18%]
s....ssss...xx...x.X...XX...x.....s.ssXssssssss.ssxs.ss.sssssssssxssssss [ 19%]
sssXssssX.sss...X....X.x..Xx..s.sssXsssssss.ssXssss.ss.sssss.xs.sssXs.ss [ 20%]
.sssssssX.......x..X...X..x.ssssss.Xssss.s..sss.ssssss.sssssssss.ss.ssxs [ 21%]
sss.X...x.....x.X.X....xX...........xxX.........X..x.....x..X...X..Xx.X. [ 21%]
.......X.x...x......X.......x......x...xx.......XXs.Xssx.....x.X...X.... [ 22%]
.XsxssX..............X.ssssXX........Xs.sss...X.X....x............X.X... [ 23%]
..X..........X.....X.........x...x...X..X.......Xss.ss.XX..X......x..... [ 24%]
..x....x.x......x...x..x.....x..x.x.x.XX............x...x.......x....x.. [ 25%]
xXx..x....x....xx.ss.sX.s.xx.......xx..x.x..x.Xxx.x....Xx.............x. [ 26%]
X......XXx....x.....xx.ss.sx.s...X..Xx.X.XX........XX..Xx...x.x.ssXssX.. [ 27%]
X.....ssss.....X.x...........X..X.X...XX....X.....x.......X...x...X...XX [ 28%]
s..Xs.sss.ss.....X.....xXs..x....x.......X.........X..sss.x.........X.... [ 28%]
X........x........X...ss.s.sX..xss...ss..x...........x..........X...X.x.. [ 29%]
..................................s.X........Xx...............x......xx. [ 30%]
..........X....sss.s....x....X..xxs..s.....s....x.X..........xx...X....x [ 31%]
..............X..............xXx........x...........Xx........x........X. [ 32%]
.........x......x.....x.x..X...x....................................Xxx. [ 33%]
......sssx........s......x..X..X...x..ss..x..s.....s...x................ [ 34%]
.................x..X.x.............x.X.......x.......................... [ 35%]
.......x....x........X..xs..s.....s..X.....XX.............X.......x...... [ 35%]
x....................X...........X....Xx.X............X.................. [ 36%]
.................................Xx.........X..x......................... [ 37%]
....X.x...............................X.......x........X................ [ 38%]
X.................................................x.X..........x......... [ 39%]
.........X....................X...............sss..................s..... [ 40%]
....X......X......x..............X...X.................................. [ 41%]
.............................XX..................................x...... [ 42%]
.............x..ssss..................................X..........x...... [ 43%]
...............................x........................................ [ 43%]
...............X.........xx............................................. [ 44%]
............x.X.X..X....x.................................XXX......x.... [ 45%]
...x.........................x......x.........s..sss...ss..........x.... [ 46%]
..X..X.........................X........X.......X...X.........X....X.... [ 47%]
.......................X..X....x..........XX.......X...x.X.............. [ 48%]
.X.X....ssss....X....X............x..............ssss...x....x.......... [ 49%]
.......x..............x..............x...........x...X.....X.x..X....X.. [ 50%]
.....X.....XX.....X..X......x..XX....X..........X.......x.X.X.X.X.....x. [ 50%]
.......X.x...........xs.sss............xs.s.s.s.......................X. [ 51%]
.sss.Xs.ss.........................................................x.... [ 52%]
....................s................................................... [ 53%]
........................................x............................... [ 54%]
.x..................................xs.sss.............................. [ 55%]
...........s............................................................ [ 56%]
...................................x........xx..........x......x........ [ 57%]
..x..............x..X.............X.........X......X.................... [ 57%]
...............x.......X......X..........x.....Xsss.X.ssss.x............ [ 58%]
....x..ssssss.sssssssssss.s.sssssssssssssssss.s......................... [ 59%]
.................................................x.............X........ [ 60%]
...............xsssssssssssss.ss.ssssssssssssssssssssss................. [ 61%]
..............................X....X.................................... [ 62%]
.............................................ss...........s............. [ 63%]
.......................s..x...................s......................... [ 64%]
................s............s.......x.........s.x..x..s.......x......... [ 64%]
....s................s........s.....................s.............s.s... [ 65%]
...........s...........s.................s...s.....s...x...........x.... [ 66%]
....ss.........x.................s.....................s........s........ [ 67%]
....................s........................x.......................... [ 68%]
................x.............x...................x..................... [ 69%]
........................................................................ [ 70%]
.....................................................................X.. [ 71%]
............XX..........X...........X........X..X....X....X...X......... [ 71%]
x.X..XX........X....X.......X......XX.XX...X....X..X....X................ [ 72%]
.X...X.XX...........XX.X......X..X..Xx.................................. [ 73%]
.....X.......X...x..X.................................x...X...X......... [ 74%]
..........................x..x................................x......... [ 75%]
.............x.......................................................... [ 76%]
..............................................x......................... [ 77%]
x...................X................................................... [ 78%]
...x..X..............X...................x.............................. [ 78%]
......X.............X................................X...X.............. [ 79%]
.......X..X......X..X........X..........X............................... [ 80%]
...............................................................X...X...x [ 81%]
...x.................................................................... [ 82%]
........................................................................ [ 83%]
........................................................................ [ 84%]
........................................................................ [ 85%]
........................................................................ [ 86%]
........................................................................ [ 86%]
........................................................................ [ 87%]
........................................................................ [ 88%]
........................................................................ [ 89%]
........................................................................ [ 90%]
........................................................................ [ 91%]
........................................................................ [ 92%]
......................................................................... [ 93%]
........................................................................ [ 93%]
........................................................................ [ 94%]
...............................................x...............x........ [ 95%]
..x.......xxxx.x........x...........xx.....x...x.......xx............... [ 96%]
x....................................................................... [ 97%]
........................................................................ [ 98%]
........................................................................ [ 99%]
......................................................................   [100%]

----------- coverage: platform linux, python 3.7.7-final-0 -----------
Coverage XML written to file coverage.xml

= 6969 passed, 579 skipped, 268 xfailed, 407 xpassed, 14434 warnings in 301.02s (0:05:01) =

modin-bot · 2020-09-01T13:15:06Z

TeamCity Ray test results bot

Tests PASSed

Tests Logs

============================= test session starts ==============================
platform linux -- Python 3.7.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: openfiles-0.5.0, remotedata-0.3.2, cov-2.10.1, forked-1.3.0, xdist-2.1.0
collected 113 items

modin/pandas/test/test_io.py .................sx..........s............. [ 38%]
....................................s..s.X.....s..................ss..   [100%]

----------- coverage: platform linux, python 3.7.7-final-0 -----------
Coverage XML written to file coverage.xml


= 104 passed, 7 skipped, 1 xfailed, 1 xpassed, 105 warnings in 86.34s (0:01:26) =
Closing remaining open files:test_write_pandas.hdf...donetest_write_modin.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.7.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: openfiles-0.5.0, remotedata-0.3.2, cov-2.10.1, forked-1.3.0, xdist-2.1.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
[gw16] node down: Not properly terminated

replacing crashed worker gw16
[gw33] node down: Not properly terminated

replacing crashed worker gw33
gw0 [8223] / gw1 [8223] / gw2 [8223] / gw3 [8223] / gw4 [8223] / gw5 [8223] / gw6 [8223] / gw7 [8223] / gw8 [8223] / gw9 [8223] / gw10 [8223] / gw11 [8223] / gw12 [8223] / gw13 [8223] / gw14 [8223] / gw15 [8223] / gw48 [8223] / gw17 [8223] / gw18 [8223] / gw19 [8223] / gw20 [8223] / gw21 [8223] / gw22 [8223] / gw23 [8223] / gw24 [8223] / gw25 [8223] / gw26 [8223] / gw27 [8223] / gw28 [8223] / gw29 [8223] / gw30 [8223] / gw31 [8223] / gw32 [8223] / gw49 [8223] / gw34 [8223] / gw35 [8223] / gw36 [8223] / gw37 [8223] / gw38 [8223] / gw39 [8223] / gw40 [8223] / gw41 [8223] / gw42 [8223] / gw43 [8223] / gw44 [8223] / gw45 [8223] / gw46 [8223] / gw47 [8223]

........................................................................ [  0%]
........................................................................ [  1%]
........................................................................ [  2%]
........................................................................ [  3%]
........................................................................ [  4%]
..........X.X.............X........X....X.......X...X.X........XX..X.... [  5%]
.........X..X.....XXX...............X....X...X......X....X..X...X.Xs..X. [  6%]
..........XXX..X......X....XX.....X........XX....XXXXX...X..X.X.......... [  6%]
.X..............X...x.........X..x..X...X........X..X...XX......XX....XX [  7%]
X..X.XX.X......X...XX......X.X............X..x.....X.....X...X.....X.x.... [  8%]
..X............X.....X..........XX...............�[2m�[36m(pid=9313)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=9313)�[0m fatal: bad object HEAD
...s.X.X......X........ [  9%]
X.....x........s.x.........X.........X.XX....XX........X............X... [ 10%]
XX...X.XXX..Xx..X..X.X....�[2m�[36m(pid=9551)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=9551)�[0m fatal: bad object HEAD
................X.........X.....X.....X....x.. [ 11%]
x...X.....X.........x................X.......Xx...XX.x......xxX...X.X..X [ 12%]
.xX..x..X.....XX...XX..X..XXX.....X....x....X.X.XxXXX..X.....X..XX...Xxx [ 13%]
....xssss...ss..Xs..X.X..XX......X.sx.sss..s..ssx.sssss.sss�[2m�[36m(pid=9471)�[0m RuntimeWarning: overflow encountered in reduce
..sssX...s.ss [ 14%]
s.sssss.sX.xssXssss.sssssXx...xX.xXXx.x....xs....X.x..........x..sss.xsx [ 14%]
sssx.s.x.X..x....Xss.x.ssss.sxss.sss.xs..ss.sssss..X..sssxxssss..ssss.ss [ 15%]
sxsxsss.sssss..ssxss.s.sssss.ss..xsxxssX.ssss.xsssssss.ssx.....XX...x... [ 16%]
.Xx.xxX.sss..sssss.sxsssss..sssssxs.....ss..sssssssXx.Xsxssssx...X..Xx.. [ 17%]
..X.....X.......X....X.....x........X.s.sx..sss.ss.X..s.x.......X.....Xx [ 18%]
..........s..x.s..sxxsssssssX...sss.ss..sss.sss.ssss.ssssXsss...x...ssss [ 19%]
s.ssss.sX.ss.ssssssxsssssss.sss.s.x..ssssss..sssssssssss.xsssssssssssX.s [ 20%]
.X.x.sssss.sX.ssssss.s.xX.ss..ss..X.X.ss..Xssssss.X.sss.sssssssss.s.s.ss.. [ 21%]
sXsssssssssssssssxsXssss...ss.X.....s....X....XxX.....xX....X............ [ 21%]
s...X...XX..........sX..XX..X........................x..X..X...sss..sss.. [ 22%]
s...sss.s.s..s.s..ss..ssx.......ssssXx..s......sssssss...ssssss...Xsss.. [ 23%]
....s.......x..Xssss...............s.................x.Xs............x.. [ 24%]
...sss..x......................xx.................X........x............ [ 25%]
.x...............X.....s.....x................x.......X.....x........xss [ 26%]
s.....s...............X........x..x............xx.....X.�[2m�[36m(pid=9313)�[0m RuntimeWarning: overflow encountered in reduce
......x....x.... [ 27%]
.......xsss......s..X....X...X.............xx.........X............X..x. [ 28%]
....x.....Xx....X..x.......x...........x.....x.........X............XXx. [ 28%]
......x..X.s..ss...s...X....s.xx.sss....X.....................x....X.x.. [ 29%]
.X...x.....x.....................X.....ss.ssX...x..xX........X.......... [ 30%]
......X........x.xX.x..s.ss.s......X.....X.....X..X.....X...xXX..X...... [ 31%]
.......x........X.......X.........X............X...........Xx.xs.....sss [ 32%]
.s..x................xX.x.....XX.........x..X........x...XX............. [ 33%]
..x.X.....X....X....x.....X.....X....X....X..ssss.sss.s..X.........xx... [ 34%]
........X....X..X.XX................x.........x......xx..X....X......... [ 35%]
..x.......X..x.....x....x...............sss..x......X...X...sss.X....... [ 35%]
.......x........x..................X...........x..X.........xx..X.....x. [ 36%]
...............x............X...x....x.......X....X......ssss...x....x.. [ 37%]
..........X.X.....................X...........Xsss.....................X. [ 38%]
............X...........X.....X.X.................X......X..........XX.. [ 39%]
...s.sssX......sss....................x..X..X.X.....X.X...x............. [ 40%]
........................x..X..................X........X.........xX..... [ 41%]
.........x............XXX.............x.Xx.......................x...... [ 42%]
............x.x..x....................x.X...X.........x........x...x.... [ 43%]
...x...................ssss..............x.................x.....X...... [ 43%]
x.........X..................x....x............................x.......x [ 44%]
......x..................x...X.............x..............x...x......... [ 45%]
x.......xss.ss.....X.......X.......x...........x..x................x.... [ 46%]
..X..........X...x....ssss.........X...x.........................x..X..X [ 47%]
.....x.......Xx..................X............X......X.....ss.....x..... [ 48%]
.........X.......XX......x..X.........x.......XxX..X.......X............ [ 49%]
X...ssss............x.ssss.................X.x......X.......ssssss...... [ 50%]
X......X...x.....X..................xx....X..........x.X..X.x........... [ 50%]
.........x...x...........X..X....x...................X............x.X... [ 51%]
........X....x...X.X...........x..sss..X......xX............x........x.. [ 52%]
..............X.X.x....sss.....X...........x.........x.....X.X....x.x... [ 53%]
........................................................................ [ 54%]
...........x.............................x......................x.s.ss.s [ 55%]
........................................................................ [ 56%]
........................................................................ [ 57%]
.......................................................X...X.......X.... [ 57%]
......X..............................X...x......x..XXssss............... [ 58%]
..Xsss.x.......x........................................................ [ 59%]
.......................x........x...................xss.ss.s.ss.ss.ssss. [ 60%]
xs.sssssssssss.ss.sssssssssssss.s.ssssssss.sssssssss.sssssssss.sss..s.ss [ 61%]
........................................................................ [ 62%]
..................s..................................................... [ 63%]
.........X.............................................................. [ 64%]
................................................x....................... [ 64%]
..................................x..x.................................. [ 65%]
......................s.............s.......................s......s�[2m�[36m(pid=10463)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=10463)�[0m fatal: bad object HEAD
.... [ 66%]
..............s....s......s.............ss.......sx................s...... [ 67%]
....x.........s......x....s........x..s...........s..................... [ 68%]
.......s......x................s...x..........x......s..........x....... [ 69%]
.............x...........s...................................s.......... [ 70%]
...................s...............s......s........X.....X....s......... [ 71%]
...........s...................................................X........ [ 71%]
X............X..........X...X..X..X.......XX..X.X........X.X............ [ 72%]
.......X...X.x...X....X....X..............XX..................X......... [ 73%]
....XX.................X..........X..X..............X.X.......XX...X.... [ 74%]
.....x...............................X............x.....x.......X...x... [ 75%]
.....X..........XX.......X...X..x..X...X.....X.x.....x...X........Xx..X. [ 76%]
......................x.............x.................................x. [ 77%]
...........X............................................................ [ 78%]
X....................................X.................................. [ 78%]
........................................................................ [ 79%]
.......X....................X........................................... [ 80%]
.....X..................X...X........................................... [ 81%]
........................................................................ [ 82%]
........................................................................ [ 83%]
........................................................................ [ 84%]
........................................................................ [ 85%]
........................................................................ [ 85%]
......................................................................... [ 86%]
........................................................................ [ 87%]
......................................................................... [ 88%]
........................................................................ [ 89%]
........................................................................ [ 90%]
........................................................................ [ 91%]
........................................................................ [ 92%]
........................................................................ [ 92%]
........................................................................ [ 93%]
........................................................................ [ 94%]
....................................................................x... [ 95%]
x........x....x...xx......................x...xx....x.....x............. [ 96%]
.......xx............x....................x......................x...... [ 97%]
........................................................................ [ 98%]
........................................................................ [ 99%]
........................................................................ [ 99%]
...                                                                      [100%]

----------- coverage: platform linux, python 3.7.7-final-0 -----------
---------------------- coverage: failed workers ----------------------
The following workers failed to return coverage data, ensure that pytest-cov is installed on these workers.
gw16
gw33
Coverage XML written to file coverage.xml

= 6969 passed, 579 skipped, 268 xfailed, 407 xpassed, 14309 warnings in 210.52s (0:03:30) =
============================= test session starts ==============================
platform linux -- Python 3.7.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: openfiles-0.5.0, remotedata-0.3.2, cov-2.10.1, forked-1.3.0, xdist-2.1.0
collected 113 items

modin/pandas/test/test_io.py .................sx..........s............. [ 38%]
....................................s..s.X.....s..................ss..   [100%]

----------- coverage: platform linux, python 3.7.7-final-0 -----------
Coverage XML written to file coverage.xml


= 104 passed, 7 skipped, 1 xfailed, 1 xpassed, 105 warnings in 86.34s (0:01:26) =
Closing remaining open files:test_write_pandas.hdf...donetest_write_modin.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.7.7, pytest-6.0.1, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: openfiles-0.5.0, remotedata-0.3.2, cov-2.10.1, forked-1.3.0, xdist-2.1.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
[gw16] node down: Not properly terminated

replacing crashed worker gw16
[gw33] node down: Not properly terminated

replacing crashed worker gw33
gw0 [8223] / gw1 [8223] / gw2 [8223] / gw3 [8223] / gw4 [8223] / gw5 [8223] / gw6 [8223] / gw7 [8223] / gw8 [8223] / gw9 [8223] / gw10 [8223] / gw11 [8223] / gw12 [8223] / gw13 [8223] / gw14 [8223] / gw15 [8223] / gw48 [8223] / gw17 [8223] / gw18 [8223] / gw19 [8223] / gw20 [8223] / gw21 [8223] / gw22 [8223] / gw23 [8223] / gw24 [8223] / gw25 [8223] / gw26 [8223] / gw27 [8223] / gw28 [8223] / gw29 [8223] / gw30 [8223] / gw31 [8223] / gw32 [8223] / gw49 [8223] / gw34 [8223] / gw35 [8223] / gw36 [8223] / gw37 [8223] / gw38 [8223] / gw39 [8223] / gw40 [8223] / gw41 [8223] / gw42 [8223] / gw43 [8223] / gw44 [8223] / gw45 [8223] / gw46 [8223] / gw47 [8223]

........................................................................ [  0%]
........................................................................ [  1%]
........................................................................ [  2%]
........................................................................ [  3%]
........................................................................ [  4%]
..........X.X.............X........X....X.......X...X.X........XX..X.... [  5%]
.........X..X.....XXX...............X....X...X......X....X..X...X.Xs..X. [  6%]
..........XXX..X......X....XX.....X........XX....XXXXX...X..X.X.......... [  6%]
.X..............X...x.........X..x..X...X........X..X...XX......XX....XX [  7%]
X..X.XX.X......X...XX......X.X............X..x.....X.....X...X.....X.x.... [  8%]
..X............X.....X..........XX...............�[2m�[36m(pid=9313)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=9313)�[0m fatal: bad object HEAD
...s.X.X......X........ [  9%]
X.....x........s.x.........X.........X.XX....XX........X............X... [ 10%]
XX...X.XXX..Xx..X..X.X....�[2m�[36m(pid=9551)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=9551)�[0m fatal: bad object HEAD
................X.........X.....X.....X....x.. [ 11%]
x...X.....X.........x................X.......Xx...XX.x......xxX...X.X..X [ 12%]
.xX..x..X.....XX...XX..X..XXX.....X....x....X.X.XxXXX..X.....X..XX...Xxx [ 13%]
....xssss...ss..Xs..X.X..XX......X.sx.sss..s..ssx.sssss.sss�[2m�[36m(pid=9471)�[0m RuntimeWarning: overflow encountered in reduce
..sssX...s.ss [ 14%]
s.sssss.sX.xssXssss.sssssXx...xX.xXXx.x....xs....X.x..........x..sss.xsx [ 14%]
sssx.s.x.X..x....Xss.x.ssss.sxss.sss.xs..ss.sssss..X..sssxxssss..ssss.ss [ 15%]
sxsxsss.sssss..ssxss.s.sssss.ss..xsxxssX.ssss.xsssssss.ssx.....XX...x... [ 16%]
.Xx.xxX.sss..sssss.sxsssss..sssssxs.....ss..sssssssXx.Xsxssssx...X..Xx.. [ 17%]
..X.....X.......X....X.....x........X.s.sx..sss.ss.X..s.x.......X.....Xx [ 18%]
..........s..x.s..sxxsssssssX...sss.ss..sss.sss.ssss.ssssXsss...x...ssss [ 19%]
s.ssss.sX.ss.ssssssxsssssss.sss.s.x..ssssss..sssssssssss.xsssssssssssX.s [ 20%]
.X.x.sssss.sX.ssssss.s.xX.ss..ss..X.X.ss..Xssssss.X.sss.sssssssss.s.s.ss.. [ 21%]
sXsssssssssssssssxsXssss...ss.X.....s....X....XxX.....xX....X............ [ 21%]
s...X...XX..........sX..XX..X........................x..X..X...sss..sss.. [ 22%]
s...sss.s.s..s.s..ss..ssx.......ssssXx..s......sssssss...ssssss...Xsss.. [ 23%]
....s.......x..Xssss...............s.................x.Xs............x.. [ 24%]
...sss..x......................xx.................X........x............ [ 25%]
.x...............X.....s.....x................x.......X.....x........xss [ 26%]
s.....s...............X........x..x............xx.....X.�[2m�[36m(pid=9313)�[0m RuntimeWarning: overflow encountered in reduce
......x....x.... [ 27%]
.......xsss......s..X....X...X.............xx.........X............X..x. [ 28%]
....x.....Xx....X..x.......x...........x.....x.........X............XXx. [ 28%]
......x..X.s..ss...s...X....s.xx.sss....X.....................x....X.x.. [ 29%]
.X...x.....x.....................X.....ss.ssX...x..xX........X.......... [ 30%]
......X........x.xX.x..s.ss.s......X.....X.....X..X.....X...xXX..X...... [ 31%]
.......x........X.......X.........X............X...........Xx.xs.....sss [ 32%]
.s..x................xX.x.....XX.........x..X........x...XX............. [ 33%]
..x.X.....X....X....x.....X.....X....X....X..ssss.sss.s..X.........xx... [ 34%]
........X....X..X.XX................x.........x......xx..X....X......... [ 35%]
..x.......X..x.....x....x...............sss..x......X...X...sss.X....... [ 35%]
.......x........x..................X...........x..X.........xx..X.....x. [ 36%]
...............x............X...x....x.......X....X......ssss...x....x.. [ 37%]
..........X.X.....................X...........Xsss.....................X. [ 38%]
............X...........X.....X.X.................X......X..........XX.. [ 39%]
...s.sssX......sss....................x..X..X.X.....X.X...x............. [ 40%]
........................x..X..................X........X.........xX..... [ 41%]
.........x............XXX.............x.Xx.......................x...... [ 42%]
............x.x..x....................x.X...X.........x........x...x.... [ 43%]
...x...................ssss..............x.................x.....X...... [ 43%]
x.........X..................x....x............................x.......x [ 44%]
......x..................x...X.............x..............x...x......... [ 45%]
x.......xss.ss.....X.......X.......x...........x..x................x.... [ 46%]
..X..........X...x....ssss.........X...x.........................x..X..X [ 47%]
.....x.......Xx..................X............X......X.....ss.....x..... [ 48%]
.........X.......XX......x..X.........x.......XxX..X.......X............ [ 49%]
X...ssss............x.ssss.................X.x......X.......ssssss...... [ 50%]
X......X...x.....X..................xx....X..........x.X..X.x........... [ 50%]
.........x...x...........X..X....x...................X............x.X... [ 51%]
........X....x...X.X...........x..sss..X......xX............x........x.. [ 52%]
..............X.X.x....sss.....X...........x.........x.....X.X....x.x... [ 53%]
........................................................................ [ 54%]
...........x.............................x......................x.s.ss.s [ 55%]
........................................................................ [ 56%]
........................................................................ [ 57%]
.......................................................X...X.......X.... [ 57%]
......X..............................X...x......x..XXssss............... [ 58%]
..Xsss.x.......x........................................................ [ 59%]
.......................x........x...................xss.ss.s.ss.ss.ssss. [ 60%]
xs.sssssssssss.ss.sssssssssssss.s.ssssssss.sssssssss.sssssssss.sss..s.ss [ 61%]
........................................................................ [ 62%]
..................s..................................................... [ 63%]
.........X.............................................................. [ 64%]
................................................x....................... [ 64%]
..................................x..x.................................. [ 65%]
......................s.............s.......................s......s�[2m�[36m(pid=10463)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=10463)�[0m fatal: bad object HEAD
.... [ 66%]
..............s....s......s.............ss.......sx................s...... [ 67%]
....x.........s......x....s........x..s...........s..................... [ 68%]
.......s......x................s...x..........x......s..........x....... [ 69%]
.............x...........s...................................s.......... [ 70%]
...................s...............s......s........X.....X....s......... [ 71%]
...........s...................................................X........ [ 71%]
X............X..........X...X..X..X.......XX..X.X........X.X............ [ 72%]
.......X...X.x...X....X....X..............XX..................X......... [ 73%]
....XX.................X..........X..X..............X.X.......XX...X.... [ 74%]
.....x...............................X............x.....x.......X...x... [ 75%]
.....X..........XX.......X...X..x..X...X.....X.x.....x...X........Xx..X. [ 76%]
......................x.............x.................................x. [ 77%]
...........X............................................................ [ 78%]
X....................................X.................................. [ 78%]
........................................................................ [ 79%]
.......X....................X........................................... [ 80%]
.....X..................X...X........................................... [ 81%]
........................................................................ [ 82%]
........................................................................ [ 83%]
........................................................................ [ 84%]
........................................................................ [ 85%]
........................................................................ [ 85%]
......................................................................... [ 86%]
........................................................................ [ 87%]
......................................................................... [ 88%]
........................................................................ [ 89%]
........................................................................ [ 90%]
........................................................................ [ 91%]
........................................................................ [ 92%]
........................................................................ [ 92%]
........................................................................ [ 93%]
........................................................................ [ 94%]
....................................................................x... [ 95%]
x........x....x...xx......................x...xx....x.....x............. [ 96%]
.......xx............x....................x......................x...... [ 97%]
........................................................................ [ 98%]
........................................................................ [ 99%]
........................................................................ [ 99%]
...                                                                      [100%]

----------- coverage: platform linux, python 3.7.7-final-0 -----------
---------------------- coverage: failed workers ----------------------
The following workers failed to return coverage data, ensure that pytest-cov is installed on these workers.
gw16
gw33
Coverage XML written to file coverage.xml

= 6969 passed, 579 skipped, 268 xfailed, 407 xpassed, 14309 warnings in 210.52s (0:03:30) =

codecov · 2020-09-01T13:16:47Z

Codecov Report

Merging #1994 into master will increase coverage by 0.00%.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##           master    #1994   +/-   ##
=======================================
  Coverage   81.99%   81.99%           
=======================================
  Files          79       79           
  Lines        9575     9576    +1     
=======================================
+ Hits         7851     7852    +1     
  Misses       1724     1724

Impacted Files	Coverage Δ
modin/pandas/dataframe.py	`90.51% <100.00%> (+0.01%)`	⬆️
modin/backends/pandas/query_compiler.py	`96.67% <0.00%> (-0.11%)`	⬇️
modin/experimental/cloud/meta_magic.py	`85.18% <0.00%> (+1.85%)`	⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 03fe0d6...f52578c. Read the comment docs.

prutskov · 2020-09-02T10:04:15Z

@devin-petersohn Root cause is in computing hash of str objects in python. By default value of hash(str) will be different in different threads(this is security feature). So we get different hashes of the same rows from different partitions.

modin/pandas/test/utils.py

modin/pandas/dataframe.py

…licated` and `drop_duplicates` functions Signed-off-by: Alexey Prutskov <alexey.prutskov@intel.com>

anmyachev

LGTM!

…_duplicates` functions (modin-project#1994) Signed-off-by: Alexey Prutskov <alexey.prutskov@intel.com>

prutskov mentioned this pull request Sep 1, 2020

[BUG] drop_duplicates does not drop all duplicates #1959

Closed

prutskov linked an issue Sep 1, 2020 that may be closed by this pull request

Result of function duplicated is incorrect #1987

Closed

prutskov force-pushed the prutskov/drop-dupl branch from 377cee7 to 0e89ab8 Compare September 1, 2020 12:54

prutskov self-assigned this Sep 1, 2020

prutskov force-pushed the prutskov/drop-dupl branch from 0e89ab8 to 970466e Compare September 1, 2020 12:56

prutskov force-pushed the prutskov/drop-dupl branch from 970466e to 33ef9c3 Compare September 2, 2020 07:41

prutskov force-pushed the prutskov/drop-dupl branch 4 times, most recently from 1dc050c to c709843 Compare September 2, 2020 14:37

prutskov added this to the 0.8.2 milestone Sep 2, 2020

prutskov force-pushed the prutskov/drop-dupl branch from c709843 to 1538ee3 Compare September 3, 2020 09:46

prutskov requested a review from devin-petersohn September 3, 2020 09:48

prutskov added the Ready for review label Sep 3, 2020

prutskov modified the milestones: 0.8.2, 0.8.1 Sep 3, 2020

prutskov force-pushed the prutskov/drop-dupl branch 2 times, most recently from 7925982 to b93a78e Compare September 4, 2020 14:40

anmyachev requested changes Sep 7, 2020

View reviewed changes

modin/pandas/test/utils.py Outdated Show resolved Hide resolved

prutskov force-pushed the prutskov/drop-dupl branch from b93a78e to 09c368b Compare September 7, 2020 12:01

prutskov requested a review from anmyachev September 7, 2020 12:36

prutskov force-pushed the prutskov/drop-dupl branch from 09c368b to 81ab13f Compare September 7, 2020 12:44

anmyachev requested changes Sep 7, 2020

View reviewed changes

modin/pandas/dataframe.py Outdated Show resolved Hide resolved

prutskov force-pushed the prutskov/drop-dupl branch from 81ab13f to 80837ca Compare September 7, 2020 13:39

FIX-modin-project#1959 modin-project#1987: Fix incorrect work of `dup…

f52578c

…licated` and `drop_duplicates` functions Signed-off-by: Alexey Prutskov <alexey.prutskov@intel.com>

prutskov force-pushed the prutskov/drop-dupl branch from 80837ca to f52578c Compare September 7, 2020 13:41

prutskov requested a review from anmyachev September 7, 2020 13:42

anmyachev approved these changes Sep 7, 2020

View reviewed changes

anmyachev merged commit 8265b71 into modin-project:master Sep 7, 2020

aregm pushed a commit to aregm/modin that referenced this pull request Sep 16, 2020

FIX-modin-project#1959 modin-project#1987: Fix duplicated and `drop…

c49b9bc

…_duplicates` functions (modin-project#1994) Signed-off-by: Alexey Prutskov <alexey.prutskov@intel.com>

prutskov deleted the prutskov/drop-dupl branch April 8, 2021 06:32

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

FIX-#1959 #1987: Fix incorrect work of `duplicated` and `drop_duplicates` functions #1994

FIX-#1959 #1987: Fix incorrect work of `duplicated` and `drop_duplicates` functions #1994

prutskov commented Sep 1, 2020 •

edited

Loading

modin-bot commented Sep 1, 2020 •

edited

Loading

modin-bot commented Sep 1, 2020 •

edited

Loading

modin-bot commented Sep 1, 2020 •

edited

Loading

codecov bot commented Sep 1, 2020 •

edited

Loading

prutskov commented Sep 2, 2020

anmyachev left a comment

FIX-#1959 #1987: Fix incorrect work of duplicated and drop_duplicates functions #1994

FIX-#1959 #1987: Fix incorrect work of duplicated and drop_duplicates functions #1994

Conversation

prutskov commented Sep 1, 2020 • edited Loading

What do these changes do?

modin-bot commented Sep 1, 2020 • edited Loading

TeamCity Python test results bot

Tests PASSed

modin-bot commented Sep 1, 2020 • edited Loading

TeamCity Dask test results bot

Tests PASSed

modin-bot commented Sep 1, 2020 • edited Loading

TeamCity Ray test results bot

Tests PASSed

codecov bot commented Sep 1, 2020 • edited Loading

Codecov Report

prutskov commented Sep 2, 2020

anmyachev left a comment

Choose a reason for hiding this comment

FIX-#1959 #1987: Fix incorrect work of `duplicated` and `drop_duplicates` functions #1994

FIX-#1959 #1987: Fix incorrect work of `duplicated` and `drop_duplicates` functions #1994

prutskov commented Sep 1, 2020 •

edited

Loading

modin-bot commented Sep 1, 2020 •

edited

Loading

modin-bot commented Sep 1, 2020 •

edited

Loading

modin-bot commented Sep 1, 2020 •

edited

Loading

codecov bot commented Sep 1, 2020 •

edited

Loading