Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

REFACTOR-#2059: Consolidate environment variables #2189

Merged
merged 27 commits into from
Oct 13, 2020
Merged

REFACTOR-#2059: Consolidate environment variables #2189

merged 27 commits into from
Oct 13, 2020

Conversation

vnlitvinov
Copy link
Collaborator

What do these changes do?

Consolidate all environment variables used for Modin configuration in single file.
Also introduce the API to manage configuration, could be generalized later for non-envinronment-based options.

Also provide short help on existing options by running python -m modin.config.

Current help 
MODIN_BACKEND: Engine running on a single node of distribution
        Provide a string (valid examples are: Pandas, OmniSci, Pyarrow)
        Current value: Pandas
MODIN_CPUS: How may CPU cores to utilize across the whole distribution
        Provide an integer value
        Current value: 8
MODIN_LOG_RPYC: Whether to gather RPyC logs (applicable for remote context)
        Provide a boolean flag (any of 'true', 'yes' or '1' in case insensitive manner is considered positive)
        Current value: None
MODIN_TRACE_RPYC: Whether to trace RPyC calls (applicable for remote context)
        Provide a boolean flag (any of 'true', 'yes' or '1' in case insensitive manner is considered positive)
        Current value: None
MODIN_USE_CALCITE: Whether to use Calcite for OmniSci queries execution
        Provide a boolean flag (any of 'true', 'yes' or '1' in case insensitive manner is considered positive)
        Current value: None
MODIN_ENGINE: Distribution engine to run queries by
        Provide a string (valid examples are: Ray, Dask, Python)
        Current value: Ray
MODIN_DEBUG: Forces Modin engine to be "Python" unless specified by $MODIN_ENGINE
        Provide a boolean flag (any of 'true', 'yes' or '1' in case insensitive manner is considered positive)
        Current value: None
MODIN_EXPERIMENTAL: Turns on experimental features
        Provide a boolean flag (any of 'true', 'yes' or '1' in case insensitive manner is considered positive)
        Current value: None
MODIN_OUT_OF_CORE: Unknown
        Provide a boolean flag (any of 'true', 'yes' or '1' in case insensitive manner is considered positive)
        Current value: None
MODIN_RAY_CLUSTER: True if Modin is running on pre-initialized Ray cluster
        Provide a boolean flag (any of 'true', 'yes' or '1' in case insensitive manner is considered positive)
        Current value: None
MODIN_MEMORY: How much memory give to each Ray worker (in bytes)
        Provide an integer value
        Current value: None
MODIN_OMNISCI_FRAGMENT_SIZE: How big a fragment in OmniSci should be when creating a table (in rows)
        Provide an integer value
        Current value: None
MODIN_ON_RAY_PLASMA_DIR: Path to Plasma storage for Ray
        Provide a string
        Current value: None
MODIN_REDIS_ADDRESS: What Redis address to connect to when running in Ray cluster
        Provide a string
        Current value: None
MODIN_SOCKS_PROXY: SOCKS proxy address if it is needed for SSH to work
        Provide a string
        Current value: None
MODIN_TEST_DATASET_SIZE: Dataset size for running some tests
        Provide a string (valid examples are: small, normal, big)
        Current value: None

@vnlitvinov vnlitvinov added the Code Quality 💯 Improvements or issues to improve quality of codebase label Oct 1, 2020
@vnlitvinov vnlitvinov added this to the 0.8.2 milestone Oct 1, 2020
@modin-bot
Copy link

modin-bot commented Oct 1, 2020 •
edited
Loading

TeamCity Python test results bot

Tests PASSed

Tests Logs 
============================= test session starts ==============================
platform linux -- Python 3.8.6, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /modin, configfile: setup.cfg
plugins: benchmark-3.2.3, cov-2.10.1, forked-1.2.0, xdist-2.1.0
collected 122 items

modin/pandas/test/test_io.py .................sX..................s..... [ 35%]
................s............................s..s.X.....s............... [ 94%]
...ss..                                                                  [100%]

----------- coverage: platform linux, python 3.8.6-final-0 -----------
Coverage XML written to file coverage.xml


=========== 112 passed, 8 skipped, 2 xpassed, 135 warnings in 38.90s ===========
Closing remaining open files:test_write_modin.hdf...donetest_write_pandas.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.8.6, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /modin, configfile: setup.cfg
plugins: benchmark-3.2.3, cov-2.10.1, forked-1.2.0, xdist-2.1.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
gw0 [5476] / gw1 [5476] / gw2 [5476] / gw3 [5476] / gw4 [5476] / gw5 [5476] / gw6 [5476] / gw7 [5476] / gw8 [5476] / gw9 [5476] / gw10 [5476] / gw11 [5476] / gw12 [5476] / gw13 [5476] / gw14 [5476] / gw15 [5476] / gw16 [5476] / gw17 [5476] / gw18 [5476] / gw19 [5476] / gw20 [5476] / gw21 [5476] / gw22 [5476] / gw23 [5476] / gw24 [5476] / gw25 [5476] / gw26 [5476] / gw27 [5476] / gw28 [5476] / gw29 [5476] / gw30 [5476] / gw31 [5476] / gw32 [5476] / gw33 [5476] / gw34 [5476] / gw35 [5476] / gw36 [5476] / gw37 [5476] / gw38 [5476] / gw39 [5476] / gw40 [5476] / gw41 [5476] / gw42 [5476] / gw43 [5476] / gw44 [5476] / gw45 [5476] / gw46 [5476] / gw47 [5476]

........................................................................ [  1%]
............................................................................. [  2%]
........................................................................ [  3%]
........................................................................ [  5%]
......................................................................... [  6%]
......................................................................... [  7%]
......................................................................... [  9%]
........s................................................................ [ 10%]
...............X..............s............x.................................... [ 11%]
.................X.......................x.......X.X..X..X....X..x...XX... [ 13%]
.....X.....XX......XXx.XX......X..................X........XXX.X......... [ 14%]
...X.X..............XX...X....X.X.X..X.......X....x...xX.XX..XX.....XX.. [ 15%]
X...X.X.X..X.............XX.....XXX..X.......X.......X.............x.... [ 17%]
.......X...x..x................X........XX..X...................x....x.. [ 18%]
.X..Xx....X......X...........x.......x.....XX..X...Xx.......x..x.....XX. [ 20%]
..............X......x...XX.X....x...XX...........s..........XXXX....XX. [ 21%]
XXX...X..........x.XXXX.....X......x.xx.....XXx.................xx...... [ 22%]
..........x......xXX...................................XXXXX.........X.. [ 24%]
............Xx..X....x.............XX....X..x..x.......................x [ 25%]
x.....x..........XX..........Xx.........................X...........x... [ 26%]
.........x.......x..........................x..............x.Xx..x...... [ 27%]
.........................x.x..x.............X..........xx.........x..... [ 29%]
.................X..................X...................x..............x [ 30%]
x......................X...................X........X................... [ 31%]
X.........X........x.....x...................X......X............x...... [ 33%]
.....X.....................X...........X.....X..........X............... [ 34%]
.....X..............s..............X.x....X..X......................X... [ 35%]
.................................X............X..x...................... [ 37%]
.......X................x..............X............X......x.x.......... [ 38%]
...........x..........................X...........................X..... [ 39%]
..................xx...............X...................x................ [ 41%]
x...........................xx.......xx...............x.....x.x......... [ 42%]
.......x......................................x.......x......x.......... [ 43%]
....x...........................x....x..............x...x............... [ 45%]
....X...........s....................................................... [ 46%]
............X...............x.xx................................xx..X... [ 47%]
.......................ssssssssssss.............s....................... [ 49%]
....x.....X..................x....X....x.sssssssssss.................... [ 50%]
...........s..................X........XX........sssssssssss..s......... [ 51%]
................X...x.............................................X..... [ 52%]
...........................................x............................ [ 54%]
.............x..................................................X....... [ 55%]
...........................x.................x.............X............ [ 56%]
.....................................x................................... [ 58%]
..............x......................s..............X..........x........ [ 59%]
.....X.............X.........X...X...........x...........ss............. [ 60%]
....x.X.....................X...........x.....X.............X........... [ 62%]
x.........................xx...........................xx............... [ 63%]
...x....................X..............X.....X................X......... [ 64%]
.......X.....................X.......................................... [ 66%]
........................................................................ [ 67%]
........................................................................ [ 68%]
........................................................................ [ 70%]
.....................................X.........X....................X... [ 71%]
........................................................................ [ 72%]
........................................................................ [ 74%]
........................................................................ [ 75%]
........................s.........s..........s..........s....s.......... [ 76%]
.....s..s...s.x..s.....s..........s......s...........s...s..s.........xx [ 77%]
s...................x.s.x.......s.....................s................. [ 79%]
.....x.s.....X....x......................X........x..............X....x. [ 80%]
X.Xx..X...s.....x...XX...XX.....X.s..X..X.XX..Xs.....s....x..Xx.......X. [ 81%]
...X...........X.X...x.x......X.X...X......X...X....X.x...XX..X.X.....X. [ 83%]
.......XX.X.......X..X........................x..X..X................X... [ 84%]
................x.........................X...........X................. [ 85%]
....................................x................X.................. [ 87%]
....x......x..........................................X................. [ 88%]
......x..........x......xx...x.X...X..........x....x......x............x [ 89%]
..x..x..............X..........X..x........x........X...X...X.........X. [ 91%]
..............X....................X.................................... [ 92%]
.......................................................x...xx..x..x..... [ 93%]
..x................................xx......x........x..x................ [ 95%]
.......x.x.................x..........................x................. [ 96%]
........................................................................ [ 97%]
........................................................................ [ 99%]
..................................x...................                   [100%]error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
fatal: bad object HEAD


----------- coverage: platform linux, python 3.8.6-final-0 -----------
Coverage XML written to file coverage.xml

= 5031 passed, 69 skipped, 156 xfailed, 220 xpassed, 12060 warnings in 59.81s ==
PytestBenchmarkWarning: Benchmarks are automatically disabled because xdist plugin is active.Benchmarks cannot be performed reliably in a parallelized environment.
============================= test session starts ==============================
platform linux -- Python 3.8.6, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /modin, configfile: setup.cfg
plugins: benchmark-3.2.3, cov-2.10.1, forked-1.2.0, xdist-2.1.0
collected 122 items

modin/pandas/test/test_io.py .................sX..................s..... [ 35%]
................s............................s..s.X.....s............... [ 94%]
...ss..                                                                  [100%]

----------- coverage: platform linux, python 3.8.6-final-0 -----------
Coverage XML written to file coverage.xml


=========== 112 passed, 8 skipped, 2 xpassed, 135 warnings in 38.90s ===========
Closing remaining open files:test_write_modin.hdf...donetest_write_pandas.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.8.6, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /modin, configfile: setup.cfg
plugins: benchmark-3.2.3, cov-2.10.1, forked-1.2.0, xdist-2.1.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
gw0 [5476] / gw1 [5476] / gw2 [5476] / gw3 [5476] / gw4 [5476] / gw5 [5476] / gw6 [5476] / gw7 [5476] / gw8 [5476] / gw9 [5476] / gw10 [5476] / gw11 [5476] / gw12 [5476] / gw13 [5476] / gw14 [5476] / gw15 [5476] / gw16 [5476] / gw17 [5476] / gw18 [5476] / gw19 [5476] / gw20 [5476] / gw21 [5476] / gw22 [5476] / gw23 [5476] / gw24 [5476] / gw25 [5476] / gw26 [5476] / gw27 [5476] / gw28 [5476] / gw29 [5476] / gw30 [5476] / gw31 [5476] / gw32 [5476] / gw33 [5476] / gw34 [5476] / gw35 [5476] / gw36 [5476] / gw37 [5476] / gw38 [5476] / gw39 [5476] / gw40 [5476] / gw41 [5476] / gw42 [5476] / gw43 [5476] / gw44 [5476] / gw45 [5476] / gw46 [5476] / gw47 [5476]

........................................................................ [  1%]
............................................................................. [  2%]
........................................................................ [  3%]
........................................................................ [  5%]
......................................................................... [  6%]
......................................................................... [  7%]
......................................................................... [  9%]
........s................................................................ [ 10%]
...............X..............s............x.................................... [ 11%]
.................X.......................x.......X.X..X..X....X..x...XX... [ 13%]
.....X.....XX......XXx.XX......X..................X........XXX.X......... [ 14%]
...X.X..............XX...X....X.X.X..X.......X....x...xX.XX..XX.....XX.. [ 15%]
X...X.X.X..X.............XX.....XXX..X.......X.......X.............x.... [ 17%]
.......X...x..x................X........XX..X...................x....x.. [ 18%]
.X..Xx....X......X...........x.......x.....XX..X...Xx.......x..x.....XX. [ 20%]
..............X......x...XX.X....x...XX...........s..........XXXX....XX. [ 21%]
XXX...X..........x.XXXX.....X......x.xx.....XXx.................xx...... [ 22%]
..........x......xXX...................................XXXXX.........X.. [ 24%]
............Xx..X....x.............XX....X..x..x.......................x [ 25%]
x.....x..........XX..........Xx.........................X...........x... [ 26%]
.........x.......x..........................x..............x.Xx..x...... [ 27%]
.........................x.x..x.............X..........xx.........x..... [ 29%]
.................X..................X...................x..............x [ 30%]
x......................X...................X........X................... [ 31%]
X.........X........x.....x...................X......X............x...... [ 33%]
.....X.....................X...........X.....X..........X............... [ 34%]
.....X..............s..............X.x....X..X......................X... [ 35%]
.................................X............X..x...................... [ 37%]
.......X................x..............X............X......x.x.......... [ 38%]
...........x..........................X...........................X..... [ 39%]
..................xx...............X...................x................ [ 41%]
x...........................xx.......xx...............x.....x.x......... [ 42%]
.......x......................................x.......x......x.......... [ 43%]
....x...........................x....x..............x...x............... [ 45%]
....X...........s....................................................... [ 46%]
............X...............x.xx................................xx..X... [ 47%]
.......................ssssssssssss.............s....................... [ 49%]
....x.....X..................x....X....x.sssssssssss.................... [ 50%]
...........s..................X........XX........sssssssssss..s......... [ 51%]
................X...x.............................................X..... [ 52%]
...........................................x............................ [ 54%]
.............x..................................................X....... [ 55%]
...........................x.................x.............X............ [ 56%]
.....................................x................................... [ 58%]
..............x......................s..............X..........x........ [ 59%]
.....X.............X.........X...X...........x...........ss............. [ 60%]
....x.X.....................X...........x.....X.............X........... [ 62%]
x.........................xx...........................xx............... [ 63%]
...x....................X..............X.....X................X......... [ 64%]
.......X.....................X.......................................... [ 66%]
........................................................................ [ 67%]
........................................................................ [ 68%]
........................................................................ [ 70%]
.....................................X.........X....................X... [ 71%]
........................................................................ [ 72%]
........................................................................ [ 74%]
........................................................................ [ 75%]
........................s.........s..........s..........s....s.......... [ 76%]
.....s..s...s.x..s.....s..........s......s...........s...s..s.........xx [ 77%]
s...................x.s.x.......s.....................s................. [ 79%]
.....x.s.....X....x......................X........x..............X....x. [ 80%]
X.Xx..X...s.....x...XX...XX.....X.s..X..X.XX..Xs.....s....x..Xx.......X. [ 81%]
...X...........X.X...x.x......X.X...X......X...X....X.x...XX..X.X.....X. [ 83%]
.......XX.X.......X..X........................x..X..X................X... [ 84%]
................x.........................X...........X................. [ 85%]
....................................x................X.................. [ 87%]
....x......x..........................................X................. [ 88%]
......x..........x......xx...x.X...X..........x....x......x............x [ 89%]
..x..x..............X..........X..x........x........X...X...X.........X. [ 91%]
..............X....................X.................................... [ 92%]
.......................................................x...xx..x..x..... [ 93%]
..x................................xx......x........x..x................ [ 95%]
.......x.x.................x..........................x................. [ 96%]
........................................................................ [ 97%]
........................................................................ [ 99%]
..................................x...................                   [100%]error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
fatal: bad object HEAD


----------- coverage: platform linux, python 3.8.6-final-0 -----------
Coverage XML written to file coverage.xml

= 5031 passed, 69 skipped, 156 xfailed, 220 xpassed, 12060 warnings in 59.81s ==
PytestBenchmarkWarning: Benchmarks are automatically disabled because xdist plugin is active.Benchmarks cannot be performed reliably in a parallelized environment.

@codecov
Copy link

codecov bot commented Oct 1, 2020 •
edited
Loading

Codecov Report

Merging #2189 into master will decrease coverage by 9.33%.
The diff coverage is 81.90%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #2189      +/-   ##
==========================================
- Coverage   82.63%   73.29%   -9.34%     
==========================================
  Files         116      114       -2     
  Lines       12532    12437      -95     
==========================================
- Hits        10356     9116    -1240     
- Misses       2176     3321    +1145
Impacted Files Coverage Δ
modin/config/__main__.py 0.00% <0.00%> (ø)
...tal/engines/omnisci_on_ray/frame/omnisci_worker.py 0.00% <0.00%> (-81.09%) ⬇️
.../engines/omnisci_on_ray/frame/partition_manager.py 0.00% <0.00%> (-75.00%) ⬇️
modin/experimental/cloud/base.py 45.94% <50.00%> (+1.50%) ⬆️
modin/config/envvars.py 83.33% <83.33%> (ø)
modin/data_management/factories/dispatcher.py 90.81% <85.71%> (-0.28%) ⬇️
modin/config/pubsub.py 89.70% <89.70%> (ø)
modin/config/__init__.py 100.00% <100.00%> (ø)
modin/data_management/factories/factories.py 94.54% <100.00%> (+12.12%) ⬆️
modin/engines/base/io/file_reader.py 92.39% <100.00%> (ø)
... and 44 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update bd8f73a...7c0dc90. Read the comment docs.

@modin-bot
Copy link

modin-bot commented Oct 1, 2020 •
edited
Loading

TeamCity Dask test results bot

Tests PASSed

Tests Logs 
============================= test session starts ==============================
platform linux -- Python 3.8.6, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /modin, configfile: setup.cfg
plugins: benchmark-3.2.3, cov-2.10.1, forked-1.2.0, xdist-2.1.0
collected 122 items

modin/pandas/test/test_io.py .................sx..................s..... [ 35%]
.............................................s..s.X.....s............... [ 94%]
...ss..                                                                  [100%]

----------- coverage: platform linux, python 3.8.6-final-0 -----------
Coverage XML written to file coverage.xml


= 113 passed, 7 skipped, 1 xfailed, 1 xpassed, 104 warnings in 92.15s (0:01:32) =
Closing remaining open files:test_write_modin.hdf...donetest_write_pandas.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.8.6, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /modin, configfile: setup.cfg
plugins: benchmark-3.2.3, cov-2.10.1, forked-1.2.0, xdist-2.1.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
gw0 [5476] / gw1 [5476] / gw2 [5476] / gw3 [5476] / gw4 [5476] / gw5 [5476] / gw6 [5476] / gw7 [5476] / gw8 [5476] / gw9 [5476] / gw10 [5476] / gw11 [5476] / gw12 [5476] / gw13 [5476] / gw14 [5476] / gw15 [5476] / gw16 [5476] / gw17 [5476] / gw18 [5476] / gw19 [5476] / gw20 [5476] / gw21 [5476] / gw22 [5476] / gw23 [5476] / gw24 [5476] / gw25 [5476] / gw26 [5476] / gw27 [5476] / gw28 [5476] / gw29 [5476] / gw30 [5476] / gw31 [5476] / gw32 [5476] / gw33 [5476] / gw34 [5476] / gw35 [5476] / gw36 [5476] / gw37 [5476] / gw38 [5476] / gw39 [5476] / gw40 [5476] / gw41 [5476] / gw42 [5476] / gw43 [5476] / gw44 [5476] / gw45 [5476] / gw46 [5476] / gw47 [5476]

......................................................................... [  1%]
........................................................................ [  2%]
........................................................................ [  3%]
........................................................................ [  5%]
........................................................................ [  6%]
........................................................................ [  7%]
.....................................x.s.........................X....... [  9%]
....................................................X.................... [ 10%]
...................X................X..............X.XXx.X.............. [ 11%]
..X.s........X...X.....X......................x...X..........X.......... [ 13%]
.....X..XX.X.............X.........................x......X...X....X...x [ 14%]
X..........................X....xx................X....X........X....x.X [ 15%]
.........xx...X........X......X.X...x....X.....X......X...X..x.......X.. [ 17%]
......x..........X....................xx.................x.........XX... [ 18%]
.x..X....X..X..........X...X.X..X..X....X.X.................X.x....x.... [ 19%]
.X...x.....................x......x..x..............x................... [ 21%]
...x.........x.X....X..........X..x......x....X..x.X...x.....X........... [ 22%]
.X.......X...x.....X.......X.....XX....X.X..X.......x.X.......x.X.....Xx [ 23%]
.X...............................x......x.....X......................... [ 25%]
................X......X..........x.................X..X................ [ 26%]
.............x........x.x.............X..........X.X........X........... [ 27%]
..X.......................X....X......................................... [ 28%]
..................X.....x............................................X.... [ 30%]
.....................x.................................................. [ 31%]
..X.x................................................................... [ 32%]
.......X....s..X.X..x......................................X............ [ 34%]
........X.......X..............Xx....................................... [ 35%]
.X....................x.x.......................X........X....X.....X... [ 36%]
...........X.......x......x.......X........XX.........x..............x.. [ 38%]
X............x...................x....x........x............X....x..X... [ 39%]
..X.............X............Xx....x.x..X................................ [ 40%]
.....x.....................................x.....X...................... [ 42%]
....x.s...ssssX....ssssss.X..s.ssss..ss.ss.s.s.X..X....X........X.....X. [ 43%]
....X..........X...X..Xss.s.s.X.X.x.X.....X...............x............. [ 44%]
.......x.X.....x.............X..........xX......................x......x [ 46%]
....................x..................X.............X....X........X.... [ 47%]
....X.......X...............................x...................x....... [ 48%]
...........x.........................x....................s......x...... [ 50%]
.......x.........................x.x.................................... [ 51%]
...........................x.......X..........x...........x............. [ 52%]
x...................x......x......X...X.X..X...........s..s.sss.sss.s.s. [ 54%]
........................................................................ [ 55%]
.......xx.............................................x................. [ 56%]
........................................................................ [ 57%]
...............X........................X................................ [ 59%]
........................................................................ [ 60%]
..................................x...............X.x................... [ 61%]
.X......X...................................x........x.................. [ 63%]
...............X........................................x..............x [ 64%]
......X...................X...............................x.....XX.x.... [ 65%]
....x........x........x.....x...X.X.X..X....X..XX......x...............s [ 67%]
.x...........X.......................................................... [ 68%]
......x................................................................. [ 69%]
..x...........X.....x................................................... [ 71%]
..........s..s.......................................................... [ 72%]
........................................................................ [ 73%]
......................................................................... [ 75%]
........................................s............s.................. [ 76%]
.....s...s..s.......s.x..x............xx.........x.s..s.s...s........... [ 77%]
...s........s...........s..x....s..s................s...sxx...x..s...... [ 79%]
...s..s.........X.x..X..s.....X....X.....X.....X..s....s.......X....XXx.. [ 80%]
..X...X..s.X.XX.....XXX....X..X..XXX......X.....X.X..XX.XX......X...XX.. [ 81%]
.X.....X.....X...X....X..x........X.....X.X..X....XxX..X........X.....X. [ 83%]
X...X..X............X................................................... [ 84%]
....x........................x.......................................... [ 85%]
..........................X.....................................X....... [ 86%]
..............................x.x.........X..............s...xXX....x... [ 88%]
.x..................x..x..............x..x.........xx.x................. [ 89%]
.....................xx...........x.x......s.......................x.x... [ 90%]
..............................................X....................X.... [ 92%]
.....................................................................x.x [ 93%]
..........xxx.x..xx...x...........x.x...x.x....X........................ [ 94%]
...............x.x..............x....................................... [ 96%]
........................................................................ [ 97%]
.......................................X..X.x..x..X..X.x................ [ 98%]
................................................................         [100%]error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
fatal: bad object HEAD


----------- coverage: platform linux, python 3.8.6-final-0 -----------
Coverage XML written to file coverage.xml

= 5031 passed, 69 skipped, 156 xfailed, 220 xpassed, 11289 warnings in 200.73s (0:03:20) =
PytestBenchmarkWarning: Benchmarks are automatically disabled because xdist plugin is active.Benchmarks cannot be performed reliably in a parallelized environment.
============================= test session starts ==============================
platform linux -- Python 3.8.6, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /modin, configfile: setup.cfg
plugins: benchmark-3.2.3, cov-2.10.1, forked-1.2.0, xdist-2.1.0
collected 122 items

modin/pandas/test/test_io.py .................sx..................s..... [ 35%]
.............................................s..s.X.....s............... [ 94%]
...ss..                                                                  [100%]

----------- coverage: platform linux, python 3.8.6-final-0 -----------
Coverage XML written to file coverage.xml


= 113 passed, 7 skipped, 1 xfailed, 1 xpassed, 104 warnings in 92.15s (0:01:32) =
Closing remaining open files:test_write_modin.hdf...donetest_write_pandas.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.8.6, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /modin, configfile: setup.cfg
plugins: benchmark-3.2.3, cov-2.10.1, forked-1.2.0, xdist-2.1.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
gw0 [5476] / gw1 [5476] / gw2 [5476] / gw3 [5476] / gw4 [5476] / gw5 [5476] / gw6 [5476] / gw7 [5476] / gw8 [5476] / gw9 [5476] / gw10 [5476] / gw11 [5476] / gw12 [5476] / gw13 [5476] / gw14 [5476] / gw15 [5476] / gw16 [5476] / gw17 [5476] / gw18 [5476] / gw19 [5476] / gw20 [5476] / gw21 [5476] / gw22 [5476] / gw23 [5476] / gw24 [5476] / gw25 [5476] / gw26 [5476] / gw27 [5476] / gw28 [5476] / gw29 [5476] / gw30 [5476] / gw31 [5476] / gw32 [5476] / gw33 [5476] / gw34 [5476] / gw35 [5476] / gw36 [5476] / gw37 [5476] / gw38 [5476] / gw39 [5476] / gw40 [5476] / gw41 [5476] / gw42 [5476] / gw43 [5476] / gw44 [5476] / gw45 [5476] / gw46 [5476] / gw47 [5476]

......................................................................... [  1%]
........................................................................ [  2%]
........................................................................ [  3%]
........................................................................ [  5%]
........................................................................ [  6%]
........................................................................ [  7%]
.....................................x.s.........................X....... [  9%]
....................................................X.................... [ 10%]
...................X................X..............X.XXx.X.............. [ 11%]
..X.s........X...X.....X......................x...X..........X.......... [ 13%]
.....X..XX.X.............X.........................x......X...X....X...x [ 14%]
X..........................X....xx................X....X........X....x.X [ 15%]
.........xx...X........X......X.X...x....X.....X......X...X..x.......X.. [ 17%]
......x..........X....................xx.................x.........XX... [ 18%]
.x..X....X..X..........X...X.X..X..X....X.X.................X.x....x.... [ 19%]
.X...x.....................x......x..x..............x................... [ 21%]
...x.........x.X....X..........X..x......x....X..x.X...x.....X........... [ 22%]
.X.......X...x.....X.......X.....XX....X.X..X.......x.X.......x.X.....Xx [ 23%]
.X...............................x......x.....X......................... [ 25%]
................X......X..........x.................X..X................ [ 26%]
.............x........x.x.............X..........X.X........X........... [ 27%]
..X.......................X....X......................................... [ 28%]
..................X.....x............................................X.... [ 30%]
.....................x.................................................. [ 31%]
..X.x................................................................... [ 32%]
.......X....s..X.X..x......................................X............ [ 34%]
........X.......X..............Xx....................................... [ 35%]
.X....................x.x.......................X........X....X.....X... [ 36%]
...........X.......x......x.......X........XX.........x..............x.. [ 38%]
X............x...................x....x........x............X....x..X... [ 39%]
..X.............X............Xx....x.x..X................................ [ 40%]
.....x.....................................x.....X...................... [ 42%]
....x.s...ssssX....ssssss.X..s.ssss..ss.ss.s.s.X..X....X........X.....X. [ 43%]
....X..........X...X..Xss.s.s.X.X.x.X.....X...............x............. [ 44%]
.......x.X.....x.............X..........xX......................x......x [ 46%]
....................x..................X.............X....X........X.... [ 47%]
....X.......X...............................x...................x....... [ 48%]
...........x.........................x....................s......x...... [ 50%]
.......x.........................x.x.................................... [ 51%]
...........................x.......X..........x...........x............. [ 52%]
x...................x......x......X...X.X..X...........s..s.sss.sss.s.s. [ 54%]
........................................................................ [ 55%]
.......xx.............................................x................. [ 56%]
........................................................................ [ 57%]
...............X........................X................................ [ 59%]
........................................................................ [ 60%]
..................................x...............X.x................... [ 61%]
.X......X...................................x........x.................. [ 63%]
...............X........................................x..............x [ 64%]
......X...................X...............................x.....XX.x.... [ 65%]
....x........x........x.....x...X.X.X..X....X..XX......x...............s [ 67%]
.x...........X.......................................................... [ 68%]
......x................................................................. [ 69%]
..x...........X.....x................................................... [ 71%]
..........s..s.......................................................... [ 72%]
........................................................................ [ 73%]
......................................................................... [ 75%]
........................................s............s.................. [ 76%]
.....s...s..s.......s.x..x............xx.........x.s..s.s...s........... [ 77%]
...s........s...........s..x....s..s................s...sxx...x..s...... [ 79%]
...s..s.........X.x..X..s.....X....X.....X.....X..s....s.......X....XXx.. [ 80%]
..X...X..s.X.XX.....XXX....X..X..XXX......X.....X.X..XX.XX......X...XX.. [ 81%]
.X.....X.....X...X....X..x........X.....X.X..X....XxX..X........X.....X. [ 83%]
X...X..X............X................................................... [ 84%]
....x........................x.......................................... [ 85%]
..........................X.....................................X....... [ 86%]
..............................x.x.........X..............s...xXX....x... [ 88%]
.x..................x..x..............x..x.........xx.x................. [ 89%]
.....................xx...........x.x......s.......................x.x... [ 90%]
..............................................X....................X.... [ 92%]
.....................................................................x.x [ 93%]
..........xxx.x..xx...x...........x.x...x.x....X........................ [ 94%]
...............x.x..............x....................................... [ 96%]
........................................................................ [ 97%]
.......................................X..X.x..x..X..X.x................ [ 98%]
................................................................         [100%]error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
fatal: bad object HEAD


----------- coverage: platform linux, python 3.8.6-final-0 -----------
Coverage XML written to file coverage.xml

= 5031 passed, 69 skipped, 156 xfailed, 220 xpassed, 11289 warnings in 200.73s (0:03:20) =
PytestBenchmarkWarning: Benchmarks are automatically disabled because xdist plugin is active.Benchmarks cannot be performed reliably in a parallelized environment.

@modin-bot
Copy link

modin-bot commented Oct 1, 2020 •
edited
Loading

TeamCity Ray test results bot

Tests PASSed

Tests Logs 
============================= test session starts ==============================
platform linux -- Python 3.8.6, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /modin, configfile: setup.cfg
plugins: benchmark-3.2.3, cov-2.10.1, forked-1.2.0, xdist-2.1.0
collected 122 items

modin/pandas/test/test_io.py .................sx..................s..... [ 35%]
.............................................s..s.X.....s............... [ 94%]
...ss..                                                                  [100%]

----------- coverage: platform linux, python 3.8.6-final-0 -----------
Coverage XML written to file coverage.xml


= 113 passed, 7 skipped, 1 xfailed, 1 xpassed, 92 warnings in 60.99s (0:01:00) =
Closing remaining open files:test_write_modin.hdf...donetest_write_pandas.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.8.6, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /modin, configfile: setup.cfg
plugins: benchmark-3.2.3, cov-2.10.1, forked-1.2.0, xdist-2.1.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
[gw16] node down: Not properly terminated

replacing crashed worker gw16
gw0 [5476] / gw1 [5476] / gw2 [5476] / gw3 [5476] / gw4 [5476] / gw5 [5476] / gw6 [5476] / gw7 [5476] / gw8 [5476] / gw9 [5476] / gw10 [5476] / gw11 [5476] / gw12 [5476] / gw13 [5476] / gw14 [5476] / gw15 [5476] / gw48 [5476] / gw17 [5476] / gw18 [5476] / gw19 [5476] / gw20 [5476] / gw21 [5476] / gw22 [5476] / gw23 [5476] / gw24 [5476] / gw25 [5476] / gw26 [5476] / gw27 [5476] / gw28 [5476] / gw29 [5476] / gw30 [5476] / gw31 [5476] / gw32 [5476] / gw33 [5476] / gw34 [5476] / gw35 [5476] / gw36 [5476] / gw37 [5476] / gw38 [5476] / gw39 [5476] / gw40 [5476] / gw41 [5476] / gw42 [5476] / gw43 [5476] / gw44 [5476] / gw45 [5476] / gw46 [5476] / gw47 [5476]

........................................................................ [  1%]
........................................................................ [  2%]
........................................................................ [  3%]
........................................................................ [  5%]
........................................................................ [  6%]
...............................x.................�[2m�[36m(pid=5846)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
.�[2m�[36m(pid=5846)�[0m fatal: bad object HEAD
...................... [  7%]
.......X..........X......X..............................x......X........ [  9%]
s....................................................................... [ 10%]
X...............X...............X....X..�[2m�[36m(pid=6341)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=6341)�[0m fatal: bad object HEAD
.....X.........X.........s.X.... [ 11%]
..X................X..........................x..X.X.X.X..X............. [ 13%]
.........X........X.X....X...................x..........x.............X. [ 14%]
X.....x....X.X..................X...............X........xx.....XX.X..X. [ 15%]
..X....x..XX...X.xX...X...x.x.X..xXx...xX....x.Xx.....X.xX.....x......... [ 17%]
...XX....X..X......XX..X..X....X..X......X........XX....XX.X...x.X......x [ 18%]
.....X..X.......x....Xx........x............................X........x.. [ 19%]
....x.X......X.........X............................................X... [ 21%]
...X...x..............X�[2m�[36m(pid=5326)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=5326)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=5326)�[0m 
�[2m�[36m(pid=5326)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=5326)�[0m 
�[2m�[36m(pid=5326)�[0m becomes:
�[2m�[36m(pid=5326)�[0m 
�[2m�[36m(pid=5326)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=5326)�[0m 
..............X..............X..XX....X......X... [ 22%]
..........s.X.................................x....X.................... [ 23%]
.............................................................x.......... [ 25%]
..............x..............X....................................x..X.. [ 26%]
......................X.....x......................X.........X.........x [ 27%]
..........................X................................X.....x...... [ 28%]
......X..............................X...........X..............X....... [ 30%]
................X.....x................X........X...............x....... [ 31%]
.....XX..................X.x...........x....................x....X...... [ 32%]
..X...�[2m�[36m(pid=6845)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=6845)�[0m fatal: bad object HEAD
.x...........X......................X.x....................x...... [ 34%]
...........X.....................X.............x..x...x............X.... [ 35%]
.....................x.....x.............X.............................. [ 36%]
....X......x.........x..x..........................X..........x......... [ 38%]
...........x...............X...............xs.................X.x....... [ 39%]
............X.......................x.....X.........X......x........X... [ 40%]
..................x........................x..................X......... [ 42%]
.............................x.X..........................X............. [ 43%]
...................x..........x....X..............X..................... [ 44%]
...x....X........xxx.........X...x.x...............x............x....... [ 46%]
........X...........X.................s.sssssssssss.s..........x....xx.X [ 47%]
.....X.ssss...................�[2m�[36m(pid=1436)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=1436)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m becomes:
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=1436)�[0m 
.............X..........�[2m�[36m(pid=5832)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=5832)�[0m The new arguments that you should use are 'offset' or 'origin'.
.�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m becomes:
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", offset="2s")X
�[2m�[36m(pid=5832)�[0m 
...x..........X. [ 48%]
.........sss.sssssssss..s..........x...........X........�[2m�[36m(pid=5832)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=5832)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m becomes:
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=5832)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m becomes:
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=5832)�[0m 
..........�[2m�[36m(pid=1436)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
.�[2m�[36m(pid=1436)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m becomes:
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=1436)�[0m �[2m�[36m(pid=5832)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=5832)�[0m The new arguments that you should use are 'offset' or 'origin'.
..
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m becomes:
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=5832)�[0m ..X [ 50%]
........X.........X....�[2m�[36m(pid=1436)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=1436)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m becomes:
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=1436)�[0m 
.............x...X�[2m�[36m(pid=1436)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=1436)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m becomes:
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=1436)�[0m 
..............x.....X.......... [ 51%]
.x.......X......x.............xX�[2m�[36m(pid=5832)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=5832)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", base=2)
.�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m becomes:
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=5832)�[0m 
..................x...................s [ 52%]
sssss..................................................................�[2m�[36m(pid=6621)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=6621)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=6621)�[0m 
�[2m�[36m(pid=6621)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=6621)�[0m 
�[2m�[36m(pid=6621)�[0m becomes:
�[2m�[36m(pid=6621)�[0m 
�[2m�[36m(pid=6621)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=6621)�[0m 
. [ 53%]
......................ss......�[2m�[36m(pid=6621)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=6621)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=6621)�[0m 
�[2m�[36m(pid=6621)�[0m >>> df.resample(freq="3s", base=2).
�[2m�[36m(pid=6621)�[0m 
�[2m�[36m(pid=6621)�[0m becomes:
�[2m�[36m(pid=6621)�[0m 
�[2m�[36m(pid=6621)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=6621)�[0m 
......................................... [ 55%]
......................................................................... [ 56%]
.............................x........X..........X.....�[2m�[36m(pid=5886)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=5886)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=5886)�[0m 
�[2m�[36m(pid=5886)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=5886)�[0m 
�[2m�[36m(pid=5886)�[0m becomes:
�[2m�[36m(pid=5886)�[0m 
�[2m�[36m(pid=5886)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=5886)�[0m 
..x.....x........ [ 57%]
........................................................................ [ 59%]
............................x...............x........................... [ 60%]
.X.........................................X............................. [ 61%]
....X................xX.......X............xX..XX.....x...s..x...Xx..... [ 63%]
....x..x.........x..XXX.X.....X...X....x..x..X...X...xx..X....x......... [ 64%]
x..........x.........xX.........x.....................x................. [ 65%]
..................................X..................................... [ 67%]
...................................................................x.... [ 68%]
...............x........................................................ [ 69%]
........................................................................ [ 71%]
........................................................................ [ 72%]
.x...................................................................... [ 73%]
..........s.........................s.................s.........s....... [ 75%]
.s......s............s..s..s.........x...s......s....x.......s.sx....... [ 76%]
......sx.x...x...s.......xs...s...x...........s..........s..s..x.....X.. [ 77%]
.X.............X..X..X.....X.....X.X.X.....X...xXX......XX.X....x...x..X [ 78%]
.X.......X..X..XX..X...X.X......X....X.X....X..xX..X.....X....x...X...XX [ 80%]
...X.......X...X.....X.X........x.......X....X.x.....X.X....X...x....... [ 81%]
s...X....X............sXx..................s............................ [ 82%]
........................................................s.............X. [ 84%]
..........x........................X...................................s. [ 85%]
..x..X.......x......................X..................x...............x [ 86%]
.............x.x..............xX.....X.......X................x.....x..x [ 88%]
..........Xxx........x...........x............................X....X.X.. [ 89%]
..X.X................................................................... [ 90%]
........................................................................ [ 92%]
...........................Xx.....s....x.X..x................x.......... [ 93%]
....................................�[2m�[36m(pid=5832)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.....x..........x.x...x...........x. [ 94%]
.�[2m�[36m(pid=1194)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=1194)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
...........x...........�[2m�[36m(pid=6741)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=6741)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
..�[2m�[36m(pid=5947)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=5947)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.x�[2m�[36m(pid=5829)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=5829)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.x�[2m�[36m(pid=6867)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
..�[2m�[36m(pid=7149)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
..x.�[2m�[36m(pid=6191)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.....�[2m�[36m(pid=6845)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.�[2m�[36m(pid=3828)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=3828)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.......x......�[2m�[36m(pid=5813)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
..�[2m�[36m(pid=6715)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.�[2m�[36m(pid=5727)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=5727)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
..�[2m�[36m(pid=5904)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
...�[2m�[36m(pid=5832)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.x.�[2m�[36m(pid=5351)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
..... [ 96%]
....�[2m�[36m(pid=6028)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
......�[2m�[36m(pid=6999)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
............�[2m�[36m(pid=6672)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
............�[2m�[36m(pid=5813)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
...�[2m�[36m(pid=5886)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=5886)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
...........�[2m�[36m(pid=6918)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
....�[2m�[36m(pid=7149)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=7149)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
....�[2m�[36m(pid=6741)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=6741)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.............�[2m�[36m(pid=6867)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
... [ 97%]
.....�[2m�[36m(pid=5832)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=5832)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.....................�[2m�[36m(pid=5798)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=5798)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.............................................. [ 98%]
.............................................X.X.x...x�[2m�[36m(pid=5935)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=5935)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=5935)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.................  [100%]error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
fatal: bad object HEAD
�[2m�[36m(pid=379)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=379)�[0m fatal: bad object HEAD


----------- coverage: platform linux, python 3.8.6-final-0 -----------
---------------------- coverage: failed workers ----------------------
The following workers failed to return coverage data, ensure that pytest-cov is installed on these workers.
gw16
Coverage XML written to file coverage.xml

= 5031 passed, 69 skipped, 156 xfailed, 220 xpassed, 11296 warnings in 118.80s (0:01:58) =
PytestBenchmarkWarning: Benchmarks are automatically disabled because xdist plugin is active.Benchmarks cannot be performed reliably in a parallelized environment.
============================= test session starts ==============================
platform linux -- Python 3.8.6, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /modin, configfile: setup.cfg
plugins: benchmark-3.2.3, cov-2.10.1, forked-1.2.0, xdist-2.1.0
collected 122 items

modin/pandas/test/test_io.py .................sx..................s..... [ 35%]
.............................................s..s.X.....s............... [ 94%]
...ss..                                                                  [100%]

----------- coverage: platform linux, python 3.8.6-final-0 -----------
Coverage XML written to file coverage.xml


= 113 passed, 7 skipped, 1 xfailed, 1 xpassed, 92 warnings in 60.99s (0:01:00) =
Closing remaining open files:test_write_modin.hdf...donetest_write_pandas.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.8.6, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /modin, configfile: setup.cfg
plugins: benchmark-3.2.3, cov-2.10.1, forked-1.2.0, xdist-2.1.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
[gw16] node down: Not properly terminated

replacing crashed worker gw16
gw0 [5476] / gw1 [5476] / gw2 [5476] / gw3 [5476] / gw4 [5476] / gw5 [5476] / gw6 [5476] / gw7 [5476] / gw8 [5476] / gw9 [5476] / gw10 [5476] / gw11 [5476] / gw12 [5476] / gw13 [5476] / gw14 [5476] / gw15 [5476] / gw48 [5476] / gw17 [5476] / gw18 [5476] / gw19 [5476] / gw20 [5476] / gw21 [5476] / gw22 [5476] / gw23 [5476] / gw24 [5476] / gw25 [5476] / gw26 [5476] / gw27 [5476] / gw28 [5476] / gw29 [5476] / gw30 [5476] / gw31 [5476] / gw32 [5476] / gw33 [5476] / gw34 [5476] / gw35 [5476] / gw36 [5476] / gw37 [5476] / gw38 [5476] / gw39 [5476] / gw40 [5476] / gw41 [5476] / gw42 [5476] / gw43 [5476] / gw44 [5476] / gw45 [5476] / gw46 [5476] / gw47 [5476]

........................................................................ [  1%]
........................................................................ [  2%]
........................................................................ [  3%]
........................................................................ [  5%]
........................................................................ [  6%]
...............................x.................�[2m�[36m(pid=5846)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
.�[2m�[36m(pid=5846)�[0m fatal: bad object HEAD
...................... [  7%]
.......X..........X......X..............................x......X........ [  9%]
s....................................................................... [ 10%]
X...............X...............X....X..�[2m�[36m(pid=6341)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=6341)�[0m fatal: bad object HEAD
.....X.........X.........s.X.... [ 11%]
..X................X..........................x..X.X.X.X..X............. [ 13%]
.........X........X.X....X...................x..........x.............X. [ 14%]
X.....x....X.X..................X...............X........xx.....XX.X..X. [ 15%]
..X....x..XX...X.xX...X...x.x.X..xXx...xX....x.Xx.....X.xX.....x......... [ 17%]
...XX....X..X......XX..X..X....X..X......X........XX....XX.X...x.X......x [ 18%]
.....X..X.......x....Xx........x............................X........x.. [ 19%]
....x.X......X.........X............................................X... [ 21%]
...X...x..............X�[2m�[36m(pid=5326)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=5326)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=5326)�[0m 
�[2m�[36m(pid=5326)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=5326)�[0m 
�[2m�[36m(pid=5326)�[0m becomes:
�[2m�[36m(pid=5326)�[0m 
�[2m�[36m(pid=5326)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=5326)�[0m 
..............X..............X..XX....X......X... [ 22%]
..........s.X.................................x....X.................... [ 23%]
.............................................................x.......... [ 25%]
..............x..............X....................................x..X.. [ 26%]
......................X.....x......................X.........X.........x [ 27%]
..........................X................................X.....x...... [ 28%]
......X..............................X...........X..............X....... [ 30%]
................X.....x................X........X...............x....... [ 31%]
.....XX..................X.x...........x....................x....X...... [ 32%]
..X...�[2m�[36m(pid=6845)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=6845)�[0m fatal: bad object HEAD
.x...........X......................X.x....................x...... [ 34%]
...........X.....................X.............x..x...x............X.... [ 35%]
.....................x.....x.............X.............................. [ 36%]
....X......x.........x..x..........................X..........x......... [ 38%]
...........x...............X...............xs.................X.x....... [ 39%]
............X.......................x.....X.........X......x........X... [ 40%]
..................x........................x..................X......... [ 42%]
.............................x.X..........................X............. [ 43%]
...................x..........x....X..............X..................... [ 44%]
...x....X........xxx.........X...x.x...............x............x....... [ 46%]
........X...........X.................s.sssssssssss.s..........x....xx.X [ 47%]
.....X.ssss...................�[2m�[36m(pid=1436)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=1436)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m becomes:
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=1436)�[0m 
.............X..........�[2m�[36m(pid=5832)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=5832)�[0m The new arguments that you should use are 'offset' or 'origin'.
.�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m becomes:
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", offset="2s")X
�[2m�[36m(pid=5832)�[0m 
...x..........X. [ 48%]
.........sss.sssssssss..s..........x...........X........�[2m�[36m(pid=5832)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=5832)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m becomes:
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=5832)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m becomes:
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=5832)�[0m 
..........�[2m�[36m(pid=1436)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
.�[2m�[36m(pid=1436)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m becomes:
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=1436)�[0m �[2m�[36m(pid=5832)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=5832)�[0m The new arguments that you should use are 'offset' or 'origin'.
..
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m becomes:
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=5832)�[0m ..X [ 50%]
........X.........X....�[2m�[36m(pid=1436)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=1436)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m becomes:
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=1436)�[0m 
.............x...X�[2m�[36m(pid=1436)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=1436)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m becomes:
�[2m�[36m(pid=1436)�[0m 
�[2m�[36m(pid=1436)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=1436)�[0m 
..............x.....X.......... [ 51%]
.x.......X......x.............xX�[2m�[36m(pid=5832)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=5832)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", base=2)
.�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m becomes:
�[2m�[36m(pid=5832)�[0m 
�[2m�[36m(pid=5832)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=5832)�[0m 
..................x...................s [ 52%]
sssss..................................................................�[2m�[36m(pid=6621)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=6621)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=6621)�[0m 
�[2m�[36m(pid=6621)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=6621)�[0m 
�[2m�[36m(pid=6621)�[0m becomes:
�[2m�[36m(pid=6621)�[0m 
�[2m�[36m(pid=6621)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=6621)�[0m 
. [ 53%]
......................ss......�[2m�[36m(pid=6621)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=6621)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=6621)�[0m 
�[2m�[36m(pid=6621)�[0m >>> df.resample(freq="3s", base=2).
�[2m�[36m(pid=6621)�[0m 
�[2m�[36m(pid=6621)�[0m becomes:
�[2m�[36m(pid=6621)�[0m 
�[2m�[36m(pid=6621)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=6621)�[0m 
......................................... [ 55%]
......................................................................... [ 56%]
.............................x........X..........X.....�[2m�[36m(pid=5886)�[0m FutureWarning: 'base' in .resample() and in Grouper() is deprecated.
�[2m�[36m(pid=5886)�[0m The new arguments that you should use are 'offset' or 'origin'.
�[2m�[36m(pid=5886)�[0m 
�[2m�[36m(pid=5886)�[0m >>> df.resample(freq="3s", base=2)
�[2m�[36m(pid=5886)�[0m 
�[2m�[36m(pid=5886)�[0m becomes:
�[2m�[36m(pid=5886)�[0m 
�[2m�[36m(pid=5886)�[0m >>> df.resample(freq="3s", offset="2s")
�[2m�[36m(pid=5886)�[0m 
..x.....x........ [ 57%]
........................................................................ [ 59%]
............................x...............x........................... [ 60%]
.X.........................................X............................. [ 61%]
....X................xX.......X............xX..XX.....x...s..x...Xx..... [ 63%]
....x..x.........x..XXX.X.....X...X....x..x..X...X...xx..X....x......... [ 64%]
x..........x.........xX.........x.....................x................. [ 65%]
..................................X..................................... [ 67%]
...................................................................x.... [ 68%]
...............x........................................................ [ 69%]
........................................................................ [ 71%]
........................................................................ [ 72%]
.x...................................................................... [ 73%]
..........s.........................s.................s.........s....... [ 75%]
.s......s............s..s..s.........x...s......s....x.......s.sx....... [ 76%]
......sx.x...x...s.......xs...s...x...........s..........s..s..x.....X.. [ 77%]
.X.............X..X..X.....X.....X.X.X.....X...xXX......XX.X....x...x..X [ 78%]
.X.......X..X..XX..X...X.X......X....X.X....X..xX..X.....X....x...X...XX [ 80%]
...X.......X...X.....X.X........x.......X....X.x.....X.X....X...x....... [ 81%]
s...X....X............sXx..................s............................ [ 82%]
........................................................s.............X. [ 84%]
..........x........................X...................................s. [ 85%]
..x..X.......x......................X..................x...............x [ 86%]
.............x.x..............xX.....X.......X................x.....x..x [ 88%]
..........Xxx........x...........x............................X....X.X.. [ 89%]
..X.X................................................................... [ 90%]
........................................................................ [ 92%]
...........................Xx.....s....x.X..x................x.......... [ 93%]
....................................�[2m�[36m(pid=5832)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.....x..........x.x...x...........x. [ 94%]
.�[2m�[36m(pid=1194)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=1194)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
...........x...........�[2m�[36m(pid=6741)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=6741)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
..�[2m�[36m(pid=5947)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=5947)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.x�[2m�[36m(pid=5829)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=5829)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.x�[2m�[36m(pid=6867)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
..�[2m�[36m(pid=7149)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
..x.�[2m�[36m(pid=6191)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.....�[2m�[36m(pid=6845)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.�[2m�[36m(pid=3828)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=3828)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.......x......�[2m�[36m(pid=5813)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
..�[2m�[36m(pid=6715)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.�[2m�[36m(pid=5727)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=5727)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
..�[2m�[36m(pid=5904)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
...�[2m�[36m(pid=5832)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.x.�[2m�[36m(pid=5351)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
..... [ 96%]
....�[2m�[36m(pid=6028)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
......�[2m�[36m(pid=6999)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
............�[2m�[36m(pid=6672)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
............�[2m�[36m(pid=5813)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
...�[2m�[36m(pid=5886)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=5886)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
...........�[2m�[36m(pid=6918)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
....�[2m�[36m(pid=7149)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=7149)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
....�[2m�[36m(pid=6741)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=6741)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.............�[2m�[36m(pid=6867)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
... [ 97%]
.....�[2m�[36m(pid=5832)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=5832)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.....................�[2m�[36m(pid=5798)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=5798)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.............................................. [ 98%]
.............................................X.X.x...x�[2m�[36m(pid=5935)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=5935)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
�[2m�[36m(pid=5935)�[0m FutureWarning: The `squeeze` parameter is deprecated and will be removed in a future version.
.................  [100%]error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
fatal: bad object HEAD
�[2m�[36m(pid=379)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=379)�[0m fatal: bad object HEAD


----------- coverage: platform linux, python 3.8.6-final-0 -----------
---------------------- coverage: failed workers ----------------------
The following workers failed to return coverage data, ensure that pytest-cov is installed on these workers.
gw16
Coverage XML written to file coverage.xml

= 5031 passed, 69 skipped, 156 xfailed, 220 xpassed, 11296 warnings in 118.80s (0:01:58) =
PytestBenchmarkWarning: Benchmarks are automatically disabled because xdist plugin is active.Benchmarks cannot be performed reliably in a parallelized environment.

@vnlitvinov vnlitvinov force-pushed the consolidate-env-vars branch 2 times, most recently from dcd8de7 to f884996 Compare October 2, 2020 07:35
anmyachev
anmyachev requested changes Oct 2, 2020
View reviewed changes
.github/workflows/ci.yml Outdated Show resolved Hide resolved
modin/config/envvars.py Show resolved Hide resolved
modin/config/envvars.py Show resolved Hide resolved
modin/config/envvars.py Show resolved Hide resolved
modin/config/envvars.py Show resolved Hide resolved
@anmyachev
Copy link
Collaborator

LGTM, let's wait @devin-petersohn.

anmyachev
anmyachev previously approved these changes Oct 2, 2020
View reviewed changes
@vnlitvinov
Copy link
Collaborator Author

Anything needed from me to get this merged?

@anmyachev
Copy link
Collaborator

Anything needed from me to get this merged?

I think nothing is needed.

@anmyachev
Copy link
Collaborator

@vnlitvinov please restart CI. Tests for Omnisci backend should be working now.

@anmyachev
Copy link
Collaborator

After this I will do merge.

@vnlitvinov
REFACTOR-modin-project#2059: Implement vars in single package
91fc628 
Other parts of Modin not adapted yet

Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Simplify passing varname
30b75ec 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Simplify getter for parameter
c238647 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Rename Publisher -> Parameter for clarity
0ae78da 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Improve single vs plural in warning
cd3610e 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Fix defaults for MODIN_ENGINE and MODIN_…
0247ad3 
…BACKEND

Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Make computed default be on demand
efb007e 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Adapt moved test
425ea3f 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Add tests for envvars
227bc26 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Reduce "import *" effect
f757eec 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Beautify help a bit
86127de 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Introduce abstract parameter concept
c530318 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Fix flake8 issues
195c0f3 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Migrate MODIN_EXPERIMENTAL
d13ffcd 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Migrate MODIN_RAY_CLUSTER and MODIN_REDI…
a09fca3 
…S_ADDRESS

Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Migrate MODIN_CPUS
c7481cf 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Migrate remaining Ray params
902502a 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Migrate SOCKS proxy and RPyC tracing and…
6707746 
… logging

Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Migrate remaining vars
3590b58 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Adapt CI to tests change
e85ab96 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Fix linting and API testing issues
04a42f7 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Fix test_dispatcher
b7d522e 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Mark test_from_sql_distributed as xfail,…
2650c7e 
… see modin-project#2194

Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Add missing docstrings
d941efa 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
REFACTOR-modin-project#2059: Skip coverage for modin/config/tests
433b797 
Signed-off-by: Vasilij Litvinov <[email protected]>
@vnlitvinov
Copy link
Collaborator Author

I've rebased off master to make sure I got all recent CI fixes

@vnlitvinov
Copy link
Collaborator Author

@anmyachev @devin-petersohn I believe the failure in running OmniSci tests isn't related to this PR (the tests actually pass, all the things crashed and burnt during the exit of the interpreter according to the logs).

I think we should merge this PR.

devin-petersohn
devin-petersohn approved these changes Oct 13, 2020
View reviewed changes
Copy link
Collaborator

@devin-petersohn devin-petersohn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, it's quite clean.

Can we create an issue to add this list to the documentation?

@vnlitvinov vnlitvinov mentioned this pull request Oct 13, 2020
Open
@devin-petersohn devin-petersohn merged commit cc57954 into modin-project:master Oct 13, 2020
@vnlitvinov vnlitvinov deleted the consolidate-env-vars branch October 13, 2020 19:57
@vnlitvinov vnlitvinov mentioned this pull request Nov 25, 2020
Closed
@dchigarev dchigarev mentioned this pull request Feb 2, 2021
Merged
6 tasks
@vnlitvinov vnlitvinov mentioned this pull request Apr 6, 2021
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@devin-petersohn devin-petersohn devin-petersohn approved these changes

@anmyachev anmyachev Awaiting requested review from anmyachev anmyachev is a code owner

Assignees
No one assigned
Labels
Code Quality 💯 Improvements or issues to improve quality of codebase Needs Review PR Needs Review Ready for review
Projects
None yet
Milestone
0.8.2
Development

Successfully merging this pull request may close these issues.

Group all controlling environment variables in single file
4 participants
@vnlitvinov @modin-bot @anmyachev @devin-petersohn