SuccessConsole Output

[EnvInject] - Mask passwords passed as build parameters.
GitHub pull request #93 of commit d659274c9ca20cc0f399e7f7e54ec7221971130d automatically merged.
[EnvInject] - Loading node environment variables.
Building remotely on amp-jenkins-staging-worker-02 (ubuntu staging-02 staging) in workspace /home/jenkins/workspace/Modin-Performance-Testing
[WS-CLEANUP] Deleting project workspace...
[WS-CLEANUP] Done
Cloning the remote Git repository
Cloning repository https://github.com/modin-project/modin
 > git init /home/jenkins/workspace/Modin-Performance-Testing # timeout=10
Fetching upstream changes from https://github.com/modin-project/modin
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/modin-project/modin +refs/heads/*:refs/remotes/origin/*
 > git config remote.origin.url https://github.com/modin-project/modin # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/modin-project/modin # timeout=10
Fetching upstream changes from https://github.com/modin-project/modin
 > git fetch --tags --progress https://github.com/modin-project/modin +refs/pull/*:refs/remotes/origin/pr/*
 > git rev-parse origin/pr/93/merge^{commit} # timeout=10
 > git branch -a -v --no-abbrev --contains 2f2df551aa48bdcae45f36b045aeeaf59bab9af2 # timeout=10
Checking out Revision 2f2df551aa48bdcae45f36b045aeeaf59bab9af2 (origin/pr/93/merge)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 2f2df551aa48bdcae45f36b045aeeaf59bab9af2
 > git rev-list 53bfe6f5ba1f886bd0f3649de60ed001510877a0 # timeout=10
First time build. Skipping changelog.
[Modin-Performance-Testing] $ /bin/sh -xe /tmp/hudson5284757211023629543.sh
+ bash .jenkins/performance-tests/run_perf_ci.sh
++ git rev-parse --verify --short HEAD
+ sha_tag=2f2df55
+ docker build -t modin-project/perf-test:2f2df55 -f .jenkins/performance-tests/Dockerfile .
Sending build context to Docker daemon   5.91MB

Step 1/7 : FROM python:3.6.6-stretch
 ---> 8256ec07b2ad
Step 2/7 : COPY requirements.txt requirements.txt
 ---> Using cache
 ---> 26ae0f28215f
Step 3/7 : RUN pip install -r requirements.txt
 ---> Using cache
 ---> bf4a32969d64
Step 4/7 : RUN pip install -q awscli pytest pytest-benchmark feather-format lxml openpyxl xlrd numpy matplotlib
 ---> Using cache
 ---> 1a50d665f5f1
Step 5/7 : COPY . .
 ---> 0849f1466511
Step 6/7 : RUN pip install -e .
 ---> Running in d48b9a1152c1
Obtaining file:///
Requirement already satisfied: pandas==0.23.4 in /usr/local/lib/python3.6/site-packages (from modin==0.2.2) (0.23.4)
Requirement already satisfied: ray==0.5.3 in /usr/local/lib/python3.6/site-packages (from modin==0.2.2) (0.5.3)
Requirement already satisfied: typing in /usr/local/lib/python3.6/site-packages (from modin==0.2.2) (3.6.6)
Requirement already satisfied: numpy>=1.9.0 in /usr/local/lib/python3.6/site-packages (from pandas==0.23.4->modin==0.2.2) (1.15.4)
Requirement already satisfied: pytz>=2011k in /usr/local/lib/python3.6/site-packages (from pandas==0.23.4->modin==0.2.2) (2018.7)
Requirement already satisfied: python-dateutil>=2.5.0 in /usr/local/lib/python3.6/site-packages (from pandas==0.23.4->modin==0.2.2) (2.7.5)
Requirement already satisfied: flatbuffers in /usr/local/lib/python3.6/site-packages (from ray==0.5.3->modin==0.2.2) (1.10)
Requirement already satisfied: funcsigs in /usr/local/lib/python3.6/site-packages (from ray==0.5.3->modin==0.2.2) (1.0.2)
Requirement already satisfied: click in /usr/local/lib/python3.6/site-packages (from ray==0.5.3->modin==0.2.2) (7.0)
Requirement already satisfied: colorama in /usr/local/lib/python3.6/site-packages (from ray==0.5.3->modin==0.2.2) (0.3.9)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.6/site-packages (from ray==0.5.3->modin==0.2.2) (3.13)
Requirement already satisfied: pytest in /usr/local/lib/python3.6/site-packages (from ray==0.5.3->modin==0.2.2) (3.10.0)
Requirement already satisfied: redis in /usr/local/lib/python3.6/site-packages (from ray==0.5.3->modin==0.2.2) (2.10.6)
Requirement already satisfied: six>=1.0.0 in /usr/local/lib/python3.6/site-packages (from ray==0.5.3->modin==0.2.2) (1.11.0)
Requirement already satisfied: atomicwrites>=1.0 in /usr/local/lib/python3.6/site-packages (from pytest->ray==0.5.3->modin==0.2.2) (1.2.1)
Requirement already satisfied: setuptools in /usr/local/lib/python3.6/site-packages (from pytest->ray==0.5.3->modin==0.2.2) (40.4.3)
Requirement already satisfied: py>=1.5.0 in /usr/local/lib/python3.6/site-packages (from pytest->ray==0.5.3->modin==0.2.2) (1.7.0)
Requirement already satisfied: attrs>=17.4.0 in /usr/local/lib/python3.6/site-packages (from pytest->ray==0.5.3->modin==0.2.2) (18.2.0)
Requirement already satisfied: more-itertools>=4.0.0 in /usr/local/lib/python3.6/site-packages (from pytest->ray==0.5.3->modin==0.2.2) (4.3.0)
Requirement already satisfied: pluggy>=0.7 in /usr/local/lib/python3.6/site-packages (from pytest->ray==0.5.3->modin==0.2.2) (0.8.0)
Installing collected packages: modin
  Running setup.py develop for modin
Successfully installed modin
Removing intermediate container d48b9a1152c1
 ---> f3546820b70b
Step 7/7 : ENTRYPOINT ["bash", ".jenkins/performance-tests/run_perf_test.sh"]
 ---> Running in 6e3062fa2fdc
Removing intermediate container 6e3062fa2fdc
 ---> b4b363e25c9f
Successfully built b4b363e25c9f
Successfully tagged modin-project/perf-test:2f2df55
+ docker run --rm --shm-size=1g -e AWS_ACCESS_KEY_ID=**** -e AWS_SECRET_ACCESS_KEY=**** modin-project/perf-test:2f2df55
+ source activate py3
.jenkins/performance-tests/run_perf_test.sh: line 3: activate: No such file or directory
+ python -c 'import ray; ray.init()'
Process STDOUT and STDERR is being redirected to /tmp/raylogs/.
Waiting for redis server at 127.0.0.1:33696 to respond...
Waiting for redis server at 127.0.0.1:20429 to respond...
Warning: Reducing object store memory because /dev/shm has only 1073741824 bytes available. You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you may need to pass an argument with the flag '--shm-size' to 'docker run'.
Starting the Plasma object store with 0.00 GB memory.
Starting local scheduler with the following resources: {'CPU': 48, 'GPU': 0}.
Failed to start the UI, you may need to run 'pip install jupyter'.
I1109 23:59:03.102313   166 local_scheduler.cc:178] Killed worker pid 167 which hadn't started yet.
I1109 23:59:03.104104   166 local_scheduler.cc:178] Killed worker pid 168 which hadn't started yet.
I1109 23:59:03.105598   166 local_scheduler.cc:178] Killed worker pid 169 which hadn't started yet.
I1109 23:59:03.106590   166 local_scheduler.cc:178] Killed worker pid 170 which hadn't started yet.
I1109 23:59:03.108001   166 local_scheduler.cc:178] Killed worker pid 171 which hadn't started yet.
I1109 23:59:03.109491   166 local_scheduler.cc:178] Killed worker pid 172 which hadn't started yet.
I1109 23:59:03.110393   166 local_scheduler.cc:178] Killed worker pid 173 which hadn't started yet.
I1109 23:59:03.111336   166 local_scheduler.cc:178] Killed worker pid 174 which hadn't started yet.
I1109 23:59:03.112606   166 local_scheduler.cc:178] Killed worker pid 175 which hadn't started yet.
I1109 23:59:03.113925   166 local_scheduler.cc:178] Killed worker pid 176 which hadn't started yet.
I1109 23:59:03.115324   166 local_scheduler.cc:178] Killed worker pid 177 which hadn't started yet.
I1109 23:59:03.116037   166 local_scheduler.cc:178] Killed worker pid 178 which hadn't started yet.
I1109 23:59:03.116680   166 local_scheduler.cc:178] Killed worker pid 179 which hadn't started yet.
I1109 23:59:03.117413   166 local_scheduler.cc:178] Killed worker pid 180 which hadn't started yet.
I1109 23:59:03.118847   166 local_scheduler.cc:178] Killed worker pid 181 which hadn't started yet.
I1109 23:59:03.119591   166 local_scheduler.cc:178] Killed worker pid 182 which hadn't started yet.
I1109 23:59:03.120587   166 local_scheduler.cc:178] Killed worker pid 183 which hadn't started yet.
I1109 23:59:03.121212   166 local_scheduler.cc:178] Killed worker pid 184 which hadn't started yet.
I1109 23:59:03.122237   166 local_scheduler.cc:178] Killed worker pid 185 which hadn't started yet.
I1109 23:59:03.123347   166 local_scheduler.cc:178] Killed worker pid 186 which hadn't started yet.
I1109 23:59:03.124632   166 local_scheduler.cc:178] Killed worker pid 187 which hadn't started yet.
I1109 23:59:03.125492   166 local_scheduler.cc:178] Killed worker pid 188 which hadn't started yet.
I1109 23:59:03.126487   166 local_scheduler.cc:178] Killed worker pid 189 which hadn't started yet.
I1109 23:59:03.127354   166 local_scheduler.cc:178] Killed worker pid 190 which hadn't started yet.
I1109 23:59:03.128432   166 local_scheduler.cc:178] Killed worker pid 191 which hadn't started yet.
I1109 23:59:03.129145   166 local_scheduler.cc:178] Killed worker pid 192 which hadn't started yet.
I1109 23:59:03.129971   166 local_scheduler.cc:178] Killed worker pid 193 which hadn't started yet.
I1109 23:59:03.130551   166 local_scheduler.cc:178] Killed worker pid 194 which hadn't started yet.
I1109 23:59:03.131310   166 local_scheduler.cc:178] Killed worker pid 195 which hadn't started yet.
I1109 23:59:03.132165   166 local_scheduler.cc:178] Killed worker pid 196 which hadn't started yet.
I1109 23:59:03.132958   166 local_scheduler.cc:178] Killed worker pid 197 which hadn't started yet.
I1109 23:59:03.133976   166 local_scheduler.cc:178] Killed worker pid 198 which hadn't started yet.
I1109 23:59:03.134716   166 local_scheduler.cc:178] Killed worker pid 199 which hadn't started yet.
I1109 23:59:03.135541   166 local_scheduler.cc:178] Killed worker pid 200 which hadn't started yet.
I1109 23:59:03.136195   166 local_scheduler.cc:178] Killed worker pid 201 which hadn't started yet.
I1109 23:59:03.136880   166 local_scheduler.cc:178] Killed worker pid 202 which hadn't started yet.
I1109 23:59:03.137446   166 local_scheduler.cc:178] Killed worker pid 203 which hadn't started yet.
I1109 23:59:03.138298   166 local_scheduler.cc:178] Killed worker pid 204 which hadn't started yet.
I1109 23:59:03.139029   166 local_scheduler.cc:178] Killed worker pid 205 which hadn't started yet.
I1109 23:59:03.139626   166 local_scheduler.cc:178] Killed worker pid 206 which hadn't started yet.
I1109 23:59:03.140308   166 local_scheduler.cc:178] Killed worker pid 207 which hadn't started yet.
I1109 23:59:03.140959   166 local_scheduler.cc:178] Killed worker pid 208 which hadn't started yet.
I1109 23:59:03.141567   166 local_scheduler.cc:178] Killed worker pid 209 which hadn't started yet.
I1109 23:59:03.142323   166 local_scheduler.cc:178] Killed worker pid 210 which hadn't started yet.
I1109 23:59:03.143007   166 local_scheduler.cc:178] Killed worker pid 211 which hadn't started yet.
I1109 23:59:03.143544   166 local_scheduler.cc:178] Killed worker pid 212 which hadn't started yet.
I1109 23:59:03.144078   166 local_scheduler.cc:178] Killed worker pid 213 which hadn't started yet.
I1109 23:59:03.144608   166 local_scheduler.cc:178] Killed worker pid 214 which hadn't started yet.
+ pytest --benchmark-autosave --disable-pytest-warnings modin/pandas/test/test_performance.py
============================= test session starts ==============================
platform linux -- Python 3.6.6, pytest-3.10.0, py-1.7.0, pluggy-0.8.0
benchmark: 3.1.1 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /, inifile:
plugins: benchmark-3.1.1
collected 6 items

modin/pandas/test/test_performance.py ......                             [100%]
Saved benchmark data in: //.benchmarks/Linux-CPython-3.6-64bit/0001_2f2df551aa48bdcae45f36b045aeeaf59bab9af2_20181109_235904.json




Computing stats ...
Computing stats ... group 1/1
Computing stats ... group 1/1: min
Computing stats ... group 1/1: min (1/6)
Computing stats ... group 1/1: min (2/6)
Computing stats ... group 1/1: min (3/6)
Computing stats ... group 1/1: min (4/6)
Computing stats ... group 1/1: min (5/6)
Computing stats ... group 1/1: min (6/6)
Computing stats ... group 1/1: min (1/6)
Computing stats ... group 1/1: min (2/6)
Computing stats ... group 1/1: min (3/6)
Computing stats ... group 1/1: min (4/6)
Computing stats ... group 1/1: min (5/6)
Computing stats ... group 1/1: min (6/6)
Computing stats ... group 1/1: max
Computing stats ... group 1/1: max (1/6)
Computing stats ... group 1/1: max (2/6)
Computing stats ... group 1/1: max (3/6)
Computing stats ... group 1/1: max (4/6)
Computing stats ... group 1/1: max (5/6)
Computing stats ... group 1/1: max (6/6)
Computing stats ... group 1/1: max (1/6)
Computing stats ... group 1/1: max (2/6)
Computing stats ... group 1/1: max (3/6)
Computing stats ... group 1/1: max (4/6)
Computing stats ... group 1/1: max (5/6)
Computing stats ... group 1/1: max (6/6)
Computing stats ... group 1/1: mean
Computing stats ... group 1/1: mean (1/6)
Computing stats ... group 1/1: mean (2/6)
Computing stats ... group 1/1: mean (3/6)
Computing stats ... group 1/1: mean (4/6)
Computing stats ... group 1/1: mean (5/6)
Computing stats ... group 1/1: mean (6/6)
Computing stats ... group 1/1: mean (1/6)
Computing stats ... group 1/1: mean (2/6)
Computing stats ... group 1/1: mean (3/6)
Computing stats ... group 1/1: mean (4/6)
Computing stats ... group 1/1: mean (5/6)
Computing stats ... group 1/1: mean (6/6)
Computing stats ... group 1/1: median
Computing stats ... group 1/1: median (1/6)
Computing stats ... group 1/1: median (2/6)
Computing stats ... group 1/1: median (3/6)
Computing stats ... group 1/1: median (4/6)
Computing stats ... group 1/1: median (5/6)
Computing stats ... group 1/1: median (6/6)
Computing stats ... group 1/1: median (1/6)
Computing stats ... group 1/1: median (2/6)
Computing stats ... group 1/1: median (3/6)
Computing stats ... group 1/1: median (4/6)
Computing stats ... group 1/1: median (5/6)
Computing stats ... group 1/1: median (6/6)
Computing stats ... group 1/1: iqr
Computing stats ... group 1/1: iqr (1/6)
Computing stats ... group 1/1: iqr (2/6)
Computing stats ... group 1/1: iqr (3/6)
Computing stats ... group 1/1: iqr (4/6)
Computing stats ... group 1/1: iqr (5/6)
Computing stats ... group 1/1: iqr (6/6)
Computing stats ... group 1/1: iqr (1/6)
Computing stats ... group 1/1: iqr (2/6)
Computing stats ... group 1/1: iqr (3/6)
Computing stats ... group 1/1: iqr (4/6)
Computing stats ... group 1/1: iqr (5/6)
Computing stats ... group 1/1: iqr (6/6)
Computing stats ... group 1/1: stddev
Computing stats ... group 1/1: stddev (1/6)
Computing stats ... group 1/1: stddev (2/6)
Computing stats ... group 1/1: stddev (3/6)
Computing stats ... group 1/1: stddev (4/6)
Computing stats ... group 1/1: stddev (5/6)
Computing stats ... group 1/1: stddev (6/6)
Computing stats ... group 1/1: stddev (1/6)
Computing stats ... group 1/1: stddev (2/6)
Computing stats ... group 1/1: stddev (3/6)
Computing stats ... group 1/1: stddev (4/6)
Computing stats ... group 1/1: stddev (5/6)
Computing stats ... group 1/1: stddev (6/6)
Computing stats ... group 1/1: ops
Computing stats ... group 1/1: ops (1/6)
Computing stats ... group 1/1: ops (2/6)
Computing stats ... group 1/1: ops (3/6)
Computing stats ... group 1/1: ops (4/6)
Computing stats ... group 1/1: ops (5/6)
Computing stats ... group 1/1: ops (6/6)
Computing stats ... group 1/1: ops (1/6)
Computing stats ... group 1/1: ops (2/6)
Computing stats ... group 1/1: ops (3/6)
Computing stats ... group 1/1: ops (4/6)
Computing stats ... group 1/1: ops (5/6)
Computing stats ... group 1/1: ops (6/6)
Computing stats ... group 1/1: ops: outliers
Computing stats ... group 1/1: ops: outliers (1/6)
Computing stats ... group 1/1: ops: outliers (2/6)
Computing stats ... group 1/1: ops: outliers (3/6)
Computing stats ... group 1/1: ops: outliers (4/6)
Computing stats ... group 1/1: ops: outliers (5/6)
Computing stats ... group 1/1: ops: outliers (6/6)
Computing stats ... group 1/1: ops: rounds
Computing stats ... group 1/1: ops: rounds (1/6)
Computing stats ... group 1/1: ops: rounds (2/6)
Computing stats ... group 1/1: ops: rounds (3/6)
Computing stats ... group 1/1: ops: rounds (4/6)
Computing stats ... group 1/1: ops: rounds (5/6)
Computing stats ... group 1/1: ops: rounds (6/6)
Computing stats ... group 1/1: ops: iterations
Computing stats ... group 1/1: ops: iterations (1/6)
Computing stats ... group 1/1: ops: iterations (2/6)
Computing stats ... group 1/1: ops: iterations (3/6)
Computing stats ... group 1/1: ops: iterations (4/6)
Computing stats ... group 1/1: ops: iterations (5/6)
Computing stats ... group 1/1: ops: iterations (6/6)
------------------------------------------------------------------------------------ benchmark: 6 tests ------------------------------------------------------------------------------------
Name (time in ms)          Min                 Max                Mean             StdDev              Median                IQR            Outliers       OPS            Rounds  Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fillna             1.9827 (1.0)       44.2417 (1.41)       4.1446 (1.0)       2.8278 (1.65)       3.7015 (1.0)       1.1233 (1.0)         16;23  241.2796 (1.0)         410           1
test_isna              24.5992 (12.41)     31.4143 (1.0)       26.1584 (6.31)      1.7154 (1.0)       25.2790 (6.83)      2.4374 (2.17)          8;1   38.2286 (0.16)         35           1
test_describe          41.9219 (21.14)     63.7035 (2.03)      49.5716 (11.96)     8.5792 (5.00)      48.4924 (13.10)    10.2386 (9.11)          1;0   20.1729 (0.08)          5           1
test_add               56.4243 (28.46)    104.0272 (3.31)      78.5207 (18.95)    15.3057 (8.92)      77.6200 (20.97)    20.7574 (18.48)         4;0   12.7355 (0.05)         12           1
test_sum              269.4207 (135.89)   376.5531 (11.99)    323.2547 (77.99)    38.4887 (22.44)    323.9415 (87.52)    41.2565 (36.73)         2;0    3.0935 (0.01)          5           1
test_add_df           367.8107 (185.51)   475.6276 (15.14)    411.0383 (99.18)    45.3701 (26.45)    392.3358 (105.99)   72.4524 (64.50)         1;0    2.4329 (0.01)          5           1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
==================== 6 passed, 1 warnings in 15.06 seconds =====================
++ git rev-parse --verify --short HEAD
+ sha_tag=2f2df55
+ aws s3 cp .benchmarks/Linux-CPython-3.6-64bit/0001_2f2df551aa48bdcae45f36b045aeeaf59bab9af2_20181109_235904.json s3://modin-jenkins-result/2f2df55-perf/ --acl public-read
Completed 8.3 KiB/8.3 KiB (22.1 KiB/s) with 1 file(s) remaining
upload: .benchmarks/Linux-CPython-3.6-64bit/0001_2f2df551aa48bdcae45f36b045aeeaf59bab9af2_20181109_235904.json to s3://modin-jenkins-result/2f2df55-perf/0001_2f2df551aa48bdcae45f36b045aeeaf59bab9af2_20181109_235904.json
+ rm -rf .benchmarks
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-Testing/52/
Test PASSed.
Finished: SUCCESS