SuccessConsole Output

Skipping 7,224 KB.. Full Log
a4d3122db9 
 [integration_py36_admin_unit_test] 20-04-03:10:21:57 INFO     [clipper_admin.py:539] [admin-test-cluster-4879] Successfully tagged admin-test-cluster-4879-buildmodeltest:py35 
 [integration_py36_admin_unit_test] 20-04-03:10:21:57 INFO     [clipper_admin.py:541] [admin-test-cluster-4879] Pushing model Docker image to admin-test-cluster-4879-buildmodeltest:py35 
 [integration_py36_multi_tenancy] 20-04-03:10:22:02 INFO     [clipper_admin.py:1424] [multi-tenancy-2-6178] Stopped all Clipper cluster and all model containers 
 [integration_py36_multi_tenancy] '{"query_id":0,"output":0.6000000000000001,"default":false}', 5.238000 ms 
 [integration_py36_multi_tenancy] '{"query_id":0,"output":0.6000000000000001,"default":false}', 4.905000 ms 
 [integration_py36_multi_tenancy] 20-04-03:03:22:03 INFO     [retry_with_timeout.py:90] Success! 
===== finished: integration_py36_multi_tenancy =====
 [integration_py36_tensorflow] 20-04-03:10:22:04 INFO     [docker_container_manager.py:433] [tf-4353] Found 0 replicas for tensorflow-model:2. Adding 1 
 [integration_py36_many_apps_many_models] 20-04-03:10:22:06 INFO     [clipper_admin.py:1424] [many-app-4000] Stopped all Clipper cluster and all model containers 
 [integration_py36_tensorflow] 20-04-03:10:22:06 INFO     [clipper_admin.py:724] [tf-4353] Successfully registered model tensorflow-model:2 
 [integration_py36_tensorflow] 20-04-03:10:22:06 INFO     [clipper_admin.py:642] [tf-4353] Done deploying model tensorflow-model:2. 
 [integration_py36_many_apps_many_models] 20-04-03:03:22:06 INFO     [retry_with_timeout.py:90] Success! 
===== finished: integration_py36_many_apps_many_models =====
 [integration_py36_pyspark_pipeline] 20-04-03:10:22:08 INFO     [test_utils.py:107] Creating DockerContainerManager 
 [integration_py36_pyspark_pipeline] 20-04-03:10:22:08 INFO     [test_utils.py:112] Cleaning up Docker cluster spark-pipe-4785 
 [integration_py36_admin_unit_test] 20-04-03:10:22:13 INFO     [clipper_admin.py:534] [admin-test-cluster-4879] Building model Docker image with model data from /tmp/clipper/tmpyelz4y_o 
 [integration_py36_admin_unit_test] 20-04-03:10:22:14 INFO     [clipper_admin.py:539] [admin-test-cluster-4879] Step 1/3 : FROM clipper/python36-closure-container:a66648a301 
 [integration_py36_admin_unit_test] 20-04-03:10:22:14 INFO     [clipper_admin.py:539] [admin-test-cluster-4879]  ---> e49ff9c3e757 
 [integration_py36_admin_unit_test] 20-04-03:10:22:14 INFO     [clipper_admin.py:539] [admin-test-cluster-4879] Step 2/3 : RUN apt-get -y install build-essential && pip install sympy==1.1.* 
 [integration_py36_admin_unit_test] 20-04-03:10:22:14 INFO     [clipper_admin.py:539] [admin-test-cluster-4879]  ---> Using cache 
 [integration_py36_admin_unit_test] 20-04-03:10:22:14 INFO     [clipper_admin.py:539] [admin-test-cluster-4879]  ---> ceca65a7fbba 
 [integration_py36_admin_unit_test] 20-04-03:10:22:14 INFO     [clipper_admin.py:539] [admin-test-cluster-4879] Step 3/3 : COPY /tmp/clipper/tmpyelz4y_o /model/ 
 [integration_py36_admin_unit_test] 20-04-03:10:22:14 INFO     [clipper_admin.py:539] [admin-test-cluster-4879]  ---> eb8982042e4e 
 [integration_py36_admin_unit_test] 20-04-03:10:22:14 INFO     [clipper_admin.py:539] [admin-test-cluster-4879] Successfully built eb8982042e4e 
 [integration_py36_admin_unit_test] 20-04-03:10:22:14 INFO     [clipper_admin.py:539] [admin-test-cluster-4879] Successfully tagged admin-test-cluster-4879-buildmodeltest:py36 
 [integration_py36_admin_unit_test] 20-04-03:10:22:14 INFO     [clipper_admin.py:541] [admin-test-cluster-4879] Pushing model Docker image to admin-test-cluster-4879-buildmodeltest:py36 
 [integration_py36_pyspark_pipeline] 20-04-03:10:22:14 INFO     [clipper_admin.py:1424] [spark-pipe-4785] Stopped all Clipper cluster and all model containers 
 [integration_py36_pyspark_pipeline] 20-04-03:10:22:14 INFO     [deploy_pyspark_pipeline_models.py:183] ALL TESTS PASSED 
 [integration_py36_pyspark_pipeline] (4, spark i j k) --> prob=[0.1596407738787475,0.8403592261212525], prediction=1.000000 
 [integration_py36_pyspark_pipeline] (5, l m n) --> prob=[0.8378325685476744,0.16216743145232562], prediction=0.000000 
 [integration_py36_pyspark_pipeline] (6, spark hadoop spark) --> prob=[0.06926633132976037,0.9307336686702395], prediction=1.000000 
 [integration_py36_pyspark_pipeline] (7, apache hadoop) --> prob=[0.9821575333444218,0.01784246665557808], prediction=0.000000 
 [integration_py36_pyspark_pipeline] ['{"prob": "[0.1596407738787475,0.8403592261212525]", "prediction": 1.0}'] 
 [integration_py36_pyspark_pipeline] 20-04-03:03:22:15 INFO     [retry_with_timeout.py:90] Success! 
===== finished: integration_py36_pyspark_pipeline =====
 [integration_py36_admin_unit_test] 20-04-03:10:22:25 INFO     [clipper_admin.py:534] [admin-test-cluster-4879] Building model Docker image with model data from /tmp/clipper/tmpyelz4y_o 
 [integration_py36_admin_unit_test] 20-04-03:10:22:25 INFO     [clipper_admin.py:539] [admin-test-cluster-4879] Step 1/3 : FROM clipper/python37-closure-container:a66648a301 
 [integration_py36_admin_unit_test] 20-04-03:10:22:25 INFO     [clipper_admin.py:539] [admin-test-cluster-4879]  ---> 2660542c0759 
 [integration_py36_admin_unit_test] 20-04-03:10:22:25 INFO     [clipper_admin.py:539] [admin-test-cluster-4879] Step 2/3 : RUN apt-get -y install build-essential && pip install sympy==1.1.* 
 [integration_py36_admin_unit_test] 20-04-03:10:22:25 INFO     [clipper_admin.py:539] [admin-test-cluster-4879]  ---> Using cache 
 [integration_py36_admin_unit_test] 20-04-03:10:22:25 INFO     [clipper_admin.py:539] [admin-test-cluster-4879]  ---> b409305036fc 
 [integration_py36_admin_unit_test] 20-04-03:10:22:25 INFO     [clipper_admin.py:539] [admin-test-cluster-4879] Step 3/3 : COPY /tmp/clipper/tmpyelz4y_o /model/ 
 [integration_py36_admin_unit_test] 20-04-03:10:22:25 INFO     [clipper_admin.py:539] [admin-test-cluster-4879]  ---> 783cbd032b25 
 [integration_py36_admin_unit_test] 20-04-03:10:22:25 INFO     [clipper_admin.py:539] [admin-test-cluster-4879] Successfully built 783cbd032b25 
 [integration_py36_admin_unit_test] 20-04-03:10:22:25 INFO     [clipper_admin.py:539] [admin-test-cluster-4879] Successfully tagged admin-test-cluster-4879-buildmodeltest:py37 
 [integration_py36_admin_unit_test] 20-04-03:10:22:25 INFO     [clipper_admin.py:541] [admin-test-cluster-4879] Pushing model Docker image to admin-test-cluster-4879-buildmodeltest:py37 
 [integration_py36_admin_unit_test] 20-04-03:10:22:30 INFO     [test_utils.py:107] Creating DockerContainerManager 
 [integration_py36_admin_unit_test] 20-04-03:10:22:30 INFO     [test_utils.py:112] Cleaning up Docker cluster admin-test-cluster-4879 
 [integration_py36_admin_unit_test] 20-04-03:10:22:35 INFO     [clipper_admin.py:1424] [admin-test-cluster-4879] Stopped all Clipper cluster and all model containers 
 [integration_py36_admin_unit_test] ok 
 [integration_py36_admin_unit_test] test_unregister_application_correct (__main__.ClipperManagerTestCaseShort) ... 20-04-03:10:22:35 INFO     [test_utils.py:107] Creating DockerContainerManager 
 [integration_py36_admin_unit_test] 20-04-03:10:22:35 INFO     [test_utils.py:128] Starting up Docker cluster admin-test-cluster-1873 
 [integration_py36_admin_unit_test] 20-04-03:10:22:35 INFO     [test_utils.py:143] Starting Clipper 
 [integration_py36_admin_unit_test] 20-04-03:10:22:35 INFO     [docker_container_manager.py:192] [admin-test-cluster-1873] Starting managed Redis instance in Docker 
 [integration_py36_tensorflow] INFO:tensorflow:No assets to save. 
 [integration_py36_tensorflow] 20-04-03:10:22:36 INFO     [builder_impl.py:629] No assets to save. 
 [integration_py36_tensorflow] INFO:tensorflow:No assets to write. 
 [integration_py36_tensorflow] 20-04-03:10:22:36 INFO     [builder_impl.py:449] No assets to write. 
 [integration_py36_tensorflow] INFO:tensorflow:SavedModel written to: data/export_dir/saved_model.pb 
 [integration_py36_tensorflow] 20-04-03:10:22:36 INFO     [builder_impl.py:414] SavedModel written to: data/export_dir/saved_model.pb 
 [integration_py36_tensorflow] 20-04-03:10:22:36 INFO     [deployer_utils.py:41] Saving function to /tmp/tmpb1jea8kvclipper 
 [integration_py36_tensorflow] 20-04-03:10:22:36 INFO     [deployer_utils.py:51] Serialized and supplied predict function 
 [integration_py36_tensorflow] 20-04-03:10:22:36 INFO     [tensorflow.py:264] TensorFlow model copied to: tfmodel 
 [integration_py36_tensorflow] 20-04-03:10:22:36 INFO     [tensorflow.py:277] Using Python 3.6 base image 
 [integration_py36_tensorflow] 20-04-03:10:22:36 INFO     [clipper_admin.py:534] [tf-4353] Building model Docker image with model data from /tmp/tmpb1jea8kvclipper 
 [integration_py36_tensorflow] 20-04-03:10:22:37 INFO     [clipper_admin.py:539] [tf-4353] Step 1/2 : FROM clipper/tf36-container:a66648a301 
 [integration_py36_tensorflow] 20-04-03:10:22:37 INFO     [clipper_admin.py:539] [tf-4353]  ---> ac3c38a48a9d 
 [integration_py36_tensorflow] 20-04-03:10:22:37 INFO     [clipper_admin.py:539] [tf-4353] Step 2/2 : COPY /tmp/tmpb1jea8kvclipper /model/ 
 [integration_py36_tensorflow] 20-04-03:10:22:37 INFO     [clipper_admin.py:539] [tf-4353]  ---> 86ab484cf07c 
 [integration_py36_tensorflow] 20-04-03:10:22:37 INFO     [clipper_admin.py:539] [tf-4353] Successfully built 86ab484cf07c 
 [integration_py36_tensorflow] 20-04-03:10:22:37 INFO     [clipper_admin.py:539] [tf-4353] Successfully tagged tf-4353-tensorflow-model:3 
 [integration_py36_tensorflow] 20-04-03:10:22:37 INFO     [clipper_admin.py:541] [tf-4353] Pushing model Docker image to tf-4353-tensorflow-model:3 
 [integration_py36_tensorflow] 20-04-03:10:22:39 INFO     [docker_container_manager.py:433] [tf-4353] Found 0 replicas for tensorflow-model:3. Adding 1 
 [integration_py36_tensorflow] 20-04-03:10:22:40 INFO     [clipper_admin.py:724] [tf-4353] Successfully registered model tensorflow-model:3 
 [integration_py36_tensorflow] 20-04-03:10:22:40 INFO     [clipper_admin.py:642] [tf-4353] Done deploying model tensorflow-model:3. 
 [integration_py36_admin_unit_test] 20-04-03:10:22:40 INFO     [docker_container_manager.py:294] [admin-test-cluster-1873] Metric Configuration Saved at /tmp/tmp6yzw5ehv.yml 
 [integration_py36_admin_unit_test] 20-04-03:10:22:42 INFO     [clipper_admin.py:162] [admin-test-cluster-1873] Clipper is running 
 [integration_py36_admin_unit_test] 20-04-03:10:22:43 INFO     [clipper_admin.py:236] [admin-test-cluster-1873] Application testapp was successfully registered 
 [integration_py36_admin_unit_test] 20-04-03:10:22:43 INFO     [clipper_admin.py:260] [admin-test-cluster-1873] Application testapp was successfully unregistered 
 [integration_py36_admin_unit_test] 20-04-03:10:22:43 INFO     [test_utils.py:107] Creating DockerContainerManager 
 [integration_py36_admin_unit_test] 20-04-03:10:22:43 INFO     [test_utils.py:112] Cleaning up Docker cluster admin-test-cluster-1873 
 [integration_py36_admin_unit_test] 20-04-03:10:22:47 INFO     [clipper_admin.py:1424] [admin-test-cluster-1873] Stopped all Clipper cluster and all model containers 
 [integration_py36_admin_unit_test] ok 
 [integration_py36_admin_unit_test] test_query_specific_model_version (__main__.ClipperManagerTestCaseShort) ... 20-04-03:10:22:47 INFO     [test_utils.py:107] Creating DockerContainerManager 
 [integration_py36_admin_unit_test] 20-04-03:10:22:47 INFO     [test_utils.py:128] Starting up Docker cluster admin-test-cluster-1761 
 [integration_py36_admin_unit_test] 20-04-03:10:22:47 INFO     [test_utils.py:143] Starting Clipper 
 [integration_py36_admin_unit_test] 20-04-03:10:22:47 INFO     [docker_container_manager.py:192] [admin-test-cluster-1761] Starting managed Redis instance in Docker 
 [integration_py36_admin_unit_test] 20-04-03:10:22:53 INFO     [docker_container_manager.py:294] [admin-test-cluster-1761] Metric Configuration Saved at /tmp/tmpaiicjvqm.yml 
 [integration_py36_admin_unit_test] 20-04-03:10:22:54 INFO     [clipper_admin.py:162] [admin-test-cluster-1761] Clipper is running 
 [integration_py36_admin_unit_test] 20-04-03:10:22:55 INFO     [clipper_admin.py:236] [admin-test-cluster-1761] Application testapp was successfully registered 
 [integration_py36_admin_unit_test] 20-04-03:10:22:55 INFO     [deployer_utils.py:41] Saving function to /tmp/tmpgd75ez0_clipper 
 [integration_py36_admin_unit_test] 20-04-03:10:22:55 INFO     [deployer_utils.py:51] Serialized and supplied predict function 
 [integration_py36_admin_unit_test] 20-04-03:10:22:55 INFO     [python.py:192] Python closure saved 
 [integration_py36_admin_unit_test] 20-04-03:10:22:55 INFO     [python.py:206] Using Python 3.6 base image 
 [integration_py36_admin_unit_test] 20-04-03:10:22:55 INFO     [clipper_admin.py:534] [admin-test-cluster-1761] Building model Docker image with model data from /tmp/tmpgd75ez0_clipper 
 [integration_py36_admin_unit_test] 20-04-03:10:22:56 INFO     [clipper_admin.py:539] [admin-test-cluster-1761] Step 1/2 : FROM clipper/python36-closure-container:a66648a301 
 [integration_py36_admin_unit_test] 20-04-03:10:22:56 INFO     [clipper_admin.py:539] [admin-test-cluster-1761]  ---> e49ff9c3e757 
 [integration_py36_admin_unit_test] 20-04-03:10:22:56 INFO     [clipper_admin.py:539] [admin-test-cluster-1761] Step 2/2 : COPY /tmp/tmpgd75ez0_clipper /model/ 
 [integration_py36_admin_unit_test] 20-04-03:10:22:56 INFO     [clipper_admin.py:539] [admin-test-cluster-1761]  ---> ba97e1716d9a 
 [integration_py36_admin_unit_test] 20-04-03:10:22:56 INFO     [clipper_admin.py:539] [admin-test-cluster-1761] Successfully built ba97e1716d9a 
 [integration_py36_admin_unit_test] 20-04-03:10:22:56 INFO     [clipper_admin.py:539] [admin-test-cluster-1761] Successfully tagged admin-test-cluster-1761-testmodel:v1 
 [integration_py36_admin_unit_test] 20-04-03:10:22:56 INFO     [clipper_admin.py:541] [admin-test-cluster-1761] Pushing model Docker image to admin-test-cluster-1761-testmodel:v1 
 [integration_py36_admin_unit_test] 20-04-03:10:22:57 INFO     [docker_container_manager.py:433] [admin-test-cluster-1761] Found 0 replicas for testmodel:v1. Adding 1 
 [integration_py36_admin_unit_test] 20-04-03:10:22:59 INFO     [clipper_admin.py:724] [admin-test-cluster-1761] Successfully registered model testmodel:v1 
 [integration_py36_admin_unit_test] 20-04-03:10:22:59 INFO     [clipper_admin.py:642] [admin-test-cluster-1761] Done deploying model testmodel:v1. 
 [integration_py36_admin_unit_test] 20-04-03:10:22:59 INFO     [clipper_admin.py:303] [admin-test-cluster-1761] Model testmodel is now linked to application testapp 
 [integration_py36_tensorflow] 20-04-03:10:23:10 INFO     [clipper_admin.py:236] [tf-4353] Application easy-register-app-model was successfully registered 
 [integration_py36_tensorflow] 20-04-03:10:23:10 INFO     [deployer_utils.py:41] Saving function to /tmp/tmprd3szeyqclipper 
 [integration_py36_tensorflow] 20-04-03:10:23:10 INFO     [deployer_utils.py:51] Serialized and supplied predict function 
 [integration_py36_tensorflow] 20-04-03:10:23:10 INFO     [tensorflow.py:264] TensorFlow model copied to: tfmodel 
 [integration_py36_tensorflow] 20-04-03:10:23:10 INFO     [tensorflow.py:277] Using Python 3.6 base image 
 [integration_py36_tensorflow] 20-04-03:10:23:10 INFO     [clipper_admin.py:534] [tf-4353] Building model Docker image with model data from /tmp/tmprd3szeyqclipper 
 [integration_py36_tensorflow] 20-04-03:10:23:11 INFO     [clipper_admin.py:539] [tf-4353] Step 1/2 : FROM clipper/tf36-container:a66648a301 
 [integration_py36_tensorflow] 20-04-03:10:23:11 INFO     [clipper_admin.py:539] [tf-4353]  ---> ac3c38a48a9d 
 [integration_py36_tensorflow] 20-04-03:10:23:11 INFO     [clipper_admin.py:539] [tf-4353] Step 2/2 : COPY /tmp/tmprd3szeyqclipper /model/ 
 [integration_py36_tensorflow] 20-04-03:10:23:11 INFO     [clipper_admin.py:539] [tf-4353]  ---> 01299ece7140 
 [integration_py36_tensorflow] 20-04-03:10:23:11 INFO     [clipper_admin.py:539] [tf-4353] Successfully built 01299ece7140 
 [integration_py36_tensorflow] 20-04-03:10:23:11 INFO     [clipper_admin.py:539] [tf-4353] Successfully tagged tf-4353-easy-register-app-model:1 
 [integration_py36_tensorflow] 20-04-03:10:23:11 INFO     [clipper_admin.py:541] [tf-4353] Pushing model Docker image to tf-4353-easy-register-app-model:1 
 [integration_py36_tensorflow] 20-04-03:10:23:11 INFO     [docker_container_manager.py:433] [tf-4353] Found 0 replicas for easy-register-app-model:1. Adding 1 
 [integration_py36_tensorflow] 20-04-03:10:23:13 INFO     [clipper_admin.py:724] [tf-4353] Successfully registered model easy-register-app-model:1 
 [integration_py36_tensorflow] 20-04-03:10:23:13 INFO     [clipper_admin.py:642] [tf-4353] Done deploying model easy-register-app-model:1. 
 [integration_py36_tensorflow] 20-04-03:10:23:13 INFO     [clipper_admin.py:303] [tf-4353] Model easy-register-app-model is now linked to application easy-register-app-model 
 [integration_py36_admin_unit_test] 20-04-03:10:23:29 INFO     [deployer_utils.py:41] Saving function to /tmp/tmpza47hcs6clipper 
 [integration_py36_admin_unit_test] 20-04-03:10:23:29 INFO     [deployer_utils.py:51] Serialized and supplied predict function 
 [integration_py36_admin_unit_test] 20-04-03:10:23:29 INFO     [python.py:192] Python closure saved 
 [integration_py36_admin_unit_test] 20-04-03:10:23:29 INFO     [python.py:206] Using Python 3.6 base image 
 [integration_py36_admin_unit_test] 20-04-03:10:23:29 INFO     [clipper_admin.py:534] [admin-test-cluster-1761] Building model Docker image with model data from /tmp/tmpza47hcs6clipper 
 [integration_py36_admin_unit_test] 20-04-03:10:23:29 INFO     [clipper_admin.py:539] [admin-test-cluster-1761] Step 1/2 : FROM clipper/python36-closure-container:a66648a301 
 [integration_py36_admin_unit_test] 20-04-03:10:23:29 INFO     [clipper_admin.py:539] [admin-test-cluster-1761]  ---> e49ff9c3e757 
 [integration_py36_admin_unit_test] 20-04-03:10:23:29 INFO     [clipper_admin.py:539] [admin-test-cluster-1761] Step 2/2 : COPY /tmp/tmpza47hcs6clipper /model/ 
 [integration_py36_admin_unit_test] 20-04-03:10:23:29 INFO     [clipper_admin.py:539] [admin-test-cluster-1761]  ---> 4b6f4f012f54 
 [integration_py36_admin_unit_test] 20-04-03:10:23:29 INFO     [clipper_admin.py:539] [admin-test-cluster-1761] Successfully built 4b6f4f012f54 
 [integration_py36_admin_unit_test] 20-04-03:10:23:29 INFO     [clipper_admin.py:539] [admin-test-cluster-1761] Successfully tagged admin-test-cluster-1761-testmodel:v2 
 [integration_py36_admin_unit_test] 20-04-03:10:23:29 INFO     [clipper_admin.py:541] [admin-test-cluster-1761] Pushing model Docker image to admin-test-cluster-1761-testmodel:v2 
 [integration_py36_admin_unit_test] 20-04-03:10:23:30 INFO     [docker_container_manager.py:433] [admin-test-cluster-1761] Found 0 replicas for testmodel:v2. Adding 1 
 [integration_py36_admin_unit_test] 20-04-03:10:23:31 INFO     [clipper_admin.py:724] [admin-test-cluster-1761] Successfully registered model testmodel:v2 
 [integration_py36_admin_unit_test] 20-04-03:10:23:31 INFO     [clipper_admin.py:642] [admin-test-cluster-1761] Done deploying model testmodel:v2. 
 [integration_py36_tensorflow] 20-04-03:10:23:38 INFO     [test_utils.py:107] Creating DockerContainerManager 
 [integration_py36_tensorflow] 20-04-03:10:23:38 INFO     [test_utils.py:112] Cleaning up Docker cluster tf-4353 
 [integration_py36_tensorflow] 20-04-03:10:23:46 INFO     [clipper_admin.py:1424] [tf-4353] Stopped all Clipper cluster and all model containers 
 [integration_py36_tensorflow] Cost , Accuracy 
 [integration_py36_tensorflow] [6659.062, 0.63461536] 
 [integration_py36_tensorflow] Cost , Accuracy 
 [integration_py36_tensorflow] [0.0, 1.0] 
 [integration_py36_tensorflow] Cost , Accuracy 
 [integration_py36_tensorflow] [0.0, 1.0] 
 [integration_py36_tensorflow] Cost , Accuracy 
 [integration_py36_tensorflow] [0.0, 1.0] 
 [integration_py36_tensorflow] Cost , Accuracy 
 [integration_py36_tensorflow] [0.0, 1.0] 
 [integration_py36_tensorflow] localhost:34940 
 [integration_py36_tensorflow] localhost:34940 
 [integration_py36_tensorflow] localhost:34940 
 [integration_py36_tensorflow] localhost:34940 
 [integration_py36_tensorflow] 20-04-03:03:23:47 INFO     [retry_with_timeout.py:90] Success! 
===== finished: integration_py36_tensorflow =====
 [integration_py36_admin_unit_test] 20-04-03:10:24:31 INFO     [clipper_admin_tests.py:564] {"error":"Query processing error","cause":"Requested version: skjfhkdjshfjksdhkjf does not exist for model: testmodel"} 
 [integration_py36_admin_unit_test] 20-04-03:10:24:31 INFO     [test_utils.py:107] Creating DockerContainerManager 
 [integration_py36_admin_unit_test] 20-04-03:10:24:31 INFO     [test_utils.py:112] Cleaning up Docker cluster admin-test-cluster-1761 
 [integration_py36_admin_unit_test] 20-04-03:10:24:37 INFO     [clipper_admin.py:1424] [admin-test-cluster-1761] Stopped all Clipper cluster and all model containers 
 [integration_py36_admin_unit_test] ok 
 [integration_py36_admin_unit_test] 20-04-03:10:24:37 INFO     [test_utils.py:107] Creating DockerContainerManager 
 [integration_py36_admin_unit_test] 20-04-03:10:24:37 INFO     [test_utils.py:128] Starting up Docker cluster admin-l-6574 
 [integration_py36_admin_unit_test] 20-04-03:10:24:37 INFO     [test_utils.py:143] Starting Clipper 
 [integration_py36_admin_unit_test] 20-04-03:10:24:38 INFO     [docker_container_manager.py:192] [admin-l-6574] Starting managed Redis instance in Docker 
 [integration_py36_admin_unit_test] 20-04-03:10:24:43 INFO     [docker_container_manager.py:294] [admin-l-6574] Metric Configuration Saved at /tmp/tmprqhtp58l.yml 
 [integration_py36_admin_unit_test] 20-04-03:10:24:44 INFO     [clipper_admin.py:162] [admin-l-6574] Clipper is running 
 [integration_py36_admin_unit_test] 20-04-03:10:24:45 INFO     [clipper_admin.py:236] [admin-l-6574] Application app3 was successfully registered 
 [integration_py36_admin_unit_test] 20-04-03:10:24:45 INFO     [clipper_admin.py:236] [admin-l-6574] Application app4 was successfully registered 
 [integration_py36_admin_unit_test] 20-04-03:10:24:45 INFO     [clipper_admin.py:236] [admin-l-6574] Application app5 was successfully registered 
 [integration_py36_admin_unit_test] 20-04-03:10:24:45 INFO     [clipper_admin.py:236] [admin-l-6574] Application app6 was successfully registered 
 [integration_py36_admin_unit_test] 20-04-03:10:24:45 INFO     [clipper_admin.py:236] [admin-l-6574] Application app7 was successfully registered 
 [integration_py36_admin_unit_test] test_remove_inactive_container (__main__.ClipperManagerTestCaseLong) ... 20-04-03:10:24:45 INFO     [clipper_admin.py:534] [admin-l-6574] Building model Docker image with model data from /tmp/clipper/tmpyelz4y_o 
 [integration_py36_admin_unit_test] 20-04-03:10:24:45 INFO     [clipper_admin.py:539] [admin-l-6574] Step 1/2 : FROM clipper/noop-container:a66648a301 
 [integration_py36_admin_unit_test] 20-04-03:10:24:45 INFO     [clipper_admin.py:539] [admin-l-6574]  ---> 68b10f028fa1 
 [integration_py36_admin_unit_test] 20-04-03:10:24:45 INFO     [clipper_admin.py:539] [admin-l-6574] Step 2/2 : COPY /tmp/clipper/tmpyelz4y_o /model/ 
 [integration_py36_admin_unit_test] 20-04-03:10:24:45 INFO     [clipper_admin.py:539] [admin-l-6574]  ---> Using cache 
 [integration_py36_admin_unit_test] 20-04-03:10:24:45 INFO     [clipper_admin.py:539] [admin-l-6574]  ---> 7187c8c38ca1 
 [integration_py36_admin_unit_test] 20-04-03:10:24:45 INFO     [clipper_admin.py:539] [admin-l-6574] Successfully built 7187c8c38ca1 
 [integration_py36_admin_unit_test] 20-04-03:10:24:45 INFO     [clipper_admin.py:539] [admin-l-6574] Successfully tagged admin-l-6574-m8:1 
 [integration_py36_admin_unit_test] 20-04-03:10:24:45 INFO     [clipper_admin.py:541] [admin-l-6574] Pushing model Docker image to admin-l-6574-m8:1 
 [integration_py36_admin_unit_test] 20-04-03:10:24:46 INFO     [docker_container_manager.py:433] [admin-l-6574] Found 0 replicas for m8:1. Adding 2 
 [integration_py36_admin_unit_test] 20-04-03:10:24:49 INFO     [clipper_admin.py:724] [admin-l-6574] Successfully registered model m8:1 
 [integration_py36_admin_unit_test] 20-04-03:10:24:49 INFO     [clipper_admin.py:642] [admin-l-6574] Done deploying model m8:1. 
 [integration_py36_admin_unit_test] 20-04-03:10:24:49 INFO     [clipper_admin.py:303] [admin-l-6574] Model m8 is now linked to application app7 
 [integration_py36_admin_unit_test] 20-04-03:10:25:19 INFO     [docker_container_manager.py:453] [admin-l-6574] Found 2 replicas for m8:1. Removing 1 
 [integration_py36_admin_unit_test] 20-04-03:10:27:10 INFO     [docker_container_manager.py:453] [admin-l-6574] Found 1 replicas for m8:1. Removing 1 
 [integration_py36_admin_unit_test] ok 
 [integration_py36_admin_unit_test] test_unlinked_app_returns_default_predictions (__main__.ClipperManagerTestCaseLong) ... 20-04-03:10:29:01 INFO     [clipper_admin_tests.py:671] {'query_id': 6, 'output': 'DEFAULT', 'default': True, 'default_explanation': 'No connected models found for query'} 
 [integration_py36_admin_unit_test] ok 
 [integration_py36_admin_unit_test] test_deployed_model_queried_successfully (__main__.ClipperManagerTestCaseLong) ... 20-04-03:10:29:01 INFO     [clipper_admin.py:534] [admin-l-6574] Building model Docker image with model data from /tmp/clipper/tmpyelz4y_o 
 [integration_py36_admin_unit_test] 20-04-03:10:29:01 INFO     [clipper_admin.py:539] [admin-l-6574] Step 1/2 : FROM clipper/noop-container:a66648a301 
 [integration_py36_admin_unit_test] 20-04-03:10:29:01 INFO     [clipper_admin.py:539] [admin-l-6574]  ---> 68b10f028fa1 
 [integration_py36_admin_unit_test] 20-04-03:10:29:01 INFO     [clipper_admin.py:539] [admin-l-6574] Step 2/2 : COPY /tmp/clipper/tmpyelz4y_o /model/ 
 [integration_py36_admin_unit_test] 20-04-03:10:29:01 INFO     [clipper_admin.py:539] [admin-l-6574]  ---> Using cache 
 [integration_py36_admin_unit_test] 20-04-03:10:29:01 INFO     [clipper_admin.py:539] [admin-l-6574]  ---> 7187c8c38ca1 
 [integration_py36_admin_unit_test] 20-04-03:10:29:01 INFO     [clipper_admin.py:539] [admin-l-6574] Successfully built 7187c8c38ca1 
 [integration_py36_admin_unit_test] 20-04-03:10:29:01 INFO     [clipper_admin.py:539] [admin-l-6574] Successfully tagged admin-l-6574-m5:1 
 [integration_py36_admin_unit_test] 20-04-03:10:29:01 INFO     [clipper_admin.py:541] [admin-l-6574] Pushing model Docker image to admin-l-6574-m5:1 
 [integration_py36_admin_unit_test] 20-04-03:10:29:02 INFO     [docker_container_manager.py:433] [admin-l-6574] Found 0 replicas for m5:1. Adding 1 
 [integration_py36_admin_unit_test] 20-04-03:10:29:03 INFO     [clipper_admin.py:724] [admin-l-6574] Successfully registered model m5:1 
 [integration_py36_admin_unit_test] 20-04-03:10:29:03 INFO     [clipper_admin.py:642] [admin-l-6574] Done deploying model m5:1. 
 [integration_py36_admin_unit_test] 20-04-03:10:29:03 INFO     [clipper_admin.py:303] [admin-l-6574] Model m5 is now linked to application app4 
 [integration_py36_admin_unit_test] 20-04-03:10:29:33 INFO     [clipper_admin_tests.py:693] {'query_id': 7, 'output': 1.0, 'default': False} 
 [integration_py36_admin_unit_test] ok 
 [integration_py36_admin_unit_test] test_batch_queries_returned_successfully (__main__.ClipperManagerTestCaseLong) ... 20-04-03:10:29:33 INFO     [clipper_admin.py:534] [admin-l-6574] Building model Docker image with model data from /tmp/clipper/tmpyelz4y_o 
 [integration_py36_admin_unit_test] 20-04-03:10:29:34 INFO     [clipper_admin.py:539] [admin-l-6574] Step 1/2 : FROM clipper/noop-container:a66648a301 
 [integration_py36_admin_unit_test] 20-04-03:10:29:34 INFO     [clipper_admin.py:539] [admin-l-6574]  ---> 68b10f028fa1 
 [integration_py36_admin_unit_test] 20-04-03:10:29:34 INFO     [clipper_admin.py:539] [admin-l-6574] Step 2/2 : COPY /tmp/clipper/tmpyelz4y_o /model/ 
 [integration_py36_admin_unit_test] 20-04-03:10:29:34 INFO     [clipper_admin.py:539] [admin-l-6574]  ---> Using cache 
 [integration_py36_admin_unit_test] 20-04-03:10:29:34 INFO     [clipper_admin.py:539] [admin-l-6574]  ---> 7187c8c38ca1 
 [integration_py36_admin_unit_test] 20-04-03:10:29:34 INFO     [clipper_admin.py:539] [admin-l-6574] Successfully built 7187c8c38ca1 
 [integration_py36_admin_unit_test] 20-04-03:10:29:34 INFO     [clipper_admin.py:539] [admin-l-6574] Successfully tagged admin-l-6574-m6:1 
 [integration_py36_admin_unit_test] 20-04-03:10:29:34 INFO     [clipper_admin.py:541] [admin-l-6574] Pushing model Docker image to admin-l-6574-m6:1 
 [integration_py36_admin_unit_test] 20-04-03:10:29:34 INFO     [docker_container_manager.py:433] [admin-l-6574] Found 0 replicas for m6:1. Adding 1 
 [integration_py36_admin_unit_test] 20-04-03:10:29:36 INFO     [clipper_admin.py:724] [admin-l-6574] Successfully registered model m6:1 
 [integration_py36_admin_unit_test] 20-04-03:10:29:36 INFO     [clipper_admin.py:642] [admin-l-6574] Done deploying model m6:1. 
 [integration_py36_admin_unit_test] 20-04-03:10:29:36 INFO     [clipper_admin.py:303] [admin-l-6574] Model m6 is now linked to application app5 
 [integration_py36_admin_unit_test] 20-04-03:10:30:06 INFO     [clipper_admin_tests.py:716] {'batch_predictions': [{'query_id': 8, 'output': 1.0, 'default': False}, {'query_id': 9, 'output': 1.0, 'default': False}, {'query_id': 10, 'output': 1.0, 'default': False}, {'query_id': 11, 'output': 1.0, 'default': False}]} 
 [integration_py36_admin_unit_test] ok 
 [integration_py36_admin_unit_test] test_deployed_python_closure_queried_successfully (__main__.ClipperManagerTestCaseLong) ... 20-04-03:10:30:06 INFO     [deployer_utils.py:41] Saving function to /tmp/tmpzon05decclipper 
 [integration_py36_admin_unit_test] 20-04-03:10:30:06 INFO     [deployer_utils.py:51] Serialized and supplied predict function 
 [integration_py36_admin_unit_test] 20-04-03:10:30:06 INFO     [python.py:192] Python closure saved 
 [integration_py36_admin_unit_test] 20-04-03:10:30:06 INFO     [python.py:206] Using Python 3.6 base image 
 [integration_py36_admin_unit_test] 20-04-03:10:30:06 INFO     [clipper_admin.py:534] [admin-l-6574] Building model Docker image with model data from /tmp/tmpzon05decclipper 
 [integration_py36_admin_unit_test] 20-04-03:10:30:06 INFO     [clipper_admin.py:539] [admin-l-6574] Step 1/2 : FROM clipper/python36-closure-container:a66648a301 
 [integration_py36_admin_unit_test] 20-04-03:10:30:06 INFO     [clipper_admin.py:539] [admin-l-6574]  ---> e49ff9c3e757 
 [integration_py36_admin_unit_test] 20-04-03:10:30:06 INFO     [clipper_admin.py:539] [admin-l-6574] Step 2/2 : COPY /tmp/tmpzon05decclipper /model/ 
 [integration_py36_admin_unit_test] 20-04-03:10:30:06 INFO     [clipper_admin.py:539] [admin-l-6574]  ---> aa6229b5d4a1 
 [integration_py36_admin_unit_test] 20-04-03:10:30:06 INFO     [clipper_admin.py:539] [admin-l-6574] Successfully built aa6229b5d4a1 
 [integration_py36_admin_unit_test] 20-04-03:10:30:06 INFO     [clipper_admin.py:539] [admin-l-6574] Successfully tagged admin-l-6574-m4:1 
 [integration_py36_admin_unit_test] 20-04-03:10:30:06 INFO     [clipper_admin.py:541] [admin-l-6574] Pushing model Docker image to admin-l-6574-m4:1 
 [integration_py36_admin_unit_test] 20-04-03:10:30:07 INFO     [docker_container_manager.py:433] [admin-l-6574] Found 0 replicas for m4:1. Adding 1 
 [integration_py36_admin_unit_test] 20-04-03:10:30:08 INFO     [clipper_admin.py:724] [admin-l-6574] Successfully registered model m4:1 
 [integration_py36_admin_unit_test] 20-04-03:10:30:08 INFO     [clipper_admin.py:642] [admin-l-6574] Done deploying model m4:1. 
 [integration_py36_admin_unit_test] 20-04-03:10:30:08 INFO     [clipper_admin.py:303] [admin-l-6574] Model m4 is now linked to application app3 
 [integration_py36_admin_unit_test] ok 
 [integration_py36_admin_unit_test] test_fixed_batch_size_model_processes_specified_query_batch_size_when_saturated (__main__.ClipperManagerTestCaseLong) ... 20-04-03:10:31:08 INFO     [deployer_utils.py:41] Saving function to /tmp/tmpby3ake0yclipper 
 [integration_py36_admin_unit_test] 20-04-03:10:31:08 INFO     [deployer_utils.py:51] Serialized and supplied predict function 
 [integration_py36_admin_unit_test] 20-04-03:10:31:08 INFO     [python.py:192] Python closure saved 
 [integration_py36_admin_unit_test] 20-04-03:10:31:08 INFO     [python.py:206] Using Python 3.6 base image 
 [integration_py36_admin_unit_test] 20-04-03:10:31:08 INFO     [clipper_admin.py:534] [admin-l-6574] Building model Docker image with model data from /tmp/tmpby3ake0yclipper 
 [integration_py36_admin_unit_test] 20-04-03:10:31:09 INFO     [clipper_admin.py:539] [admin-l-6574] Step 1/2 : FROM clipper/python36-closure-container:a66648a301 
 [integration_py36_admin_unit_test] 20-04-03:10:31:09 INFO     [clipper_admin.py:539] [admin-l-6574]  ---> e49ff9c3e757 
 [integration_py36_admin_unit_test] 20-04-03:10:31:09 INFO     [clipper_admin.py:539] [admin-l-6574] Step 2/2 : COPY /tmp/tmpby3ake0yclipper /model/ 
 [integration_py36_admin_unit_test] 20-04-03:10:31:09 INFO     [clipper_admin.py:539] [admin-l-6574]  ---> 7c78ae081871 
 [integration_py36_admin_unit_test] 20-04-03:10:31:09 INFO     [clipper_admin.py:539] [admin-l-6574] Successfully built 7c78ae081871 
 [integration_py36_admin_unit_test] 20-04-03:10:31:09 INFO     [clipper_admin.py:539] [admin-l-6574] Successfully tagged admin-l-6574-m7:1 
 [integration_py36_admin_unit_test] 20-04-03:10:31:09 INFO     [clipper_admin.py:541] [admin-l-6574] Pushing model Docker image to admin-l-6574-m7:1 
 [integration_py36_admin_unit_test] 20-04-03:10:31:10 INFO     [docker_container_manager.py:433] [admin-l-6574] Found 0 replicas for m7:1. Adding 1 
 [integration_py36_admin_unit_test] 20-04-03:10:31:11 INFO     [clipper_admin.py:724] [admin-l-6574] Successfully registered model m7:1 
 [integration_py36_admin_unit_test] 20-04-03:10:31:11 INFO     [clipper_admin.py:642] [admin-l-6574] Done deploying model m7:1. 
 [integration_py36_admin_unit_test] 20-04-03:10:31:11 INFO     [clipper_admin.py:303] [admin-l-6574] Model m7 is now linked to application app6 
 [integration_py36_admin_unit_test] ok 
 [integration_py36_admin_unit_test] 20-04-03:10:32:37 INFO     [test_utils.py:107] Creating DockerContainerManager 
 [integration_py36_admin_unit_test] 20-04-03:10:32:37 INFO     [test_utils.py:112] Cleaning up Docker cluster admin-l-6574 
 [integration_py36_admin_unit_test] 20-04-03:10:32:37 INFO     [test_utils.py:66] Socket error: [Errno 98] Address already in use 
 [integration_py36_admin_unit_test] 20-04-03:10:32:37 INFO     [test_utils.py:68] randomly generated port 44736 is bound. Trying again. 
 [integration_py36_admin_unit_test] 20-04-03:10:32:42 INFO     [clipper_admin.py:1424] [admin-l-6574] Stopped all Clipper cluster and all model containers 
 [integration_py36_admin_unit_test]  
 [integration_py36_admin_unit_test] ---------------------------------------------------------------------- 
 [integration_py36_admin_unit_test] Ran 27 tests in 1156.313s 
 [integration_py36_admin_unit_test]  
 [integration_py36_admin_unit_test] OK 
 [integration_py36_admin_unit_test] {'query_id': 12, 'output': 3, 'default': False} 
 [integration_py36_admin_unit_test] 20-04-03:03:32:42 INFO     [retry_with_timeout.py:90] Success! 
===== finished: integration_py36_admin_unit_test =====
+ '[' -z x ']'
Sending e-mails to: xmo@berkeley.edu
Setting commit status on GitHub for https://github.com/ucbrise/clipper/commit/a66648a301c618fed4528e7b103fe737bf803768
Finished: SUCCESS