11:06:09.133 main INFO CoarseGrainedExecutorBackend: Started daemon with process name: 224931@amp-jenkins-worker-04 11:06:09.148 main INFO SignalUtils: Registering signal handler for TERM 11:06:09.150 main INFO SignalUtils: Registering signal handler for HUP 11:06:09.151 main INFO SignalUtils: Registering signal handler for INT 11:06:09.729 main WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 11:06:09.888 main INFO SecurityManager: Changing view acls to: jenkins 11:06:09.889 main INFO SecurityManager: Changing modify acls to: jenkins 11:06:09.891 main INFO SecurityManager: Changing view acls groups to: 11:06:09.892 main INFO SecurityManager: Changing modify acls groups to: 11:06:09.893 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 11:06:10.985 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:36562 after 114 ms (0 ms spent in bootstraps) 11:06:11.130 main INFO SecurityManager: Changing view acls to: jenkins 11:06:11.130 main INFO SecurityManager: Changing modify acls to: jenkins 11:06:11.130 main INFO SecurityManager: Changing view acls groups to: 11:06:11.131 main INFO SecurityManager: Changing modify acls groups to: 11:06:11.131 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 11:06:11.228 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:36562 after 4 ms (0 ms spent in bootstraps) 11:06:11.321 main INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-b35d5202-1788-428e-88d8-d2d00e91cd96/executor-4571603c-8970-4ea6-91f5-1d47331a6f34/blockmgr-aa0acb54-ff27-4b38-9b9a-b13e73926d52 11:06:11.389 main INFO MemoryStore: MemoryStore started with capacity 546.3 MiB 11:06:11.667 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Registering PWR handler. 11:06:11.667 dispatcher-Executor INFO SignalUtils: Registering signal handler for PWR 11:06:11.668 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Connecting to driver: spark://CoarseGrainedScheduler@amp-jenkins-worker-04.amp:36562 11:06:11.669 main INFO WorkerWatcher: Connecting to worker spark://Worker@amp-jenkins-worker-04.amp:38991 11:06:11.679 netty-rpc-connection-1 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:38991 after 7 ms (0 ms spent in bootstraps) 11:06:11.686 dispatcher-event-loop-0 INFO WorkerWatcher: Successfully connected to spark://Worker@amp-jenkins-worker-04.amp:38991 11:06:11.696 dispatcher-Executor INFO ResourceUtils: ============================================================== 11:06:11.697 dispatcher-Executor INFO ResourceUtils: No custom resources configured for spark.executor. 11:06:11.697 dispatcher-Executor INFO ResourceUtils: ============================================================== 11:06:11.723 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Successfully registered with driver 11:06:11.726 dispatcher-Executor INFO Executor: Starting executor ID 0 on host amp-jenkins-worker-04.amp 11:06:11.845 dispatcher-Executor INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 34583. 11:06:11.846 dispatcher-Executor INFO NettyBlockTransferService: Server created on amp-jenkins-worker-04.amp:34583 11:06:11.849 dispatcher-Executor INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 11:06:11.859 dispatcher-Executor INFO BlockManagerMaster: Registering BlockManager BlockManagerId(0, amp-jenkins-worker-04.amp, 34583, None) 11:06:11.869 dispatcher-Executor INFO BlockManagerMaster: Registered BlockManager BlockManagerId(0, amp-jenkins-worker-04.amp, 34583, None) 11:06:11.870 dispatcher-Executor INFO BlockManager: Initialized BlockManager: BlockManagerId(0, amp-jenkins-worker-04.amp, 34583, None) 11:06:11.928 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 1 11:06:11.944 Executor task launch worker for task 1 INFO Executor: Running task 1.0 in stage 0.0 (TID 1) 11:06:12.106 Executor task launch worker for task 1 INFO TorrentBroadcast: Started reading broadcast variable 1 with 1 pieces (estimated total size 4.0 MiB) 11:06:12.189 Executor task launch worker for task 1 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:41246 after 8 ms (0 ms spent in bootstraps) 11:06:12.251 Executor task launch worker for task 1 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 3.8 KiB, free 546.3 MiB) 11:06:12.266 Executor task launch worker for task 1 INFO TorrentBroadcast: Reading broadcast variable 1 took 160 ms 11:06:12.453 Executor task launch worker for task 1 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 6.9 KiB, free 546.3 MiB) 11:06:15.202 Executor task launch worker for task 1 INFO Executor: Finished task 1.0 in stage 0.0 (TID 1). 1084 bytes result sent to driver 11:06:15.213 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 3 11:06:15.213 Executor task launch worker for task 3 INFO Executor: Running task 1.0 in stage 1.0 (TID 3) 11:06:15.220 Executor task launch worker for task 3 INFO MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 11:06:15.225 Executor task launch worker for task 3 INFO TorrentBroadcast: Started reading broadcast variable 2 with 1 pieces (estimated total size 4.0 MiB) 11:06:15.233 Executor task launch worker for task 3 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:41702 after 1 ms (0 ms spent in bootstraps) 11:06:15.249 Executor task launch worker for task 3 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 5.8 KiB, free 546.3 MiB) 11:06:15.253 Executor task launch worker for task 3 INFO TorrentBroadcast: Reading broadcast variable 2 took 27 ms 11:06:15.257 Executor task launch worker for task 3 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 10.9 KiB, free 546.3 MiB) 11:06:15.897 Executor task launch worker for task 3 INFO TorrentBroadcast: Started reading broadcast variable 0 with 1 pieces (estimated total size 4.0 MiB) 11:06:15.911 Executor task launch worker for task 3 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 27.6 KiB, free 546.2 MiB) 11:06:15.915 Executor task launch worker for task 3 INFO TorrentBroadcast: Reading broadcast variable 0 took 18 ms 11:06:15.983 Executor task launch worker for task 3 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 424.3 KiB, free 545.8 MiB) 11:06:15.988 Executor task launch worker for task 3 INFO StateStore: State Store maintenance task started 11:06:17.243 Executor task launch worker for task 3 INFO StateStore: Retrieved reference to StateStoreCoordinator: org.apache.spark.sql.execution.streaming.state.StateStoreCoordinatorRef@3335b24a 11:06:17.253 Executor task launch worker for task 3 INFO StateStore: Reported that the loaded instance StateStoreProviderId(StateStoreId(/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315,0,1,default),181e1917-6f0b-4dab-97fd-0a1e48bce0f8) is active 11:06:17.257 Executor task launch worker for task 3 INFO HDFSBackedStateStoreProvider: Retrieved version 0 of HDFSStateStoreProvider[id = (op=0,part=1),dir = /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1] for update 11:06:17.259 Executor task launch worker for task 3 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 0, fetching them 11:06:17.261 Executor task launch worker for task 3 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@amp-jenkins-worker-04.amp:36562) 11:06:17.365 Executor task launch worker for task 3 INFO MapOutputTrackerWorker: Got the output locations 11:06:17.426 Executor task launch worker for task 3 INFO ShuffleBlockFetcherIterator: Getting 2 (108.0 B) non-empty blocks including 1 (54.0 B) local and 0 (0.0 B) host-local and 1 (54.0 B) remote blocks 11:06:17.441 Executor task launch worker for task 3 INFO ShuffleBlockFetcherIterator: Started 1 remote fetches in 34 ms 11:06:22.417 Executor task launch worker for task 3 INFO CodeGenerator: Code generated in 3932.322838 ms 11:06:22.449 Executor task launch worker for task 3 INFO CodeGenerator: Code generated in 22.175985 ms 11:06:23.069 Executor task launch worker for task 3 INFO CheckpointFileManager: Writing atomically to /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1/1.delta using temp file /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1/.1.delta.05e44438-0fc8-45e8-b8c1-8487ca3b1008.TID3.tmp 11:06:23.115 Executor task launch worker for task 3 INFO CheckpointFileManager: Renamed temp file /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1/.1.delta.05e44438-0fc8-45e8-b8c1-8487ca3b1008.TID3.tmp to /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1/1.delta 11:06:23.118 Executor task launch worker for task 3 INFO HDFSBackedStateStoreProvider: Committed version 1 for HDFSStateStore[id=(op=0,part=1),dir=/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1] to file /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1/1.delta 11:06:23.124 Executor task launch worker for task 3 INFO Executor: Finished task 1.0 in stage 1.0 (TID 3). 1409 bytes result sent to driver 11:06:23.163 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 4 11:06:23.164 Executor task launch worker for task 4 INFO Executor: Running task 0.0 in stage 2.0 (TID 4) 11:06:23.169 Executor task launch worker for task 4 INFO TorrentBroadcast: Started reading broadcast variable 4 with 1 pieces (estimated total size 4.0 MiB) 11:06:23.178 Executor task launch worker for task 4 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 3.8 KiB, free 545.8 MiB) 11:06:23.182 Executor task launch worker for task 4 INFO TorrentBroadcast: Reading broadcast variable 4 took 12 ms 11:06:23.186 Executor task launch worker for task 4 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 6.9 KiB, free 545.8 MiB) 11:06:23.207 Executor task launch worker for task 4 INFO Executor: Finished task 0.0 in stage 2.0 (TID 4). 1041 bytes result sent to driver 11:06:23.217 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 6 11:06:23.218 Executor task launch worker for task 6 INFO Executor: Running task 1.0 in stage 3.0 (TID 6) 11:06:23.220 Executor task launch worker for task 6 INFO MapOutputTrackerWorker: Updating epoch to 2 and clearing cache 11:06:23.223 Executor task launch worker for task 6 INFO TorrentBroadcast: Started reading broadcast variable 5 with 1 pieces (estimated total size 4.0 MiB) 11:06:23.232 Executor task launch worker for task 6 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 5.8 KiB, free 545.8 MiB) 11:06:23.238 Executor task launch worker for task 6 INFO TorrentBroadcast: Reading broadcast variable 5 took 14 ms 11:06:23.241 Executor task launch worker for task 6 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 10.9 KiB, free 545.8 MiB) 11:06:23.249 Executor task launch worker for task 6 INFO TorrentBroadcast: Started reading broadcast variable 3 with 1 pieces (estimated total size 4.0 MiB) 11:06:23.257 Executor task launch worker for task 6 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 27.6 KiB, free 545.8 MiB) 11:06:23.260 Executor task launch worker for task 6 INFO TorrentBroadcast: Reading broadcast variable 3 took 11 ms 11:06:23.298 Executor task launch worker for task 6 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 424.3 KiB, free 545.4 MiB) 11:06:23.301 Executor task launch worker for task 6 INFO StateStore: Retrieved reference to StateStoreCoordinator: org.apache.spark.sql.execution.streaming.state.StateStoreCoordinatorRef@3335b24a 11:06:23.302 Executor task launch worker for task 6 INFO StateStore: Reported that the loaded instance StateStoreProviderId(StateStoreId(/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315,0,1,default),c5beeea1-f130-45d3-ab88-a7fb0dccd628) is active 11:06:23.303 Executor task launch worker for task 6 WARN HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query. 11:06:23.320 Executor task launch worker for task 6 INFO HDFSBackedStateStoreProvider: Read delta file for version 1 of HDFSStateStoreProvider[id = (op=0,part=1),dir = /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1] from /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1/1.delta 11:06:23.322 Executor task launch worker for task 6 INFO HDFSBackedStateStoreProvider: Retrieved version 1 of HDFSStateStoreProvider[id = (op=0,part=1),dir = /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1] for update 11:06:23.322 Executor task launch worker for task 6 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 1, fetching them 11:06:23.323 Executor task launch worker for task 6 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@amp-jenkins-worker-04.amp:36562) 11:06:23.327 Executor task launch worker for task 6 INFO MapOutputTrackerWorker: Got the output locations 11:06:23.339 Executor task launch worker for task 6 INFO ShuffleBlockFetcherIterator: Getting 2 (108.0 B) non-empty blocks including 1 (54.0 B) local and 0 (0.0 B) host-local and 1 (54.0 B) remote blocks 11:06:23.348 Executor task launch worker for task 6 INFO ShuffleBlockFetcherIterator: Started 1 remote fetches in 10 ms 11:06:23.381 Executor task launch worker for task 6 INFO CheckpointFileManager: Writing atomically to /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1/2.delta using temp file /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1/.2.delta.b670bcb6-1e7b-4026-81fc-437753870ac4.TID6.tmp 11:06:23.410 Executor task launch worker for task 6 INFO CheckpointFileManager: Renamed temp file /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1/.2.delta.b670bcb6-1e7b-4026-81fc-437753870ac4.TID6.tmp to /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1/2.delta 11:06:23.410 Executor task launch worker for task 6 INFO HDFSBackedStateStoreProvider: Committed version 2 for HDFSStateStore[id=(op=0,part=1),dir=/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1] to file /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1/2.delta 11:06:23.413 Executor task launch worker for task 6 INFO Executor: Finished task 1.0 in stage 3.0 (TID 6). 1429 bytes result sent to driver 11:06:23.430 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 9 11:06:23.430 Executor task launch worker for task 9 INFO Executor: Running task 1.0 in stage 5.0 (TID 9) 11:06:23.435 Executor task launch worker for task 9 INFO TorrentBroadcast: Started reading broadcast variable 6 with 1 pieces (estimated total size 4.0 MiB) 11:06:23.442 Executor task launch worker for task 9 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 5.8 KiB, free 545.4 MiB) 11:06:23.445 Executor task launch worker for task 9 INFO TorrentBroadcast: Reading broadcast variable 6 took 10 ms 11:06:23.448 Executor task launch worker for task 9 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 10.9 KiB, free 545.3 MiB) 11:06:23.454 Executor task launch worker for task 9 INFO StateStore: Retrieved reference to StateStoreCoordinator: org.apache.spark.sql.execution.streaming.state.StateStoreCoordinatorRef@3335b24a 11:06:23.455 Executor task launch worker for task 9 INFO StateStore: Reported that the loaded instance StateStoreProviderId(StateStoreId(/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315,0,1,default),181e1917-6f0b-4dab-97fd-0a1e48bce0f8) is active 11:06:23.455 Executor task launch worker for task 9 INFO HDFSBackedStateStoreProvider: Retrieved version 0 of HDFSStateStoreProvider[id = (op=0,part=1),dir = /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1] for update 11:06:23.455 Executor task launch worker for task 9 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 0, fetching them 11:06:23.455 Executor task launch worker for task 9 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@amp-jenkins-worker-04.amp:36562) 11:06:23.457 Executor task launch worker for task 9 INFO MapOutputTrackerWorker: Got the output locations 11:06:23.465 Executor task launch worker for task 9 INFO ShuffleBlockFetcherIterator: Getting 2 (108.0 B) non-empty blocks including 1 (54.0 B) local and 0 (0.0 B) host-local and 1 (54.0 B) remote blocks 11:06:23.466 Executor task launch worker for task 9 INFO ShuffleBlockFetcherIterator: Started 1 remote fetches in 2 ms 11:06:23.484 Executor task launch worker for task 9 INFO CheckpointFileManager: Writing atomically to /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1/1.delta using temp file /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1/.1.delta.dcc78116-62db-437e-a412-deb48ba9c468.TID9.tmp 11:06:23.510 Executor task launch worker for task 9 INFO CheckpointFileManager: Renamed temp file /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1/.1.delta.dcc78116-62db-437e-a412-deb48ba9c468.TID9.tmp to /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1/1.delta 11:06:23.511 Executor task launch worker for task 9 INFO HDFSBackedStateStoreProvider: Committed version 1 for HDFSStateStore[id=(op=0,part=1),dir=/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1] to file /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/1/1.delta 11:06:23.513 Executor task launch worker for task 9 INFO Executor: Finished task 1.0 in stage 5.0 (TID 9). 1409 bytes result sent to driver 11:06:23.535 SIGTERM handler ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM 11:06:23.535 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver commanded a shutdown 11:06:23.541 dispatcher-event-loop-0 ERROR WorkerWatcher: Lost connection to worker rpc endpoint spark://Worker@amp-jenkins-worker-04.amp:38991. Exiting. 11:06:23.541 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver from amp-jenkins-worker-04.amp:38991 disconnected during shutdown 11:06:23.541 shutdown-hook-0 INFO DiskBlockManager: Shutdown hook called 11:06:23.577 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver from amp-jenkins-worker-04.amp:36562 disconnected during shutdown 11:06:23.577 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver from amp-jenkins-worker-04.amp:36562 disconnected during shutdown 11:06:23.577 shutdown-hook-0 INFO ShutdownHookManager: Shutdown hook called 11:06:23.580 CoarseGrainedExecutorBackend-stop-executor INFO MemoryStore: MemoryStore cleared 11:06:23.581 CoarseGrainedExecutorBackend-stop-executor INFO BlockManager: BlockManager stopped