11:06:08.027 main INFO CoarseGrainedExecutorBackend: Started daemon with process name: 224932@amp-jenkins-worker-04 11:06:08.043 main INFO SignalUtils: Registering signal handler for TERM 11:06:08.045 main INFO SignalUtils: Registering signal handler for HUP 11:06:08.046 main INFO SignalUtils: Registering signal handler for INT 11:06:09.203 main WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 11:06:09.381 main INFO SecurityManager: Changing view acls to: jenkins 11:06:09.382 main INFO SecurityManager: Changing modify acls to: jenkins 11:06:09.383 main INFO SecurityManager: Changing view acls groups to: 11:06:09.384 main INFO SecurityManager: Changing modify acls groups to: 11:06:09.385 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 11:06:10.365 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:36562 after 533 ms (0 ms spent in bootstraps) 11:06:10.490 main INFO SecurityManager: Changing view acls to: jenkins 11:06:10.490 main INFO SecurityManager: Changing modify acls to: jenkins 11:06:10.490 main INFO SecurityManager: Changing view acls groups to: 11:06:10.490 main INFO SecurityManager: Changing modify acls groups to: 11:06:10.490 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 11:06:10.564 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:36562 after 3 ms (0 ms spent in bootstraps) 11:06:10.639 main INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-b35d5202-1788-428e-88d8-d2d00e91cd96/executor-e4b21191-d99b-4f53-91f7-a3f62e6a436f/blockmgr-524e6ec3-cea0-4aef-9a7b-840ba27a5ccf 11:06:10.692 main INFO MemoryStore: MemoryStore started with capacity 546.3 MiB 11:06:10.970 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Registering PWR handler. 11:06:10.971 dispatcher-Executor INFO SignalUtils: Registering signal handler for PWR 11:06:10.971 main INFO WorkerWatcher: Connecting to worker spark://Worker@amp-jenkins-worker-04.amp:45476 11:06:10.972 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Connecting to driver: spark://CoarseGrainedScheduler@amp-jenkins-worker-04.amp:36562 11:06:10.976 netty-rpc-connection-1 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:45476 after 3 ms (0 ms spent in bootstraps) 11:06:10.983 dispatcher-event-loop-1 INFO WorkerWatcher: Successfully connected to spark://Worker@amp-jenkins-worker-04.amp:45476 11:06:10.998 dispatcher-Executor INFO ResourceUtils: ============================================================== 11:06:10.999 dispatcher-Executor INFO ResourceUtils: No custom resources configured for spark.executor. 11:06:11.000 dispatcher-Executor INFO ResourceUtils: ============================================================== 11:06:11.042 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Successfully registered with driver 11:06:11.046 dispatcher-Executor INFO Executor: Starting executor ID 1 on host amp-jenkins-worker-04.amp 11:06:11.171 dispatcher-Executor INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 41246. 11:06:11.173 dispatcher-Executor INFO NettyBlockTransferService: Server created on amp-jenkins-worker-04.amp:41246 11:06:11.178 dispatcher-Executor INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 11:06:11.188 dispatcher-Executor INFO BlockManagerMaster: Registering BlockManager BlockManagerId(1, amp-jenkins-worker-04.amp, 41246, None) 11:06:11.198 dispatcher-Executor INFO BlockManagerMaster: Registered BlockManager BlockManagerId(1, amp-jenkins-worker-04.amp, 41246, None) 11:06:11.199 dispatcher-Executor INFO BlockManager: Initialized BlockManager: BlockManagerId(1, amp-jenkins-worker-04.amp, 41246, None) 11:06:11.255 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 0 11:06:11.266 Executor task launch worker for task 0 INFO Executor: Running task 0.0 in stage 0.0 (TID 0) 11:06:11.452 Executor task launch worker for task 0 INFO TorrentBroadcast: Started reading broadcast variable 1 with 1 pieces (estimated total size 4.0 MiB) 11:06:11.520 Executor task launch worker for task 0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:41702 after 3 ms (0 ms spent in bootstraps) 11:06:11.551 Executor task launch worker for task 0 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 3.8 KiB, free 546.3 MiB) 11:06:11.580 Executor task launch worker for task 0 INFO TorrentBroadcast: Reading broadcast variable 1 took 127 ms 11:06:11.783 Executor task launch worker for task 0 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 6.9 KiB, free 546.3 MiB) 11:06:12.950 Executor task launch worker for task 0 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1127 bytes result sent to driver 11:06:15.212 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 2 11:06:15.213 Executor task launch worker for task 2 INFO Executor: Running task 0.0 in stage 1.0 (TID 2) 11:06:15.222 Executor task launch worker for task 2 INFO MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 11:06:15.227 Executor task launch worker for task 2 INFO TorrentBroadcast: Started reading broadcast variable 2 with 1 pieces (estimated total size 4.0 MiB) 11:06:15.238 Executor task launch worker for task 2 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 5.8 KiB, free 546.3 MiB) 11:06:15.248 Executor task launch worker for task 2 INFO TorrentBroadcast: Reading broadcast variable 2 took 20 ms 11:06:15.251 Executor task launch worker for task 2 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 10.9 KiB, free 546.3 MiB) 11:06:16.037 Executor task launch worker for task 2 INFO TorrentBroadcast: Started reading broadcast variable 0 with 1 pieces (estimated total size 4.0 MiB) 11:06:16.047 Executor task launch worker for task 2 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 27.6 KiB, free 546.2 MiB) 11:06:16.050 Executor task launch worker for task 2 INFO TorrentBroadcast: Reading broadcast variable 0 took 13 ms 11:06:16.457 Executor task launch worker for task 2 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 424.3 KiB, free 545.8 MiB) 11:06:16.461 Executor task launch worker for task 2 INFO StateStore: State Store maintenance task started 11:06:17.302 Executor task launch worker for task 2 INFO StateStore: Retrieved reference to StateStoreCoordinator: org.apache.spark.sql.execution.streaming.state.StateStoreCoordinatorRef@1d597f90 11:06:17.312 Executor task launch worker for task 2 INFO StateStore: Reported that the loaded instance StateStoreProviderId(StateStoreId(/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315,0,0,default),181e1917-6f0b-4dab-97fd-0a1e48bce0f8) is active 11:06:17.339 Executor task launch worker for task 2 INFO HDFSBackedStateStoreProvider: Retrieved version 0 of HDFSStateStoreProvider[id = (op=0,part=0),dir = /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0] for update 11:06:17.340 Executor task launch worker for task 2 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 0, fetching them 11:06:17.342 Executor task launch worker for task 2 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@amp-jenkins-worker-04.amp:36562) 11:06:17.372 Executor task launch worker for task 2 INFO MapOutputTrackerWorker: Got the output locations 11:06:17.425 Executor task launch worker for task 2 INFO ShuffleBlockFetcherIterator: Getting 1 (54.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 1 (54.0 B) remote blocks 11:06:17.434 Executor task launch worker for task 2 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:34583 after 2 ms (0 ms spent in bootstraps) 11:06:17.448 Executor task launch worker for task 2 INFO ShuffleBlockFetcherIterator: Started 1 remote fetches in 39 ms 11:06:22.193 Executor task launch worker for task 2 INFO CodeGenerator: Code generated in 3724.747423 ms 11:06:22.219 Executor task launch worker for task 2 INFO CodeGenerator: Code generated in 17.111929 ms 11:06:22.256 Executor task launch worker for task 2 INFO CheckpointFileManager: Writing atomically to /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0/1.delta using temp file /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0/.1.delta.8c26c209-4aef-4a8f-a772-fb911cae6955.TID2.tmp 11:06:22.296 Executor task launch worker for task 2 INFO CheckpointFileManager: Renamed temp file /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0/.1.delta.8c26c209-4aef-4a8f-a772-fb911cae6955.TID2.tmp to /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0/1.delta 11:06:22.299 Executor task launch worker for task 2 INFO HDFSBackedStateStoreProvider: Committed version 1 for HDFSStateStore[id=(op=0,part=0),dir=/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0] to file /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0/1.delta 11:06:22.308 Executor task launch worker for task 2 INFO Executor: Finished task 0.0 in stage 1.0 (TID 2). 1409 bytes result sent to driver 11:06:23.163 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 5 11:06:23.164 Executor task launch worker for task 5 INFO Executor: Running task 1.0 in stage 2.0 (TID 5) 11:06:23.170 Executor task launch worker for task 5 INFO TorrentBroadcast: Started reading broadcast variable 4 with 1 pieces (estimated total size 4.0 MiB) 11:06:23.178 Executor task launch worker for task 5 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 3.8 KiB, free 545.8 MiB) 11:06:23.183 Executor task launch worker for task 5 INFO TorrentBroadcast: Reading broadcast variable 4 took 13 ms 11:06:23.187 Executor task launch worker for task 5 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 6.9 KiB, free 545.8 MiB) 11:06:23.206 Executor task launch worker for task 5 INFO Executor: Finished task 1.0 in stage 2.0 (TID 5). 1041 bytes result sent to driver 11:06:23.218 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 7 11:06:23.218 Executor task launch worker for task 7 INFO Executor: Running task 0.0 in stage 3.0 (TID 7) 11:06:23.220 Executor task launch worker for task 7 INFO MapOutputTrackerWorker: Updating epoch to 2 and clearing cache 11:06:23.223 Executor task launch worker for task 7 INFO TorrentBroadcast: Started reading broadcast variable 5 with 1 pieces (estimated total size 4.0 MiB) 11:06:23.233 Executor task launch worker for task 7 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 5.8 KiB, free 545.8 MiB) 11:06:23.239 Executor task launch worker for task 7 INFO TorrentBroadcast: Reading broadcast variable 5 took 16 ms 11:06:23.242 Executor task launch worker for task 7 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 10.9 KiB, free 545.8 MiB) 11:06:23.253 Executor task launch worker for task 7 INFO TorrentBroadcast: Started reading broadcast variable 3 with 1 pieces (estimated total size 4.0 MiB) 11:06:23.261 Executor task launch worker for task 7 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 27.6 KiB, free 545.8 MiB) 11:06:23.265 Executor task launch worker for task 7 INFO TorrentBroadcast: Reading broadcast variable 3 took 12 ms 11:06:23.305 Executor task launch worker for task 7 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 424.3 KiB, free 545.4 MiB) 11:06:23.308 Executor task launch worker for task 7 INFO StateStore: Retrieved reference to StateStoreCoordinator: org.apache.spark.sql.execution.streaming.state.StateStoreCoordinatorRef@1d597f90 11:06:23.309 Executor task launch worker for task 7 INFO StateStore: Reported that the loaded instance StateStoreProviderId(StateStoreId(/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315,0,0,default),c5beeea1-f130-45d3-ab88-a7fb0dccd628) is active 11:06:23.310 Executor task launch worker for task 7 WARN HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query. 11:06:23.331 Executor task launch worker for task 7 INFO HDFSBackedStateStoreProvider: Read delta file for version 1 of HDFSStateStoreProvider[id = (op=0,part=0),dir = /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0] from /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0/1.delta 11:06:23.331 Executor task launch worker for task 7 INFO HDFSBackedStateStoreProvider: Retrieved version 1 of HDFSStateStoreProvider[id = (op=0,part=0),dir = /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0] for update 11:06:23.332 Executor task launch worker for task 7 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 1, fetching them 11:06:23.332 Executor task launch worker for task 7 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@amp-jenkins-worker-04.amp:36562) 11:06:23.342 Executor task launch worker for task 7 INFO MapOutputTrackerWorker: Got the output locations 11:06:23.362 Executor task launch worker for task 7 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 11:06:23.362 Executor task launch worker for task 7 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms 11:06:23.389 Executor task launch worker for task 7 INFO CheckpointFileManager: Writing atomically to /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0/2.delta using temp file /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0/.2.delta.00b68f29-283f-4d73-9113-4e8227bf2b7a.TID7.tmp 11:06:23.411 Executor task launch worker for task 7 INFO CheckpointFileManager: Renamed temp file /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0/.2.delta.00b68f29-283f-4d73-9113-4e8227bf2b7a.TID7.tmp to /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0/2.delta 11:06:23.411 Executor task launch worker for task 7 INFO HDFSBackedStateStoreProvider: Committed version 2 for HDFSStateStore[id=(op=0,part=0),dir=/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0] to file /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0/2.delta 11:06:23.413 Executor task launch worker for task 7 INFO Executor: Finished task 0.0 in stage 3.0 (TID 7). 1409 bytes result sent to driver 11:06:23.430 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 8 11:06:23.430 Executor task launch worker for task 8 INFO Executor: Running task 0.0 in stage 5.0 (TID 8) 11:06:23.433 Executor task launch worker for task 8 INFO TorrentBroadcast: Started reading broadcast variable 6 with 1 pieces (estimated total size 4.0 MiB) 11:06:23.441 Executor task launch worker for task 8 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 5.8 KiB, free 545.4 MiB) 11:06:23.445 Executor task launch worker for task 8 INFO TorrentBroadcast: Reading broadcast variable 6 took 11 ms 11:06:23.448 Executor task launch worker for task 8 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 10.9 KiB, free 545.3 MiB) 11:06:23.455 Executor task launch worker for task 8 INFO StateStore: Retrieved reference to StateStoreCoordinator: org.apache.spark.sql.execution.streaming.state.StateStoreCoordinatorRef@1d597f90 11:06:23.455 Executor task launch worker for task 8 INFO StateStore: Reported that the loaded instance StateStoreProviderId(StateStoreId(/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315,0,0,default),181e1917-6f0b-4dab-97fd-0a1e48bce0f8) is active 11:06:23.456 Executor task launch worker for task 8 INFO HDFSBackedStateStoreProvider: Retrieved version 0 of HDFSStateStoreProvider[id = (op=0,part=0),dir = /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0] for update 11:06:23.456 Executor task launch worker for task 8 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 0, fetching them 11:06:23.456 Executor task launch worker for task 8 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@amp-jenkins-worker-04.amp:36562) 11:06:23.460 Executor task launch worker for task 8 INFO MapOutputTrackerWorker: Got the output locations 11:06:23.468 Executor task launch worker for task 8 INFO ShuffleBlockFetcherIterator: Getting 1 (54.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 1 (54.0 B) remote blocks 11:06:23.469 Executor task launch worker for task 8 INFO ShuffleBlockFetcherIterator: Started 1 remote fetches in 1 ms 11:06:23.505 Executor task launch worker for task 8 INFO CheckpointFileManager: Writing atomically to /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0/1.delta using temp file /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0/.1.delta.9b96926a-3d2d-40b0-8a11-9888c76aaa2d.TID8.tmp 11:06:23.523 Executor task launch worker for task 8 INFO CheckpointFileManager: Renamed temp file /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0/.1.delta.9b96926a-3d2d-40b0-8a11-9888c76aaa2d.TID8.tmp to /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0/1.delta 11:06:23.523 Executor task launch worker for task 8 INFO HDFSBackedStateStoreProvider: Committed version 1 for HDFSStateStore[id=(op=0,part=0),dir=/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0] to file /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/StateStoreRDDSuite4676795634820552022/0.14471513-a1e72b00-ca32-4a39-b689-b55b66934315/0/0/1.delta 11:06:23.526 Executor task launch worker for task 8 INFO Executor: Finished task 0.0 in stage 5.0 (TID 8). 1452 bytes result sent to driver 11:06:23.535 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver commanded a shutdown 11:06:23.537 SIGTERM handler ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM 11:06:23.542 shutdown-hook-0 INFO DiskBlockManager: Shutdown hook called 11:06:23.545 dispatcher-event-loop-1 ERROR WorkerWatcher: Lost connection to worker rpc endpoint spark://Worker@amp-jenkins-worker-04.amp:45476. Exiting. 11:06:23.545 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver from amp-jenkins-worker-04.amp:45476 disconnected during shutdown 11:06:23.555 shutdown-hook-0 INFO ShutdownHookManager: Shutdown hook called 11:06:23.563 CoarseGrainedExecutorBackend-stop-executor INFO MemoryStore: MemoryStore cleared 11:06:23.564 CoarseGrainedExecutorBackend-stop-executor INFO BlockManager: BlockManager stopped