12:13:17.611 main INFO CoarseGrainedExecutorBackend: Started daemon with process name: 30361@amp-jenkins-worker-04 12:13:17.618 main INFO SignalUtils: Registering signal handler for TERM 12:13:17.619 main INFO SignalUtils: Registering signal handler for HUP 12:13:17.620 main INFO SignalUtils: Registering signal handler for INT 12:13:18.006 main WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 12:13:18.101 main INFO SecurityManager: Changing view acls to: jenkins 12:13:18.102 main INFO SecurityManager: Changing modify acls to: jenkins 12:13:18.102 main INFO SecurityManager: Changing view acls groups to: 12:13:18.103 main INFO SecurityManager: Changing modify acls groups to: 12:13:18.103 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 12:13:18.522 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:37358 after 78 ms (0 ms spent in bootstraps) 12:13:18.620 main INFO SecurityManager: Changing view acls to: jenkins 12:13:18.620 main INFO SecurityManager: Changing modify acls to: jenkins 12:13:18.620 main INFO SecurityManager: Changing view acls groups to: 12:13:18.621 main INFO SecurityManager: Changing modify acls groups to: 12:13:18.621 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 12:13:18.677 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:37358 after 2 ms (0 ms spent in bootstraps) 12:13:18.734 main INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-b35d5202-1788-428e-88d8-d2d00e91cd96/executor-5c1c943d-dc77-4cd6-a271-20654de132c9/blockmgr-21fe8fef-4397-48ce-89a0-1a2ff72b765e 12:13:18.782 main INFO MemoryStore: MemoryStore started with capacity 546.3 MiB 12:13:18.975 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Registering PWR handler. 12:13:18.975 dispatcher-Executor INFO SignalUtils: Registering signal handler for PWR 12:13:18.976 main INFO WorkerWatcher: Connecting to worker spark://Worker@amp-jenkins-worker-04.amp:46023 12:13:18.977 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Connecting to driver: spark://CoarseGrainedScheduler@amp-jenkins-worker-04.amp:37358 12:13:18.979 netty-rpc-connection-1 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:46023 after 1 ms (0 ms spent in bootstraps) 12:13:18.982 dispatcher-event-loop-1 INFO WorkerWatcher: Successfully connected to spark://Worker@amp-jenkins-worker-04.amp:46023 12:13:18.990 dispatcher-Executor INFO ResourceUtils: ============================================================== 12:13:18.990 dispatcher-Executor INFO ResourceUtils: No custom resources configured for spark.executor. 12:13:18.990 dispatcher-Executor INFO ResourceUtils: ============================================================== 12:13:19.012 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Successfully registered with driver 12:13:19.015 dispatcher-Executor INFO Executor: Starting executor ID 0 on host amp-jenkins-worker-04.amp 12:13:19.115 dispatcher-Executor INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 37972. 12:13:19.115 dispatcher-Executor INFO NettyBlockTransferService: Server created on amp-jenkins-worker-04.amp:37972 12:13:19.117 dispatcher-Executor INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 12:13:19.127 dispatcher-Executor INFO BlockManagerMaster: Registering BlockManager BlockManagerId(0, amp-jenkins-worker-04.amp, 37972, None) 12:13:19.135 dispatcher-Executor INFO BlockManagerMaster: Registered BlockManager BlockManagerId(0, amp-jenkins-worker-04.amp, 37972, None) 12:13:19.135 dispatcher-Executor INFO BlockManager: Initialized BlockManager: BlockManagerId(0, amp-jenkins-worker-04.amp, 37972, None) 12:13:19.179 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 1 12:13:19.191 Executor task launch worker for task 1 INFO Executor: Running task 1.0 in stage 0.0 (TID 1) 12:13:19.333 Executor task launch worker for task 1 INFO TorrentBroadcast: Started reading broadcast variable 0 with 1 pieces (estimated total size 4.0 MiB) 12:13:19.374 Executor task launch worker for task 1 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:35814 after 1 ms (0 ms spent in bootstraps) 12:13:19.398 Executor task launch worker for task 1 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 546.3 MiB) 12:13:19.407 Executor task launch worker for task 1 INFO TorrentBroadcast: Reading broadcast variable 0 took 73 ms 12:13:19.632 Executor task launch worker for task 1 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 4.4 KiB, free 546.3 MiB) 12:13:20.081 Executor task launch worker for task 1 INFO Executor: Finished task 1.0 in stage 0.0 (TID 1). 1430 bytes result sent to driver 12:13:20.102 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 2 12:13:20.103 Executor task launch worker for task 2 INFO Executor: Running task 0.0 in stage 1.0 (TID 2) 12:13:20.108 Executor task launch worker for task 2 INFO TorrentBroadcast: Started reading broadcast variable 2 with 1 pieces (estimated total size 4.0 MiB) 12:13:20.117 Executor task launch worker for task 2 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 4.8 KiB, free 546.3 MiB) 12:13:20.119 Executor task launch worker for task 2 INFO TorrentBroadcast: Reading broadcast variable 2 took 10 ms 12:13:20.122 Executor task launch worker for task 2 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 9.4 KiB, free 546.3 MiB) 12:13:20.195 Executor task launch worker for task 2 INFO TorrentBroadcast: Started reading broadcast variable 1 with 1 pieces (estimated total size 4.0 MiB) 12:13:20.202 Executor task launch worker for task 2 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 222.0 B, free 546.3 MiB) 12:13:20.204 Executor task launch worker for task 2 INFO TorrentBroadcast: Reading broadcast variable 1 took 9 ms 12:13:20.219 Executor task launch worker for task 2 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 120.0 B, free 546.3 MiB) 12:13:20.696 Executor task launch worker for task 2 INFO CodeGenerator: Code generated in 242.335627 ms 12:13:20.738 Executor task launch worker for task 2 INFO CodeGenerator: Code generated in 24.551685 ms 12:13:20.762 Executor task launch worker for task 2 INFO CodeGenerator: Code generated in 11.126469 ms 12:13:20.769 Executor task launch worker for task 2 INFO Executor: Finished task 0.0 in stage 1.0 (TID 2). 1814 bytes result sent to driver 12:13:20.822 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 4 12:13:20.822 Executor task launch worker for task 4 INFO Executor: Running task 0.0 in stage 2.0 (TID 4) 12:13:20.826 Executor task launch worker for task 4 INFO TorrentBroadcast: Started reading broadcast variable 3 with 1 pieces (estimated total size 4.0 MiB) 12:13:20.833 Executor task launch worker for task 4 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 546.3 MiB) 12:13:20.835 Executor task launch worker for task 4 INFO TorrentBroadcast: Reading broadcast variable 3 took 8 ms 12:13:20.837 Executor task launch worker for task 4 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.4 KiB, free 546.3 MiB) 12:13:20.843 Executor task launch worker for task 4 INFO Executor: Finished task 0.0 in stage 2.0 (TID 4). 1340 bytes result sent to driver 12:13:20.864 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 7 12:13:20.865 Executor task launch worker for task 7 INFO Executor: Running task 1.0 in stage 3.0 (TID 7) 12:13:20.868 Executor task launch worker for task 7 INFO TorrentBroadcast: Started reading broadcast variable 5 with 1 pieces (estimated total size 4.0 MiB) 12:13:20.878 Executor task launch worker for task 7 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 4.9 KiB, free 546.3 MiB) 12:13:20.881 Executor task launch worker for task 7 INFO TorrentBroadcast: Reading broadcast variable 5 took 12 ms 12:13:20.883 Executor task launch worker for task 7 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 9.4 KiB, free 546.3 MiB) 12:13:20.889 Executor task launch worker for task 7 INFO TorrentBroadcast: Started reading broadcast variable 4 with 1 pieces (estimated total size 4.0 MiB) 12:13:20.894 Executor task launch worker for task 7 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 222.0 B, free 546.3 MiB) 12:13:20.897 Executor task launch worker for task 7 INFO TorrentBroadcast: Reading broadcast variable 4 took 7 ms 12:13:20.902 Executor task launch worker for task 7 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 120.0 B, free 546.3 MiB) 12:13:20.921 Executor task launch worker for task 7 INFO Executor: Finished task 1.0 in stage 3.0 (TID 7). 1815 bytes result sent to driver 12:13:20.968 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 8 12:13:20.969 Executor task launch worker for task 8 INFO Executor: Running task 0.0 in stage 4.0 (TID 8) 12:13:20.971 Executor task launch worker for task 8 INFO TorrentBroadcast: Started reading broadcast variable 6 with 1 pieces (estimated total size 4.0 MiB) 12:13:20.977 Executor task launch worker for task 8 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 546.3 MiB) 12:13:20.980 Executor task launch worker for task 8 INFO TorrentBroadcast: Reading broadcast variable 6 took 8 ms 12:13:20.982 Executor task launch worker for task 8 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 4.4 KiB, free 546.3 MiB) 12:13:20.986 Executor task launch worker for task 8 INFO Executor: Finished task 0.0 in stage 4.0 (TID 8). 1340 bytes result sent to driver 12:13:21.014 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 11 12:13:21.015 Executor task launch worker for task 11 INFO Executor: Running task 1.0 in stage 5.0 (TID 11) 12:13:21.020 Executor task launch worker for task 11 INFO TorrentBroadcast: Started reading broadcast variable 8 with 1 pieces (estimated total size 4.0 MiB) 12:13:21.028 Executor task launch worker for task 11 INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 4.8 KiB, free 546.2 MiB) 12:13:21.030 Executor task launch worker for task 11 INFO TorrentBroadcast: Reading broadcast variable 8 took 9 ms 12:13:21.036 Executor task launch worker for task 11 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 9.4 KiB, free 546.2 MiB) 12:13:21.045 Executor task launch worker for task 11 INFO TorrentBroadcast: Started reading broadcast variable 7 with 1 pieces (estimated total size 4.0 MiB) 12:13:21.051 Executor task launch worker for task 11 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 222.0 B, free 546.2 MiB) 12:13:21.054 Executor task launch worker for task 11 INFO TorrentBroadcast: Reading broadcast variable 7 took 8 ms 12:13:21.058 Executor task launch worker for task 11 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 120.0 B, free 546.2 MiB) 12:13:21.078 Executor task launch worker for task 11 INFO CodeGenerator: Code generated in 12.275902 ms 12:13:21.085 Executor task launch worker for task 11 INFO Executor: Finished task 1.0 in stage 5.0 (TID 11). 1781 bytes result sent to driver 12:13:22.380 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 12 12:13:22.381 Executor task launch worker for task 12 INFO Executor: Running task 0.0 in stage 6.0 (TID 12) 12:13:22.394 Executor task launch worker for task 12 INFO TorrentBroadcast: Started reading broadcast variable 9 with 1 pieces (estimated total size 4.0 MiB) 12:13:22.403 Executor task launch worker for task 12 INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 6.2 KiB, free 546.3 MiB) 12:13:22.406 Executor task launch worker for task 12 INFO TorrentBroadcast: Reading broadcast variable 9 took 12 ms 12:13:22.409 Executor task launch worker for task 12 INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 12.8 KiB, free 546.3 MiB) 12:13:22.575 Executor task launch worker for task 12 INFO CodeGenerator: Code generated in 41.0946 ms 12:13:27.357 dispatcher-Executor INFO Executor: Executor is trying to kill task 0.0 in stage 6.0 (TID 12), reason: Stage cancelled 12:13:27.359 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver commanded a shutdown 12:13:27.360 SIGTERM handler ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM 12:13:27.360 Executor task launch worker for task 12 INFO Executor: Executor interrupted and killed task 0.0 in stage 6.0 (TID 12), reason: Stage cancelled 12:13:27.361 dispatcher-event-loop-1 ERROR WorkerWatcher: Lost connection to worker rpc endpoint spark://Worker@amp-jenkins-worker-04.amp:46023. Exiting. 12:13:27.361 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver from amp-jenkins-worker-04.amp:46023 disconnected during shutdown 12:13:27.364 shutdown-hook-0 INFO DiskBlockManager: Shutdown hook called 12:13:27.374 shutdown-hook-0 INFO ShutdownHookManager: Shutdown hook called 12:13:27.380 CoarseGrainedExecutorBackend-stop-executor INFO MemoryStore: MemoryStore cleared 12:13:27.380 CoarseGrainedExecutorBackend-stop-executor INFO BlockManager: BlockManager stopped