12:13:17.597 main INFO CoarseGrainedExecutorBackend: Started daemon with process name: 30360@amp-jenkins-worker-04 12:13:17.605 main INFO SignalUtils: Registering signal handler for TERM 12:13:17.606 main INFO SignalUtils: Registering signal handler for HUP 12:13:17.606 main INFO SignalUtils: Registering signal handler for INT 12:13:17.989 main WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 12:13:18.083 main INFO SecurityManager: Changing view acls to: jenkins 12:13:18.083 main INFO SecurityManager: Changing modify acls to: jenkins 12:13:18.084 main INFO SecurityManager: Changing view acls groups to: 12:13:18.085 main INFO SecurityManager: Changing modify acls groups to: 12:13:18.085 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 12:13:18.494 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:37358 after 78 ms (0 ms spent in bootstraps) 12:13:18.597 main INFO SecurityManager: Changing view acls to: jenkins 12:13:18.598 main INFO SecurityManager: Changing modify acls to: jenkins 12:13:18.598 main INFO SecurityManager: Changing view acls groups to: 12:13:18.598 main INFO SecurityManager: Changing modify acls groups to: 12:13:18.598 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 12:13:18.655 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:37358 after 2 ms (0 ms spent in bootstraps) 12:13:18.712 main INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-b35d5202-1788-428e-88d8-d2d00e91cd96/executor-90d40cce-a38b-4dd9-9138-81a6b18ced03/blockmgr-54130adb-13f6-4939-adf6-8b69569732e2 12:13:18.757 main INFO MemoryStore: MemoryStore started with capacity 546.3 MiB 12:13:18.958 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Registering PWR handler. 12:13:18.958 dispatcher-Executor INFO SignalUtils: Registering signal handler for PWR 12:13:18.959 main INFO WorkerWatcher: Connecting to worker spark://Worker@amp-jenkins-worker-04.amp:33877 12:13:18.959 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Connecting to driver: spark://CoarseGrainedScheduler@amp-jenkins-worker-04.amp:37358 12:13:18.962 netty-rpc-connection-1 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:33877 after 2 ms (0 ms spent in bootstraps) 12:13:18.965 dispatcher-event-loop-0 INFO WorkerWatcher: Successfully connected to spark://Worker@amp-jenkins-worker-04.amp:33877 12:13:18.977 dispatcher-Executor INFO ResourceUtils: ============================================================== 12:13:18.978 dispatcher-Executor INFO ResourceUtils: No custom resources configured for spark.executor. 12:13:18.978 dispatcher-Executor INFO ResourceUtils: ============================================================== 12:13:19.005 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Successfully registered with driver 12:13:19.009 dispatcher-Executor INFO Executor: Starting executor ID 1 on host amp-jenkins-worker-04.amp 12:13:19.098 dispatcher-Executor INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 46004. 12:13:19.098 dispatcher-Executor INFO NettyBlockTransferService: Server created on amp-jenkins-worker-04.amp:46004 12:13:19.100 dispatcher-Executor INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 12:13:19.108 dispatcher-Executor INFO BlockManagerMaster: Registering BlockManager BlockManagerId(1, amp-jenkins-worker-04.amp, 46004, None) 12:13:19.116 dispatcher-Executor INFO BlockManagerMaster: Registered BlockManager BlockManagerId(1, amp-jenkins-worker-04.amp, 46004, None) 12:13:19.117 dispatcher-Executor INFO BlockManager: Initialized BlockManager: BlockManagerId(1, amp-jenkins-worker-04.amp, 46004, None) 12:13:19.159 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 0 12:13:19.170 Executor task launch worker for task 0 INFO Executor: Running task 0.0 in stage 0.0 (TID 0) 12:13:19.310 Executor task launch worker for task 0 INFO TorrentBroadcast: Started reading broadcast variable 0 with 1 pieces (estimated total size 4.0 MiB) 12:13:19.351 Executor task launch worker for task 0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:35814 after 2 ms (0 ms spent in bootstraps) 12:13:19.376 Executor task launch worker for task 0 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 546.3 MiB) 12:13:19.387 Executor task launch worker for task 0 INFO TorrentBroadcast: Reading broadcast variable 0 took 76 ms 12:13:19.634 Executor task launch worker for task 0 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 4.4 KiB, free 546.3 MiB) 12:13:20.040 Executor task launch worker for task 0 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1426 bytes result sent to driver 12:13:20.102 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 3 12:13:20.103 Executor task launch worker for task 3 INFO Executor: Running task 1.0 in stage 1.0 (TID 3) 12:13:20.108 Executor task launch worker for task 3 INFO TorrentBroadcast: Started reading broadcast variable 2 with 1 pieces (estimated total size 4.0 MiB) 12:13:20.115 Executor task launch worker for task 3 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 4.8 KiB, free 546.3 MiB) 12:13:20.117 Executor task launch worker for task 3 INFO TorrentBroadcast: Reading broadcast variable 2 took 8 ms 12:13:20.120 Executor task launch worker for task 3 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 9.4 KiB, free 546.3 MiB) 12:13:20.195 Executor task launch worker for task 3 INFO TorrentBroadcast: Started reading broadcast variable 1 with 1 pieces (estimated total size 4.0 MiB) 12:13:20.202 Executor task launch worker for task 3 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 222.0 B, free 546.3 MiB) 12:13:20.204 Executor task launch worker for task 3 INFO TorrentBroadcast: Reading broadcast variable 1 took 8 ms 12:13:20.218 Executor task launch worker for task 3 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 120.0 B, free 546.3 MiB) 12:13:20.688 Executor task launch worker for task 3 INFO CodeGenerator: Code generated in 235.669849 ms 12:13:20.721 Executor task launch worker for task 3 INFO CodeGenerator: Code generated in 20.517288 ms 12:13:20.743 Executor task launch worker for task 3 INFO CodeGenerator: Code generated in 9.343539 ms 12:13:20.748 Executor task launch worker for task 3 INFO Executor: Finished task 1.0 in stage 1.0 (TID 3). 1781 bytes result sent to driver 12:13:20.822 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 5 12:13:20.822 Executor task launch worker for task 5 INFO Executor: Running task 1.0 in stage 2.0 (TID 5) 12:13:20.826 Executor task launch worker for task 5 INFO TorrentBroadcast: Started reading broadcast variable 3 with 1 pieces (estimated total size 4.0 MiB) 12:13:20.833 Executor task launch worker for task 5 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 546.3 MiB) 12:13:20.835 Executor task launch worker for task 5 INFO TorrentBroadcast: Reading broadcast variable 3 took 8 ms 12:13:20.838 Executor task launch worker for task 5 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.4 KiB, free 546.3 MiB) 12:13:20.843 Executor task launch worker for task 5 INFO Executor: Finished task 1.0 in stage 2.0 (TID 5). 1344 bytes result sent to driver 12:13:20.865 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 6 12:13:20.865 Executor task launch worker for task 6 INFO Executor: Running task 0.0 in stage 3.0 (TID 6) 12:13:20.869 Executor task launch worker for task 6 INFO TorrentBroadcast: Started reading broadcast variable 5 with 1 pieces (estimated total size 4.0 MiB) 12:13:20.879 Executor task launch worker for task 6 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 4.9 KiB, free 546.3 MiB) 12:13:20.881 Executor task launch worker for task 6 INFO TorrentBroadcast: Reading broadcast variable 5 took 12 ms 12:13:20.884 Executor task launch worker for task 6 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 9.4 KiB, free 546.3 MiB) 12:13:20.889 Executor task launch worker for task 6 INFO TorrentBroadcast: Started reading broadcast variable 4 with 1 pieces (estimated total size 4.0 MiB) 12:13:20.895 Executor task launch worker for task 6 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 222.0 B, free 546.3 MiB) 12:13:20.898 Executor task launch worker for task 6 INFO TorrentBroadcast: Reading broadcast variable 4 took 8 ms 12:13:20.902 Executor task launch worker for task 6 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 120.0 B, free 546.3 MiB) 12:13:20.922 Executor task launch worker for task 6 INFO Executor: Finished task 0.0 in stage 3.0 (TID 6). 1814 bytes result sent to driver 12:13:20.968 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 9 12:13:20.969 Executor task launch worker for task 9 INFO Executor: Running task 1.0 in stage 4.0 (TID 9) 12:13:20.971 Executor task launch worker for task 9 INFO TorrentBroadcast: Started reading broadcast variable 6 with 1 pieces (estimated total size 4.0 MiB) 12:13:20.978 Executor task launch worker for task 9 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 546.3 MiB) 12:13:20.980 Executor task launch worker for task 9 INFO TorrentBroadcast: Reading broadcast variable 6 took 8 ms 12:13:20.982 Executor task launch worker for task 9 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 4.4 KiB, free 546.3 MiB) 12:13:20.986 Executor task launch worker for task 9 INFO Executor: Finished task 1.0 in stage 4.0 (TID 9). 1344 bytes result sent to driver 12:13:21.013 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 10 12:13:21.014 Executor task launch worker for task 10 INFO Executor: Running task 0.0 in stage 5.0 (TID 10) 12:13:21.019 Executor task launch worker for task 10 INFO TorrentBroadcast: Started reading broadcast variable 8 with 1 pieces (estimated total size 4.0 MiB) 12:13:21.029 Executor task launch worker for task 10 INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 4.8 KiB, free 546.2 MiB) 12:13:21.034 Executor task launch worker for task 10 INFO TorrentBroadcast: Reading broadcast variable 8 took 14 ms 12:13:21.039 Executor task launch worker for task 10 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 9.4 KiB, free 546.2 MiB) 12:13:21.047 Executor task launch worker for task 10 INFO TorrentBroadcast: Started reading broadcast variable 7 with 1 pieces (estimated total size 4.0 MiB) 12:13:21.054 Executor task launch worker for task 10 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 222.0 B, free 546.2 MiB) 12:13:21.056 Executor task launch worker for task 10 INFO TorrentBroadcast: Reading broadcast variable 7 took 8 ms 12:13:21.059 Executor task launch worker for task 10 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 120.0 B, free 546.2 MiB) 12:13:21.079 Executor task launch worker for task 10 INFO CodeGenerator: Code generated in 11.818257 ms 12:13:21.085 Executor task launch worker for task 10 INFO Executor: Finished task 0.0 in stage 5.0 (TID 10). 1807 bytes result sent to driver 12:13:22.380 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 13 12:13:22.380 Executor task launch worker for task 13 INFO Executor: Running task 1.0 in stage 6.0 (TID 13) 12:13:22.394 Executor task launch worker for task 13 INFO TorrentBroadcast: Started reading broadcast variable 9 with 1 pieces (estimated total size 4.0 MiB) 12:13:22.402 Executor task launch worker for task 13 INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 6.2 KiB, free 546.3 MiB) 12:13:22.406 Executor task launch worker for task 13 INFO TorrentBroadcast: Reading broadcast variable 9 took 12 ms 12:13:22.408 Executor task launch worker for task 13 INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 12.8 KiB, free 546.3 MiB) 12:13:22.575 Executor task launch worker for task 13 INFO CodeGenerator: Code generated in 40.936631 ms 12:13:27.358 dispatcher-Executor INFO Executor: Executor is trying to kill task 1.0 in stage 6.0 (TID 13), reason: Stage cancelled 12:13:27.359 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver commanded a shutdown 12:13:27.361 SIGTERM handler ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM 12:13:27.361 Executor task launch worker for task 13 INFO Executor: Executor interrupted and killed task 1.0 in stage 6.0 (TID 13), reason: Stage cancelled 12:13:27.366 shutdown-hook-0 INFO DiskBlockManager: Shutdown hook called 12:13:27.368 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver from amp-jenkins-worker-04.amp:33877 disconnected during shutdown 12:13:27.368 dispatcher-event-loop-0 ERROR WorkerWatcher: Lost connection to worker rpc endpoint spark://Worker@amp-jenkins-worker-04.amp:33877. Exiting. 12:13:27.375 shutdown-hook-0 INFO ShutdownHookManager: Shutdown hook called 12:13:27.399 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver from amp-jenkins-worker-04.amp:37358 disconnected during shutdown 12:13:27.400 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver from amp-jenkins-worker-04.amp:37358 disconnected during shutdown 12:13:27.400 CoarseGrainedExecutorBackend-stop-executor INFO MemoryStore: MemoryStore cleared 12:13:27.400 CoarseGrainedExecutorBackend-stop-executor INFO BlockManager: BlockManager stopped