12:13:28.603 main INFO CoarseGrainedExecutorBackend: Started daemon with process name: 31943@amp-jenkins-worker-04 12:13:28.610 main INFO SignalUtils: Registering signal handler for TERM 12:13:28.611 main INFO SignalUtils: Registering signal handler for HUP 12:13:28.611 main INFO SignalUtils: Registering signal handler for INT 12:13:28.981 main WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 12:13:29.085 main INFO SecurityManager: Changing view acls to: jenkins 12:13:29.085 main INFO SecurityManager: Changing modify acls to: jenkins 12:13:29.086 main INFO SecurityManager: Changing view acls groups to: 12:13:29.087 main INFO SecurityManager: Changing modify acls groups to: 12:13:29.087 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 12:13:29.481 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:34347 after 80 ms (0 ms spent in bootstraps) 12:13:29.576 main INFO SecurityManager: Changing view acls to: jenkins 12:13:29.576 main INFO SecurityManager: Changing modify acls to: jenkins 12:13:29.576 main INFO SecurityManager: Changing view acls groups to: 12:13:29.576 main INFO SecurityManager: Changing modify acls groups to: 12:13:29.577 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 12:13:29.631 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:34347 after 2 ms (0 ms spent in bootstraps) 12:13:29.684 main INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-b35d5202-1788-428e-88d8-d2d00e91cd96/executor-0c1be59c-ca69-449a-9365-2974acd7db15/blockmgr-fe01ad74-b2c2-4c58-aa0a-1d13d405616e 12:13:29.757 main INFO MemoryStore: MemoryStore started with capacity 546.3 MiB 12:13:29.948 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Registering PWR handler. 12:13:29.948 dispatcher-Executor INFO SignalUtils: Registering signal handler for PWR 12:13:29.949 main INFO WorkerWatcher: Connecting to worker spark://Worker@amp-jenkins-worker-04.amp:37996 12:13:29.949 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Connecting to driver: spark://CoarseGrainedScheduler@amp-jenkins-worker-04.amp:34347 12:13:29.952 netty-rpc-connection-1 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:37996 after 1 ms (0 ms spent in bootstraps) 12:13:29.956 dispatcher-event-loop-1 INFO WorkerWatcher: Successfully connected to spark://Worker@amp-jenkins-worker-04.amp:37996 12:13:29.963 dispatcher-Executor INFO ResourceUtils: ============================================================== 12:13:29.964 dispatcher-Executor INFO ResourceUtils: No custom resources configured for spark.executor. 12:13:29.964 dispatcher-Executor INFO ResourceUtils: ============================================================== 12:13:29.986 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Successfully registered with driver 12:13:29.989 dispatcher-Executor INFO Executor: Starting executor ID 1 on host amp-jenkins-worker-04.amp 12:13:30.073 dispatcher-Executor INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 39759. 12:13:30.074 dispatcher-Executor INFO NettyBlockTransferService: Server created on amp-jenkins-worker-04.amp:39759 12:13:30.076 dispatcher-Executor INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 12:13:30.084 dispatcher-Executor INFO BlockManagerMaster: Registering BlockManager BlockManagerId(1, amp-jenkins-worker-04.amp, 39759, None) 12:13:30.092 dispatcher-Executor INFO BlockManagerMaster: Registered BlockManager BlockManagerId(1, amp-jenkins-worker-04.amp, 39759, None) 12:13:30.092 dispatcher-Executor INFO BlockManager: Initialized BlockManager: BlockManagerId(1, amp-jenkins-worker-04.amp, 39759, None) 12:13:30.137 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 1 12:13:30.147 Executor task launch worker for task 1 INFO Executor: Running task 1.0 in stage 0.0 (TID 1) 12:13:30.293 Executor task launch worker for task 1 INFO TorrentBroadcast: Started reading broadcast variable 0 with 1 pieces (estimated total size 4.0 MiB) 12:13:30.337 Executor task launch worker for task 1 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:39302 after 1 ms (0 ms spent in bootstraps) 12:13:30.361 Executor task launch worker for task 1 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 546.3 MiB) 12:13:30.370 Executor task launch worker for task 1 INFO TorrentBroadcast: Reading broadcast variable 0 took 76 ms 12:13:30.628 Executor task launch worker for task 1 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 4.4 KiB, free 546.3 MiB) 12:13:31.105 Executor task launch worker for task 1 INFO Executor: Finished task 1.0 in stage 0.0 (TID 1). 1430 bytes result sent to driver 12:13:31.163 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 2 12:13:31.163 Executor task launch worker for task 2 INFO Executor: Running task 0.0 in stage 1.0 (TID 2) 12:13:31.168 Executor task launch worker for task 2 INFO TorrentBroadcast: Started reading broadcast variable 2 with 1 pieces (estimated total size 4.0 MiB) 12:13:31.174 Executor task launch worker for task 2 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 4.8 KiB, free 546.3 MiB) 12:13:31.176 Executor task launch worker for task 2 INFO TorrentBroadcast: Reading broadcast variable 2 took 7 ms 12:13:31.178 Executor task launch worker for task 2 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 9.4 KiB, free 546.3 MiB) 12:13:31.248 Executor task launch worker for task 2 INFO TorrentBroadcast: Started reading broadcast variable 1 with 1 pieces (estimated total size 4.0 MiB) 12:13:31.254 Executor task launch worker for task 2 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 222.0 B, free 546.3 MiB) 12:13:31.256 Executor task launch worker for task 2 INFO TorrentBroadcast: Reading broadcast variable 1 took 7 ms 12:13:31.269 Executor task launch worker for task 2 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 120.0 B, free 546.3 MiB) 12:13:31.760 Executor task launch worker for task 2 INFO CodeGenerator: Code generated in 256.200147 ms 12:13:31.796 Executor task launch worker for task 2 INFO CodeGenerator: Code generated in 23.644917 ms 12:13:31.823 Executor task launch worker for task 2 INFO CodeGenerator: Code generated in 12.380479 ms 12:13:31.830 Executor task launch worker for task 2 INFO Executor: Finished task 0.0 in stage 1.0 (TID 2). 1814 bytes result sent to driver 12:13:31.907 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 4 12:13:31.907 Executor task launch worker for task 4 INFO Executor: Running task 0.0 in stage 2.0 (TID 4) 12:13:31.913 Executor task launch worker for task 4 INFO TorrentBroadcast: Started reading broadcast variable 3 with 1 pieces (estimated total size 4.0 MiB) 12:13:31.920 Executor task launch worker for task 4 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 546.3 MiB) 12:13:31.922 Executor task launch worker for task 4 INFO TorrentBroadcast: Reading broadcast variable 3 took 8 ms 12:13:31.924 Executor task launch worker for task 4 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.4 KiB, free 546.3 MiB) 12:13:31.929 Executor task launch worker for task 4 INFO Executor: Finished task 0.0 in stage 2.0 (TID 4). 1340 bytes result sent to driver 12:13:31.950 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 6 12:13:31.950 Executor task launch worker for task 6 INFO Executor: Running task 0.0 in stage 3.0 (TID 6) 12:13:31.955 Executor task launch worker for task 6 INFO TorrentBroadcast: Started reading broadcast variable 5 with 1 pieces (estimated total size 4.0 MiB) 12:13:31.964 Executor task launch worker for task 6 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 4.9 KiB, free 546.3 MiB) 12:13:31.966 Executor task launch worker for task 6 INFO TorrentBroadcast: Reading broadcast variable 5 took 10 ms 12:13:31.970 Executor task launch worker for task 6 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 9.4 KiB, free 546.3 MiB) 12:13:31.977 Executor task launch worker for task 6 INFO TorrentBroadcast: Started reading broadcast variable 4 with 1 pieces (estimated total size 4.0 MiB) 12:13:32.024 Executor task launch worker for task 6 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 222.0 B, free 546.3 MiB) 12:13:32.027 Executor task launch worker for task 6 INFO TorrentBroadcast: Reading broadcast variable 4 took 12 ms 12:13:32.030 Executor task launch worker for task 6 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 120.0 B, free 546.3 MiB) 12:13:32.049 Executor task launch worker for task 6 INFO Executor: Finished task 0.0 in stage 3.0 (TID 6). 1814 bytes result sent to driver 12:13:32.096 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 9 12:13:32.096 Executor task launch worker for task 9 INFO Executor: Running task 1.0 in stage 4.0 (TID 9) 12:13:32.099 Executor task launch worker for task 9 INFO TorrentBroadcast: Started reading broadcast variable 6 with 1 pieces (estimated total size 4.0 MiB) 12:13:32.106 Executor task launch worker for task 9 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 546.3 MiB) 12:13:32.108 Executor task launch worker for task 9 INFO TorrentBroadcast: Reading broadcast variable 6 took 9 ms 12:13:32.112 Executor task launch worker for task 9 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 4.4 KiB, free 546.3 MiB) 12:13:32.122 Executor task launch worker for task 9 INFO Executor: Finished task 1.0 in stage 4.0 (TID 9). 1344 bytes result sent to driver 12:13:32.150 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 10 12:13:32.151 Executor task launch worker for task 10 INFO Executor: Running task 0.0 in stage 5.0 (TID 10) 12:13:32.154 Executor task launch worker for task 10 INFO TorrentBroadcast: Started reading broadcast variable 8 with 1 pieces (estimated total size 4.0 MiB) 12:13:32.165 Executor task launch worker for task 10 INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 4.9 KiB, free 546.2 MiB) 12:13:32.169 Executor task launch worker for task 10 INFO TorrentBroadcast: Reading broadcast variable 8 took 14 ms 12:13:32.173 Executor task launch worker for task 10 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 9.4 KiB, free 546.2 MiB) 12:13:32.180 Executor task launch worker for task 10 INFO TorrentBroadcast: Started reading broadcast variable 7 with 1 pieces (estimated total size 4.0 MiB) 12:13:32.186 Executor task launch worker for task 10 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:42028 after 1 ms (0 ms spent in bootstraps) 12:13:32.206 Executor task launch worker for task 10 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 222.0 B, free 546.2 MiB) 12:13:32.209 Executor task launch worker for task 10 INFO TorrentBroadcast: Reading broadcast variable 7 took 28 ms 12:13:32.213 Executor task launch worker for task 10 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 120.0 B, free 546.2 MiB) 12:13:32.236 Executor task launch worker for task 10 INFO CodeGenerator: Code generated in 13.022209 ms 12:13:32.242 Executor task launch worker for task 10 INFO Executor: Finished task 0.0 in stage 5.0 (TID 10). 1807 bytes result sent to driver 12:13:33.497 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 12 12:13:33.498 Executor task launch worker for task 12 INFO Executor: Running task 0.0 in stage 6.0 (TID 12) 12:13:33.508 Executor task launch worker for task 12 INFO TorrentBroadcast: Started reading broadcast variable 9 with 1 pieces (estimated total size 4.0 MiB) 12:13:33.518 Executor task launch worker for task 12 INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 6.2 KiB, free 546.3 MiB) 12:13:33.521 Executor task launch worker for task 12 INFO TorrentBroadcast: Reading broadcast variable 9 took 13 ms 12:13:33.526 Executor task launch worker for task 12 INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 12.8 KiB, free 546.3 MiB) 12:13:33.685 Executor task launch worker for task 12 INFO CodeGenerator: Code generated in 48.226167 ms 12:13:38.488 dispatcher-Executor INFO Executor: Executor is trying to kill task 0.0 in stage 6.0 (TID 12), reason: Stage cancelled 12:13:38.489 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver commanded a shutdown 12:13:38.491 Executor task launch worker for task 12 INFO Executor: Executor interrupted and killed task 0.0 in stage 6.0 (TID 12), reason: Stage cancelled 12:13:38.492 SIGTERM handler ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM 12:13:38.496 shutdown-hook-0 INFO DiskBlockManager: Shutdown hook called 12:13:38.501 dispatcher-event-loop-1 ERROR WorkerWatcher: Lost connection to worker rpc endpoint spark://Worker@amp-jenkins-worker-04.amp:37996. Exiting. 12:13:38.501 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver from amp-jenkins-worker-04.amp:37996 disconnected during shutdown 12:13:38.505 shutdown-hook-0 INFO ShutdownHookManager: Shutdown hook called 12:13:38.510 CoarseGrainedExecutorBackend-stop-executor INFO MemoryStore: MemoryStore cleared 12:13:38.511 CoarseGrainedExecutorBackend-stop-executor INFO BlockManager: BlockManager stopped