19/12/27 06:44:08.980 main INFO CoarseGrainedExecutorBackend: Started daemon with process name: 135172@amp-jenkins-worker-05 19/12/27 06:44:08.989 main INFO SignalUtils: Registered signal handler for TERM 19/12/27 06:44:08.990 main INFO SignalUtils: Registered signal handler for HUP 19/12/27 06:44:08.990 main INFO SignalUtils: Registered signal handler for INT 19/12/27 06:44:09.492 main WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 19/12/27 06:44:09.589 main INFO SecurityManager: Changing view acls to: jenkins 19/12/27 06:44:09.590 main INFO SecurityManager: Changing modify acls to: jenkins 19/12/27 06:44:09.590 main INFO SecurityManager: Changing view acls groups to: 19/12/27 06:44:09.591 main INFO SecurityManager: Changing modify acls groups to: 19/12/27 06:44:09.591 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 19/12/27 06:44:10.017 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-05.amp/192.168.10.25:34005 after 76 ms (0 ms spent in bootstraps) 19/12/27 06:44:10.097 main INFO SecurityManager: Changing view acls to: jenkins 19/12/27 06:44:10.097 main INFO SecurityManager: Changing modify acls to: jenkins 19/12/27 06:44:10.097 main INFO SecurityManager: Changing view acls groups to: 19/12/27 06:44:10.097 main INFO SecurityManager: Changing modify acls groups to: 19/12/27 06:44:10.098 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 19/12/27 06:44:10.192 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-05.amp/192.168.10.25:34005 after 2 ms (0 ms spent in bootstraps) 19/12/27 06:44:10.246 main INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-6e9e4417-1262-4550-9cbb-1aa31fd88268/executor-ce33c788-b1be-4402-9add-5de55ddf9775/blockmgr-6aa980a7-e462-4ca3-b223-a344ce5cb4de 19/12/27 06:44:10.279 main INFO MemoryStore: MemoryStore started with capacity 366.3 MiB 19/12/27 06:44:10.471 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Connecting to driver: spark://CoarseGrainedScheduler@amp-jenkins-worker-05.amp:34005 19/12/27 06:44:10.472 main INFO WorkerWatcher: Connecting to worker spark://Worker@amp-jenkins-worker-05.amp:42228 19/12/27 06:44:10.475 netty-rpc-connection-1 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-05.amp/192.168.10.25:42228 after 1 ms (0 ms spent in bootstraps) 19/12/27 06:44:10.478 dispatcher-event-loop-1 INFO WorkerWatcher: Successfully connected to spark://Worker@amp-jenkins-worker-05.amp:42228 19/12/27 06:44:10.501 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Successfully registered with driver 19/12/27 06:44:10.504 dispatcher-Executor INFO Executor: Starting executor ID 0 on host amp-jenkins-worker-05.amp 19/12/27 06:44:10.582 dispatcher-Executor INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 42523. 19/12/27 06:44:10.583 dispatcher-Executor INFO NettyBlockTransferService: Server created on amp-jenkins-worker-05.amp:42523 19/12/27 06:44:10.584 dispatcher-Executor INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 19/12/27 06:44:10.591 dispatcher-Executor INFO BlockManagerMaster: Registering BlockManager BlockManagerId(0, amp-jenkins-worker-05.amp, 42523, None) 19/12/27 06:44:10.598 dispatcher-Executor INFO BlockManagerMaster: Registered BlockManager BlockManagerId(0, amp-jenkins-worker-05.amp, 42523, None) 19/12/27 06:44:10.599 dispatcher-Executor INFO BlockManager: external shuffle service port = 44898 19/12/27 06:44:10.600 dispatcher-Executor INFO BlockManager: Registering executor with local external shuffle service. 19/12/27 06:44:10.605 dispatcher-Executor INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-05.amp/192.168.10.25:44898 after 1 ms (0 ms spent in bootstraps) 19/12/27 06:44:10.609 dispatcher-Executor INFO BlockManager: Initialized BlockManager: BlockManagerId(0, amp-jenkins-worker-05.amp, 42523, None) 19/12/27 06:44:10.641 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 1 19/12/27 06:44:10.647 Executor task launch worker for task 1 INFO Executor: Running task 1.0 in stage 0.0 (TID 1) 19/12/27 06:44:11.203 Executor task launch worker for task 1 INFO TorrentBroadcast: Started reading broadcast variable 0 with 1 pieces (estimated total size 4.0 MiB) 19/12/27 06:44:11.238 Executor task launch worker for task 1 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-05.amp/192.168.10.25:40549 after 2 ms (0 ms spent in bootstraps) 19/12/27 06:44:11.281 Executor task launch worker for task 1 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 3.4 KiB, free 366.3 MiB) 19/12/27 06:44:11.292 Executor task launch worker for task 1 INFO TorrentBroadcast: Reading broadcast variable 0 took 88 ms 19/12/27 06:44:11.408 Executor task launch worker for task 1 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 6.7 KiB, free 366.3 MiB) 19/12/27 06:44:11.849 Executor task launch worker for task 1 INFO Executor: Finished task 1.0 in stage 0.0 (TID 1). 1023 bytes result sent to driver 19/12/27 06:44:11.875 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 3 19/12/27 06:44:11.876 Executor task launch worker for task 3 INFO Executor: Running task 1.0 in stage 1.0 (TID 3) 19/12/27 06:44:11.883 Executor task launch worker for task 3 INFO TorrentBroadcast: Started reading broadcast variable 1 with 1 pieces (estimated total size 4.0 MiB) 19/12/27 06:44:11.887 Executor task launch worker for task 3 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-05.amp/192.168.10.25:42830 after 1 ms (0 ms spent in bootstraps) 19/12/27 06:44:11.890 Executor task launch worker for task 3 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 4.3 KiB, free 366.3 MiB) 19/12/27 06:44:11.895 Executor task launch worker for task 3 INFO TorrentBroadcast: Reading broadcast variable 1 took 12 ms 19/12/27 06:44:11.898 Executor task launch worker for task 3 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 8.0 KiB, free 366.3 MiB) 19/12/27 06:44:11.970 Executor task launch worker for task 3 INFO Executor: Finished task 1.0 in stage 1.0 (TID 3). 966 bytes result sent to driver 19/12/27 06:44:11.992 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 4 19/12/27 06:44:11.992 Executor task launch worker for task 4 INFO Executor: Running task 0.0 in stage 2.0 (TID 4) 19/12/27 06:44:11.996 Executor task launch worker for task 4 INFO MapOutputTrackerWorker: Updating epoch to 1 and clearing cache 19/12/27 06:44:11.998 Executor task launch worker for task 4 INFO TorrentBroadcast: Started reading broadcast variable 2 with 1 pieces (estimated total size 4.0 MiB) 19/12/27 06:44:12.004 Executor task launch worker for task 4 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 4.2 KiB, free 366.3 MiB) 19/12/27 06:44:12.006 Executor task launch worker for task 4 INFO TorrentBroadcast: Reading broadcast variable 2 took 7 ms 19/12/27 06:44:12.009 Executor task launch worker for task 4 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 7.9 KiB, free 366.3 MiB) 19/12/27 06:44:12.015 Executor task launch worker for task 4 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 0, fetching them 19/12/27 06:44:12.017 Executor task launch worker for task 4 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@amp-jenkins-worker-05.amp:34005) 19/12/27 06:44:12.037 Executor task launch worker for task 4 INFO MapOutputTrackerWorker: Got the output locations 19/12/27 06:44:12.067 Executor task launch worker for task 4 INFO ShuffleBlockFetcherIterator: Getting 1 (142.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 1 (142.0 B) remote blocks 19/12/27 06:44:12.071 Executor task launch worker for task 4 INFO TransportClientFactory: Found inactive connection to amp-jenkins-worker-05.amp/192.168.10.25:44898, creating a new one. 19/12/27 06:44:12.072 Executor task launch worker for task 4 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-05.amp/192.168.10.25:44898 after 1 ms (0 ms spent in bootstraps) 19/12/27 06:44:12.076 Executor task launch worker for task 4 INFO ShuffleBlockFetcherIterator: Started 1 remote fetches in 18 ms 19/12/27 06:44:12.116 Executor task launch worker for task 4 INFO Executor: Finished task 0.0 in stage 2.0 (TID 4). 1231 bytes result sent to driver 19/12/27 06:44:12.125 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver commanded a shutdown 19/12/27 06:44:12.125 SIGTERM handler ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM 19/12/27 06:44:12.126 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver from amp-jenkins-worker-05.amp:42228 disconnected during shutdown 19/12/27 06:44:12.126 dispatcher-event-loop-1 ERROR WorkerWatcher: Lost connection to worker rpc endpoint spark://Worker@amp-jenkins-worker-05.amp:42228. Exiting. 19/12/27 06:44:12.128 Thread-2 INFO DiskBlockManager: Shutdown hook called 19/12/27 06:44:12.128 Thread-2 INFO ShutdownHookManager: Shutdown hook called