20/06/28 21:40:40.443 main INFO CoarseGrainedExecutorBackend: Started daemon with process name: 816@amp-jenkins-worker-04
20/06/28 21:40:40.450 main INFO SignalUtils: Registering signal handler for TERM
20/06/28 21:40:40.451 main INFO SignalUtils: Registering signal handler for HUP
20/06/28 21:40:40.451 main INFO SignalUtils: Registering signal handler for INT
20/06/28 21:40:40.832 main WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
20/06/28 21:40:40.914 main INFO SecurityManager: Changing view acls to: jenkins
20/06/28 21:40:40.914 main INFO SecurityManager: Changing modify acls to: jenkins
20/06/28 21:40:40.915 main INFO SecurityManager: Changing view acls groups to: 
20/06/28 21:40:40.915 main INFO SecurityManager: Changing modify acls groups to: 
20/06/28 21:40:40.916 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(jenkins); groups with view permissions: Set(); users  with modify permissions: Set(jenkins); groups with modify permissions: Set()
20/06/28 21:40:41.298 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:33831 after 82 ms (0 ms spent in bootstraps)
20/06/28 21:40:41.392 main INFO SecurityManager: Changing view acls to: jenkins
20/06/28 21:40:41.393 main INFO SecurityManager: Changing modify acls to: jenkins
20/06/28 21:40:41.393 main INFO SecurityManager: Changing view acls groups to: 
20/06/28 21:40:41.393 main INFO SecurityManager: Changing modify acls groups to: 
20/06/28 21:40:41.393 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(jenkins); groups with view permissions: Set(); users  with modify permissions: Set(jenkins); groups with modify permissions: Set()
20/06/28 21:40:41.443 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:33831 after 2 ms (0 ms spent in bootstraps)
20/06/28 21:40:41.501 main INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-095bb982-4d6a-4f3b-b20a-d219c3533c62/executor-ccd4677a-c227-41d8-9ce9-730bae2a2438/blockmgr-1d666501-7fcb-40b5-9ac1-054ad56dbc98
20/06/28 21:40:41.542 main INFO MemoryStore: MemoryStore started with capacity 546.3 MiB
20/06/28 21:40:41.721 main INFO WorkerWatcher: Connecting to worker spark://Worker@amp-jenkins-worker-04.amp:44631
20/06/28 21:40:41.721 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Registering PWR handler.
20/06/28 21:40:41.723 dispatcher-Executor INFO SignalUtils: Registering signal handler for PWR
20/06/28 21:40:41.724 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Connecting to driver: spark://CoarseGrainedScheduler@amp-jenkins-worker-04.amp:33831
20/06/28 21:40:41.725 netty-rpc-connection-1 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:44631 after 2 ms (0 ms spent in bootstraps)
20/06/28 21:40:41.728 dispatcher-event-loop-1 INFO WorkerWatcher: Successfully connected to spark://Worker@amp-jenkins-worker-04.amp:44631
20/06/28 21:40:41.737 dispatcher-Executor INFO ResourceUtils: ==============================================================
20/06/28 21:40:41.738 dispatcher-Executor INFO ResourceUtils: No custom resources configured for spark.executor.
20/06/28 21:40:41.738 dispatcher-Executor INFO ResourceUtils: ==============================================================
20/06/28 21:40:41.767 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Successfully registered with driver
20/06/28 21:40:41.770 dispatcher-Executor INFO Executor: Starting executor ID 0 on host amp-jenkins-worker-04.amp
20/06/28 21:40:41.854 dispatcher-Executor INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 36481.
20/06/28 21:40:41.854 dispatcher-Executor INFO NettyBlockTransferService: Server created on amp-jenkins-worker-04.amp:36481
20/06/28 21:40:41.856 dispatcher-Executor INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
20/06/28 21:40:41.864 dispatcher-Executor INFO BlockManagerMaster: Registering BlockManager BlockManagerId(0, amp-jenkins-worker-04.amp, 36481, None)
20/06/28 21:40:41.873 dispatcher-Executor INFO BlockManagerMaster: Registered BlockManager BlockManagerId(0, amp-jenkins-worker-04.amp, 36481, None)
20/06/28 21:40:41.874 dispatcher-Executor INFO BlockManager: Initialized BlockManager: BlockManagerId(0, amp-jenkins-worker-04.amp, 36481, None)
20/06/28 21:40:41.882 dispatcher-Executor INFO Executor: Using REPL class URI: spark://amp-jenkins-worker-04.amp:33831/classes
20/06/28 21:40:41.920 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 0
20/06/28 21:40:41.930 Executor task launch worker for task 0 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
20/06/28 21:40:42.033 Executor task launch worker for task 0 INFO TorrentBroadcast: Started reading broadcast variable 0 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:42.080 Executor task launch worker for task 0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:39011 after 2 ms (0 ms spent in bootstraps)
20/06/28 21:40:42.107 Executor task launch worker for task 0 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 546.3 MiB)
20/06/28 21:40:42.117 Executor task launch worker for task 0 INFO TorrentBroadcast: Reading broadcast variable 0 took 83 ms
20/06/28 21:40:42.272 Executor task launch worker for task 0 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 4.7 KiB, free 546.3 MiB)
20/06/28 21:40:42.398 Executor task launch worker for task 0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:33831 after 1 ms (0 ms spent in bootstraps)
20/06/28 21:40:42.740 Executor task launch worker for task 0 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 923 bytes result sent to driver
20/06/28 21:40:43.704 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 2
20/06/28 21:40:43.705 Executor task launch worker for task 2 INFO Executor: Running task 0.0 in stage 1.0 (TID 2)
20/06/28 21:40:43.718 Executor task launch worker for task 2 INFO TorrentBroadcast: Started reading broadcast variable 1 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:43.734 Executor task launch worker for task 2 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.6 KiB, free 546.3 MiB)
20/06/28 21:40:43.741 Executor task launch worker for task 2 INFO TorrentBroadcast: Reading broadcast variable 1 took 22 ms
20/06/28 21:40:43.746 Executor task launch worker for task 2 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 5.1 KiB, free 546.3 MiB)
20/06/28 21:40:43.814 Executor task launch worker for task 2 INFO Executor: Finished task 0.0 in stage 1.0 (TID 2). 840 bytes result sent to driver
20/06/28 21:40:44.086 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 5
20/06/28 21:40:44.086 Executor task launch worker for task 5 INFO Executor: Running task 1.0 in stage 2.0 (TID 5)
20/06/28 21:40:44.092 Executor task launch worker for task 5 INFO TorrentBroadcast: Started reading broadcast variable 2 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:44.098 Executor task launch worker for task 5 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.6 KiB, free 546.3 MiB)
20/06/28 21:40:44.101 Executor task launch worker for task 5 INFO TorrentBroadcast: Reading broadcast variable 2 took 8 ms
20/06/28 21:40:44.103 Executor task launch worker for task 5 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 5.1 KiB, free 546.3 MiB)
20/06/28 21:40:44.139 Executor task launch worker for task 5 INFO Executor: Finished task 1.0 in stage 2.0 (TID 5). 840 bytes result sent to driver
20/06/28 21:40:44.782 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 7
20/06/28 21:40:44.783 Executor task launch worker for task 7 INFO Executor: Running task 1.0 in stage 3.0 (TID 7)
20/06/28 21:40:44.787 Executor task launch worker for task 7 INFO TorrentBroadcast: Started reading broadcast variable 3 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:44.795 Executor task launch worker for task 7 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 1807.0 B, free 546.3 MiB)
20/06/28 21:40:44.798 Executor task launch worker for task 7 INFO TorrentBroadcast: Reading broadcast variable 3 took 10 ms
20/06/28 21:40:44.800 Executor task launch worker for task 7 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 3.1 KiB, free 546.3 MiB)
20/06/28 21:40:44.821 Executor task launch worker for task 7 INFO Executor: Finished task 1.0 in stage 3.0 (TID 7). 840 bytes result sent to driver
20/06/28 21:40:45.214 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 9
20/06/28 21:40:45.215 Executor task launch worker for task 9 INFO Executor: Running task 1.0 in stage 4.0 (TID 9)
20/06/28 21:40:45.221 Executor task launch worker for task 9 INFO TorrentBroadcast: Started reading broadcast variable 4 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:45.229 Executor task launch worker for task 9 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 2.6 KiB, free 546.3 MiB)
20/06/28 21:40:45.232 Executor task launch worker for task 9 INFO TorrentBroadcast: Reading broadcast variable 4 took 10 ms
20/06/28 21:40:45.234 Executor task launch worker for task 9 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 5.1 KiB, free 546.3 MiB)
20/06/28 21:40:45.282 Executor task launch worker for task 9 INFO Executor: Finished task 1.0 in stage 4.0 (TID 9). 840 bytes result sent to driver
20/06/28 21:40:45.769 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 11
20/06/28 21:40:45.770 Executor task launch worker for task 11 INFO Executor: Running task 1.0 in stage 5.0 (TID 11)
20/06/28 21:40:45.775 Executor task launch worker for task 11 INFO TorrentBroadcast: Started reading broadcast variable 5 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:45.782 Executor task launch worker for task 11 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 2.9 KiB, free 546.3 MiB)
20/06/28 21:40:45.786 Executor task launch worker for task 11 INFO TorrentBroadcast: Reading broadcast variable 5 took 11 ms
20/06/28 21:40:45.788 Executor task launch worker for task 11 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 6.0 KiB, free 546.3 MiB)
20/06/28 21:40:45.864 Executor task launch worker for task 11 INFO Executor: Finished task 1.0 in stage 5.0 (TID 11). 840 bytes result sent to driver
20/06/28 21:40:46.122 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 12
20/06/28 21:40:46.123 Executor task launch worker for task 12 INFO Executor: Running task 0.0 in stage 6.0 (TID 12)
20/06/28 21:40:46.126 Executor task launch worker for task 12 INFO TorrentBroadcast: Started reading broadcast variable 6 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:46.132 Executor task launch worker for task 12 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 2.9 KiB, free 546.3 MiB)
20/06/28 21:40:46.137 Executor task launch worker for task 12 INFO TorrentBroadcast: Reading broadcast variable 6 took 10 ms
20/06/28 21:40:46.139 Executor task launch worker for task 12 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 6.0 KiB, free 546.3 MiB)
20/06/28 21:40:46.163 Executor task launch worker for task 12 INFO Executor: Finished task 0.0 in stage 6.0 (TID 12). 840 bytes result sent to driver
20/06/28 21:40:46.775 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 14
20/06/28 21:40:46.776 Executor task launch worker for task 14 INFO Executor: Running task 0.0 in stage 7.0 (TID 14)
20/06/28 21:40:46.780 Executor task launch worker for task 14 INFO TorrentBroadcast: Started reading broadcast variable 8 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:46.786 Executor task launch worker for task 14 INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 546.3 MiB)
20/06/28 21:40:46.790 Executor task launch worker for task 14 INFO TorrentBroadcast: Reading broadcast variable 8 took 10 ms
20/06/28 21:40:46.794 Executor task launch worker for task 14 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 6.6 KiB, free 546.3 MiB)
20/06/28 21:40:46.889 Executor task launch worker for task 14 INFO TorrentBroadcast: Started reading broadcast variable 7 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:46.898 Executor task launch worker for task 14 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 80.0 B, free 546.3 MiB)
20/06/28 21:40:46.901 Executor task launch worker for task 14 INFO TorrentBroadcast: Reading broadcast variable 7 took 11 ms
20/06/28 21:40:46.905 Executor task launch worker for task 14 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 64.0 B, free 546.3 MiB)
20/06/28 21:40:46.908 Executor task launch worker for task 14 INFO Executor: Finished task 0.0 in stage 7.0 (TID 14). 828 bytes result sent to driver
20/06/28 21:40:47.146 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 16
20/06/28 21:40:47.147 Executor task launch worker for task 16 INFO Executor: Running task 0.0 in stage 8.0 (TID 16)
20/06/28 21:40:47.150 Executor task launch worker for task 16 INFO TorrentBroadcast: Started reading broadcast variable 9 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:47.156 Executor task launch worker for task 16 INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 546.3 MiB)
20/06/28 21:40:47.160 Executor task launch worker for task 16 INFO TorrentBroadcast: Reading broadcast variable 9 took 9 ms
20/06/28 21:40:47.162 Executor task launch worker for task 16 INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 6.6 KiB, free 546.3 MiB)
20/06/28 21:40:47.186 Executor task launch worker for task 16 INFO Executor: Finished task 0.0 in stage 8.0 (TID 16). 828 bytes result sent to driver
20/06/28 21:40:47.863 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 19
20/06/28 21:40:47.863 Executor task launch worker for task 19 INFO Executor: Running task 1.0 in stage 9.0 (TID 19)
20/06/28 21:40:47.885 Executor task launch worker for task 19 INFO TorrentBroadcast: Started reading broadcast variable 11 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:47.891 Executor task launch worker for task 19 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:41893 after 2 ms (0 ms spent in bootstraps)
20/06/28 21:40:47.915 Executor task launch worker for task 19 INFO MemoryStore: Block broadcast_11_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 546.2 MiB)
20/06/28 21:40:47.920 Executor task launch worker for task 19 INFO TorrentBroadcast: Reading broadcast variable 11 took 34 ms
20/06/28 21:40:47.924 Executor task launch worker for task 19 INFO MemoryStore: Block broadcast_11 stored as values in memory (estimated size 4.1 KiB, free 546.2 MiB)
20/06/28 21:40:47.939 Executor task launch worker for task 19 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-be8a21c3-16e8-426f-9df9-3a8a09564fd2/input:16+16
20/06/28 21:40:47.940 Executor task launch worker for task 19 INFO TorrentBroadcast: Started reading broadcast variable 10 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:47.948 Executor task launch worker for task 19 INFO MemoryStore: Block broadcast_10_piece0 stored as bytes in memory (estimated size 26.9 KiB, free 546.2 MiB)
20/06/28 21:40:47.950 Executor task launch worker for task 19 INFO TorrentBroadcast: Reading broadcast variable 10 took 10 ms
20/06/28 21:40:48.013 Executor task launch worker for task 19 INFO MemoryStore: Block broadcast_10 stored as values in memory (estimated size 423.1 KiB, free 545.8 MiB)
20/06/28 21:40:48.128 Executor task launch worker for task 19 INFO MemoryStore: Block rdd_18_1 stored as values in memory (estimated size 80.0 B, free 545.8 MiB)
20/06/28 21:40:48.138 Executor task launch worker for task 19 INFO Executor: Finished task 1.0 in stage 9.0 (TID 19). 961 bytes result sent to driver
20/06/28 21:40:48.267 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 20
20/06/28 21:40:48.267 Executor task launch worker for task 20 INFO Executor: Running task 1.0 in stage 10.0 (TID 20)
20/06/28 21:40:48.287 Executor task launch worker for task 20 INFO TorrentBroadcast: Started reading broadcast variable 12 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:48.292 Executor task launch worker for task 20 INFO MemoryStore: Block broadcast_12_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 545.8 MiB)
20/06/28 21:40:48.295 Executor task launch worker for task 20 INFO TorrentBroadcast: Reading broadcast variable 12 took 7 ms
20/06/28 21:40:48.296 Executor task launch worker for task 20 INFO MemoryStore: Block broadcast_12 stored as values in memory (estimated size 4.1 KiB, free 545.8 MiB)
20/06/28 21:40:48.299 Executor task launch worker for task 20 INFO BlockManager: Found block rdd_18_1 locally
20/06/28 21:40:48.301 Executor task launch worker for task 20 INFO Executor: Finished task 1.0 in stage 10.0 (TID 20). 961 bytes result sent to driver
20/06/28 21:40:48.428 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 22
20/06/28 21:40:48.429 Executor task launch worker for task 22 INFO Executor: Running task 1.0 in stage 11.0 (TID 22)
20/06/28 21:40:48.432 Executor task launch worker for task 22 INFO TorrentBroadcast: Started reading broadcast variable 13 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:48.438 Executor task launch worker for task 22 INFO MemoryStore: Block broadcast_13_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 545.8 MiB)
20/06/28 21:40:48.442 Executor task launch worker for task 22 INFO TorrentBroadcast: Reading broadcast variable 13 took 9 ms
20/06/28 21:40:48.444 Executor task launch worker for task 22 INFO MemoryStore: Block broadcast_13 stored as values in memory (estimated size 4.1 KiB, free 545.8 MiB)
20/06/28 21:40:48.446 Executor task launch worker for task 22 INFO BlockManager: Found block rdd_18_1 locally
20/06/28 21:40:48.448 Executor task launch worker for task 22 INFO Executor: Finished task 1.0 in stage 11.0 (TID 22). 961 bytes result sent to driver
20/06/28 21:40:49.316 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 24
20/06/28 21:40:49.316 Executor task launch worker for task 24 INFO Executor: Running task 0.0 in stage 12.0 (TID 24)
20/06/28 21:40:49.319 Executor task launch worker for task 24 INFO TorrentBroadcast: Started reading broadcast variable 14 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:49.326 Executor task launch worker for task 24 INFO MemoryStore: Block broadcast_14_piece0 stored as bytes in memory (estimated size 2.9 KiB, free 545.8 MiB)
20/06/28 21:40:49.329 Executor task launch worker for task 24 INFO TorrentBroadcast: Reading broadcast variable 14 took 9 ms
20/06/28 21:40:49.330 Executor task launch worker for task 24 INFO MemoryStore: Block broadcast_14 stored as values in memory (estimated size 6.0 KiB, free 545.8 MiB)
20/06/28 21:40:49.390 Executor task launch worker for task 24 INFO Executor: Finished task 0.0 in stage 12.0 (TID 24). 840 bytes result sent to driver
20/06/28 21:40:49.654 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 26
20/06/28 21:40:49.655 Executor task launch worker for task 26 INFO Executor: Running task 0.0 in stage 13.0 (TID 26)
20/06/28 21:40:49.660 Executor task launch worker for task 26 INFO TorrentBroadcast: Started reading broadcast variable 15 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:49.666 Executor task launch worker for task 26 INFO MemoryStore: Block broadcast_15_piece0 stored as bytes in memory (estimated size 2.9 KiB, free 545.8 MiB)
20/06/28 21:40:49.669 Executor task launch worker for task 26 INFO TorrentBroadcast: Reading broadcast variable 15 took 9 ms
20/06/28 21:40:49.672 Executor task launch worker for task 26 INFO MemoryStore: Block broadcast_15 stored as values in memory (estimated size 6.0 KiB, free 545.8 MiB)
20/06/28 21:40:49.703 Executor task launch worker for task 26 INFO Executor: Finished task 0.0 in stage 13.0 (TID 26). 840 bytes result sent to driver
20/06/28 21:40:50.079 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 29
20/06/28 21:40:50.079 Executor task launch worker for task 29 INFO Executor: Running task 1.0 in stage 14.0 (TID 29)
20/06/28 21:40:50.082 Executor task launch worker for task 29 INFO TorrentBroadcast: Started reading broadcast variable 17 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:50.088 Executor task launch worker for task 29 INFO MemoryStore: Block broadcast_17_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 545.8 MiB)
20/06/28 21:40:50.091 Executor task launch worker for task 29 INFO TorrentBroadcast: Reading broadcast variable 17 took 8 ms
20/06/28 21:40:50.093 Executor task launch worker for task 29 INFO MemoryStore: Block broadcast_17 stored as values in memory (estimated size 6.6 KiB, free 545.8 MiB)
20/06/28 21:40:50.175 Executor task launch worker for task 29 INFO TorrentBroadcast: Started reading broadcast variable 16 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:50.183 Executor task launch worker for task 29 INFO MemoryStore: Block broadcast_16_piece0 stored as bytes in memory (estimated size 80.0 B, free 545.8 MiB)
20/06/28 21:40:50.186 Executor task launch worker for task 29 INFO TorrentBroadcast: Reading broadcast variable 16 took 10 ms
20/06/28 21:40:50.188 Executor task launch worker for task 29 INFO MemoryStore: Block broadcast_16 stored as values in memory (estimated size 64.0 B, free 545.8 MiB)
20/06/28 21:40:50.190 Executor task launch worker for task 29 INFO Executor: Finished task 1.0 in stage 14.0 (TID 29). 832 bytes result sent to driver
20/06/28 21:40:50.433 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 30
20/06/28 21:40:50.434 Executor task launch worker for task 30 INFO Executor: Running task 0.0 in stage 15.0 (TID 30)
20/06/28 21:40:50.437 Executor task launch worker for task 30 INFO TorrentBroadcast: Started reading broadcast variable 18 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:50.443 Executor task launch worker for task 30 INFO MemoryStore: Block broadcast_18_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 545.8 MiB)
20/06/28 21:40:50.446 Executor task launch worker for task 30 INFO TorrentBroadcast: Reading broadcast variable 18 took 9 ms
20/06/28 21:40:50.447 Executor task launch worker for task 30 INFO MemoryStore: Block broadcast_18 stored as values in memory (estimated size 6.6 KiB, free 545.8 MiB)
20/06/28 21:40:50.471 Executor task launch worker for task 30 INFO Executor: Finished task 0.0 in stage 15.0 (TID 30). 828 bytes result sent to driver
20/06/28 21:40:53.454 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 33
20/06/28 21:40:53.454 Executor task launch worker for task 33 INFO Executor: Running task 1.0 in stage 16.0 (TID 33)
20/06/28 21:40:53.457 Executor task launch worker for task 33 INFO TorrentBroadcast: Started reading broadcast variable 19 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:53.461 Executor task launch worker for task 33 INFO MemoryStore: Block broadcast_19_piece0 stored as bytes in memory (estimated size 4.6 KiB, free 545.9 MiB)
20/06/28 21:40:53.464 Executor task launch worker for task 33 INFO TorrentBroadcast: Reading broadcast variable 19 took 6 ms
20/06/28 21:40:53.465 Executor task launch worker for task 33 INFO MemoryStore: Block broadcast_19 stored as values in memory (estimated size 9.5 KiB, free 545.8 MiB)
20/06/28 21:40:53.994 Executor task launch worker for task 33 INFO CodeGenerator: Code generated in 275.19442 ms
20/06/28 21:40:54.007 Executor task launch worker for task 33 INFO Executor: Finished task 1.0 in stage 16.0 (TID 33). 1483 bytes result sent to driver
20/06/28 21:40:56.052 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 35
20/06/28 21:40:56.053 Executor task launch worker for task 35 INFO Executor: Running task 1.0 in stage 17.0 (TID 35)
20/06/28 21:40:56.058 Executor task launch worker for task 35 INFO TorrentBroadcast: Started reading broadcast variable 20 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:56.065 Executor task launch worker for task 35 INFO MemoryStore: Block broadcast_20_piece0 stored as bytes in memory (estimated size 5.6 KiB, free 545.8 MiB)
20/06/28 21:40:56.068 Executor task launch worker for task 35 INFO TorrentBroadcast: Reading broadcast variable 20 took 9 ms
20/06/28 21:40:56.071 Executor task launch worker for task 35 INFO MemoryStore: Block broadcast_20 stored as values in memory (estimated size 10.8 KiB, free 545.8 MiB)
20/06/28 21:40:56.150 Executor task launch worker for task 35 INFO CodeGenerator: Code generated in 34.167229 ms
20/06/28 21:40:56.185 Executor task launch worker for task 35 INFO Executor: Finished task 1.0 in stage 17.0 (TID 35). 1844 bytes result sent to driver
20/06/28 21:40:56.213 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 36
20/06/28 21:40:56.213 Executor task launch worker for task 36 INFO Executor: Running task 0.0 in stage 18.0 (TID 36)
20/06/28 21:40:56.218 Executor task launch worker for task 36 INFO MapOutputTrackerWorker: Updating epoch to 1 and clearing cache
20/06/28 21:40:56.220 Executor task launch worker for task 36 INFO TorrentBroadcast: Started reading broadcast variable 21 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:56.225 Executor task launch worker for task 36 INFO MemoryStore: Block broadcast_21_piece0 stored as bytes in memory (estimated size 5.4 KiB, free 545.8 MiB)
20/06/28 21:40:56.228 Executor task launch worker for task 36 INFO TorrentBroadcast: Reading broadcast variable 21 took 7 ms
20/06/28 21:40:56.230 Executor task launch worker for task 36 INFO MemoryStore: Block broadcast_21 stored as values in memory (estimated size 11.1 KiB, free 545.8 MiB)
20/06/28 21:40:56.239 Executor task launch worker for task 36 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 0, fetching them
20/06/28 21:40:56.241 Executor task launch worker for task 36 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@amp-jenkins-worker-04.amp:33831)
20/06/28 21:40:56.293 Executor task launch worker for task 36 INFO MapOutputTrackerWorker: Got the output locations
20/06/28 21:40:56.315 Executor task launch worker for task 36 INFO ShuffleBlockFetcherIterator: Getting 2 (120.0 B) non-empty blocks including 1 (60.0 B) local and 0 (0.0 B) host-local and 1 (60.0 B) remote blocks
20/06/28 21:40:56.321 Executor task launch worker for task 36 INFO ShuffleBlockFetcherIterator: Started 1 remote fetches in 16 ms
20/06/28 21:40:56.356 Executor task launch worker for task 36 INFO CodeGenerator: Code generated in 30.392125 ms
20/06/28 21:40:56.370 Executor task launch worker for task 36 INFO Executor: Finished task 0.0 in stage 18.0 (TID 36). 2648 bytes result sent to driver
20/06/28 21:40:57.755 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 38
20/06/28 21:40:57.756 Executor task launch worker for task 38 INFO Executor: Running task 1.0 in stage 19.0 (TID 38)
20/06/28 21:40:57.759 Executor task launch worker for task 38 INFO TorrentBroadcast: Started reading broadcast variable 22 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:57.765 Executor task launch worker for task 38 INFO MemoryStore: Block broadcast_22_piece0 stored as bytes in memory (estimated size 1898.0 B, free 545.8 MiB)
20/06/28 21:40:57.767 Executor task launch worker for task 38 INFO TorrentBroadcast: Reading broadcast variable 22 took 8 ms
20/06/28 21:40:57.769 Executor task launch worker for task 38 INFO MemoryStore: Block broadcast_22 stored as values in memory (estimated size 3.4 KiB, free 545.8 MiB)
20/06/28 21:40:57.790 Executor task launch worker for task 38 INFO Executor: Finished task 1.0 in stage 19.0 (TID 38). 1318 bytes result sent to driver
20/06/28 21:40:58.717 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 40
20/06/28 21:40:58.717 Executor task launch worker for task 40 INFO Executor: Running task 1.0 in stage 20.0 (TID 40)
20/06/28 21:40:58.731 Executor task launch worker for task 40 INFO TorrentBroadcast: Started reading broadcast variable 23 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:58.735 Executor task launch worker for task 40 INFO MemoryStore: Block broadcast_23_piece0 stored as bytes in memory (estimated size 1322.0 B, free 545.8 MiB)
20/06/28 21:40:58.736 Executor task launch worker for task 40 INFO TorrentBroadcast: Reading broadcast variable 23 took 5 ms
20/06/28 21:40:58.738 Executor task launch worker for task 40 INFO MemoryStore: Block broadcast_23 stored as values in memory (estimated size 2.1 KiB, free 545.8 MiB)
20/06/28 21:40:58.740 Executor task launch worker for task 40 INFO Executor: Finished task 1.0 in stage 20.0 (TID 40). 1324 bytes result sent to driver
20/06/28 21:40:58.743 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 42
20/06/28 21:40:58.744 Executor task launch worker for task 42 INFO Executor: Running task 3.0 in stage 20.0 (TID 42)
20/06/28 21:40:58.746 Executor task launch worker for task 42 INFO Executor: Finished task 3.0 in stage 20.0 (TID 42). 1324 bytes result sent to driver
20/06/28 21:40:58.749 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 43
20/06/28 21:40:58.749 Executor task launch worker for task 43 INFO Executor: Running task 4.0 in stage 20.0 (TID 43)
20/06/28 21:40:58.751 Executor task launch worker for task 43 INFO Executor: Finished task 4.0 in stage 20.0 (TID 43). 1324 bytes result sent to driver
20/06/28 21:40:58.754 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 45
20/06/28 21:40:58.754 Executor task launch worker for task 45 INFO Executor: Running task 6.0 in stage 20.0 (TID 45)
20/06/28 21:40:58.757 Executor task launch worker for task 45 INFO Executor: Finished task 6.0 in stage 20.0 (TID 45). 1324 bytes result sent to driver
20/06/28 21:40:58.760 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 47
20/06/28 21:40:58.760 Executor task launch worker for task 47 INFO Executor: Running task 8.0 in stage 20.0 (TID 47)
20/06/28 21:40:58.762 Executor task launch worker for task 47 INFO Executor: Finished task 8.0 in stage 20.0 (TID 47). 1324 bytes result sent to driver
20/06/28 21:40:59.421 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 49
20/06/28 21:40:59.422 Executor task launch worker for task 49 INFO Executor: Running task 0.0 in stage 21.0 (TID 49)
20/06/28 21:40:59.444 Executor task launch worker for task 49 INFO TorrentBroadcast: Started reading broadcast variable 24 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:59.449 Executor task launch worker for task 49 INFO MemoryStore: Block broadcast_24_piece0 stored as bytes in memory (estimated size 2.6 KiB, free 545.9 MiB)
20/06/28 21:40:59.451 Executor task launch worker for task 49 INFO TorrentBroadcast: Reading broadcast variable 24 took 6 ms
20/06/28 21:40:59.453 Executor task launch worker for task 49 INFO MemoryStore: Block broadcast_24 stored as values in memory (estimated size 4.6 KiB, free 545.9 MiB)
20/06/28 21:40:59.523 Executor task launch worker for task 49 INFO Executor: Finished task 0.0 in stage 21.0 (TID 49). 1041 bytes result sent to driver
20/06/28 21:40:59.537 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 52
20/06/28 21:40:59.537 Executor task launch worker for task 52 INFO Executor: Running task 0.0 in stage 22.0 (TID 52)
20/06/28 21:40:59.539 Executor task launch worker for task 52 INFO MapOutputTrackerWorker: Updating epoch to 2 and clearing cache
20/06/28 21:40:59.540 Executor task launch worker for task 52 INFO TorrentBroadcast: Started reading broadcast variable 25 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:59.544 Executor task launch worker for task 52 INFO MemoryStore: Block broadcast_25_piece0 stored as bytes in memory (estimated size 3.0 KiB, free 545.9 MiB)
20/06/28 21:40:59.546 Executor task launch worker for task 52 INFO TorrentBroadcast: Reading broadcast variable 25 took 5 ms
20/06/28 21:40:59.548 Executor task launch worker for task 52 INFO MemoryStore: Block broadcast_25 stored as values in memory (estimated size 5.6 KiB, free 545.8 MiB)
20/06/28 21:40:59.554 Executor task launch worker for task 52 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 1, fetching them
20/06/28 21:40:59.554 Executor task launch worker for task 52 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@amp-jenkins-worker-04.amp:33831)
20/06/28 21:40:59.557 Executor task launch worker for task 52 INFO MapOutputTrackerWorker: Got the output locations
20/06/28 21:40:59.558 Executor task launch worker for task 52 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks
20/06/28 21:40:59.558 Executor task launch worker for task 52 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
20/06/28 21:40:59.571 Executor task launch worker for task 52 INFO Executor: Finished task 0.0 in stage 22.0 (TID 52). 1263 bytes result sent to driver
20/06/28 21:41:00.902 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 53
20/06/28 21:41:00.903 Executor task launch worker for task 53 INFO Executor: Running task 0.0 in stage 23.0 (TID 53)
20/06/28 21:41:00.916 Executor task launch worker for task 53 INFO TorrentBroadcast: Started reading broadcast variable 26 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:41:00.921 Executor task launch worker for task 53 INFO MemoryStore: Block broadcast_26_piece0 stored as bytes in memory (estimated size 1319.0 B, free 545.8 MiB)
20/06/28 21:41:00.923 Executor task launch worker for task 53 INFO TorrentBroadcast: Reading broadcast variable 26 took 6 ms
20/06/28 21:41:00.924 Executor task launch worker for task 53 INFO MemoryStore: Block broadcast_26 stored as values in memory (estimated size 2.0 KiB, free 545.8 MiB)
20/06/28 21:41:00.928 Executor task launch worker for task 53 INFO MemoryStore: Block rdd_43_0 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:00.953 shuffle-server-6-1 INFO MemoryStore: Block rdd_43_1 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:00.963 Executor task launch worker for task 53 INFO Executor: Finished task 0.0 in stage 23.0 (TID 53). 875 bytes result sent to driver
20/06/28 21:41:00.967 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 55
20/06/28 21:41:00.967 Executor task launch worker for task 55 INFO Executor: Running task 2.0 in stage 23.0 (TID 55)
20/06/28 21:41:00.972 Executor task launch worker for task 55 INFO MemoryStore: Block rdd_43_2 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:00.979 shuffle-server-6-1 INFO MemoryStore: Block rdd_43_3 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:00.982 Executor task launch worker for task 55 INFO Executor: Finished task 2.0 in stage 23.0 (TID 55). 875 bytes result sent to driver
20/06/28 21:41:00.985 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 57
20/06/28 21:41:00.985 Executor task launch worker for task 57 INFO Executor: Running task 4.0 in stage 23.0 (TID 57)
20/06/28 21:41:00.989 Executor task launch worker for task 57 INFO MemoryStore: Block rdd_43_4 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:00.996 shuffle-server-6-1 INFO MemoryStore: Block rdd_43_5 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:00.998 Executor task launch worker for task 57 INFO Executor: Finished task 4.0 in stage 23.0 (TID 57). 875 bytes result sent to driver
20/06/28 21:41:01.002 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 59
20/06/28 21:41:01.002 Executor task launch worker for task 59 INFO Executor: Running task 6.0 in stage 23.0 (TID 59)
20/06/28 21:41:01.008 Executor task launch worker for task 59 INFO MemoryStore: Block rdd_43_6 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:01.014 shuffle-server-6-1 INFO MemoryStore: Block rdd_43_7 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:01.017 Executor task launch worker for task 59 INFO Executor: Finished task 6.0 in stage 23.0 (TID 59). 875 bytes result sent to driver
20/06/28 21:41:01.020 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 62
20/06/28 21:41:01.021 Executor task launch worker for task 62 INFO Executor: Running task 9.0 in stage 23.0 (TID 62)
20/06/28 21:41:01.026 Executor task launch worker for task 62 INFO MemoryStore: Block rdd_43_9 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:01.031 shuffle-server-6-1 INFO MemoryStore: Block rdd_43_8 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:01.035 Executor task launch worker for task 62 INFO Executor: Finished task 9.0 in stage 23.0 (TID 62). 875 bytes result sent to driver
20/06/28 21:41:02.053 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 63
20/06/28 21:41:02.054 Executor task launch worker for task 63 INFO Executor: Running task 0.0 in stage 24.0 (TID 63)
20/06/28 21:41:02.057 Executor task launch worker for task 63 INFO TorrentBroadcast: Started reading broadcast variable 28 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:41:02.061 Executor task launch worker for task 63 INFO MemoryStore: Block broadcast_28_piece0 stored as bytes in memory (estimated size 2.6 KiB, free 545.8 MiB)
20/06/28 21:41:02.063 Executor task launch worker for task 63 INFO TorrentBroadcast: Reading broadcast variable 28 took 5 ms
20/06/28 21:41:02.064 Executor task launch worker for task 63 INFO MemoryStore: Block broadcast_28 stored as values in memory (estimated size 4.5 KiB, free 545.8 MiB)
20/06/28 21:41:02.077 Executor task launch worker for task 63 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/pom.xml:0+2887
20/06/28 21:41:02.077 Executor task launch worker for task 63 INFO TorrentBroadcast: Started reading broadcast variable 27 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:41:02.081 Executor task launch worker for task 63 INFO MemoryStore: Block broadcast_27_piece0 stored as bytes in memory (estimated size 27.0 KiB, free 545.8 MiB)
20/06/28 21:41:02.082 Executor task launch worker for task 63 INFO TorrentBroadcast: Reading broadcast variable 27 took 4 ms
20/06/28 21:41:02.105 Executor task launch worker for task 63 INFO MemoryStore: Block broadcast_27 stored as values in memory (estimated size 423.1 KiB, free 545.4 MiB)
20/06/28 21:41:02.129 Executor task launch worker for task 63 INFO MemoryStore: Block rdd_46_0 stored as values in memory (estimated size 5.6 KiB, free 545.4 MiB)
20/06/28 21:41:02.132 Executor task launch worker for task 63 INFO Executor: Finished task 0.0 in stage 24.0 (TID 63). 961 bytes result sent to driver
20/06/28 21:41:02.447 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 66
20/06/28 21:41:02.448 Executor task launch worker for task 66 INFO Executor: Running task 0.0 in stage 25.0 (TID 66)
20/06/28 21:41:02.450 Executor task launch worker for task 66 INFO TorrentBroadcast: Started reading broadcast variable 29 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:41:02.454 Executor task launch worker for task 66 INFO MemoryStore: Block broadcast_29_piece0 stored as bytes in memory (estimated size 3.5 KiB, free 545.4 MiB)
20/06/28 21:41:02.457 Executor task launch worker for task 66 INFO TorrentBroadcast: Reading broadcast variable 29 took 6 ms
20/06/28 21:41:02.458 Executor task launch worker for task 66 INFO MemoryStore: Block broadcast_29 stored as values in memory (estimated size 6.5 KiB, free 545.4 MiB)
20/06/28 21:41:02.462 Executor task launch worker for task 66 INFO BlockManager: Found block rdd_46_0 locally
20/06/28 21:41:02.468 Executor task launch worker for task 66 INFO Executor: Finished task 0.0 in stage 25.0 (TID 66). 1127 bytes result sent to driver
20/06/28 21:41:02.482 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 68
20/06/28 21:41:02.482 Executor task launch worker for task 68 INFO Executor: Running task 1.0 in stage 26.0 (TID 68)
20/06/28 21:41:02.491 Executor task launch worker for task 68 INFO MapOutputTrackerWorker: Updating epoch to 3 and clearing cache
20/06/28 21:41:02.492 Executor task launch worker for task 68 INFO TorrentBroadcast: Started reading broadcast variable 30 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:41:02.496 Executor task launch worker for task 68 INFO MemoryStore: Block broadcast_30_piece0 stored as bytes in memory (estimated size 2.5 KiB, free 545.4 MiB)
20/06/28 21:41:02.498 Executor task launch worker for task 68 INFO TorrentBroadcast: Reading broadcast variable 30 took 6 ms
20/06/28 21:41:02.500 Executor task launch worker for task 68 INFO MemoryStore: Block broadcast_30 stored as values in memory (estimated size 4.5 KiB, free 545.4 MiB)
20/06/28 21:41:02.506 Executor task launch worker for task 68 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 2, fetching them
20/06/28 21:41:02.506 Executor task launch worker for task 68 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@amp-jenkins-worker-04.amp:33831)
20/06/28 21:41:02.508 Executor task launch worker for task 68 INFO MapOutputTrackerWorker: Got the output locations
20/06/28 21:41:02.509 Executor task launch worker for task 68 INFO ShuffleBlockFetcherIterator: Getting 2 (1304.0 B) non-empty blocks including 1 (652.0 B) local and 0 (0.0 B) host-local and 1 (652.0 B) remote blocks
20/06/28 21:41:02.509 Executor task launch worker for task 68 INFO ShuffleBlockFetcherIterator: Started 1 remote fetches in 1 ms
20/06/28 21:41:02.520 Executor task launch worker for task 68 INFO MemoryStore: Block rdd_50_1 stored as values in memory (estimated size 6.2 KiB, free 545.4 MiB)
20/06/28 21:41:02.522 Executor task launch worker for task 68 INFO Executor: Finished task 1.0 in stage 26.0 (TID 68). 1176 bytes result sent to driver
20/06/28 21:41:03.882 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 69
20/06/28 21:41:03.882 Executor task launch worker for task 69 INFO Executor: Running task 0.0 in stage 27.0 (TID 69)
20/06/28 21:41:03.884 Executor task launch worker for task 69 INFO TorrentBroadcast: Started reading broadcast variable 31 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:41:03.888 Executor task launch worker for task 69 INFO MemoryStore: Block broadcast_31_piece0 stored as bytes in memory (estimated size 1945.0 B, free 545.4 MiB)
20/06/28 21:41:03.889 Executor task launch worker for task 69 INFO TorrentBroadcast: Reading broadcast variable 31 took 4 ms
20/06/28 21:41:03.890 Executor task launch worker for task 69 INFO MemoryStore: Block broadcast_31 stored as values in memory (estimated size 3.5 KiB, free 545.4 MiB)
20/06/28 21:41:03.901 Executor task launch worker for task 69 INFO Executor: Finished task 0.0 in stage 27.0 (TID 69). 1095 bytes result sent to driver
20/06/28 21:41:04.891 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 71
20/06/28 21:41:04.891 Executor task launch worker for task 71 INFO Executor: Running task 0.0 in stage 28.0 (TID 71)
20/06/28 21:41:04.893 Executor task launch worker for task 71 INFO TorrentBroadcast: Started reading broadcast variable 32 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:41:04.897 Executor task launch worker for task 71 INFO MemoryStore: Block broadcast_32_piece0 stored as bytes in memory (estimated size 1946.0 B, free 545.4 MiB)
20/06/28 21:41:04.898 Executor task launch worker for task 71 INFO TorrentBroadcast: Reading broadcast variable 32 took 5 ms
20/06/28 21:41:04.900 Executor task launch worker for task 71 INFO MemoryStore: Block broadcast_32 stored as values in memory (estimated size 3.5 KiB, free 545.4 MiB)
20/06/28 21:41:04.913 Executor task launch worker for task 71 INFO Executor: Finished task 0.0 in stage 28.0 (TID 71). 1095 bytes result sent to driver
20/06/28 21:41:07.104 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 74
20/06/28 21:41:07.104 Executor task launch worker for task 74 INFO Executor: Running task 1.0 in stage 29.0 (TID 74)
20/06/28 21:41:07.107 Executor task launch worker for task 74 INFO TorrentBroadcast: Started reading broadcast variable 33 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:41:07.114 Executor task launch worker for task 74 INFO MemoryStore: Block broadcast_33_piece0 stored as bytes in memory (estimated size 1878.0 B, free 545.4 MiB)
20/06/28 21:41:07.117 Executor task launch worker for task 74 INFO TorrentBroadcast: Reading broadcast variable 33 took 9 ms
20/06/28 21:41:07.119 Executor task launch worker for task 74 INFO MemoryStore: Block broadcast_33 stored as values in memory (estimated size 3.4 KiB, free 545.4 MiB)
20/06/28 21:41:08.797 Executor task launch worker for task 74 INFO Executor: Finished task 1.0 in stage 29.0 (TID 74). 1289 bytes result sent to driver
20/06/28 21:41:09.199 SIGTERM handler ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM
20/06/28 21:41:09.201 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver commanded a shutdown
20/06/28 21:41:09.205 dispatcher-event-loop-1 ERROR WorkerWatcher: Lost connection to worker rpc endpoint spark://Worker@amp-jenkins-worker-04.amp:44631. Exiting.
20/06/28 21:41:09.205 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver from amp-jenkins-worker-04.amp:44631 disconnected during shutdown
20/06/28 21:41:09.206 shutdown-hook-0 INFO DiskBlockManager: Shutdown hook called
20/06/28 21:41:09.220 shutdown-hook-0 INFO ShutdownHookManager: Shutdown hook called
20/06/28 21:41:09.221 CoarseGrainedExecutorBackend-stop-executor INFO MemoryStore: MemoryStore cleared
20/06/28 21:41:09.221 CoarseGrainedExecutorBackend-stop-executor INFO BlockManager: BlockManager stopped