20/06/28 21:40:40.514 main INFO CoarseGrainedExecutorBackend: Started daemon with process name: 819@amp-jenkins-worker-04
20/06/28 21:40:40.521 main INFO SignalUtils: Registering signal handler for TERM
20/06/28 21:40:40.522 main INFO SignalUtils: Registering signal handler for HUP
20/06/28 21:40:40.522 main INFO SignalUtils: Registering signal handler for INT
20/06/28 21:40:40.870 main WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
20/06/28 21:40:40.953 main INFO SecurityManager: Changing view acls to: jenkins
20/06/28 21:40:40.954 main INFO SecurityManager: Changing modify acls to: jenkins
20/06/28 21:40:40.955 main INFO SecurityManager: Changing view acls groups to: 
20/06/28 21:40:40.955 main INFO SecurityManager: Changing modify acls groups to: 
20/06/28 21:40:40.956 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(jenkins); groups with view permissions: Set(); users  with modify permissions: Set(jenkins); groups with modify permissions: Set()
20/06/28 21:40:41.352 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:33831 after 72 ms (0 ms spent in bootstraps)
20/06/28 21:40:41.452 main INFO SecurityManager: Changing view acls to: jenkins
20/06/28 21:40:41.452 main INFO SecurityManager: Changing modify acls to: jenkins
20/06/28 21:40:41.452 main INFO SecurityManager: Changing view acls groups to: 
20/06/28 21:40:41.452 main INFO SecurityManager: Changing modify acls groups to: 
20/06/28 21:40:41.453 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(jenkins); groups with view permissions: Set(); users  with modify permissions: Set(jenkins); groups with modify permissions: Set()
20/06/28 21:40:41.503 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:33831 after 1 ms (0 ms spent in bootstraps)
20/06/28 21:40:41.557 main INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-095bb982-4d6a-4f3b-b20a-d219c3533c62/executor-6a33040a-555c-4237-9eaf-8e62e8f087df/blockmgr-aafc572d-1feb-47b6-865e-64590ee78eed
20/06/28 21:40:41.599 main INFO MemoryStore: MemoryStore started with capacity 546.3 MiB
20/06/28 21:40:41.778 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Registering PWR handler.
20/06/28 21:40:41.778 dispatcher-Executor INFO SignalUtils: Registering signal handler for PWR
20/06/28 21:40:41.779 main INFO WorkerWatcher: Connecting to worker spark://Worker@amp-jenkins-worker-04.amp:38203
20/06/28 21:40:41.779 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Connecting to driver: spark://CoarseGrainedScheduler@amp-jenkins-worker-04.amp:33831
20/06/28 21:40:41.781 netty-rpc-connection-1 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:38203 after 1 ms (0 ms spent in bootstraps)
20/06/28 21:40:41.785 dispatcher-event-loop-0 INFO WorkerWatcher: Successfully connected to spark://Worker@amp-jenkins-worker-04.amp:38203
20/06/28 21:40:41.792 dispatcher-Executor INFO ResourceUtils: ==============================================================
20/06/28 21:40:41.793 dispatcher-Executor INFO ResourceUtils: No custom resources configured for spark.executor.
20/06/28 21:40:41.793 dispatcher-Executor INFO ResourceUtils: ==============================================================
20/06/28 21:40:41.819 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Successfully registered with driver
20/06/28 21:40:41.822 dispatcher-Executor INFO Executor: Starting executor ID 1 on host amp-jenkins-worker-04.amp
20/06/28 21:40:41.911 dispatcher-Executor INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 41893.
20/06/28 21:40:41.912 dispatcher-Executor INFO NettyBlockTransferService: Server created on amp-jenkins-worker-04.amp:41893
20/06/28 21:40:41.915 dispatcher-Executor INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
20/06/28 21:40:41.923 dispatcher-Executor INFO BlockManagerMaster: Registering BlockManager BlockManagerId(1, amp-jenkins-worker-04.amp, 41893, None)
20/06/28 21:40:41.930 dispatcher-Executor INFO BlockManagerMaster: Registered BlockManager BlockManagerId(1, amp-jenkins-worker-04.amp, 41893, None)
20/06/28 21:40:41.931 dispatcher-Executor INFO BlockManager: Initialized BlockManager: BlockManagerId(1, amp-jenkins-worker-04.amp, 41893, None)
20/06/28 21:40:41.939 dispatcher-Executor INFO Executor: Using REPL class URI: spark://amp-jenkins-worker-04.amp:33831/classes
20/06/28 21:40:41.976 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 1
20/06/28 21:40:41.989 Executor task launch worker for task 1 INFO Executor: Running task 1.0 in stage 0.0 (TID 1)
20/06/28 21:40:42.092 Executor task launch worker for task 1 INFO TorrentBroadcast: Started reading broadcast variable 0 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:42.135 Executor task launch worker for task 1 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:36481 after 2 ms (0 ms spent in bootstraps)
20/06/28 21:40:42.170 Executor task launch worker for task 1 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 546.3 MiB)
20/06/28 21:40:42.181 Executor task launch worker for task 1 INFO TorrentBroadcast: Reading broadcast variable 0 took 89 ms
20/06/28 21:40:42.323 Executor task launch worker for task 1 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 4.7 KiB, free 546.3 MiB)
20/06/28 21:40:42.426 Executor task launch worker for task 1 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:33831 after 2 ms (0 ms spent in bootstraps)
20/06/28 21:40:42.751 Executor task launch worker for task 1 INFO Executor: Finished task 1.0 in stage 0.0 (TID 1). 923 bytes result sent to driver
20/06/28 21:40:43.705 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 3
20/06/28 21:40:43.706 Executor task launch worker for task 3 INFO Executor: Running task 1.0 in stage 1.0 (TID 3)
20/06/28 21:40:43.716 Executor task launch worker for task 3 INFO TorrentBroadcast: Started reading broadcast variable 1 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:43.726 Executor task launch worker for task 3 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:39011 after 3 ms (0 ms spent in bootstraps)
20/06/28 21:40:43.739 Executor task launch worker for task 3 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.6 KiB, free 546.3 MiB)
20/06/28 21:40:43.741 Executor task launch worker for task 3 INFO TorrentBroadcast: Reading broadcast variable 1 took 24 ms
20/06/28 21:40:43.747 Executor task launch worker for task 3 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 5.1 KiB, free 546.3 MiB)
20/06/28 21:40:43.819 Executor task launch worker for task 3 INFO Executor: Finished task 1.0 in stage 1.0 (TID 3). 840 bytes result sent to driver
20/06/28 21:40:44.086 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 4
20/06/28 21:40:44.087 Executor task launch worker for task 4 INFO Executor: Running task 0.0 in stage 2.0 (TID 4)
20/06/28 21:40:44.091 Executor task launch worker for task 4 INFO TorrentBroadcast: Started reading broadcast variable 2 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:44.098 Executor task launch worker for task 4 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.6 KiB, free 546.3 MiB)
20/06/28 21:40:44.100 Executor task launch worker for task 4 INFO TorrentBroadcast: Reading broadcast variable 2 took 9 ms
20/06/28 21:40:44.102 Executor task launch worker for task 4 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 5.1 KiB, free 546.3 MiB)
20/06/28 21:40:44.139 Executor task launch worker for task 4 INFO Executor: Finished task 0.0 in stage 2.0 (TID 4). 840 bytes result sent to driver
20/06/28 21:40:44.782 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 6
20/06/28 21:40:44.783 Executor task launch worker for task 6 INFO Executor: Running task 0.0 in stage 3.0 (TID 6)
20/06/28 21:40:44.789 Executor task launch worker for task 6 INFO TorrentBroadcast: Started reading broadcast variable 3 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:44.796 Executor task launch worker for task 6 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 1807.0 B, free 546.3 MiB)
20/06/28 21:40:44.799 Executor task launch worker for task 6 INFO TorrentBroadcast: Reading broadcast variable 3 took 9 ms
20/06/28 21:40:44.801 Executor task launch worker for task 6 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 3.1 KiB, free 546.3 MiB)
20/06/28 21:40:44.820 Executor task launch worker for task 6 INFO Executor: Finished task 0.0 in stage 3.0 (TID 6). 840 bytes result sent to driver
20/06/28 21:40:45.213 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 8
20/06/28 21:40:45.214 Executor task launch worker for task 8 INFO Executor: Running task 0.0 in stage 4.0 (TID 8)
20/06/28 21:40:45.220 Executor task launch worker for task 8 INFO TorrentBroadcast: Started reading broadcast variable 4 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:45.228 Executor task launch worker for task 8 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 2.6 KiB, free 546.3 MiB)
20/06/28 21:40:45.232 Executor task launch worker for task 8 INFO TorrentBroadcast: Reading broadcast variable 4 took 11 ms
20/06/28 21:40:45.234 Executor task launch worker for task 8 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 5.1 KiB, free 546.3 MiB)
20/06/28 21:40:45.281 Executor task launch worker for task 8 INFO Executor: Finished task 0.0 in stage 4.0 (TID 8). 840 bytes result sent to driver
20/06/28 21:40:45.769 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 10
20/06/28 21:40:45.770 Executor task launch worker for task 10 INFO Executor: Running task 0.0 in stage 5.0 (TID 10)
20/06/28 21:40:45.774 Executor task launch worker for task 10 INFO TorrentBroadcast: Started reading broadcast variable 5 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:45.781 Executor task launch worker for task 10 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 2.9 KiB, free 546.3 MiB)
20/06/28 21:40:45.785 Executor task launch worker for task 10 INFO TorrentBroadcast: Reading broadcast variable 5 took 10 ms
20/06/28 21:40:45.788 Executor task launch worker for task 10 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 6.0 KiB, free 546.3 MiB)
20/06/28 21:40:45.862 Executor task launch worker for task 10 INFO Executor: Finished task 0.0 in stage 5.0 (TID 10). 840 bytes result sent to driver
20/06/28 21:40:46.122 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 13
20/06/28 21:40:46.123 Executor task launch worker for task 13 INFO Executor: Running task 1.0 in stage 6.0 (TID 13)
20/06/28 21:40:46.126 Executor task launch worker for task 13 INFO TorrentBroadcast: Started reading broadcast variable 6 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:46.132 Executor task launch worker for task 13 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 2.9 KiB, free 546.3 MiB)
20/06/28 21:40:46.135 Executor task launch worker for task 13 INFO TorrentBroadcast: Reading broadcast variable 6 took 8 ms
20/06/28 21:40:46.138 Executor task launch worker for task 13 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 6.0 KiB, free 546.3 MiB)
20/06/28 21:40:46.162 Executor task launch worker for task 13 INFO Executor: Finished task 1.0 in stage 6.0 (TID 13). 840 bytes result sent to driver
20/06/28 21:40:46.775 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 15
20/06/28 21:40:46.775 Executor task launch worker for task 15 INFO Executor: Running task 1.0 in stage 7.0 (TID 15)
20/06/28 21:40:46.778 Executor task launch worker for task 15 INFO TorrentBroadcast: Started reading broadcast variable 8 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:46.784 Executor task launch worker for task 15 INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 546.3 MiB)
20/06/28 21:40:46.787 Executor task launch worker for task 15 INFO TorrentBroadcast: Reading broadcast variable 8 took 8 ms
20/06/28 21:40:46.790 Executor task launch worker for task 15 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 6.6 KiB, free 546.3 MiB)
20/06/28 21:40:46.869 Executor task launch worker for task 15 INFO TorrentBroadcast: Started reading broadcast variable 7 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:46.877 Executor task launch worker for task 15 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 80.0 B, free 546.3 MiB)
20/06/28 21:40:46.879 Executor task launch worker for task 15 INFO TorrentBroadcast: Reading broadcast variable 7 took 10 ms
20/06/28 21:40:46.881 Executor task launch worker for task 15 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 64.0 B, free 546.3 MiB)
20/06/28 21:40:46.883 Executor task launch worker for task 15 INFO Executor: Finished task 1.0 in stage 7.0 (TID 15). 832 bytes result sent to driver
20/06/28 21:40:47.146 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 17
20/06/28 21:40:47.147 Executor task launch worker for task 17 INFO Executor: Running task 1.0 in stage 8.0 (TID 17)
20/06/28 21:40:47.152 Executor task launch worker for task 17 INFO TorrentBroadcast: Started reading broadcast variable 9 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:47.161 Executor task launch worker for task 17 INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 546.3 MiB)
20/06/28 21:40:47.164 Executor task launch worker for task 17 INFO TorrentBroadcast: Reading broadcast variable 9 took 11 ms
20/06/28 21:40:47.169 Executor task launch worker for task 17 INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 6.6 KiB, free 546.3 MiB)
20/06/28 21:40:47.195 Executor task launch worker for task 17 INFO Executor: Finished task 1.0 in stage 8.0 (TID 17). 832 bytes result sent to driver
20/06/28 21:40:47.863 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 18
20/06/28 21:40:47.863 Executor task launch worker for task 18 INFO Executor: Running task 0.0 in stage 9.0 (TID 18)
20/06/28 21:40:47.878 Executor task launch worker for task 18 INFO TorrentBroadcast: Started reading broadcast variable 11 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:47.884 Executor task launch worker for task 18 INFO MemoryStore: Block broadcast_11_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 546.2 MiB)
20/06/28 21:40:47.887 Executor task launch worker for task 18 INFO TorrentBroadcast: Reading broadcast variable 11 took 9 ms
20/06/28 21:40:47.890 Executor task launch worker for task 18 INFO MemoryStore: Block broadcast_11 stored as values in memory (estimated size 4.1 KiB, free 546.2 MiB)
20/06/28 21:40:47.912 Executor task launch worker for task 18 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-be8a21c3-16e8-426f-9df9-3a8a09564fd2/input:0+16
20/06/28 21:40:47.913 Executor task launch worker for task 18 INFO TorrentBroadcast: Started reading broadcast variable 10 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:47.921 Executor task launch worker for task 18 INFO MemoryStore: Block broadcast_10_piece0 stored as bytes in memory (estimated size 26.9 KiB, free 546.2 MiB)
20/06/28 21:40:47.924 Executor task launch worker for task 18 INFO TorrentBroadcast: Reading broadcast variable 10 took 11 ms
20/06/28 21:40:47.991 Executor task launch worker for task 18 INFO MemoryStore: Block broadcast_10 stored as values in memory (estimated size 423.1 KiB, free 545.8 MiB)
20/06/28 21:40:48.105 Executor task launch worker for task 18 INFO MemoryStore: Block rdd_18_0 stored as values in memory (estimated size 152.0 B, free 545.8 MiB)
20/06/28 21:40:48.116 Executor task launch worker for task 18 INFO Executor: Finished task 0.0 in stage 9.0 (TID 18). 961 bytes result sent to driver
20/06/28 21:40:48.267 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 21
20/06/28 21:40:48.268 Executor task launch worker for task 21 INFO Executor: Running task 0.0 in stage 10.0 (TID 21)
20/06/28 21:40:48.285 Executor task launch worker for task 21 INFO TorrentBroadcast: Started reading broadcast variable 12 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:48.292 Executor task launch worker for task 21 INFO MemoryStore: Block broadcast_12_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 545.8 MiB)
20/06/28 21:40:48.294 Executor task launch worker for task 21 INFO TorrentBroadcast: Reading broadcast variable 12 took 8 ms
20/06/28 21:40:48.296 Executor task launch worker for task 21 INFO MemoryStore: Block broadcast_12 stored as values in memory (estimated size 4.1 KiB, free 545.8 MiB)
20/06/28 21:40:48.299 Executor task launch worker for task 21 INFO BlockManager: Found block rdd_18_0 locally
20/06/28 21:40:48.301 Executor task launch worker for task 21 INFO Executor: Finished task 0.0 in stage 10.0 (TID 21). 961 bytes result sent to driver
20/06/28 21:40:48.428 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 23
20/06/28 21:40:48.429 Executor task launch worker for task 23 INFO Executor: Running task 0.0 in stage 11.0 (TID 23)
20/06/28 21:40:48.432 Executor task launch worker for task 23 INFO TorrentBroadcast: Started reading broadcast variable 13 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:48.440 Executor task launch worker for task 23 INFO MemoryStore: Block broadcast_13_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 545.8 MiB)
20/06/28 21:40:48.444 Executor task launch worker for task 23 INFO TorrentBroadcast: Reading broadcast variable 13 took 11 ms
20/06/28 21:40:48.447 Executor task launch worker for task 23 INFO MemoryStore: Block broadcast_13 stored as values in memory (estimated size 4.1 KiB, free 545.8 MiB)
20/06/28 21:40:48.451 Executor task launch worker for task 23 INFO BlockManager: Found block rdd_18_0 locally
20/06/28 21:40:48.453 Executor task launch worker for task 23 INFO Executor: Finished task 0.0 in stage 11.0 (TID 23). 961 bytes result sent to driver
20/06/28 21:40:49.316 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 25
20/06/28 21:40:49.316 Executor task launch worker for task 25 INFO Executor: Running task 1.0 in stage 12.0 (TID 25)
20/06/28 21:40:49.320 Executor task launch worker for task 25 INFO TorrentBroadcast: Started reading broadcast variable 14 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:49.328 Executor task launch worker for task 25 INFO MemoryStore: Block broadcast_14_piece0 stored as bytes in memory (estimated size 2.9 KiB, free 545.8 MiB)
20/06/28 21:40:49.331 Executor task launch worker for task 25 INFO TorrentBroadcast: Reading broadcast variable 14 took 10 ms
20/06/28 21:40:49.335 Executor task launch worker for task 25 INFO MemoryStore: Block broadcast_14 stored as values in memory (estimated size 6.0 KiB, free 545.8 MiB)
20/06/28 21:40:49.400 Executor task launch worker for task 25 INFO Executor: Finished task 1.0 in stage 12.0 (TID 25). 840 bytes result sent to driver
20/06/28 21:40:49.655 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 27
20/06/28 21:40:49.655 Executor task launch worker for task 27 INFO Executor: Running task 1.0 in stage 13.0 (TID 27)
20/06/28 21:40:49.666 Executor task launch worker for task 27 INFO TorrentBroadcast: Started reading broadcast variable 15 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:49.674 Executor task launch worker for task 27 INFO MemoryStore: Block broadcast_15_piece0 stored as bytes in memory (estimated size 2.9 KiB, free 545.8 MiB)
20/06/28 21:40:49.677 Executor task launch worker for task 27 INFO TorrentBroadcast: Reading broadcast variable 15 took 11 ms
20/06/28 21:40:49.680 Executor task launch worker for task 27 INFO MemoryStore: Block broadcast_15 stored as values in memory (estimated size 6.0 KiB, free 545.8 MiB)
20/06/28 21:40:49.728 Executor task launch worker for task 27 INFO Executor: Finished task 1.0 in stage 13.0 (TID 27). 840 bytes result sent to driver
20/06/28 21:40:50.078 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 28
20/06/28 21:40:50.079 Executor task launch worker for task 28 INFO Executor: Running task 0.0 in stage 14.0 (TID 28)
20/06/28 21:40:50.083 Executor task launch worker for task 28 INFO TorrentBroadcast: Started reading broadcast variable 17 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:50.091 Executor task launch worker for task 28 INFO MemoryStore: Block broadcast_17_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 545.8 MiB)
20/06/28 21:40:50.093 Executor task launch worker for task 28 INFO TorrentBroadcast: Reading broadcast variable 17 took 10 ms
20/06/28 21:40:50.097 Executor task launch worker for task 28 INFO MemoryStore: Block broadcast_17 stored as values in memory (estimated size 6.6 KiB, free 545.8 MiB)
20/06/28 21:40:50.175 Executor task launch worker for task 28 INFO TorrentBroadcast: Started reading broadcast variable 16 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:50.183 Executor task launch worker for task 28 INFO MemoryStore: Block broadcast_16_piece0 stored as bytes in memory (estimated size 80.0 B, free 545.8 MiB)
20/06/28 21:40:50.186 Executor task launch worker for task 28 INFO TorrentBroadcast: Reading broadcast variable 16 took 11 ms
20/06/28 21:40:50.188 Executor task launch worker for task 28 INFO MemoryStore: Block broadcast_16 stored as values in memory (estimated size 64.0 B, free 545.8 MiB)
20/06/28 21:40:50.190 Executor task launch worker for task 28 INFO Executor: Finished task 0.0 in stage 14.0 (TID 28). 828 bytes result sent to driver
20/06/28 21:40:50.433 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 31
20/06/28 21:40:50.434 Executor task launch worker for task 31 INFO Executor: Running task 1.0 in stage 15.0 (TID 31)
20/06/28 21:40:50.437 Executor task launch worker for task 31 INFO TorrentBroadcast: Started reading broadcast variable 18 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:50.443 Executor task launch worker for task 31 INFO MemoryStore: Block broadcast_18_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 545.8 MiB)
20/06/28 21:40:50.446 Executor task launch worker for task 31 INFO TorrentBroadcast: Reading broadcast variable 18 took 9 ms
20/06/28 21:40:50.448 Executor task launch worker for task 31 INFO MemoryStore: Block broadcast_18 stored as values in memory (estimated size 6.6 KiB, free 545.8 MiB)
20/06/28 21:40:50.470 Executor task launch worker for task 31 INFO Executor: Finished task 1.0 in stage 15.0 (TID 31). 832 bytes result sent to driver
20/06/28 21:40:53.453 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 32
20/06/28 21:40:53.453 Executor task launch worker for task 32 INFO Executor: Running task 0.0 in stage 16.0 (TID 32)
20/06/28 21:40:53.456 Executor task launch worker for task 32 INFO TorrentBroadcast: Started reading broadcast variable 19 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:53.462 Executor task launch worker for task 32 INFO MemoryStore: Block broadcast_19_piece0 stored as bytes in memory (estimated size 4.6 KiB, free 545.9 MiB)
20/06/28 21:40:53.464 Executor task launch worker for task 32 INFO TorrentBroadcast: Reading broadcast variable 19 took 8 ms
20/06/28 21:40:53.466 Executor task launch worker for task 32 INFO MemoryStore: Block broadcast_19 stored as values in memory (estimated size 9.5 KiB, free 545.8 MiB)
20/06/28 21:40:53.994 Executor task launch worker for task 32 INFO CodeGenerator: Code generated in 269.640552 ms
20/06/28 21:40:54.007 Executor task launch worker for task 32 INFO Executor: Finished task 0.0 in stage 16.0 (TID 32). 1483 bytes result sent to driver
20/06/28 21:40:56.052 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 34
20/06/28 21:40:56.052 Executor task launch worker for task 34 INFO Executor: Running task 0.0 in stage 17.0 (TID 34)
20/06/28 21:40:56.058 Executor task launch worker for task 34 INFO TorrentBroadcast: Started reading broadcast variable 20 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:56.065 Executor task launch worker for task 34 INFO MemoryStore: Block broadcast_20_piece0 stored as bytes in memory (estimated size 5.6 KiB, free 545.8 MiB)
20/06/28 21:40:56.068 Executor task launch worker for task 34 INFO TorrentBroadcast: Reading broadcast variable 20 took 10 ms
20/06/28 21:40:56.071 Executor task launch worker for task 34 INFO MemoryStore: Block broadcast_20 stored as values in memory (estimated size 10.8 KiB, free 545.8 MiB)
20/06/28 21:40:56.154 Executor task launch worker for task 34 INFO CodeGenerator: Code generated in 34.320158 ms
20/06/28 21:40:56.189 Executor task launch worker for task 34 INFO Executor: Finished task 0.0 in stage 17.0 (TID 34). 1844 bytes result sent to driver
20/06/28 21:40:57.755 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 37
20/06/28 21:40:57.756 Executor task launch worker for task 37 INFO Executor: Running task 0.0 in stage 19.0 (TID 37)
20/06/28 21:40:57.758 Executor task launch worker for task 37 INFO MapOutputTrackerWorker: Updating epoch to 1 and clearing cache
20/06/28 21:40:57.760 Executor task launch worker for task 37 INFO TorrentBroadcast: Started reading broadcast variable 22 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:57.767 Executor task launch worker for task 37 INFO MemoryStore: Block broadcast_22_piece0 stored as bytes in memory (estimated size 1898.0 B, free 545.8 MiB)
20/06/28 21:40:57.768 Executor task launch worker for task 37 INFO TorrentBroadcast: Reading broadcast variable 22 took 8 ms
20/06/28 21:40:57.770 Executor task launch worker for task 37 INFO MemoryStore: Block broadcast_22 stored as values in memory (estimated size 3.4 KiB, free 545.8 MiB)
20/06/28 21:40:57.791 Executor task launch worker for task 37 INFO Executor: Finished task 0.0 in stage 19.0 (TID 37). 1318 bytes result sent to driver
20/06/28 21:40:58.716 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 39
20/06/28 21:40:58.716 Executor task launch worker for task 39 INFO Executor: Running task 0.0 in stage 20.0 (TID 39)
20/06/28 21:40:58.731 Executor task launch worker for task 39 INFO TorrentBroadcast: Started reading broadcast variable 23 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:58.735 Executor task launch worker for task 39 INFO MemoryStore: Block broadcast_23_piece0 stored as bytes in memory (estimated size 1322.0 B, free 545.8 MiB)
20/06/28 21:40:58.737 Executor task launch worker for task 39 INFO TorrentBroadcast: Reading broadcast variable 23 took 5 ms
20/06/28 21:40:58.738 Executor task launch worker for task 39 INFO MemoryStore: Block broadcast_23 stored as values in memory (estimated size 2.1 KiB, free 545.8 MiB)
20/06/28 21:40:58.740 Executor task launch worker for task 39 INFO Executor: Finished task 0.0 in stage 20.0 (TID 39). 1324 bytes result sent to driver
20/06/28 21:40:58.743 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 41
20/06/28 21:40:58.743 Executor task launch worker for task 41 INFO Executor: Running task 2.0 in stage 20.0 (TID 41)
20/06/28 21:40:58.746 Executor task launch worker for task 41 INFO Executor: Finished task 2.0 in stage 20.0 (TID 41). 1324 bytes result sent to driver
20/06/28 21:40:58.749 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 44
20/06/28 21:40:58.750 Executor task launch worker for task 44 INFO Executor: Running task 5.0 in stage 20.0 (TID 44)
20/06/28 21:40:58.752 Executor task launch worker for task 44 INFO Executor: Finished task 5.0 in stage 20.0 (TID 44). 1324 bytes result sent to driver
20/06/28 21:40:58.755 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 46
20/06/28 21:40:58.755 Executor task launch worker for task 46 INFO Executor: Running task 7.0 in stage 20.0 (TID 46)
20/06/28 21:40:58.758 Executor task launch worker for task 46 INFO Executor: Finished task 7.0 in stage 20.0 (TID 46). 1324 bytes result sent to driver
20/06/28 21:40:58.760 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 48
20/06/28 21:40:58.760 Executor task launch worker for task 48 INFO Executor: Running task 9.0 in stage 20.0 (TID 48)
20/06/28 21:40:58.763 Executor task launch worker for task 48 INFO Executor: Finished task 9.0 in stage 20.0 (TID 48). 1324 bytes result sent to driver
20/06/28 21:40:59.422 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 50
20/06/28 21:40:59.422 Executor task launch worker for task 50 INFO Executor: Running task 1.0 in stage 21.0 (TID 50)
20/06/28 21:40:59.437 Executor task launch worker for task 50 INFO TorrentBroadcast: Started reading broadcast variable 24 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:59.444 Executor task launch worker for task 50 INFO MemoryStore: Block broadcast_24_piece0 stored as bytes in memory (estimated size 2.6 KiB, free 545.9 MiB)
20/06/28 21:40:59.446 Executor task launch worker for task 50 INFO TorrentBroadcast: Reading broadcast variable 24 took 8 ms
20/06/28 21:40:59.448 Executor task launch worker for task 50 INFO MemoryStore: Block broadcast_24 stored as values in memory (estimated size 4.6 KiB, free 545.9 MiB)
20/06/28 21:40:59.513 Executor task launch worker for task 50 INFO Executor: Finished task 1.0 in stage 21.0 (TID 50). 1041 bytes result sent to driver
20/06/28 21:40:59.537 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 51
20/06/28 21:40:59.537 Executor task launch worker for task 51 INFO Executor: Running task 1.0 in stage 22.0 (TID 51)
20/06/28 21:40:59.539 Executor task launch worker for task 51 INFO MapOutputTrackerWorker: Updating epoch to 2 and clearing cache
20/06/28 21:40:59.540 Executor task launch worker for task 51 INFO TorrentBroadcast: Started reading broadcast variable 25 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:40:59.545 Executor task launch worker for task 51 INFO MemoryStore: Block broadcast_25_piece0 stored as bytes in memory (estimated size 3.0 KiB, free 545.9 MiB)
20/06/28 21:40:59.546 Executor task launch worker for task 51 INFO TorrentBroadcast: Reading broadcast variable 25 took 5 ms
20/06/28 21:40:59.548 Executor task launch worker for task 51 INFO MemoryStore: Block broadcast_25 stored as values in memory (estimated size 5.6 KiB, free 545.8 MiB)
20/06/28 21:40:59.557 Executor task launch worker for task 51 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 1, fetching them
20/06/28 21:40:59.558 Executor task launch worker for task 51 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@amp-jenkins-worker-04.amp:33831)
20/06/28 21:40:59.576 Executor task launch worker for task 51 INFO MapOutputTrackerWorker: Got the output locations
20/06/28 21:40:59.598 Executor task launch worker for task 51 INFO ShuffleBlockFetcherIterator: Getting 2 (668.0 B) non-empty blocks including 1 (334.0 B) local and 0 (0.0 B) host-local and 1 (334.0 B) remote blocks
20/06/28 21:40:59.604 Executor task launch worker for task 51 INFO ShuffleBlockFetcherIterator: Started 1 remote fetches in 16 ms
20/06/28 21:40:59.631 Executor task launch worker for task 51 INFO Executor: Finished task 1.0 in stage 22.0 (TID 51). 2084 bytes result sent to driver
20/06/28 21:41:00.902 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 54
20/06/28 21:41:00.903 Executor task launch worker for task 54 INFO Executor: Running task 1.0 in stage 23.0 (TID 54)
20/06/28 21:41:00.917 Executor task launch worker for task 54 INFO TorrentBroadcast: Started reading broadcast variable 26 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:41:00.921 Executor task launch worker for task 54 INFO MemoryStore: Block broadcast_26_piece0 stored as bytes in memory (estimated size 1319.0 B, free 545.8 MiB)
20/06/28 21:41:00.923 Executor task launch worker for task 54 INFO TorrentBroadcast: Reading broadcast variable 26 took 5 ms
20/06/28 21:41:00.924 Executor task launch worker for task 54 INFO MemoryStore: Block broadcast_26 stored as values in memory (estimated size 2.0 KiB, free 545.8 MiB)
20/06/28 21:41:00.928 Executor task launch worker for task 54 INFO MemoryStore: Block rdd_43_1 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:00.953 shuffle-server-6-1 INFO MemoryStore: Block rdd_43_0 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:00.963 Executor task launch worker for task 54 INFO Executor: Finished task 1.0 in stage 23.0 (TID 54). 875 bytes result sent to driver
20/06/28 21:41:00.967 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 56
20/06/28 21:41:00.967 Executor task launch worker for task 56 INFO Executor: Running task 3.0 in stage 23.0 (TID 56)
20/06/28 21:41:00.972 Executor task launch worker for task 56 INFO MemoryStore: Block rdd_43_3 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:00.979 shuffle-server-6-1 INFO MemoryStore: Block rdd_43_2 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:00.982 Executor task launch worker for task 56 INFO Executor: Finished task 3.0 in stage 23.0 (TID 56). 875 bytes result sent to driver
20/06/28 21:41:00.985 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 58
20/06/28 21:41:00.985 Executor task launch worker for task 58 INFO Executor: Running task 5.0 in stage 23.0 (TID 58)
20/06/28 21:41:00.990 Executor task launch worker for task 58 INFO MemoryStore: Block rdd_43_5 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:00.995 shuffle-server-6-1 INFO MemoryStore: Block rdd_43_4 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:00.999 Executor task launch worker for task 58 INFO Executor: Finished task 5.0 in stage 23.0 (TID 58). 875 bytes result sent to driver
20/06/28 21:41:01.002 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 60
20/06/28 21:41:01.002 Executor task launch worker for task 60 INFO Executor: Running task 7.0 in stage 23.0 (TID 60)
20/06/28 21:41:01.008 Executor task launch worker for task 60 INFO MemoryStore: Block rdd_43_7 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:01.014 shuffle-server-6-1 INFO MemoryStore: Block rdd_43_6 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:01.017 Executor task launch worker for task 60 INFO Executor: Finished task 7.0 in stage 23.0 (TID 60). 875 bytes result sent to driver
20/06/28 21:41:01.020 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 61
20/06/28 21:41:01.020 Executor task launch worker for task 61 INFO Executor: Running task 8.0 in stage 23.0 (TID 61)
20/06/28 21:41:01.026 Executor task launch worker for task 61 INFO MemoryStore: Block rdd_43_8 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:01.032 shuffle-server-6-1 INFO MemoryStore: Block rdd_43_9 stored as values in memory (estimated size 376.0 B, free 545.8 MiB)
20/06/28 21:41:01.035 Executor task launch worker for task 61 INFO Executor: Finished task 8.0 in stage 23.0 (TID 61). 875 bytes result sent to driver
20/06/28 21:41:02.054 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 64
20/06/28 21:41:02.054 Executor task launch worker for task 64 INFO Executor: Running task 1.0 in stage 24.0 (TID 64)
20/06/28 21:41:02.057 Executor task launch worker for task 64 INFO TorrentBroadcast: Started reading broadcast variable 28 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:41:02.061 Executor task launch worker for task 64 INFO MemoryStore: Block broadcast_28_piece0 stored as bytes in memory (estimated size 2.6 KiB, free 545.8 MiB)
20/06/28 21:41:02.063 Executor task launch worker for task 64 INFO TorrentBroadcast: Reading broadcast variable 28 took 5 ms
20/06/28 21:41:02.064 Executor task launch worker for task 64 INFO MemoryStore: Block broadcast_28 stored as values in memory (estimated size 4.5 KiB, free 545.8 MiB)
20/06/28 21:41:02.075 Executor task launch worker for task 64 INFO HadoopRDD: Input split: file:/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/pom.xml:2887+2888
20/06/28 21:41:02.076 Executor task launch worker for task 64 INFO TorrentBroadcast: Started reading broadcast variable 27 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:41:02.080 Executor task launch worker for task 64 INFO MemoryStore: Block broadcast_27_piece0 stored as bytes in memory (estimated size 27.0 KiB, free 545.8 MiB)
20/06/28 21:41:02.081 Executor task launch worker for task 64 INFO TorrentBroadcast: Reading broadcast variable 27 took 4 ms
20/06/28 21:41:02.098 Executor task launch worker for task 64 INFO MemoryStore: Block broadcast_27 stored as values in memory (estimated size 423.1 KiB, free 545.4 MiB)
20/06/28 21:41:02.121 Executor task launch worker for task 64 INFO MemoryStore: Block rdd_46_1 stored as values in memory (estimated size 6.6 KiB, free 545.4 MiB)
20/06/28 21:41:02.125 Executor task launch worker for task 64 INFO Executor: Finished task 1.0 in stage 24.0 (TID 64). 961 bytes result sent to driver
20/06/28 21:41:02.447 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 65
20/06/28 21:41:02.448 Executor task launch worker for task 65 INFO Executor: Running task 1.0 in stage 25.0 (TID 65)
20/06/28 21:41:02.450 Executor task launch worker for task 65 INFO TorrentBroadcast: Started reading broadcast variable 29 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:41:02.454 Executor task launch worker for task 65 INFO MemoryStore: Block broadcast_29_piece0 stored as bytes in memory (estimated size 3.5 KiB, free 545.4 MiB)
20/06/28 21:41:02.457 Executor task launch worker for task 65 INFO TorrentBroadcast: Reading broadcast variable 29 took 6 ms
20/06/28 21:41:02.459 Executor task launch worker for task 65 INFO MemoryStore: Block broadcast_29 stored as values in memory (estimated size 6.5 KiB, free 545.4 MiB)
20/06/28 21:41:02.462 Executor task launch worker for task 65 INFO BlockManager: Found block rdd_46_1 locally
20/06/28 21:41:02.469 Executor task launch worker for task 65 INFO Executor: Finished task 1.0 in stage 25.0 (TID 65). 1127 bytes result sent to driver
20/06/28 21:41:02.482 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 67
20/06/28 21:41:02.483 Executor task launch worker for task 67 INFO Executor: Running task 0.0 in stage 26.0 (TID 67)
20/06/28 21:41:02.491 Executor task launch worker for task 67 INFO MapOutputTrackerWorker: Updating epoch to 3 and clearing cache
20/06/28 21:41:02.493 Executor task launch worker for task 67 INFO TorrentBroadcast: Started reading broadcast variable 30 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:41:02.497 Executor task launch worker for task 67 INFO MemoryStore: Block broadcast_30_piece0 stored as bytes in memory (estimated size 2.5 KiB, free 545.4 MiB)
20/06/28 21:41:02.498 Executor task launch worker for task 67 INFO TorrentBroadcast: Reading broadcast variable 30 took 5 ms
20/06/28 21:41:02.499 Executor task launch worker for task 67 INFO MemoryStore: Block broadcast_30 stored as values in memory (estimated size 4.5 KiB, free 545.4 MiB)
20/06/28 21:41:02.506 Executor task launch worker for task 67 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 2, fetching them
20/06/28 21:41:02.506 Executor task launch worker for task 67 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@amp-jenkins-worker-04.amp:33831)
20/06/28 21:41:02.508 Executor task launch worker for task 67 INFO MapOutputTrackerWorker: Got the output locations
20/06/28 21:41:02.509 Executor task launch worker for task 67 INFO ShuffleBlockFetcherIterator: Getting 2 (1304.0 B) non-empty blocks including 1 (652.0 B) local and 0 (0.0 B) host-local and 1 (652.0 B) remote blocks
20/06/28 21:41:02.509 Executor task launch worker for task 67 INFO ShuffleBlockFetcherIterator: Started 1 remote fetches in 1 ms
20/06/28 21:41:02.519 Executor task launch worker for task 67 INFO MemoryStore: Block rdd_50_0 stored as values in memory (estimated size 6.3 KiB, free 545.4 MiB)
20/06/28 21:41:02.522 Executor task launch worker for task 67 INFO Executor: Finished task 0.0 in stage 26.0 (TID 67). 1176 bytes result sent to driver
20/06/28 21:41:03.882 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 70
20/06/28 21:41:03.882 Executor task launch worker for task 70 INFO Executor: Running task 1.0 in stage 27.0 (TID 70)
20/06/28 21:41:03.885 Executor task launch worker for task 70 INFO TorrentBroadcast: Started reading broadcast variable 31 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:41:03.889 Executor task launch worker for task 70 INFO MemoryStore: Block broadcast_31_piece0 stored as bytes in memory (estimated size 1945.0 B, free 545.4 MiB)
20/06/28 21:41:03.890 Executor task launch worker for task 70 INFO TorrentBroadcast: Reading broadcast variable 31 took 4 ms
20/06/28 21:41:03.891 Executor task launch worker for task 70 INFO MemoryStore: Block broadcast_31 stored as values in memory (estimated size 3.5 KiB, free 545.4 MiB)
20/06/28 21:41:03.904 Executor task launch worker for task 70 INFO Executor: Finished task 1.0 in stage 27.0 (TID 70). 1284 bytes result sent to driver
20/06/28 21:41:04.891 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 72
20/06/28 21:41:04.891 Executor task launch worker for task 72 INFO Executor: Running task 1.0 in stage 28.0 (TID 72)
20/06/28 21:41:04.894 Executor task launch worker for task 72 INFO TorrentBroadcast: Started reading broadcast variable 32 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:41:04.898 Executor task launch worker for task 72 INFO MemoryStore: Block broadcast_32_piece0 stored as bytes in memory (estimated size 1946.0 B, free 545.4 MiB)
20/06/28 21:41:04.899 Executor task launch worker for task 72 INFO TorrentBroadcast: Reading broadcast variable 32 took 5 ms
20/06/28 21:41:04.900 Executor task launch worker for task 72 INFO MemoryStore: Block broadcast_32 stored as values in memory (estimated size 3.5 KiB, free 545.4 MiB)
20/06/28 21:41:04.912 Executor task launch worker for task 72 INFO Executor: Finished task 1.0 in stage 28.0 (TID 72). 1284 bytes result sent to driver
20/06/28 21:41:07.105 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 73
20/06/28 21:41:07.105 Executor task launch worker for task 73 INFO Executor: Running task 0.0 in stage 29.0 (TID 73)
20/06/28 21:41:07.108 Executor task launch worker for task 73 INFO TorrentBroadcast: Started reading broadcast variable 33 with 1 pieces (estimated total size 4.0 MiB)
20/06/28 21:41:07.115 Executor task launch worker for task 73 INFO MemoryStore: Block broadcast_33_piece0 stored as bytes in memory (estimated size 1878.0 B, free 545.4 MiB)
20/06/28 21:41:07.117 Executor task launch worker for task 73 INFO TorrentBroadcast: Reading broadcast variable 33 took 8 ms
20/06/28 21:41:07.120 Executor task launch worker for task 73 INFO MemoryStore: Block broadcast_33 stored as values in memory (estimated size 3.4 KiB, free 545.4 MiB)
20/06/28 21:41:07.142 Executor task launch worker for task 73 INFO Executor: Finished task 0.0 in stage 29.0 (TID 73). 847 bytes result sent to driver
20/06/28 21:41:09.198 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver commanded a shutdown
20/06/28 21:41:09.202 SIGTERM handler ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM
20/06/28 21:41:09.207 shutdown-hook-0 INFO DiskBlockManager: Shutdown hook called
20/06/28 21:41:09.215 shutdown-hook-0 INFO ShutdownHookManager: Shutdown hook called
20/06/28 21:41:09.215 dispatcher-event-loop-0 ERROR WorkerWatcher: Lost connection to worker rpc endpoint spark://Worker@amp-jenkins-worker-04.amp:38203. Exiting.
20/06/28 21:41:09.215 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver from amp-jenkins-worker-04.amp:38203 disconnected during shutdown
20/06/28 21:41:09.221 CoarseGrainedExecutorBackend-stop-executor INFO MemoryStore: MemoryStore cleared
20/06/28 21:41:09.222 CoarseGrainedExecutorBackend-stop-executor INFO BlockManager: BlockManager stopped