11:19:43.450 main INFO CoarseGrainedExecutorBackend: Started daemon with process name: 16185@amp-jenkins-worker-04 11:19:43.458 main INFO SignalUtils: Registering signal handler for TERM 11:19:43.459 main INFO SignalUtils: Registering signal handler for HUP 11:19:43.459 main INFO SignalUtils: Registering signal handler for INT 11:19:43.938 main WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 11:19:44.044 main INFO SecurityManager: Changing view acls to: jenkins 11:19:44.045 main INFO SecurityManager: Changing modify acls to: jenkins 11:19:44.045 main INFO SecurityManager: Changing view acls groups to: 11:19:44.046 main INFO SecurityManager: Changing modify acls groups to: 11:19:44.047 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 11:19:44.562 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:36727 after 117 ms (0 ms spent in bootstraps) 11:19:44.679 main INFO SecurityManager: Changing view acls to: jenkins 11:19:44.679 main INFO SecurityManager: Changing modify acls to: jenkins 11:19:44.679 main INFO SecurityManager: Changing view acls groups to: 11:19:44.680 main INFO SecurityManager: Changing modify acls groups to: 11:19:44.680 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 11:19:44.743 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:36727 after 2 ms (0 ms spent in bootstraps) 11:19:44.803 main INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-b35d5202-1788-428e-88d8-d2d00e91cd96/executor-693dfa9e-a6f1-4a77-b944-e264f4fd1a28/blockmgr-aa76b1ba-6b0c-4cdc-8c09-00e0c379c178 11:19:44.849 main INFO MemoryStore: MemoryStore started with capacity 546.3 MiB 11:19:45.063 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Registering PWR handler. 11:19:45.064 dispatcher-Executor INFO SignalUtils: Registering signal handler for PWR 11:19:45.064 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Connecting to driver: spark://CoarseGrainedScheduler@amp-jenkins-worker-04.amp:36727 11:19:45.065 main INFO WorkerWatcher: Connecting to worker spark://Worker@amp-jenkins-worker-04.amp:46721 11:19:45.068 netty-rpc-connection-1 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:46721 after 1 ms (0 ms spent in bootstraps) 11:19:45.072 dispatcher-event-loop-1 INFO WorkerWatcher: Successfully connected to spark://Worker@amp-jenkins-worker-04.amp:46721 11:19:45.078 dispatcher-Executor INFO ResourceUtils: ============================================================== 11:19:45.079 dispatcher-Executor INFO ResourceUtils: No custom resources configured for spark.executor. 11:19:45.079 dispatcher-Executor INFO ResourceUtils: ============================================================== 11:19:45.107 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Successfully registered with driver 11:19:45.111 dispatcher-Executor INFO Executor: Starting executor ID 1 on host amp-jenkins-worker-04.amp 11:19:45.264 dispatcher-Executor INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 45953. 11:19:45.265 dispatcher-Executor INFO NettyBlockTransferService: Server created on amp-jenkins-worker-04.amp:45953 11:19:45.267 dispatcher-Executor INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 11:19:45.277 dispatcher-Executor INFO BlockManagerMaster: Registering BlockManager BlockManagerId(1, amp-jenkins-worker-04.amp, 45953, None) 11:19:45.304 dispatcher-Executor INFO BlockManagerMaster: Registered BlockManager BlockManagerId(1, amp-jenkins-worker-04.amp, 45953, None) 11:19:45.305 dispatcher-Executor INFO BlockManager: Initialized BlockManager: BlockManagerId(1, amp-jenkins-worker-04.amp, 45953, None) 11:19:45.348 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 1 11:19:45.358 Executor task launch worker for task 1 INFO Executor: Running task 1.0 in stage 0.0 (TID 1) 11:19:45.496 Executor task launch worker for task 1 INFO TorrentBroadcast: Started reading broadcast variable 0 with 1 pieces (estimated total size 4.0 MiB) 11:19:45.560 Executor task launch worker for task 1 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:45224 after 3 ms (0 ms spent in bootstraps) 11:19:45.595 Executor task launch worker for task 1 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 7.4 KiB, free 546.3 MiB) 11:19:45.607 Executor task launch worker for task 1 INFO TorrentBroadcast: Reading broadcast variable 0 took 110 ms 11:19:45.788 Executor task launch worker for task 1 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 16.4 KiB, free 546.3 MiB) 11:19:47.098 Executor task launch worker for task 1 INFO CodeGenerator: Code generated in 338.484092 ms 11:19:47.229 Executor task launch worker for task 1 INFO CodeGenerator: Code generated in 16.157802 ms 11:19:47.255 Executor task launch worker for task 1 INFO CodeGenerator: Code generated in 16.93166 ms 11:19:47.281 Executor task launch worker for task 1 INFO Executor: Finished task 1.0 in stage 0.0 (TID 1). 1508 bytes result sent to driver 11:19:47.441 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 2 11:19:47.442 Executor task launch worker for task 2 INFO Executor: Running task 0.0 in stage 1.0 (TID 2) 11:19:47.448 Executor task launch worker for task 2 INFO TorrentBroadcast: Started reading broadcast variable 1 with 1 pieces (estimated total size 4.0 MiB) 11:19:47.462 Executor task launch worker for task 2 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 61.7 KiB, free 546.2 MiB) 11:19:47.465 Executor task launch worker for task 2 INFO TorrentBroadcast: Reading broadcast variable 1 took 16 ms 11:19:47.476 Executor task launch worker for task 2 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 173.8 KiB, free 546.0 MiB) 11:19:47.675 Executor task launch worker for task 2 INFO CodeGenerator: Code generated in 40.987336 ms 11:19:47.695 Executor task launch worker for task 2 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 11:19:47.695 Executor task launch worker for task 2 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 11:19:47.837 Executor task launch worker for task 2 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter 11:19:47.967 Executor task launch worker for task 2 INFO FileOutputCommitter: Saved output of task 'attempt_20200701111947_0001_m_000000_2' to file:/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-acb8b29b-404b-4060-aa3c-99604451b0fe 11:19:47.968 Executor task launch worker for task 2 INFO SparkHadoopMapRedUtil: attempt_20200701111947_0001_m_000000_2: Committed 11:19:47.977 Executor task launch worker for task 2 INFO Executor: Finished task 0.0 in stage 1.0 (TID 2). 2270 bytes result sent to driver 11:19:48.109 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 5 11:19:48.110 Executor task launch worker for task 5 INFO Executor: Running task 1.0 in stage 2.0 (TID 5) 11:19:48.127 Executor task launch worker for task 5 INFO TorrentBroadcast: Started reading broadcast variable 2 with 1 pieces (estimated total size 4.0 MiB) 11:19:48.140 Executor task launch worker for task 5 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 61.6 KiB, free 546.0 MiB) 11:19:48.144 Executor task launch worker for task 5 INFO TorrentBroadcast: Reading broadcast variable 2 took 16 ms 11:19:48.154 Executor task launch worker for task 5 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 173.6 KiB, free 545.8 MiB) 11:19:48.185 Executor task launch worker for task 5 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 11:19:48.186 Executor task launch worker for task 5 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 11:19:48.187 Executor task launch worker for task 5 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter 11:19:48.219 Executor task launch worker for task 5 INFO FileOutputCommitter: Saved output of task 'attempt_20200701111948_0002_m_000001_5' to file:/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-acb8b29b-404b-4060-aa3c-99604451b0fe 11:19:48.219 Executor task launch worker for task 5 INFO SparkHadoopMapRedUtil: attempt_20200701111948_0002_m_000001_5: Committed 11:19:48.222 Executor task launch worker for task 5 INFO Executor: Finished task 1.0 in stage 2.0 (TID 5). 2227 bytes result sent to driver 11:19:48.288 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 6 11:19:48.288 Executor task launch worker for task 6 INFO Executor: Running task 0.0 in stage 3.0 (TID 6) 11:19:48.298 Executor task launch worker for task 6 INFO TorrentBroadcast: Started reading broadcast variable 4 with 1 pieces (estimated total size 4.0 MiB) 11:19:48.311 Executor task launch worker for task 6 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 6.4 KiB, free 545.8 MiB) 11:19:48.314 Executor task launch worker for task 6 INFO TorrentBroadcast: Reading broadcast variable 4 took 16 ms 11:19:48.317 Executor task launch worker for task 6 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 12.2 KiB, free 545.8 MiB) 11:19:48.423 Executor task launch worker for task 6 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-acb8b29b-404b-4060-aa3c-99604451b0fe/part-00001-4036f9b6-dfbe-4e7c-be8f-6f2d3e90b9bb-c000.json, range: 0-45, partition values: [empty row] 11:19:48.458 Executor task launch worker for task 6 INFO CodeGenerator: Code generated in 13.68922 ms 11:19:48.460 Executor task launch worker for task 6 INFO TorrentBroadcast: Started reading broadcast variable 3 with 1 pieces (estimated total size 4.0 MiB) 11:19:48.471 Executor task launch worker for task 6 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 27.6 KiB, free 545.8 MiB) 11:19:48.474 Executor task launch worker for task 6 INFO TorrentBroadcast: Reading broadcast variable 3 took 13 ms 11:19:48.530 Executor task launch worker for task 6 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 424.3 KiB, free 545.4 MiB) 11:19:48.579 Executor task launch worker for task 6 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-acb8b29b-404b-4060-aa3c-99604451b0fe/part-00001-dbadb8ec-cb64-4848-a6af-ad0d7fddc3d6-c000.json, range: 0-45, partition values: [empty row] 11:19:48.589 Executor task launch worker for task 6 INFO Executor: Finished task 0.0 in stage 3.0 (TID 6). 1916 bytes result sent to driver 11:19:48.680 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 9 11:19:48.680 Executor task launch worker for task 9 INFO Executor: Running task 1.0 in stage 4.0 (TID 9) 11:19:48.684 Executor task launch worker for task 9 INFO TorrentBroadcast: Started reading broadcast variable 5 with 1 pieces (estimated total size 4.0 MiB) 11:19:48.691 Executor task launch worker for task 9 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 7.4 KiB, free 545.4 MiB) 11:19:48.695 Executor task launch worker for task 9 INFO TorrentBroadcast: Reading broadcast variable 5 took 10 ms 11:19:48.698 Executor task launch worker for task 9 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 16.4 KiB, free 545.3 MiB) 11:19:48.714 Executor task launch worker for task 9 INFO Executor: Finished task 1.0 in stage 4.0 (TID 9). 1465 bytes result sent to driver 11:19:48.881 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 11 11:19:48.882 Executor task launch worker for task 11 INFO Executor: Running task 1.0 in stage 5.0 (TID 11) 11:19:48.885 Executor task launch worker for task 11 INFO TorrentBroadcast: Started reading broadcast variable 6 with 1 pieces (estimated total size 4.0 MiB) 11:19:48.893 Executor task launch worker for task 11 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 2.5 KiB, free 545.3 MiB) 11:19:48.896 Executor task launch worker for task 11 INFO TorrentBroadcast: Reading broadcast variable 6 took 10 ms 11:19:48.899 Executor task launch worker for task 11 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 4.4 KiB, free 545.3 MiB) 11:19:48.924 Executor task launch worker for task 11 INFO Executor: Finished task 1.0 in stage 5.0 (TID 11). 1146 bytes result sent to driver 11:19:48.963 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 12 11:19:48.964 Executor task launch worker for task 12 INFO Executor: Running task 0.0 in stage 6.0 (TID 12) 11:19:48.973 Executor task launch worker for task 12 INFO TorrentBroadcast: Started reading broadcast variable 7 with 1 pieces (estimated total size 4.0 MiB) 11:19:48.986 Executor task launch worker for task 12 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 2.5 KiB, free 545.3 MiB) 11:19:48.991 Executor task launch worker for task 12 INFO TorrentBroadcast: Reading broadcast variable 7 took 17 ms 11:19:48.994 Executor task launch worker for task 12 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 4.3 KiB, free 545.3 MiB) 11:19:49.001 Executor task launch worker for task 12 ERROR Executor: Exception in task 0.0 in stage 6.0 (TID 12) java.util.NoSuchElementException: spark.sql.a at org.apache.spark.sql.internal.SQLConf.$anonfun$getConfString$3(SQLConf.scala:3289) at scala.Option.getOrElse(Option.scala:189) at org.apache.spark.sql.internal.SQLConf.getConfString(SQLConf.scala:3289) at org.apache.spark.sql.internal.SQLConfAssertPlan.$anonfun$doExecute$2(ExecutorSideSQLConfSuite.scala:201) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.sql.internal.SQLConfAssertPlan.$anonfun$doExecute$1(ExecutorSideSQLConfSuite.scala:200) at org.apache.spark.rdd.RDD.$anonfun$mapPartitions$2(RDD.scala:863) at org.apache.spark.rdd.RDD.$anonfun$mapPartitions$2$adapted(RDD.scala:863) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.sql.execution.SQLExecutionRDD.$anonfun$compute$1(SQLExecutionRDD.scala:52) at org.apache.spark.sql.internal.SQLConf$.withExistingConf(SQLConf.scala:99) at org.apache.spark.sql.execution.SQLExecutionRDD.compute(SQLExecutionRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:127) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:464) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1377) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:467) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 11:19:49.032 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 14 11:19:49.032 Executor task launch worker for task 14 INFO Executor: Running task 1.1 in stage 6.0 (TID 14) 11:19:49.039 Executor task launch worker for task 14 ERROR Executor: Exception in task 1.1 in stage 6.0 (TID 14) java.util.NoSuchElementException: spark.sql.a at org.apache.spark.sql.internal.SQLConf.$anonfun$getConfString$3(SQLConf.scala:3289) at scala.Option.getOrElse(Option.scala:189) at org.apache.spark.sql.internal.SQLConf.getConfString(SQLConf.scala:3289) at org.apache.spark.sql.internal.SQLConfAssertPlan.$anonfun$doExecute$2(ExecutorSideSQLConfSuite.scala:201) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.sql.internal.SQLConfAssertPlan.$anonfun$doExecute$1(ExecutorSideSQLConfSuite.scala:200) at org.apache.spark.rdd.RDD.$anonfun$mapPartitions$2(RDD.scala:863) at org.apache.spark.rdd.RDD.$anonfun$mapPartitions$2$adapted(RDD.scala:863) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.sql.execution.SQLExecutionRDD.$anonfun$compute$1(SQLExecutionRDD.scala:52) at org.apache.spark.sql.internal.SQLConf$.withExistingConf(SQLConf.scala:99) at org.apache.spark.sql.execution.SQLExecutionRDD.compute(SQLExecutionRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:127) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:464) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1377) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:467) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 11:19:49.048 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 17 11:19:49.048 Executor task launch worker for task 17 INFO Executor: Running task 1.2 in stage 6.0 (TID 17) 11:19:49.054 Executor task launch worker for task 17 ERROR Executor: Exception in task 1.2 in stage 6.0 (TID 17) java.util.NoSuchElementException: spark.sql.a at org.apache.spark.sql.internal.SQLConf.$anonfun$getConfString$3(SQLConf.scala:3289) at scala.Option.getOrElse(Option.scala:189) at org.apache.spark.sql.internal.SQLConf.getConfString(SQLConf.scala:3289) at org.apache.spark.sql.internal.SQLConfAssertPlan.$anonfun$doExecute$2(ExecutorSideSQLConfSuite.scala:201) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.sql.internal.SQLConfAssertPlan.$anonfun$doExecute$1(ExecutorSideSQLConfSuite.scala:200) at org.apache.spark.rdd.RDD.$anonfun$mapPartitions$2(RDD.scala:863) at org.apache.spark.rdd.RDD.$anonfun$mapPartitions$2$adapted(RDD.scala:863) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.sql.execution.SQLExecutionRDD.$anonfun$compute$1(SQLExecutionRDD.scala:52) at org.apache.spark.sql.internal.SQLConf$.withExistingConf(SQLConf.scala:99) at org.apache.spark.sql.execution.SQLExecutionRDD.compute(SQLExecutionRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:127) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:464) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1377) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:467) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 11:19:49.063 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 18 11:19:49.064 Executor task launch worker for task 18 INFO Executor: Running task 0.3 in stage 6.0 (TID 18) 11:19:49.070 Executor task launch worker for task 18 ERROR Executor: Exception in task 0.3 in stage 6.0 (TID 18) java.util.NoSuchElementException: spark.sql.a at org.apache.spark.sql.internal.SQLConf.$anonfun$getConfString$3(SQLConf.scala:3289) at scala.Option.getOrElse(Option.scala:189) at org.apache.spark.sql.internal.SQLConf.getConfString(SQLConf.scala:3289) at org.apache.spark.sql.internal.SQLConfAssertPlan.$anonfun$doExecute$2(ExecutorSideSQLConfSuite.scala:201) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.sql.internal.SQLConfAssertPlan.$anonfun$doExecute$1(ExecutorSideSQLConfSuite.scala:200) at org.apache.spark.rdd.RDD.$anonfun$mapPartitions$2(RDD.scala:863) at org.apache.spark.rdd.RDD.$anonfun$mapPartitions$2$adapted(RDD.scala:863) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.sql.execution.SQLExecutionRDD.$anonfun$compute$1(SQLExecutionRDD.scala:52) at org.apache.spark.sql.internal.SQLConf$.withExistingConf(SQLConf.scala:99) at org.apache.spark.sql.execution.SQLExecutionRDD.compute(SQLExecutionRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:127) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:464) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1377) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:467) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 11:19:49.222 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 20 11:19:49.223 Executor task launch worker for task 20 INFO Executor: Running task 0.0 in stage 7.0 (TID 20) 11:19:49.229 Executor task launch worker for task 20 INFO TorrentBroadcast: Started reading broadcast variable 8 with 1 pieces (estimated total size 4.0 MiB) 11:19:49.239 Executor task launch worker for task 20 INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 5.8 KiB, free 545.3 MiB) 11:19:49.242 Executor task launch worker for task 20 INFO TorrentBroadcast: Reading broadcast variable 8 took 13 ms 11:19:49.245 Executor task launch worker for task 20 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 11.7 KiB, free 545.3 MiB) 11:19:49.338 Executor task launch worker for task 20 INFO CodeGenerator: Code generated in 62.668531 ms 11:19:49.360 Executor task launch worker for task 20 INFO CodeGenerator: Code generated in 18.767246 ms 11:19:49.364 Executor task launch worker for task 20 INFO Executor: Finished task 0.0 in stage 7.0 (TID 20). 1407 bytes result sent to driver 11:19:49.554 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 22 11:19:49.554 Executor task launch worker for task 22 INFO Executor: Running task 0.0 in stage 9.0 (TID 22) 11:19:49.557 Executor task launch worker for task 22 INFO TorrentBroadcast: Started reading broadcast variable 10 with 1 pieces (estimated total size 4.0 MiB) 11:19:49.563 Executor task launch worker for task 22 INFO MemoryStore: Block broadcast_10_piece0 stored as bytes in memory (estimated size 5.8 KiB, free 545.3 MiB) 11:19:49.566 Executor task launch worker for task 22 INFO TorrentBroadcast: Reading broadcast variable 10 took 9 ms 11:19:49.568 Executor task launch worker for task 22 INFO MemoryStore: Block broadcast_10 stored as values in memory (estimated size 11.7 KiB, free 545.3 MiB) 11:19:49.576 Executor task launch worker for task 22 INFO Executor: Finished task 0.0 in stage 9.0 (TID 22). 1364 bytes result sent to driver 11:19:49.681 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 25 11:19:49.681 Executor task launch worker for task 25 INFO Executor: Running task 1.0 in stage 11.0 (TID 25) 11:19:49.684 Executor task launch worker for task 25 INFO TorrentBroadcast: Started reading broadcast variable 12 with 1 pieces (estimated total size 4.0 MiB) 11:19:49.690 Executor task launch worker for task 25 INFO MemoryStore: Block broadcast_12_piece0 stored as bytes in memory (estimated size 7.5 KiB, free 545.3 MiB) 11:19:49.697 Executor task launch worker for task 25 INFO TorrentBroadcast: Reading broadcast variable 12 took 13 ms 11:19:49.700 Executor task launch worker for task 25 INFO MemoryStore: Block broadcast_12 stored as values in memory (estimated size 16.5 KiB, free 545.3 MiB) 11:19:49.736 Executor task launch worker for task 25 INFO CodeGenerator: Code generated in 32.420225 ms 11:19:49.748 Executor task launch worker for task 25 INFO Executor: Finished task 1.0 in stage 11.0 (TID 25). 1465 bytes result sent to driver 11:19:49.963 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 27 11:19:49.964 Executor task launch worker for task 27 INFO Executor: Running task 0.0 in stage 13.0 (TID 27) 11:19:49.967 Executor task launch worker for task 27 INFO TorrentBroadcast: Started reading broadcast variable 15 with 1 pieces (estimated total size 4.0 MiB) 11:19:49.975 Executor task launch worker for task 27 INFO MemoryStore: Block broadcast_15_piece0 stored as bytes in memory (estimated size 7.5 KiB, free 545.3 MiB) 11:19:49.978 Executor task launch worker for task 27 INFO TorrentBroadcast: Reading broadcast variable 15 took 10 ms 11:19:49.983 Executor task launch worker for task 27 INFO MemoryStore: Block broadcast_15 stored as values in memory (estimated size 16.5 KiB, free 545.2 MiB) 11:19:50.002 Executor task launch worker for task 27 INFO Executor: Finished task 0.0 in stage 13.0 (TID 27). 1465 bytes result sent to driver 11:19:50.029 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 29 11:19:50.036 Executor task launch worker for task 29 INFO Executor: Running task 0.0 in stage 14.0 (TID 29) 11:19:50.038 Executor task launch worker for task 29 INFO TorrentBroadcast: Started reading broadcast variable 17 with 1 pieces (estimated total size 4.0 MiB) 11:19:50.045 Executor task launch worker for task 29 INFO MemoryStore: Block broadcast_17_piece0 stored as bytes in memory (estimated size 6.9 KiB, free 545.2 MiB) 11:19:50.048 Executor task launch worker for task 29 INFO TorrentBroadcast: Reading broadcast variable 17 took 9 ms 11:19:50.051 Executor task launch worker for task 29 INFO MemoryStore: Block broadcast_17 stored as values in memory (estimated size 13.5 KiB, free 545.2 MiB) 11:19:50.113 Executor task launch worker for task 29 INFO TorrentBroadcast: Started reading broadcast variable 16 with 1 pieces (estimated total size 4.0 MiB) 11:19:50.120 Executor task launch worker for task 29 INFO MemoryStore: Block broadcast_16_piece0 stored as bytes in memory (estimated size 205.0 B, free 545.2 MiB) 11:19:50.123 Executor task launch worker for task 29 INFO TorrentBroadcast: Reading broadcast variable 16 took 9 ms 11:19:50.125 Executor task launch worker for task 29 INFO MemoryStore: Block broadcast_16 stored as values in memory (estimated size 192.0 B, free 545.2 MiB) 11:19:50.149 Executor task launch worker for task 29 INFO CodeGenerator: Code generated in 11.814717 ms 11:19:50.154 Executor task launch worker for task 29 INFO Executor: Finished task 0.0 in stage 14.0 (TID 29). 1886 bytes result sent to driver 11:19:50.165 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver commanded a shutdown 11:19:50.168 SIGTERM handler ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM 11:19:50.171 shutdown-hook-0 INFO DiskBlockManager: Shutdown hook called 11:19:50.176 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver from amp-jenkins-worker-04.amp:46721 disconnected during shutdown 11:19:50.176 dispatcher-event-loop-1 ERROR WorkerWatcher: Lost connection to worker rpc endpoint spark://Worker@amp-jenkins-worker-04.amp:46721. Exiting. 11:19:50.181 shutdown-hook-0 INFO ShutdownHookManager: Shutdown hook called 11:19:50.184 CoarseGrainedExecutorBackend-stop-executor INFO MemoryStore: MemoryStore cleared 11:19:50.185 CoarseGrainedExecutorBackend-stop-executor INFO BlockManager: BlockManager stopped