11:19:43.349 main INFO CoarseGrainedExecutorBackend: Started daemon with process name: 16180@amp-jenkins-worker-04 11:19:43.358 main INFO SignalUtils: Registering signal handler for TERM 11:19:43.359 main INFO SignalUtils: Registering signal handler for HUP 11:19:43.359 main INFO SignalUtils: Registering signal handler for INT 11:19:43.884 main WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 11:19:44.007 main INFO SecurityManager: Changing view acls to: jenkins 11:19:44.008 main INFO SecurityManager: Changing modify acls to: jenkins 11:19:44.008 main INFO SecurityManager: Changing view acls groups to: 11:19:44.009 main INFO SecurityManager: Changing modify acls groups to: 11:19:44.009 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 11:19:44.483 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:36727 after 81 ms (0 ms spent in bootstraps) 11:19:44.624 main INFO SecurityManager: Changing view acls to: jenkins 11:19:44.625 main INFO SecurityManager: Changing modify acls to: jenkins 11:19:44.625 main INFO SecurityManager: Changing view acls groups to: 11:19:44.625 main INFO SecurityManager: Changing modify acls groups to: 11:19:44.625 main INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 11:19:44.708 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:36727 after 3 ms (0 ms spent in bootstraps) 11:19:44.784 main INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-b35d5202-1788-428e-88d8-d2d00e91cd96/executor-20c52709-a519-4ca1-af67-ffdbcc705bfb/blockmgr-22e98494-7356-4265-94e5-0a00d4e343fb 11:19:44.831 main INFO MemoryStore: MemoryStore started with capacity 546.3 MiB 11:19:45.045 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Registering PWR handler. 11:19:45.045 dispatcher-Executor INFO SignalUtils: Registering signal handler for PWR 11:19:45.046 main INFO WorkerWatcher: Connecting to worker spark://Worker@amp-jenkins-worker-04.amp:43825 11:19:45.046 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Connecting to driver: spark://CoarseGrainedScheduler@amp-jenkins-worker-04.amp:36727 11:19:45.049 netty-rpc-connection-1 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:43825 after 1 ms (0 ms spent in bootstraps) 11:19:45.053 dispatcher-event-loop-0 INFO WorkerWatcher: Successfully connected to spark://Worker@amp-jenkins-worker-04.amp:43825 11:19:45.060 dispatcher-Executor INFO ResourceUtils: ============================================================== 11:19:45.061 dispatcher-Executor INFO ResourceUtils: No custom resources configured for spark.executor. 11:19:45.061 dispatcher-Executor INFO ResourceUtils: ============================================================== 11:19:45.092 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Successfully registered with driver 11:19:45.095 dispatcher-Executor INFO Executor: Starting executor ID 0 on host amp-jenkins-worker-04.amp 11:19:45.260 dispatcher-Executor INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 39953. 11:19:45.260 dispatcher-Executor INFO NettyBlockTransferService: Server created on amp-jenkins-worker-04.amp:39953 11:19:45.262 dispatcher-Executor INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 11:19:45.269 dispatcher-Executor INFO BlockManagerMaster: Registering BlockManager BlockManagerId(0, amp-jenkins-worker-04.amp, 39953, None) 11:19:45.276 dispatcher-Executor INFO BlockManagerMaster: Registered BlockManager BlockManagerId(0, amp-jenkins-worker-04.amp, 39953, None) 11:19:45.276 dispatcher-Executor INFO BlockManager: Initialized BlockManager: BlockManagerId(0, amp-jenkins-worker-04.amp, 39953, None) 11:19:45.317 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 0 11:19:45.327 Executor task launch worker for task 0 INFO Executor: Running task 0.0 in stage 0.0 (TID 0) 11:19:45.467 Executor task launch worker for task 0 INFO TorrentBroadcast: Started reading broadcast variable 0 with 1 pieces (estimated total size 4.0 MiB) 11:19:45.529 Executor task launch worker for task 0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:45224 after 2 ms (0 ms spent in bootstraps) 11:19:45.567 Executor task launch worker for task 0 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 7.4 KiB, free 546.3 MiB) 11:19:45.580 Executor task launch worker for task 0 INFO TorrentBroadcast: Reading broadcast variable 0 took 112 ms 11:19:45.776 Executor task launch worker for task 0 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 16.4 KiB, free 546.3 MiB) 11:19:47.083 Executor task launch worker for task 0 INFO CodeGenerator: Code generated in 354.859646 ms 11:19:47.224 Executor task launch worker for task 0 INFO CodeGenerator: Code generated in 15.144864 ms 11:19:47.254 Executor task launch worker for task 0 INFO CodeGenerator: Code generated in 20.53242 ms 11:19:47.278 Executor task launch worker for task 0 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1508 bytes result sent to driver 11:19:47.441 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 3 11:19:47.442 Executor task launch worker for task 3 INFO Executor: Running task 1.0 in stage 1.0 (TID 3) 11:19:47.449 Executor task launch worker for task 3 INFO TorrentBroadcast: Started reading broadcast variable 1 with 1 pieces (estimated total size 4.0 MiB) 11:19:47.461 Executor task launch worker for task 3 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 61.7 KiB, free 546.2 MiB) 11:19:47.464 Executor task launch worker for task 3 INFO TorrentBroadcast: Reading broadcast variable 1 took 15 ms 11:19:47.478 Executor task launch worker for task 3 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 173.8 KiB, free 546.0 MiB) 11:19:47.680 Executor task launch worker for task 3 INFO CodeGenerator: Code generated in 41.260926 ms 11:19:47.697 Executor task launch worker for task 3 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 11:19:47.697 Executor task launch worker for task 3 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 11:19:47.835 Executor task launch worker for task 3 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter 11:19:47.968 Executor task launch worker for task 3 INFO FileOutputCommitter: Saved output of task 'attempt_20200701111947_0001_m_000001_3' to file:/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-acb8b29b-404b-4060-aa3c-99604451b0fe 11:19:47.969 Executor task launch worker for task 3 INFO SparkHadoopMapRedUtil: attempt_20200701111947_0001_m_000001_3: Committed 11:19:47.978 Executor task launch worker for task 3 INFO Executor: Finished task 1.0 in stage 1.0 (TID 3). 2270 bytes result sent to driver 11:19:48.109 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 4 11:19:48.110 Executor task launch worker for task 4 INFO Executor: Running task 0.0 in stage 2.0 (TID 4) 11:19:48.130 Executor task launch worker for task 4 INFO TorrentBroadcast: Started reading broadcast variable 2 with 1 pieces (estimated total size 4.0 MiB) 11:19:48.142 Executor task launch worker for task 4 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 61.6 KiB, free 546.0 MiB) 11:19:48.145 Executor task launch worker for task 4 INFO TorrentBroadcast: Reading broadcast variable 2 took 14 ms 11:19:48.156 Executor task launch worker for task 4 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 173.6 KiB, free 545.8 MiB) 11:19:48.193 Executor task launch worker for task 4 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 11:19:48.193 Executor task launch worker for task 4 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 11:19:48.194 Executor task launch worker for task 4 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter 11:19:48.219 Executor task launch worker for task 4 INFO FileOutputCommitter: Saved output of task 'attempt_20200701111948_0002_m_000000_4' to file:/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-acb8b29b-404b-4060-aa3c-99604451b0fe 11:19:48.219 Executor task launch worker for task 4 INFO SparkHadoopMapRedUtil: attempt_20200701111948_0002_m_000000_4: Committed 11:19:48.222 Executor task launch worker for task 4 INFO Executor: Finished task 0.0 in stage 2.0 (TID 4). 2227 bytes result sent to driver 11:19:48.282 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 7 11:19:48.282 Executor task launch worker for task 7 INFO Executor: Running task 1.0 in stage 3.0 (TID 7) 11:19:48.301 Executor task launch worker for task 7 INFO TorrentBroadcast: Started reading broadcast variable 4 with 1 pieces (estimated total size 4.0 MiB) 11:19:48.309 Executor task launch worker for task 7 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 6.4 KiB, free 545.8 MiB) 11:19:48.312 Executor task launch worker for task 7 INFO TorrentBroadcast: Reading broadcast variable 4 took 11 ms 11:19:48.316 Executor task launch worker for task 7 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 12.2 KiB, free 545.8 MiB) 11:19:48.442 Executor task launch worker for task 7 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-acb8b29b-404b-4060-aa3c-99604451b0fe/part-00000-dbadb8ec-cb64-4848-a6af-ad0d7fddc3d6-c000.json, range: 0-45, partition values: [empty row] 11:19:48.479 Executor task launch worker for task 7 INFO CodeGenerator: Code generated in 16.64993 ms 11:19:48.482 Executor task launch worker for task 7 INFO TorrentBroadcast: Started reading broadcast variable 3 with 1 pieces (estimated total size 4.0 MiB) 11:19:48.488 Executor task launch worker for task 7 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-04.amp/192.168.10.24:45953 after 1 ms (0 ms spent in bootstraps) 11:19:48.508 Executor task launch worker for task 7 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 27.6 KiB, free 545.8 MiB) 11:19:48.511 Executor task launch worker for task 7 INFO TorrentBroadcast: Reading broadcast variable 3 took 28 ms 11:19:48.565 Executor task launch worker for task 7 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 424.3 KiB, free 545.4 MiB) 11:19:48.611 Executor task launch worker for task 7 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-acb8b29b-404b-4060-aa3c-99604451b0fe/part-00000-4036f9b6-dfbe-4e7c-be8f-6f2d3e90b9bb-c000.json, range: 0-45, partition values: [empty row] 11:19:48.621 Executor task launch worker for task 7 INFO Executor: Finished task 1.0 in stage 3.0 (TID 7). 1916 bytes result sent to driver 11:19:48.680 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 8 11:19:48.680 Executor task launch worker for task 8 INFO Executor: Running task 0.0 in stage 4.0 (TID 8) 11:19:48.683 Executor task launch worker for task 8 INFO TorrentBroadcast: Started reading broadcast variable 5 with 1 pieces (estimated total size 4.0 MiB) 11:19:48.691 Executor task launch worker for task 8 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 7.4 KiB, free 545.4 MiB) 11:19:48.695 Executor task launch worker for task 8 INFO TorrentBroadcast: Reading broadcast variable 5 took 11 ms 11:19:48.698 Executor task launch worker for task 8 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 16.4 KiB, free 545.3 MiB) 11:19:48.712 Executor task launch worker for task 8 INFO Executor: Finished task 0.0 in stage 4.0 (TID 8). 1465 bytes result sent to driver 11:19:48.881 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 10 11:19:48.882 Executor task launch worker for task 10 INFO Executor: Running task 0.0 in stage 5.0 (TID 10) 11:19:48.885 Executor task launch worker for task 10 INFO TorrentBroadcast: Started reading broadcast variable 6 with 1 pieces (estimated total size 4.0 MiB) 11:19:48.893 Executor task launch worker for task 10 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 2.5 KiB, free 545.3 MiB) 11:19:48.896 Executor task launch worker for task 10 INFO TorrentBroadcast: Reading broadcast variable 6 took 10 ms 11:19:48.898 Executor task launch worker for task 10 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 4.4 KiB, free 545.3 MiB) 11:19:48.920 Executor task launch worker for task 10 INFO Executor: Finished task 0.0 in stage 5.0 (TID 10). 1146 bytes result sent to driver 11:19:48.963 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 13 11:19:48.964 Executor task launch worker for task 13 INFO Executor: Running task 1.0 in stage 6.0 (TID 13) 11:19:48.973 Executor task launch worker for task 13 INFO TorrentBroadcast: Started reading broadcast variable 7 with 1 pieces (estimated total size 4.0 MiB) 11:19:48.986 Executor task launch worker for task 13 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 2.5 KiB, free 545.3 MiB) 11:19:48.992 Executor task launch worker for task 13 INFO TorrentBroadcast: Reading broadcast variable 7 took 18 ms 11:19:48.994 Executor task launch worker for task 13 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 4.3 KiB, free 545.3 MiB) 11:19:49.004 Executor task launch worker for task 13 ERROR Executor: Exception in task 1.0 in stage 6.0 (TID 13) java.util.NoSuchElementException: spark.sql.a at org.apache.spark.sql.internal.SQLConf.$anonfun$getConfString$3(SQLConf.scala:3289) at scala.Option.getOrElse(Option.scala:189) at org.apache.spark.sql.internal.SQLConf.getConfString(SQLConf.scala:3289) at org.apache.spark.sql.internal.SQLConfAssertPlan.$anonfun$doExecute$2(ExecutorSideSQLConfSuite.scala:201) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.sql.internal.SQLConfAssertPlan.$anonfun$doExecute$1(ExecutorSideSQLConfSuite.scala:200) at org.apache.spark.rdd.RDD.$anonfun$mapPartitions$2(RDD.scala:863) at org.apache.spark.rdd.RDD.$anonfun$mapPartitions$2$adapted(RDD.scala:863) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.sql.execution.SQLExecutionRDD.$anonfun$compute$1(SQLExecutionRDD.scala:52) at org.apache.spark.sql.internal.SQLConf$.withExistingConf(SQLConf.scala:99) at org.apache.spark.sql.execution.SQLExecutionRDD.compute(SQLExecutionRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:127) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:464) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1377) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:467) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 11:19:49.032 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 15 11:19:49.032 Executor task launch worker for task 15 INFO Executor: Running task 0.1 in stage 6.0 (TID 15) 11:19:49.038 Executor task launch worker for task 15 ERROR Executor: Exception in task 0.1 in stage 6.0 (TID 15) java.util.NoSuchElementException: spark.sql.a at org.apache.spark.sql.internal.SQLConf.$anonfun$getConfString$3(SQLConf.scala:3289) at scala.Option.getOrElse(Option.scala:189) at org.apache.spark.sql.internal.SQLConf.getConfString(SQLConf.scala:3289) at org.apache.spark.sql.internal.SQLConfAssertPlan.$anonfun$doExecute$2(ExecutorSideSQLConfSuite.scala:201) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.sql.internal.SQLConfAssertPlan.$anonfun$doExecute$1(ExecutorSideSQLConfSuite.scala:200) at org.apache.spark.rdd.RDD.$anonfun$mapPartitions$2(RDD.scala:863) at org.apache.spark.rdd.RDD.$anonfun$mapPartitions$2$adapted(RDD.scala:863) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.sql.execution.SQLExecutionRDD.$anonfun$compute$1(SQLExecutionRDD.scala:52) at org.apache.spark.sql.internal.SQLConf$.withExistingConf(SQLConf.scala:99) at org.apache.spark.sql.execution.SQLExecutionRDD.compute(SQLExecutionRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:127) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:464) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1377) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:467) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 11:19:49.047 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 16 11:19:49.048 Executor task launch worker for task 16 INFO Executor: Running task 0.2 in stage 6.0 (TID 16) 11:19:49.054 Executor task launch worker for task 16 ERROR Executor: Exception in task 0.2 in stage 6.0 (TID 16) java.util.NoSuchElementException: spark.sql.a at org.apache.spark.sql.internal.SQLConf.$anonfun$getConfString$3(SQLConf.scala:3289) at scala.Option.getOrElse(Option.scala:189) at org.apache.spark.sql.internal.SQLConf.getConfString(SQLConf.scala:3289) at org.apache.spark.sql.internal.SQLConfAssertPlan.$anonfun$doExecute$2(ExecutorSideSQLConfSuite.scala:201) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.sql.internal.SQLConfAssertPlan.$anonfun$doExecute$1(ExecutorSideSQLConfSuite.scala:200) at org.apache.spark.rdd.RDD.$anonfun$mapPartitions$2(RDD.scala:863) at org.apache.spark.rdd.RDD.$anonfun$mapPartitions$2$adapted(RDD.scala:863) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.sql.execution.SQLExecutionRDD.$anonfun$compute$1(SQLExecutionRDD.scala:52) at org.apache.spark.sql.internal.SQLConf$.withExistingConf(SQLConf.scala:99) at org.apache.spark.sql.execution.SQLExecutionRDD.compute(SQLExecutionRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:127) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:464) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1377) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:467) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 11:19:49.063 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 19 11:19:49.063 Executor task launch worker for task 19 INFO Executor: Running task 1.3 in stage 6.0 (TID 19) 11:19:49.069 Executor task launch worker for task 19 ERROR Executor: Exception in task 1.3 in stage 6.0 (TID 19) java.util.NoSuchElementException: spark.sql.a at org.apache.spark.sql.internal.SQLConf.$anonfun$getConfString$3(SQLConf.scala:3289) at scala.Option.getOrElse(Option.scala:189) at org.apache.spark.sql.internal.SQLConf.getConfString(SQLConf.scala:3289) at org.apache.spark.sql.internal.SQLConfAssertPlan.$anonfun$doExecute$2(ExecutorSideSQLConfSuite.scala:201) at scala.collection.immutable.List.foreach(List.scala:392) at org.apache.spark.sql.internal.SQLConfAssertPlan.$anonfun$doExecute$1(ExecutorSideSQLConfSuite.scala:200) at org.apache.spark.rdd.RDD.$anonfun$mapPartitions$2(RDD.scala:863) at org.apache.spark.rdd.RDD.$anonfun$mapPartitions$2$adapted(RDD.scala:863) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.sql.execution.SQLExecutionRDD.$anonfun$compute$1(SQLExecutionRDD.scala:52) at org.apache.spark.sql.internal.SQLConf$.withExistingConf(SQLConf.scala:99) at org.apache.spark.sql.execution.SQLExecutionRDD.compute(SQLExecutionRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:127) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:464) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1377) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:467) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 11:19:49.387 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 21 11:19:49.388 Executor task launch worker for task 21 INFO Executor: Running task 0.0 in stage 8.0 (TID 21) 11:19:49.393 Executor task launch worker for task 21 INFO TorrentBroadcast: Started reading broadcast variable 9 with 1 pieces (estimated total size 4.0 MiB) 11:19:49.401 Executor task launch worker for task 21 INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 545.3 MiB) 11:19:49.404 Executor task launch worker for task 21 INFO TorrentBroadcast: Reading broadcast variable 9 took 10 ms 11:19:49.407 Executor task launch worker for task 21 INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 6.5 KiB, free 545.3 MiB) 11:19:49.427 Executor task launch worker for task 21 INFO CodeGenerator: Code generated in 17.131629 ms 11:19:49.431 Executor task launch worker for task 21 INFO Executor: Finished task 0.0 in stage 8.0 (TID 21). 1465 bytes result sent to driver 11:19:49.593 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 23 11:19:49.594 Executor task launch worker for task 23 INFO Executor: Running task 0.0 in stage 10.0 (TID 23) 11:19:49.596 Executor task launch worker for task 23 INFO TorrentBroadcast: Started reading broadcast variable 11 with 1 pieces (estimated total size 4.0 MiB) 11:19:49.602 Executor task launch worker for task 23 INFO MemoryStore: Block broadcast_11_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 545.3 MiB) 11:19:49.605 Executor task launch worker for task 23 INFO TorrentBroadcast: Reading broadcast variable 11 took 8 ms 11:19:49.607 Executor task launch worker for task 23 INFO MemoryStore: Block broadcast_11 stored as values in memory (estimated size 6.5 KiB, free 545.3 MiB) 11:19:49.611 Executor task launch worker for task 23 INFO Executor: Finished task 0.0 in stage 10.0 (TID 23). 1465 bytes result sent to driver 11:19:49.681 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 24 11:19:49.681 Executor task launch worker for task 24 INFO Executor: Running task 0.0 in stage 11.0 (TID 24) 11:19:49.684 Executor task launch worker for task 24 INFO TorrentBroadcast: Started reading broadcast variable 12 with 1 pieces (estimated total size 4.0 MiB) 11:19:49.690 Executor task launch worker for task 24 INFO MemoryStore: Block broadcast_12_piece0 stored as bytes in memory (estimated size 7.5 KiB, free 545.3 MiB) 11:19:49.706 Executor task launch worker for task 24 INFO TorrentBroadcast: Reading broadcast variable 12 took 22 ms 11:19:49.710 Executor task launch worker for task 24 INFO MemoryStore: Block broadcast_12 stored as values in memory (estimated size 16.5 KiB, free 545.3 MiB) 11:19:49.755 Executor task launch worker for task 24 INFO CodeGenerator: Code generated in 37.191722 ms 11:19:49.768 Executor task launch worker for task 24 INFO Executor: Finished task 0.0 in stage 11.0 (TID 24). 1508 bytes result sent to driver 11:19:49.789 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 26 11:19:49.789 Executor task launch worker for task 26 INFO Executor: Running task 0.0 in stage 12.0 (TID 26) 11:19:49.792 Executor task launch worker for task 26 INFO TorrentBroadcast: Started reading broadcast variable 14 with 1 pieces (estimated total size 4.0 MiB) 11:19:49.799 Executor task launch worker for task 26 INFO MemoryStore: Block broadcast_14_piece0 stored as bytes in memory (estimated size 6.9 KiB, free 545.3 MiB) 11:19:49.803 Executor task launch worker for task 26 INFO TorrentBroadcast: Reading broadcast variable 14 took 10 ms 11:19:49.806 Executor task launch worker for task 26 INFO MemoryStore: Block broadcast_14 stored as values in memory (estimated size 13.5 KiB, free 545.3 MiB) 11:19:49.859 Executor task launch worker for task 26 INFO TorrentBroadcast: Started reading broadcast variable 13 with 1 pieces (estimated total size 4.0 MiB) 11:19:49.866 Executor task launch worker for task 26 INFO MemoryStore: Block broadcast_13_piece0 stored as bytes in memory (estimated size 205.0 B, free 545.3 MiB) 11:19:49.869 Executor task launch worker for task 26 INFO TorrentBroadcast: Reading broadcast variable 13 took 9 ms 11:19:49.871 Executor task launch worker for task 26 INFO MemoryStore: Block broadcast_13 stored as values in memory (estimated size 192.0 B, free 545.3 MiB) 11:19:49.898 Executor task launch worker for task 26 INFO CodeGenerator: Code generated in 15.12139 ms 11:19:49.903 Executor task launch worker for task 26 INFO Executor: Finished task 0.0 in stage 12.0 (TID 26). 1886 bytes result sent to driver 11:19:49.964 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Got assigned task 28 11:19:49.964 Executor task launch worker for task 28 INFO Executor: Running task 1.0 in stage 13.0 (TID 28) 11:19:49.967 Executor task launch worker for task 28 INFO TorrentBroadcast: Started reading broadcast variable 15 with 1 pieces (estimated total size 4.0 MiB) 11:19:49.975 Executor task launch worker for task 28 INFO MemoryStore: Block broadcast_15_piece0 stored as bytes in memory (estimated size 7.5 KiB, free 545.3 MiB) 11:19:49.978 Executor task launch worker for task 28 INFO TorrentBroadcast: Reading broadcast variable 15 took 11 ms 11:19:49.982 Executor task launch worker for task 28 INFO MemoryStore: Block broadcast_15 stored as values in memory (estimated size 16.5 KiB, free 545.2 MiB) 11:19:50.004 Executor task launch worker for task 28 INFO Executor: Finished task 1.0 in stage 13.0 (TID 28). 1465 bytes result sent to driver 11:19:50.164 SIGTERM handler ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM 11:19:50.165 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver commanded a shutdown 11:19:50.168 shutdown-hook-0 INFO DiskBlockManager: Shutdown hook called 11:19:50.169 dispatcher-Executor INFO CoarseGrainedExecutorBackend: Driver from amp-jenkins-worker-04.amp:43825 disconnected during shutdown 11:19:50.169 dispatcher-event-loop-0 ERROR WorkerWatcher: Lost connection to worker rpc endpoint spark://Worker@amp-jenkins-worker-04.amp:43825. Exiting. 11:19:50.175 shutdown-hook-0 INFO ShutdownHookManager: Shutdown hook called 11:19:50.179 CoarseGrainedExecutorBackend-stop-executor INFO MemoryStore: MemoryStore cleared 11:19:50.180 CoarseGrainedExecutorBackend-stop-executor INFO BlockManager: BlockManager stopped