10:39:49.385 pool-1-thread-1 INFO SparkContext: Running Spark version 3.1.0-SNAPSHOT 10:39:49.563 pool-1-thread-1 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 10:39:49.648 pool-1-thread-1 INFO ResourceUtils: ============================================================== 10:39:49.649 pool-1-thread-1 INFO ResourceUtils: No custom resources configured for spark.driver. 10:39:49.649 pool-1-thread-1 INFO ResourceUtils: ============================================================== 10:39:49.650 pool-1-thread-1 INFO SparkContext: Submitted application: test-sql-context 10:39:49.676 pool-1-thread-1 INFO ResourceProfile: Default ResourceProfile created, executor resources: Map(cores -> name: cores, amount: 1, script: , vendor: , memory -> name: memory, amount: 1024, script: , vendor: ), task resources: Map(cpus -> name: cpus, amount: 1.0) 10:39:49.697 pool-1-thread-1 INFO ResourceProfile: Limiting resource is cpu 10:39:49.698 pool-1-thread-1 INFO ResourceProfileManager: Added ResourceProfile id: 0 10:39:49.767 pool-1-thread-1 INFO SecurityManager: Changing view acls to: jenkins 10:39:49.768 pool-1-thread-1 INFO SecurityManager: Changing modify acls to: jenkins 10:39:49.768 pool-1-thread-1 INFO SecurityManager: Changing view acls groups to: 10:39:49.769 pool-1-thread-1 INFO SecurityManager: Changing modify acls groups to: 10:39:49.769 pool-1-thread-1 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 10:39:50.128 pool-1-thread-1 INFO Utils: Successfully started service 'sparkDriver' on port 44238. 10:39:50.165 pool-1-thread-1 INFO SparkEnv: Registering MapOutputTracker 10:39:50.201 pool-1-thread-1 INFO SparkEnv: Registering BlockManagerMaster 10:39:50.207 pool-1-thread-1 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 10:39:50.208 pool-1-thread-1 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up 10:39:50.212 pool-1-thread-1 INFO SparkEnv: Registering BlockManagerMasterHeartbeat 10:39:50.230 pool-1-thread-1 INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/target/tmp/org.apache.spark.sql.SQLQueryTestSuite/blockmgr-26d55fd8-b1c1-4453-9b69-287676597a98 10:39:50.279 pool-1-thread-1 INFO MemoryStore: MemoryStore started with capacity 2.1 GiB 10:39:50.299 pool-1-thread-1 INFO SparkEnv: Registering OutputCommitCoordinator 10:39:50.477 pool-1-thread-1 INFO Executor: Starting executor ID driver on host amp-jenkins-worker-04.amp 10:39:50.503 pool-1-thread-1 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 34728. 10:39:50.503 pool-1-thread-1 INFO NettyBlockTransferService: Server created on amp-jenkins-worker-04.amp:34728 10:39:50.505 pool-1-thread-1 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 10:39:50.512 pool-1-thread-1 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, amp-jenkins-worker-04.amp, 34728, None) 10:39:50.517 dispatcher-BlockManagerMaster INFO BlockManagerMasterEndpoint: Registering block manager amp-jenkins-worker-04.amp:34728 with 2.1 GiB RAM, BlockManagerId(driver, amp-jenkins-worker-04.amp, 34728, None) 10:39:50.522 pool-1-thread-1 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, amp-jenkins-worker-04.amp, 34728, None) 10:39:50.523 pool-1-thread-1 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, amp-jenkins-worker-04.amp, 34728, None) 10:39:50.764 pool-1-thread-1 INFO log: Logging initialized @7346ms to org.eclipse.jetty.util.log.Slf4jLog 10:39:51.337 pool-1-thread-1 INFO SharedState: loading hive config file: file:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/target/scala-2.12/test-classes/hive-site.xml 10:39:51.374 pool-1-thread-1 INFO SharedState: Setting hive.metastore.warehouse.dir ('null') to the value of spark.sql.warehouse.dir ('file:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite'). 10:39:51.375 pool-1-thread-1 INFO SharedState: Warehouse path is 'file:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite'. 10:39:52.940 pool-1-thread-1 INFO CodeGenerator: Code generated in 375.322583 ms 10:39:54.059 pool-1-thread-1 INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:39:54.060 pool-1-thread-1 INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:39:54.876 pool-1-thread-1 INFO ParquetFileFormat: Using default output committer for Parquet: org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:54.936 pool-1-thread-1 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:39:54.936 pool-1-thread-1 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:39:54.939 pool-1-thread-1 INFO SQLHadoopMapReduceCommitProtocol: Using user defined output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:54.939 pool-1-thread-1 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:39:54.939 pool-1-thread-1 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:39:54.941 pool-1-thread-1 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:55.100 pool-1-thread-1 INFO CodeGenerator: Code generated in 47.078171 ms 10:39:55.140 pool-1-thread-1 INFO CodeGenerator: Code generated in 32.249604 ms 10:39:55.422 pool-1-thread-1 INFO SparkContext: Starting job: beforeAll at BeforeAndAfterAll.scala:212 10:39:55.467 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 2 (beforeAll at BeforeAndAfterAll.scala:212) as input to shuffle 0 10:39:55.474 dag-scheduler-event-loop INFO DAGScheduler: Got job 0 (beforeAll at BeforeAndAfterAll.scala:212) with 1 output partitions 10:39:55.474 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 1 (beforeAll at BeforeAndAfterAll.scala:212) 10:39:55.475 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 0) 10:39:55.478 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 0) 10:39:55.486 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 0 (MapPartitionsRDD[2] at beforeAll at BeforeAndAfterAll.scala:212), which has no missing parents 10:39:55.634 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 9.5 KiB, free 2.1 GiB) 10:39:55.725 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 5.0 KiB, free 2.1 GiB) 10:39:55.730 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.0 KiB, free: 2.1 GiB) 10:39:55.753 dag-scheduler-event-loop INFO SparkContext: Created broadcast 0 from broadcast at DAGScheduler.scala:1293 10:39:55.773 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 0 (MapPartitionsRDD[2] at beforeAll at BeforeAndAfterAll.scala:212) (first 15 tasks are for partitions Vector(0, 1)) 10:39:55.776 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 0.0 with 2 tasks resource profile 0 10:39:55.861 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 9931 bytes) taskResourceAssignments Map() 10:39:55.865 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 0.0 (TID 1, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 9931 bytes) taskResourceAssignments Map() 10:39:55.886 Executor task launch worker for task 0 INFO Executor: Running task 0.0 in stage 0.0 (TID 0) 10:39:55.886 Executor task launch worker for task 1 INFO Executor: Running task 1.0 in stage 0.0 (TID 1) 10:39:56.344 Executor task launch worker for task 0 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1745 bytes result sent to driver 10:39:56.344 Executor task launch worker for task 1 INFO Executor: Finished task 1.0 in stage 0.0 (TID 1). 1745 bytes result sent to driver 10:39:56.355 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 0.0 (TID 1) in 490 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:39:56.357 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 524 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:39:56.358 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 10:39:56.371 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 0 (beforeAll at BeforeAndAfterAll.scala:212) finished in 0.860 s 10:39:56.372 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:39:56.372 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:39:56.373 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 1) 10:39:56.374 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:39:56.380 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 1 (ShuffledRowRDD[3] at beforeAll at BeforeAndAfterAll.scala:212), which has no missing parents 10:39:56.523 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 171.1 KiB, free 2.1 GiB) 10:39:56.548 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 60.7 KiB, free 2.1 GiB) 10:39:56.549 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 60.7 KiB, free: 2.1 GiB) 10:39:56.550 dag-scheduler-event-loop INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1293 10:39:56.554 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 1 (ShuffledRowRDD[3] at beforeAll at BeforeAndAfterAll.scala:212) (first 15 tasks are for partitions Vector(0)) 10:39:56.554 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 1.0 with 1 tasks resource profile 0 10:39:56.563 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 2, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:39:56.564 Executor task launch worker for task 2 INFO Executor: Running task 0.0 in stage 1.0 (TID 2) 10:39:56.940 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_0_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.0 KiB, free: 2.1 GiB) 10:39:56.951 Executor task launch worker for task 2 INFO ShuffleBlockFetcherIterator: Getting 2 (1369.0 B) non-empty blocks including 2 (1369.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:39:56.953 Executor task launch worker for task 2 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 11 ms 10:39:56.965 Executor task launch worker for task 2 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:39:56.965 Executor task launch worker for task 2 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:39:56.967 Executor task launch worker for task 2 INFO SQLHadoopMapReduceCommitProtocol: Using user defined output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:56.967 Executor task launch worker for task 2 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:39:56.967 Executor task launch worker for task 2 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:39:56.968 Executor task launch worker for task 2 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:56.975 Executor task launch worker for task 2 INFO CodecConfig: Compression: SNAPPY 10:39:56.981 Executor task launch worker for task 2 INFO CodecConfig: Compression: SNAPPY 10:39:57.017 Executor task launch worker for task 2 INFO ParquetOutputFormat: Parquet block size to 134217728 10:39:57.022 Executor task launch worker for task 2 INFO ParquetOutputFormat: Parquet page size to 1048576 10:39:57.022 Executor task launch worker for task 2 INFO ParquetOutputFormat: Parquet dictionary page size to 1048576 10:39:57.022 Executor task launch worker for task 2 INFO ParquetOutputFormat: Dictionary is on 10:39:57.022 Executor task launch worker for task 2 INFO ParquetOutputFormat: Validation is off 10:39:57.022 Executor task launch worker for task 2 INFO ParquetOutputFormat: Writer version is: PARQUET_1_0 10:39:57.022 Executor task launch worker for task 2 INFO ParquetOutputFormat: Maximum row group padding size is 8388608 bytes 10:39:57.022 Executor task launch worker for task 2 INFO ParquetOutputFormat: Page size checking is: estimated 10:39:57.022 Executor task launch worker for task 2 INFO ParquetOutputFormat: Min row count for page size check is: 100 10:39:57.022 Executor task launch worker for task 2 INFO ParquetOutputFormat: Max row count for page size check is: 10000 10:39:57.116 Executor task launch worker for task 2 INFO ParquetWriteSupport: Initialized Parquet WriteSupport with Catalyst schema: { "type" : "struct", "fields" : [ { "name" : "key", "type" : "integer", "nullable" : false, "metadata" : { } }, { "name" : "value", "type" : "string", "nullable" : true, "metadata" : { } } ] } and corresponding Parquet message type: message spark_schema { required int32 key; optional binary value (UTF8); } 10:39:57.211 Executor task launch worker for task 2 INFO CodecPool: Got brand-new compressor [.snappy] 10:39:57.659 Executor task launch worker for task 2 INFO InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 1792 10:39:57.955 Executor task launch worker for task 2 INFO FileOutputCommitter: Saved output of task 'attempt_20200701103955_0001_m_000000_2' to file:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/testdata 10:39:57.955 Executor task launch worker for task 2 INFO SparkHadoopMapRedUtil: attempt_20200701103955_0001_m_000000_2: Committed 10:39:57.961 Executor task launch worker for task 2 INFO Executor: Finished task 0.0 in stage 1.0 (TID 2). 3281 bytes result sent to driver 10:39:57.963 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 2) in 1404 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:39:57.963 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 10:39:57.966 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 1 (beforeAll at BeforeAndAfterAll.scala:212) finished in 1.573 s 10:39:57.972 dag-scheduler-event-loop INFO DAGScheduler: Job 0 is finished. Cancelling potential speculative or zombie tasks for this job 10:39:57.973 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 1: Stage finished 10:39:57.976 pool-1-thread-1 INFO DAGScheduler: Job 0 finished: beforeAll at BeforeAndAfterAll.scala:212, took 2.554019 s 10:39:57.999 pool-1-thread-1 INFO FileFormatWriter: Write Job 35831e9d-24fa-4bae-ae3f-71a2dca16d56 committed. 10:39:58.004 pool-1-thread-1 INFO FileFormatWriter: Finished processing stats for write job 35831e9d-24fa-4bae-ae3f-71a2dca16d56. 10:39:58.072 pool-1-thread-1 INFO InMemoryFileIndex: It took 24 ms to list leaf files for 1 paths. 10:39:58.530 pool-1-thread-1 INFO CodeGenerator: Code generated in 114.253773 ms 10:39:58.694 pool-1-thread-1 INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:39:58.695 pool-1-thread-1 INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:39:58.788 pool-1-thread-1 INFO ParquetFileFormat: Using default output committer for Parquet: org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:58.792 pool-1-thread-1 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:39:58.792 pool-1-thread-1 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:39:58.793 pool-1-thread-1 INFO SQLHadoopMapReduceCommitProtocol: Using user defined output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:58.793 pool-1-thread-1 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:39:58.793 pool-1-thread-1 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:39:58.794 pool-1-thread-1 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:58.925 pool-1-thread-1 INFO CodeGenerator: Code generated in 75.678658 ms 10:39:58.984 pool-1-thread-1 INFO CodeGenerator: Code generated in 50.673684 ms 10:39:59.028 pool-1-thread-1 INFO SparkContext: Starting job: beforeAll at BeforeAndAfterAll.scala:212 10:39:59.030 dag-scheduler-event-loop INFO DAGScheduler: Got job 1 (beforeAll at BeforeAndAfterAll.scala:212) with 2 output partitions 10:39:59.030 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 2 (beforeAll at BeforeAndAfterAll.scala:212) 10:39:59.030 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:39:59.030 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:39:59.031 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 2 (MapPartitionsRDD[7] at beforeAll at BeforeAndAfterAll.scala:212), which has no missing parents 10:39:59.135 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 175.2 KiB, free 2.1 GiB) 10:39:59.168 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 61.7 KiB, free 2.1 GiB) 10:39:59.170 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 61.7 KiB, free: 2.1 GiB) 10:39:59.170 dag-scheduler-event-loop INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1293 10:39:59.171 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 2 (MapPartitionsRDD[7] at beforeAll at BeforeAndAfterAll.scala:212) (first 15 tasks are for partitions Vector(0, 1)) 10:39:59.172 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 2.0 with 2 tasks resource profile 0 10:39:59.174 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 2.0 (TID 3, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7621 bytes) taskResourceAssignments Map() 10:39:59.174 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 2.0 (TID 4, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7621 bytes) taskResourceAssignments Map() 10:39:59.175 Executor task launch worker for task 3 INFO Executor: Running task 0.0 in stage 2.0 (TID 3) 10:39:59.175 Executor task launch worker for task 4 INFO Executor: Running task 1.0 in stage 2.0 (TID 4) 10:39:59.241 Executor task launch worker for task 4 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:39:59.241 Executor task launch worker for task 4 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:39:59.242 Executor task launch worker for task 4 INFO SQLHadoopMapReduceCommitProtocol: Using user defined output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:59.242 Executor task launch worker for task 4 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:39:59.242 Executor task launch worker for task 4 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:39:59.243 Executor task launch worker for task 4 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:59.243 Executor task launch worker for task 4 INFO CodecConfig: Compression: SNAPPY 10:39:59.247 Executor task launch worker for task 3 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:39:59.247 Executor task launch worker for task 3 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:39:59.248 Executor task launch worker for task 3 INFO SQLHadoopMapReduceCommitProtocol: Using user defined output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:59.248 Executor task launch worker for task 3 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:39:59.248 Executor task launch worker for task 3 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:39:59.249 Executor task launch worker for task 3 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:59.249 Executor task launch worker for task 3 INFO CodecConfig: Compression: SNAPPY 10:39:59.249 Executor task launch worker for task 3 INFO CodecConfig: Compression: SNAPPY 10:39:59.250 Executor task launch worker for task 3 INFO ParquetOutputFormat: Parquet block size to 134217728 10:39:59.250 Executor task launch worker for task 3 INFO ParquetOutputFormat: Parquet page size to 1048576 10:39:59.250 Executor task launch worker for task 3 INFO ParquetOutputFormat: Parquet dictionary page size to 1048576 10:39:59.250 Executor task launch worker for task 3 INFO ParquetOutputFormat: Dictionary is on 10:39:59.250 Executor task launch worker for task 3 INFO ParquetOutputFormat: Validation is off 10:39:59.250 Executor task launch worker for task 3 INFO ParquetOutputFormat: Writer version is: PARQUET_1_0 10:39:59.250 Executor task launch worker for task 3 INFO ParquetOutputFormat: Maximum row group padding size is 8388608 bytes 10:39:59.250 Executor task launch worker for task 3 INFO ParquetOutputFormat: Page size checking is: estimated 10:39:59.250 Executor task launch worker for task 3 INFO ParquetOutputFormat: Min row count for page size check is: 100 10:39:59.250 Executor task launch worker for task 3 INFO ParquetOutputFormat: Max row count for page size check is: 10000 10:39:59.251 Executor task launch worker for task 4 INFO CodecConfig: Compression: SNAPPY 10:39:59.252 Executor task launch worker for task 4 INFO ParquetOutputFormat: Parquet block size to 134217728 10:39:59.252 Executor task launch worker for task 4 INFO ParquetOutputFormat: Parquet page size to 1048576 10:39:59.252 Executor task launch worker for task 4 INFO ParquetOutputFormat: Parquet dictionary page size to 1048576 10:39:59.252 Executor task launch worker for task 4 INFO ParquetOutputFormat: Dictionary is on 10:39:59.252 Executor task launch worker for task 4 INFO ParquetOutputFormat: Validation is off 10:39:59.252 Executor task launch worker for task 4 INFO ParquetOutputFormat: Writer version is: PARQUET_1_0 10:39:59.252 Executor task launch worker for task 4 INFO ParquetOutputFormat: Maximum row group padding size is 8388608 bytes 10:39:59.252 Executor task launch worker for task 4 INFO ParquetOutputFormat: Page size checking is: estimated 10:39:59.252 Executor task launch worker for task 4 INFO ParquetOutputFormat: Min row count for page size check is: 100 10:39:59.252 Executor task launch worker for task 4 INFO ParquetOutputFormat: Max row count for page size check is: 10000 10:39:59.254 Executor task launch worker for task 3 INFO ParquetWriteSupport: Initialized Parquet WriteSupport with Catalyst schema: { "type" : "struct", "fields" : [ { "name" : "arraycol", "type" : { "type" : "array", "elementType" : "integer", "containsNull" : false }, "nullable" : true, "metadata" : { } }, { "name" : "nestedarraycol", "type" : { "type" : "array", "elementType" : { "type" : "array", "elementType" : "integer", "containsNull" : false }, "containsNull" : true }, "nullable" : true, "metadata" : { } } ] } and corresponding Parquet message type: message spark_schema { optional group arraycol (LIST) { repeated group list { required int32 element; } } optional group nestedarraycol (LIST) { repeated group list { optional group element (LIST) { repeated group list { required int32 element; } } } } } 10:39:59.254 Executor task launch worker for task 4 INFO ParquetWriteSupport: Initialized Parquet WriteSupport with Catalyst schema: { "type" : "struct", "fields" : [ { "name" : "arraycol", "type" : { "type" : "array", "elementType" : "integer", "containsNull" : false }, "nullable" : true, "metadata" : { } }, { "name" : "nestedarraycol", "type" : { "type" : "array", "elementType" : { "type" : "array", "elementType" : "integer", "containsNull" : false }, "containsNull" : true }, "nullable" : true, "metadata" : { } } ] } and corresponding Parquet message type: message spark_schema { optional group arraycol (LIST) { repeated group list { required int32 element; } } optional group nestedarraycol (LIST) { repeated group list { optional group element (LIST) { repeated group list { required int32 element; } } } } } 10:39:59.327 Executor task launch worker for task 4 INFO InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 48 10:39:59.344 Executor task launch worker for task 3 INFO CodecPool: Got brand-new compressor [.snappy] 10:39:59.347 Executor task launch worker for task 3 INFO InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 48 10:39:59.356 Executor task launch worker for task 3 INFO FileOutputCommitter: Saved output of task 'attempt_20200701103958_0002_m_000000_3' to file:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/arraydata 10:39:59.356 Executor task launch worker for task 3 INFO SparkHadoopMapRedUtil: attempt_20200701103958_0002_m_000000_3: Committed 10:39:59.365 Executor task launch worker for task 3 INFO Executor: Finished task 0.0 in stage 2.0 (TID 3). 2184 bytes result sent to driver 10:39:59.371 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 2.0 (TID 3) in 198 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:39:59.376 Executor task launch worker for task 4 INFO FileOutputCommitter: Saved output of task 'attempt_20200701103958_0002_m_000001_4' to file:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/arraydata 10:39:59.376 Executor task launch worker for task 4 INFO SparkHadoopMapRedUtil: attempt_20200701103958_0002_m_000001_4: Committed 10:39:59.378 Executor task launch worker for task 4 INFO Executor: Finished task 1.0 in stage 2.0 (TID 4). 2184 bytes result sent to driver 10:39:59.380 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 2.0 (TID 4) in 206 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:39:59.380 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 2.0, whose tasks have all completed, from pool 10:39:59.381 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 2 (beforeAll at BeforeAndAfterAll.scala:212) finished in 0.348 s 10:39:59.382 dag-scheduler-event-loop INFO DAGScheduler: Job 1 is finished. Cancelling potential speculative or zombie tasks for this job 10:39:59.382 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 2: Stage finished 10:39:59.382 pool-1-thread-1 INFO DAGScheduler: Job 1 finished: beforeAll at BeforeAndAfterAll.scala:212, took 0.353668 s 10:39:59.398 pool-1-thread-1 INFO FileFormatWriter: Write Job c87d420a-1655-4265-b8a4-ae9d5074d830 committed. 10:39:59.399 pool-1-thread-1 INFO FileFormatWriter: Finished processing stats for write job c87d420a-1655-4265-b8a4-ae9d5074d830. 10:39:59.414 pool-1-thread-1 INFO InMemoryFileIndex: It took 4 ms to list leaf files for 1 paths. 10:39:59.604 pool-1-thread-1 INFO CodeGenerator: Code generated in 72.226823 ms 10:39:59.676 pool-1-thread-1 INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:39:59.677 pool-1-thread-1 INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:39:59.726 pool-1-thread-1 INFO ParquetFileFormat: Using default output committer for Parquet: org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:59.729 pool-1-thread-1 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:39:59.730 pool-1-thread-1 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:39:59.730 pool-1-thread-1 INFO SQLHadoopMapReduceCommitProtocol: Using user defined output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:59.730 pool-1-thread-1 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:39:59.730 pool-1-thread-1 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:39:59.730 pool-1-thread-1 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:59.788 pool-1-thread-1 INFO CodeGenerator: Code generated in 34.610451 ms 10:39:59.812 pool-1-thread-1 INFO CodeGenerator: Code generated in 21.927918 ms 10:39:59.843 pool-1-thread-1 INFO SparkContext: Starting job: beforeAll at BeforeAndAfterAll.scala:212 10:39:59.844 dag-scheduler-event-loop INFO DAGScheduler: Got job 2 (beforeAll at BeforeAndAfterAll.scala:212) with 2 output partitions 10:39:59.844 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 3 (beforeAll at BeforeAndAfterAll.scala:212) 10:39:59.844 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:39:59.845 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:39:59.845 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 3 (MapPartitionsRDD[11] at beforeAll at BeforeAndAfterAll.scala:212), which has no missing parents 10:39:59.943 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 174.4 KiB, free 2.1 GiB) 10:39:59.952 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 61.8 KiB, free 2.1 GiB) 10:39:59.952 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 61.8 KiB, free: 2.1 GiB) 10:39:59.953 dag-scheduler-event-loop INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1293 10:39:59.954 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 3 (MapPartitionsRDD[11] at beforeAll at BeforeAndAfterAll.scala:212) (first 15 tasks are for partitions Vector(0, 1)) 10:39:59.955 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 3.0 with 2 tasks resource profile 0 10:39:59.956 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 5, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7822 bytes) taskResourceAssignments Map() 10:39:59.957 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 3.0 (TID 6, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7839 bytes) taskResourceAssignments Map() 10:39:59.957 Executor task launch worker for task 5 INFO Executor: Running task 0.0 in stage 3.0 (TID 5) 10:39:59.957 Executor task launch worker for task 6 INFO Executor: Running task 1.0 in stage 3.0 (TID 6) 10:39:59.986 Executor task launch worker for task 5 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:39:59.986 Executor task launch worker for task 6 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:39:59.987 Executor task launch worker for task 5 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:39:59.987 Executor task launch worker for task 6 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:39:59.987 Executor task launch worker for task 6 INFO SQLHadoopMapReduceCommitProtocol: Using user defined output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:59.987 Executor task launch worker for task 5 INFO SQLHadoopMapReduceCommitProtocol: Using user defined output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:59.987 Executor task launch worker for task 6 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:39:59.987 Executor task launch worker for task 5 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:39:59.987 Executor task launch worker for task 6 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:39:59.987 Executor task launch worker for task 5 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:39:59.987 Executor task launch worker for task 6 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:59.988 Executor task launch worker for task 5 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:39:59.988 Executor task launch worker for task 5 INFO CodecConfig: Compression: SNAPPY 10:39:59.988 Executor task launch worker for task 6 INFO CodecConfig: Compression: SNAPPY 10:39:59.988 Executor task launch worker for task 5 INFO CodecConfig: Compression: SNAPPY 10:39:59.988 Executor task launch worker for task 6 INFO CodecConfig: Compression: SNAPPY 10:39:59.989 Executor task launch worker for task 6 INFO ParquetOutputFormat: Parquet block size to 134217728 10:39:59.989 Executor task launch worker for task 5 INFO ParquetOutputFormat: Parquet block size to 134217728 10:39:59.989 Executor task launch worker for task 6 INFO ParquetOutputFormat: Parquet page size to 1048576 10:39:59.989 Executor task launch worker for task 5 INFO ParquetOutputFormat: Parquet page size to 1048576 10:39:59.989 Executor task launch worker for task 6 INFO ParquetOutputFormat: Parquet dictionary page size to 1048576 10:39:59.989 Executor task launch worker for task 5 INFO ParquetOutputFormat: Parquet dictionary page size to 1048576 10:39:59.989 Executor task launch worker for task 6 INFO ParquetOutputFormat: Dictionary is on 10:39:59.989 Executor task launch worker for task 5 INFO ParquetOutputFormat: Dictionary is on 10:39:59.989 Executor task launch worker for task 6 INFO ParquetOutputFormat: Validation is off 10:39:59.989 Executor task launch worker for task 5 INFO ParquetOutputFormat: Validation is off 10:39:59.989 Executor task launch worker for task 6 INFO ParquetOutputFormat: Writer version is: PARQUET_1_0 10:39:59.989 Executor task launch worker for task 5 INFO ParquetOutputFormat: Writer version is: PARQUET_1_0 10:39:59.989 Executor task launch worker for task 6 INFO ParquetOutputFormat: Maximum row group padding size is 8388608 bytes 10:39:59.989 Executor task launch worker for task 5 INFO ParquetOutputFormat: Maximum row group padding size is 8388608 bytes 10:39:59.989 Executor task launch worker for task 6 INFO ParquetOutputFormat: Page size checking is: estimated 10:39:59.989 Executor task launch worker for task 5 INFO ParquetOutputFormat: Page size checking is: estimated 10:39:59.989 Executor task launch worker for task 6 INFO ParquetOutputFormat: Min row count for page size check is: 100 10:39:59.989 Executor task launch worker for task 5 INFO ParquetOutputFormat: Min row count for page size check is: 100 10:39:59.989 Executor task launch worker for task 6 INFO ParquetOutputFormat: Max row count for page size check is: 10000 10:39:59.989 Executor task launch worker for task 5 INFO ParquetOutputFormat: Max row count for page size check is: 10000 10:39:59.992 Executor task launch worker for task 5 INFO ParquetWriteSupport: Initialized Parquet WriteSupport with Catalyst schema: { "type" : "struct", "fields" : [ { "name" : "mapcol", "type" : { "type" : "map", "keyType" : "integer", "valueType" : "string", "valueContainsNull" : true }, "nullable" : true, "metadata" : { } } ] } and corresponding Parquet message type: message spark_schema { optional group mapcol (MAP) { repeated group key_value { required int32 key; optional binary value (UTF8); } } } 10:39:59.992 Executor task launch worker for task 6 INFO ParquetWriteSupport: Initialized Parquet WriteSupport with Catalyst schema: { "type" : "struct", "fields" : [ { "name" : "mapcol", "type" : { "type" : "map", "keyType" : "integer", "valueType" : "string", "valueContainsNull" : true }, "nullable" : true, "metadata" : { } } ] } and corresponding Parquet message type: message spark_schema { optional group mapcol (MAP) { repeated group key_value { required int32 key; optional binary value (UTF8); } } } 10:40:00.011 Executor task launch worker for task 5 INFO InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 274 10:40:00.011 Executor task launch worker for task 6 INFO InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 96 10:40:00.029 Executor task launch worker for task 5 INFO FileOutputCommitter: Saved output of task 'attempt_20200701103959_0003_m_000000_5' to file:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/mapdata 10:40:00.029 Executor task launch worker for task 6 INFO FileOutputCommitter: Saved output of task 'attempt_20200701103959_0003_m_000001_6' to file:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/mapdata 10:40:00.029 Executor task launch worker for task 5 INFO SparkHadoopMapRedUtil: attempt_20200701103959_0003_m_000000_5: Committed 10:40:00.029 Executor task launch worker for task 6 INFO SparkHadoopMapRedUtil: attempt_20200701103959_0003_m_000001_6: Committed 10:40:00.031 Executor task launch worker for task 5 INFO Executor: Finished task 0.0 in stage 3.0 (TID 5). 2184 bytes result sent to driver 10:40:00.031 Executor task launch worker for task 6 INFO Executor: Finished task 1.0 in stage 3.0 (TID 6). 2184 bytes result sent to driver 10:40:00.034 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 3.0 (TID 6) in 77 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:00.038 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 5) in 82 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:00.039 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 10:40:00.040 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 3 (beforeAll at BeforeAndAfterAll.scala:212) finished in 0.194 s 10:40:00.040 dag-scheduler-event-loop INFO DAGScheduler: Job 2 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:00.040 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 3: Stage finished 10:40:00.041 pool-1-thread-1 INFO DAGScheduler: Job 2 finished: beforeAll at BeforeAndAfterAll.scala:212, took 0.197490 s 10:40:00.051 pool-1-thread-1 INFO FileFormatWriter: Write Job ed124c39-de8d-4444-9e98-71cc46a4c326 committed. 10:40:00.051 pool-1-thread-1 INFO FileFormatWriter: Finished processing stats for write job ed124c39-de8d-4444-9e98-71cc46a4c326. 10:40:00.062 pool-1-thread-1 INFO InMemoryFileIndex: It took 2 ms to list leaf files for 1 paths. 10:40:00.097 pool-1-thread-1 INFO InMemoryFileIndex: It took 2 ms to list leaf files for 1 paths. 10:40:00.121 pool-1-thread-1 INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:00.121 pool-1-thread-1 INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:00.153 pool-1-thread-1 INFO FileSourceStrategy: Pruning directories with: 10:40:00.160 pool-1-thread-1 INFO FileSourceStrategy: Pushed Filters: 10:40:00.161 pool-1-thread-1 INFO FileSourceStrategy: Post-Scan Filters: 10:40:00.165 pool-1-thread-1 INFO FileSourceStrategy: Output Data Schema: struct 10:40:00.189 pool-1-thread-1 INFO ParquetFileFormat: Using default output committer for Parquet: org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:00.190 pool-1-thread-1 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:40:00.190 pool-1-thread-1 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:40:00.190 pool-1-thread-1 INFO SQLHadoopMapReduceCommitProtocol: Using user defined output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:00.190 pool-1-thread-1 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:40:00.190 pool-1-thread-1 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:40:00.191 pool-1-thread-1 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:00.222 pool-1-thread-1 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 305.2 KiB, free 2.1 GiB) 10:40:00.241 pool-1-thread-1 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 27.9 KiB, free 2.1 GiB) 10:40:00.242 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 27.9 KiB, free: 2.1 GiB) 10:40:00.243 pool-1-thread-1 INFO SparkContext: Created broadcast 4 from beforeAll at BeforeAndAfterAll.scala:212 10:40:00.280 pool-1-thread-1 INFO FileSourceScanExec: Planning scan with bin packing, max size: 4194304 bytes, open cost is considered as scanning 4194304 bytes. 10:40:00.360 pool-1-thread-1 INFO SparkContext: Starting job: beforeAll at BeforeAndAfterAll.scala:212 10:40:00.361 dag-scheduler-event-loop INFO DAGScheduler: Got job 3 (beforeAll at BeforeAndAfterAll.scala:212) with 1 output partitions 10:40:00.362 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 4 (beforeAll at BeforeAndAfterAll.scala:212) 10:40:00.362 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:00.362 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:00.363 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 4 (MapPartitionsRDD[15] at beforeAll at BeforeAndAfterAll.scala:212), which has no missing parents 10:40:00.473 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 173.8 KiB, free 2.1 GiB) 10:40:00.485 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 62.2 KiB, free 2.1 GiB) 10:40:00.486 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 62.2 KiB, free: 2.1 GiB) 10:40:00.486 dag-scheduler-event-loop INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1293 10:40:00.487 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 4 (MapPartitionsRDD[15] at beforeAll at BeforeAndAfterAll.scala:212) (first 15 tasks are for partitions Vector(0)) 10:40:00.487 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 4.0 with 1 tasks resource profile 0 10:40:00.492 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 4.0 (TID 7, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7824 bytes) taskResourceAssignments Map() 10:40:00.493 Executor task launch worker for task 7 INFO Executor: Running task 0.0 in stage 4.0 (TID 7) 10:40:00.547 Executor task launch worker for task 7 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:40:00.548 Executor task launch worker for task 7 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:40:00.548 Executor task launch worker for task 7 INFO SQLHadoopMapReduceCommitProtocol: Using user defined output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:00.548 Executor task launch worker for task 7 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:40:00.548 Executor task launch worker for task 7 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:40:00.548 Executor task launch worker for task 7 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:00.548 Executor task launch worker for task 7 INFO CodecConfig: Compression: SNAPPY 10:40:00.549 Executor task launch worker for task 7 INFO CodecConfig: Compression: SNAPPY 10:40:00.549 Executor task launch worker for task 7 INFO ParquetOutputFormat: Parquet block size to 134217728 10:40:00.549 Executor task launch worker for task 7 INFO ParquetOutputFormat: Parquet page size to 1048576 10:40:00.549 Executor task launch worker for task 7 INFO ParquetOutputFormat: Parquet dictionary page size to 1048576 10:40:00.549 Executor task launch worker for task 7 INFO ParquetOutputFormat: Dictionary is on 10:40:00.549 Executor task launch worker for task 7 INFO ParquetOutputFormat: Validation is off 10:40:00.549 Executor task launch worker for task 7 INFO ParquetOutputFormat: Writer version is: PARQUET_1_0 10:40:00.549 Executor task launch worker for task 7 INFO ParquetOutputFormat: Maximum row group padding size is 8388608 bytes 10:40:00.549 Executor task launch worker for task 7 INFO ParquetOutputFormat: Page size checking is: estimated 10:40:00.549 Executor task launch worker for task 7 INFO ParquetOutputFormat: Min row count for page size check is: 100 10:40:00.549 Executor task launch worker for task 7 INFO ParquetOutputFormat: Max row count for page size check is: 10000 10:40:00.552 Executor task launch worker for task 7 INFO ParquetWriteSupport: Initialized Parquet WriteSupport with Catalyst schema: { "type" : "struct", "fields" : [ { "name" : "a", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "b", "type" : "float", "nullable" : true, "metadata" : { } } ] } and corresponding Parquet message type: message spark_schema { optional int32 a; optional float b; } 10:40:00.581 Executor task launch worker for task 7 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/target/scala-2.12/test-classes/test-data/postgresql/agg.data, range: 0-38, partition values: [empty row] 10:40:00.602 Executor task launch worker for task 7 INFO CodeGenerator: Code generated in 16.080299 ms 10:40:00.701 Executor task launch worker for task 7 INFO InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 64 10:40:00.713 Executor task launch worker for task 7 INFO FileOutputCommitter: Saved output of task 'attempt_20200701104000_0004_m_000000_7' to file:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/aggtest 10:40:00.713 Executor task launch worker for task 7 INFO SparkHadoopMapRedUtil: attempt_20200701104000_0004_m_000000_7: Committed 10:40:00.715 Executor task launch worker for task 7 INFO Executor: Finished task 0.0 in stage 4.0 (TID 7). 2198 bytes result sent to driver 10:40:00.717 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 4.0 (TID 7) in 229 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:00.717 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 4.0, whose tasks have all completed, from pool 10:40:00.720 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 4 (beforeAll at BeforeAndAfterAll.scala:212) finished in 0.353 s 10:40:00.721 dag-scheduler-event-loop INFO DAGScheduler: Job 3 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:00.721 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 4: Stage finished 10:40:00.721 pool-1-thread-1 INFO DAGScheduler: Job 3 finished: beforeAll at BeforeAndAfterAll.scala:212, took 0.361201 s 10:40:00.735 pool-1-thread-1 INFO FileFormatWriter: Write Job 3415f6c7-d250-4db1-b650-c6ad33cd262d committed. 10:40:00.736 pool-1-thread-1 INFO FileFormatWriter: Finished processing stats for write job 3415f6c7-d250-4db1-b650-c6ad33cd262d. 10:40:00.747 pool-1-thread-1 INFO InMemoryFileIndex: It took 2 ms to list leaf files for 1 paths. 10:40:00.774 pool-1-thread-1 INFO InMemoryFileIndex: It took 1 ms to list leaf files for 1 paths. 10:40:00.816 pool-1-thread-1 INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:00.817 pool-1-thread-1 INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:00.856 pool-1-thread-1 INFO FileSourceStrategy: Pruning directories with: 10:40:00.857 pool-1-thread-1 INFO FileSourceStrategy: Pushed Filters: 10:40:00.857 pool-1-thread-1 INFO FileSourceStrategy: Post-Scan Filters: 10:40:00.858 pool-1-thread-1 INFO FileSourceStrategy: Output Data Schema: struct 10:40:00.869 pool-1-thread-1 INFO ParquetFileFormat: Using default output committer for Parquet: org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:00.873 pool-1-thread-1 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:40:00.873 pool-1-thread-1 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:40:00.874 pool-1-thread-1 INFO SQLHadoopMapReduceCommitProtocol: Using user defined output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:00.874 pool-1-thread-1 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:40:00.874 pool-1-thread-1 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:40:00.874 pool-1-thread-1 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:00.891 pool-1-thread-1 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 305.2 KiB, free 2.1 GiB) 10:40:00.904 pool-1-thread-1 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 27.9 KiB, free 2.1 GiB) 10:40:00.905 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 27.9 KiB, free: 2.1 GiB) 10:40:00.906 pool-1-thread-1 INFO SparkContext: Created broadcast 6 from beforeAll at BeforeAndAfterAll.scala:212 10:40:00.907 pool-1-thread-1 INFO FileSourceScanExec: Planning scan with bin packing, max size: 4194304 bytes, open cost is considered as scanning 4194304 bytes. 10:40:00.928 pool-1-thread-1 INFO SparkContext: Starting job: beforeAll at BeforeAndAfterAll.scala:212 10:40:00.930 dag-scheduler-event-loop INFO DAGScheduler: Got job 4 (beforeAll at BeforeAndAfterAll.scala:212) with 1 output partitions 10:40:00.930 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 5 (beforeAll at BeforeAndAfterAll.scala:212) 10:40:00.930 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:00.931 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:00.931 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 5 (MapPartitionsRDD[19] at beforeAll at BeforeAndAfterAll.scala:212), which has no missing parents 10:40:01.025 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 177.0 KiB, free 2.1 GiB) 10:40:01.033 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 63.1 KiB, free 2.1 GiB) 10:40:01.034 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_7_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 63.1 KiB, free: 2.1 GiB) 10:40:01.035 dag-scheduler-event-loop INFO SparkContext: Created broadcast 7 from broadcast at DAGScheduler.scala:1293 10:40:01.036 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 5 (MapPartitionsRDD[19] at beforeAll at BeforeAndAfterAll.scala:212) (first 15 tasks are for partitions Vector(0)) 10:40:01.036 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 5.0 with 1 tasks resource profile 0 10:40:01.038 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 8, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7825 bytes) taskResourceAssignments Map() 10:40:01.039 Executor task launch worker for task 8 INFO Executor: Running task 0.0 in stage 5.0 (TID 8) 10:40:01.058 Executor task launch worker for task 8 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:40:01.058 Executor task launch worker for task 8 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:40:01.059 Executor task launch worker for task 8 INFO SQLHadoopMapReduceCommitProtocol: Using user defined output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:01.059 Executor task launch worker for task 8 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:40:01.059 Executor task launch worker for task 8 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:40:01.059 Executor task launch worker for task 8 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:01.059 Executor task launch worker for task 8 INFO CodecConfig: Compression: SNAPPY 10:40:01.060 Executor task launch worker for task 8 INFO CodecConfig: Compression: SNAPPY 10:40:01.060 Executor task launch worker for task 8 INFO ParquetOutputFormat: Parquet block size to 134217728 10:40:01.060 Executor task launch worker for task 8 INFO ParquetOutputFormat: Parquet page size to 1048576 10:40:01.060 Executor task launch worker for task 8 INFO ParquetOutputFormat: Parquet dictionary page size to 1048576 10:40:01.060 Executor task launch worker for task 8 INFO ParquetOutputFormat: Dictionary is on 10:40:01.060 Executor task launch worker for task 8 INFO ParquetOutputFormat: Validation is off 10:40:01.060 Executor task launch worker for task 8 INFO ParquetOutputFormat: Writer version is: PARQUET_1_0 10:40:01.060 Executor task launch worker for task 8 INFO ParquetOutputFormat: Maximum row group padding size is 8388608 bytes 10:40:01.060 Executor task launch worker for task 8 INFO ParquetOutputFormat: Page size checking is: estimated 10:40:01.060 Executor task launch worker for task 8 INFO ParquetOutputFormat: Min row count for page size check is: 100 10:40:01.060 Executor task launch worker for task 8 INFO ParquetOutputFormat: Max row count for page size check is: 10000 10:40:01.068 Executor task launch worker for task 8 INFO ParquetWriteSupport: Initialized Parquet WriteSupport with Catalyst schema: { "type" : "struct", "fields" : [ { "name" : "unique1", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "unique2", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "two", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "four", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "ten", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "twenty", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "hundred", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "thousand", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "twothousand", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "fivethous", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "tenthous", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "odd", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "even", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "stringu1", "type" : "string", "nullable" : true, "metadata" : { } }, { "name" : "stringu2", "type" : "string", "nullable" : true, "metadata" : { } }, { "name" : "string4", "type" : "string", "nullable" : true, "metadata" : { } } ] } and corresponding Parquet message type: message spark_schema { optional int32 unique1; optional int32 unique2; optional int32 two; optional int32 four; optional int32 ten; optional int32 twenty; optional int32 hundred; optional int32 thousand; optional int32 twothousand; optional int32 fivethous; optional int32 tenthous; optional int32 odd; optional int32 even; optional binary stringu1 (UTF8); optional binary stringu2 (UTF8); optional binary string4 (UTF8); } 10:40:01.087 Executor task launch worker for task 8 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/target/scala-2.12/test-classes/test-data/postgresql/onek.data, range: 0-58300, partition values: [empty row] 10:40:01.130 Executor task launch worker for task 8 INFO CodeGenerator: Code generated in 29.19363 ms 10:40:01.325 Executor task launch worker for task 8 INFO InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 96264 10:40:01.362 Executor task launch worker for task 8 INFO FileOutputCommitter: Saved output of task 'attempt_20200701104000_0005_m_000000_8' to file:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/onek 10:40:01.362 Executor task launch worker for task 8 INFO SparkHadoopMapRedUtil: attempt_20200701104000_0005_m_000000_8: Committed 10:40:01.364 Executor task launch worker for task 8 INFO Executor: Finished task 0.0 in stage 5.0 (TID 8). 2198 bytes result sent to driver 10:40:01.367 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 8) in 329 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:01.368 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 10:40:01.369 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 5 (beforeAll at BeforeAndAfterAll.scala:212) finished in 0.436 s 10:40:01.369 dag-scheduler-event-loop INFO DAGScheduler: Job 4 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:01.369 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 5: Stage finished 10:40:01.370 pool-1-thread-1 INFO DAGScheduler: Job 4 finished: beforeAll at BeforeAndAfterAll.scala:212, took 0.441066 s 10:40:01.378 pool-1-thread-1 INFO FileFormatWriter: Write Job e50473b1-8b69-4781-83be-0e9e14ca4208 committed. 10:40:01.378 pool-1-thread-1 INFO FileFormatWriter: Finished processing stats for write job e50473b1-8b69-4781-83be-0e9e14ca4208. 10:40:01.416 pool-1-thread-1 INFO InMemoryFileIndex: It took 9 ms to list leaf files for 1 paths. 10:40:01.441 pool-1-thread-1 INFO InMemoryFileIndex: It took 1 ms to list leaf files for 1 paths. 10:40:01.484 pool-1-thread-1 INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:01.485 pool-1-thread-1 INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:01.523 pool-1-thread-1 INFO FileSourceStrategy: Pruning directories with: 10:40:01.524 pool-1-thread-1 INFO FileSourceStrategy: Pushed Filters: 10:40:01.524 pool-1-thread-1 INFO FileSourceStrategy: Post-Scan Filters: 10:40:01.525 pool-1-thread-1 INFO FileSourceStrategy: Output Data Schema: struct 10:40:01.538 pool-1-thread-1 INFO ParquetFileFormat: Using default output committer for Parquet: org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:01.542 pool-1-thread-1 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:40:01.542 pool-1-thread-1 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:40:01.543 pool-1-thread-1 INFO SQLHadoopMapReduceCommitProtocol: Using user defined output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:01.543 pool-1-thread-1 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:40:01.543 pool-1-thread-1 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:40:01.543 pool-1-thread-1 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:01.574 pool-1-thread-1 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 305.2 KiB, free 2.1 GiB) 10:40:01.590 pool-1-thread-1 INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 27.9 KiB, free 2.1 GiB) 10:40:01.591 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_8_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 27.9 KiB, free: 2.1 GiB) 10:40:01.592 pool-1-thread-1 INFO SparkContext: Created broadcast 8 from beforeAll at BeforeAndAfterAll.scala:212 10:40:01.594 pool-1-thread-1 INFO FileSourceScanExec: Planning scan with bin packing, max size: 4194304 bytes, open cost is considered as scanning 4194304 bytes. 10:40:01.623 pool-1-thread-1 INFO SparkContext: Starting job: beforeAll at BeforeAndAfterAll.scala:212 10:40:01.625 dag-scheduler-event-loop INFO DAGScheduler: Got job 5 (beforeAll at BeforeAndAfterAll.scala:212) with 1 output partitions 10:40:01.625 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 6 (beforeAll at BeforeAndAfterAll.scala:212) 10:40:01.625 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:01.625 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:01.625 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 6 (MapPartitionsRDD[23] at beforeAll at BeforeAndAfterAll.scala:212), which has no missing parents 10:40:01.724 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 177.0 KiB, free 2.1 GiB) 10:40:01.728 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 63.1 KiB, free 2.1 GiB) 10:40:01.729 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_9_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 63.1 KiB, free: 2.1 GiB) 10:40:01.730 dag-scheduler-event-loop INFO SparkContext: Created broadcast 9 from broadcast at DAGScheduler.scala:1293 10:40:01.730 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 6 (MapPartitionsRDD[23] at beforeAll at BeforeAndAfterAll.scala:212) (first 15 tasks are for partitions Vector(0)) 10:40:01.731 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 6.0 with 1 tasks resource profile 0 10:40:01.732 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 6.0 (TID 9, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7825 bytes) taskResourceAssignments Map() 10:40:01.733 Executor task launch worker for task 9 INFO Executor: Running task 0.0 in stage 6.0 (TID 9) 10:40:01.752 Executor task launch worker for task 9 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:40:01.752 Executor task launch worker for task 9 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:40:01.753 Executor task launch worker for task 9 INFO SQLHadoopMapReduceCommitProtocol: Using user defined output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:01.753 Executor task launch worker for task 9 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:40:01.753 Executor task launch worker for task 9 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:40:01.753 Executor task launch worker for task 9 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:01.753 Executor task launch worker for task 9 INFO CodecConfig: Compression: SNAPPY 10:40:01.753 Executor task launch worker for task 9 INFO CodecConfig: Compression: SNAPPY 10:40:01.754 Executor task launch worker for task 9 INFO ParquetOutputFormat: Parquet block size to 134217728 10:40:01.754 Executor task launch worker for task 9 INFO ParquetOutputFormat: Parquet page size to 1048576 10:40:01.754 Executor task launch worker for task 9 INFO ParquetOutputFormat: Parquet dictionary page size to 1048576 10:40:01.754 Executor task launch worker for task 9 INFO ParquetOutputFormat: Dictionary is on 10:40:01.754 Executor task launch worker for task 9 INFO ParquetOutputFormat: Validation is off 10:40:01.754 Executor task launch worker for task 9 INFO ParquetOutputFormat: Writer version is: PARQUET_1_0 10:40:01.754 Executor task launch worker for task 9 INFO ParquetOutputFormat: Maximum row group padding size is 8388608 bytes 10:40:01.754 Executor task launch worker for task 9 INFO ParquetOutputFormat: Page size checking is: estimated 10:40:01.754 Executor task launch worker for task 9 INFO ParquetOutputFormat: Min row count for page size check is: 100 10:40:01.754 Executor task launch worker for task 9 INFO ParquetOutputFormat: Max row count for page size check is: 10000 10:40:01.760 Executor task launch worker for task 9 INFO ParquetWriteSupport: Initialized Parquet WriteSupport with Catalyst schema: { "type" : "struct", "fields" : [ { "name" : "unique1", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "unique2", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "two", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "four", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "ten", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "twenty", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "hundred", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "thousand", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "twothousand", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "fivethous", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "tenthous", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "odd", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "even", "type" : "integer", "nullable" : true, "metadata" : { } }, { "name" : "stringu1", "type" : "string", "nullable" : true, "metadata" : { } }, { "name" : "stringu2", "type" : "string", "nullable" : true, "metadata" : { } }, { "name" : "string4", "type" : "string", "nullable" : true, "metadata" : { } } ] } and corresponding Parquet message type: message spark_schema { optional int32 unique1; optional int32 unique2; optional int32 two; optional int32 four; optional int32 ten; optional int32 twenty; optional int32 hundred; optional int32 thousand; optional int32 twothousand; optional int32 fivethous; optional int32 tenthous; optional int32 odd; optional int32 even; optional binary stringu1 (UTF8); optional binary stringu2 (UTF8); optional binary string4 (UTF8); } 10:40:01.772 Executor task launch worker for task 9 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/target/scala-2.12/test-classes/test-data/postgresql/tenk.data, range: 0-670800, partition values: [empty row] 10:40:02.085 Executor task launch worker for task 9 INFO InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 900144 10:40:02.155 Executor task launch worker for task 9 INFO FileOutputCommitter: Saved output of task 'attempt_20200701104001_0006_m_000000_9' to file:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/tenk1 10:40:02.155 Executor task launch worker for task 9 INFO SparkHadoopMapRedUtil: attempt_20200701104001_0006_m_000000_9: Committed 10:40:02.157 Executor task launch worker for task 9 INFO Executor: Finished task 0.0 in stage 6.0 (TID 9). 2198 bytes result sent to driver 10:40:02.159 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 6.0 (TID 9) in 427 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:02.159 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 6.0, whose tasks have all completed, from pool 10:40:02.160 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 6 (beforeAll at BeforeAndAfterAll.scala:212) finished in 0.534 s 10:40:02.160 dag-scheduler-event-loop INFO DAGScheduler: Job 5 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:02.160 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 6: Stage finished 10:40:02.161 pool-1-thread-1 INFO DAGScheduler: Job 5 finished: beforeAll at BeforeAndAfterAll.scala:212, took 0.537289 s 10:40:02.173 pool-1-thread-1 INFO FileFormatWriter: Write Job 8e839710-3384-4144-8d44-b6bfca573c17 committed. 10:40:02.173 pool-1-thread-1 INFO FileFormatWriter: Finished processing stats for write job 8e839710-3384-4144-8d44-b6bfca573c17. 10:40:02.183 pool-1-thread-1 INFO InMemoryFileIndex: It took 2 ms to list leaf files for 1 paths. 10:40:02.268 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== TEST OUTPUT FOR o.a.s.sql.SQLQueryTestSuite: 'decimalArithmeticOperations.sql' ===== 10:40:02.413 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:02.413 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:02.578 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:02.579 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:02.683 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 30.28116 ms 10:40:02.723 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:02.725 dag-scheduler-event-loop INFO DAGScheduler: Got job 6 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:02.725 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 7 (apply at OutcomeOf.scala:85) 10:40:02.725 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:02.725 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:02.726 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 7 (MapPartitionsRDD[28] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:02.730 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_10 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:02.742 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_10_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:02.743 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_10_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:02.744 dag-scheduler-event-loop INFO SparkContext: Created broadcast 10 from broadcast at DAGScheduler.scala:1293 10:40:02.745 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 7 (MapPartitionsRDD[28] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:02.746 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 7.0 with 1 tasks resource profile 0 10:40:02.749 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 10, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:02.750 Executor task launch worker for task 10 INFO Executor: Running task 0.0 in stage 7.0 (TID 10) 10:40:02.847 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_4_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 27.9 KiB, free: 2.1 GiB) 10:40:02.879 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_6_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 27.9 KiB, free: 2.1 GiB) 10:40:02.920 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_7_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 63.1 KiB, free: 2.1 GiB) 10:40:02.926 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_2_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 61.7 KiB, free: 2.1 GiB) 10:40:02.932 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_3_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 61.8 KiB, free: 2.1 GiB) 10:40:02.937 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_5_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 62.2 KiB, free: 2.1 GiB) 10:40:02.945 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_8_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 27.9 KiB, free: 2.1 GiB) 10:40:02.967 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_9_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 63.1 KiB, free: 2.1 GiB) 10:40:02.969 Executor task launch worker for task 10 INFO Executor: Finished task 0.0 in stage 7.0 (TID 10). 1440 bytes result sent to driver 10:40:02.971 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 10) in 223 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:02.971 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool 10:40:02.972 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 7 (apply at OutcomeOf.scala:85) finished in 0.244 s 10:40:02.972 dag-scheduler-event-loop INFO DAGScheduler: Job 6 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:02.972 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 7: Stage finished 10:40:02.973 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 6 finished: apply at OutcomeOf.scala:85, took 0.249201 s 10:40:03.018 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:03.019 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:03.079 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 12.109025 ms 10:40:03.099 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:03.100 dag-scheduler-event-loop INFO DAGScheduler: Got job 7 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:03.100 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 8 (apply at OutcomeOf.scala:85) 10:40:03.100 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:03.101 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:03.101 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 8 (MapPartitionsRDD[30] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:03.104 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_11 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:03.111 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_11_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:03.112 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_11_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:03.113 dag-scheduler-event-loop INFO SparkContext: Created broadcast 11 from broadcast at DAGScheduler.scala:1293 10:40:03.113 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 8 (MapPartitionsRDD[30] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:03.114 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 8.0 with 1 tasks resource profile 0 10:40:03.115 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 8.0 (TID 11, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:03.116 Executor task launch worker for task 11 INFO Executor: Running task 0.0 in stage 8.0 (TID 11) 10:40:03.125 Executor task launch worker for task 11 INFO Executor: Finished task 0.0 in stage 8.0 (TID 11). 1397 bytes result sent to driver 10:40:03.127 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 8.0 (TID 11) in 12 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:03.127 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 8.0, whose tasks have all completed, from pool 10:40:03.128 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 8 (apply at OutcomeOf.scala:85) finished in 0.026 s 10:40:03.129 dag-scheduler-event-loop INFO DAGScheduler: Job 7 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:03.129 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 8: Stage finished 10:40:03.130 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 7 finished: apply at OutcomeOf.scala:85, took 0.030260 s 10:40:03.211 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:03.211 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:03.276 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:03.277 dag-scheduler-event-loop INFO DAGScheduler: Got job 8 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:03.277 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 9 (apply at OutcomeOf.scala:85) 10:40:03.277 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:03.278 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:03.279 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 9 (MapPartitionsRDD[32] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:03.282 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_12 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:03.285 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_12_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:03.286 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_12_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:03.286 dag-scheduler-event-loop INFO SparkContext: Created broadcast 12 from broadcast at DAGScheduler.scala:1293 10:40:03.287 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 9 (MapPartitionsRDD[32] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:03.287 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 9.0 with 1 tasks resource profile 0 10:40:03.290 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 9.0 (TID 12, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:03.291 Executor task launch worker for task 12 INFO Executor: Running task 0.0 in stage 9.0 (TID 12) 10:40:03.296 Executor task launch worker for task 12 INFO Executor: Finished task 0.0 in stage 9.0 (TID 12). 1397 bytes result sent to driver 10:40:03.301 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 9.0 (TID 12) in 11 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:03.301 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 9.0, whose tasks have all completed, from pool 10:40:03.305 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 9 (apply at OutcomeOf.scala:85) finished in 0.025 s 10:40:03.305 dag-scheduler-event-loop INFO DAGScheduler: Job 8 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:03.305 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 9: Stage finished 10:40:03.306 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 8 finished: apply at OutcomeOf.scala:85, took 0.029337 s 10:40:03.361 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:03.361 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:03.382 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO InMemoryFileIndex: It took 0 ms to list leaf files for 0 paths. 10:40:03.596 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO InMemoryFileIndex: It took 98 ms to list leaf files for 1 paths. 10:40:03.644 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:03.644 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:03.783 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO ParquetFileFormat: Using default output committer for Parquet: org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:03.785 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:40:03.785 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:40:03.786 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLHadoopMapReduceCommitProtocol: Using user defined output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:03.786 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:40:03.786 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:40:03.786 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:03.846 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 15.683284 ms 10:40:03.868 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 20.121287 ms 10:40:03.910 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:03.912 dag-scheduler-event-loop INFO DAGScheduler: Got job 9 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:03.912 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 10 (apply at OutcomeOf.scala:85) 10:40:03.912 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:03.912 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:03.913 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 10 (MapPartitionsRDD[34] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:04.055 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_13 stored as values in memory (estimated size 172.8 KiB, free 2.1 GiB) 10:40:04.059 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_13_piece0 stored as bytes in memory (estimated size 61.2 KiB, free 2.1 GiB) 10:40:04.060 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_13_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 61.2 KiB, free: 2.1 GiB) 10:40:04.061 dag-scheduler-event-loop INFO SparkContext: Created broadcast 13 from broadcast at DAGScheduler.scala:1293 10:40:04.062 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 10 (MapPartitionsRDD[34] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:04.062 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 10.0 with 2 tasks resource profile 0 10:40:04.065 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 10.0 (TID 13, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7654 bytes) taskResourceAssignments Map() 10:40:04.067 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 10.0 (TID 14, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7654 bytes) taskResourceAssignments Map() 10:40:04.068 Executor task launch worker for task 13 INFO Executor: Running task 0.0 in stage 10.0 (TID 13) 10:40:04.068 Executor task launch worker for task 14 INFO Executor: Running task 1.0 in stage 10.0 (TID 14) 10:40:04.089 Executor task launch worker for task 14 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:40:04.089 Executor task launch worker for task 13 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:40:04.089 Executor task launch worker for task 14 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:40:04.089 Executor task launch worker for task 13 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:40:04.089 Executor task launch worker for task 14 INFO SQLHadoopMapReduceCommitProtocol: Using user defined output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:04.089 Executor task launch worker for task 13 INFO SQLHadoopMapReduceCommitProtocol: Using user defined output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:04.090 Executor task launch worker for task 14 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:40:04.090 Executor task launch worker for task 14 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:40:04.090 Executor task launch worker for task 14 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:04.091 Executor task launch worker for task 14 INFO CodecConfig: Compression: SNAPPY 10:40:04.091 Executor task launch worker for task 14 INFO CodecConfig: Compression: SNAPPY 10:40:04.091 Executor task launch worker for task 13 INFO FileOutputCommitter: File Output Committer Algorithm version is 2 10:40:04.091 Executor task launch worker for task 13 INFO FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 10:40:04.091 Executor task launch worker for task 14 INFO ParquetOutputFormat: Parquet block size to 134217728 10:40:04.091 Executor task launch worker for task 14 INFO ParquetOutputFormat: Parquet page size to 1048576 10:40:04.091 Executor task launch worker for task 14 INFO ParquetOutputFormat: Parquet dictionary page size to 1048576 10:40:04.091 Executor task launch worker for task 14 INFO ParquetOutputFormat: Dictionary is on 10:40:04.091 Executor task launch worker for task 14 INFO ParquetOutputFormat: Validation is off 10:40:04.091 Executor task launch worker for task 14 INFO ParquetOutputFormat: Writer version is: PARQUET_1_0 10:40:04.091 Executor task launch worker for task 14 INFO ParquetOutputFormat: Maximum row group padding size is 8388608 bytes 10:40:04.091 Executor task launch worker for task 14 INFO ParquetOutputFormat: Page size checking is: estimated 10:40:04.092 Executor task launch worker for task 14 INFO ParquetOutputFormat: Min row count for page size check is: 100 10:40:04.092 Executor task launch worker for task 14 INFO ParquetOutputFormat: Max row count for page size check is: 10000 10:40:04.091 Executor task launch worker for task 13 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.parquet.hadoop.ParquetOutputCommitter 10:40:04.092 Executor task launch worker for task 13 INFO CodecConfig: Compression: SNAPPY 10:40:04.092 Executor task launch worker for task 13 INFO CodecConfig: Compression: SNAPPY 10:40:04.092 Executor task launch worker for task 13 INFO ParquetOutputFormat: Parquet block size to 134217728 10:40:04.092 Executor task launch worker for task 13 INFO ParquetOutputFormat: Parquet page size to 1048576 10:40:04.092 Executor task launch worker for task 13 INFO ParquetOutputFormat: Parquet dictionary page size to 1048576 10:40:04.092 Executor task launch worker for task 13 INFO ParquetOutputFormat: Dictionary is on 10:40:04.092 Executor task launch worker for task 13 INFO ParquetOutputFormat: Validation is off 10:40:04.092 Executor task launch worker for task 13 INFO ParquetOutputFormat: Writer version is: PARQUET_1_0 10:40:04.092 Executor task launch worker for task 13 INFO ParquetOutputFormat: Maximum row group padding size is 8388608 bytes 10:40:04.092 Executor task launch worker for task 13 INFO ParquetOutputFormat: Page size checking is: estimated 10:40:04.093 Executor task launch worker for task 13 INFO ParquetOutputFormat: Min row count for page size check is: 100 10:40:04.093 Executor task launch worker for task 13 INFO ParquetOutputFormat: Max row count for page size check is: 10000 10:40:04.100 Executor task launch worker for task 14 INFO ParquetWriteSupport: Initialized Parquet WriteSupport with Catalyst schema: { "type" : "struct", "fields" : [ { "name" : "id", "type" : "integer", "nullable" : false, "metadata" : { } }, { "name" : "a", "type" : "decimal(38,18)", "nullable" : false, "metadata" : { } }, { "name" : "b", "type" : "decimal(38,18)", "nullable" : false, "metadata" : { } } ] } and corresponding Parquet message type: message spark_schema { required int32 id; required fixed_len_byte_array(16) a (DECIMAL(38,18)); required fixed_len_byte_array(16) b (DECIMAL(38,18)); } 10:40:04.103 Executor task launch worker for task 13 INFO ParquetWriteSupport: Initialized Parquet WriteSupport with Catalyst schema: { "type" : "struct", "fields" : [ { "name" : "id", "type" : "integer", "nullable" : false, "metadata" : { } }, { "name" : "a", "type" : "decimal(38,18)", "nullable" : false, "metadata" : { } }, { "name" : "b", "type" : "decimal(38,18)", "nullable" : false, "metadata" : { } } ] } and corresponding Parquet message type: message spark_schema { required int32 id; required fixed_len_byte_array(16) a (DECIMAL(38,18)); required fixed_len_byte_array(16) b (DECIMAL(38,18)); } 10:40:04.127 Executor task launch worker for task 14 INFO InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 2064 10:40:04.128 Executor task launch worker for task 13 INFO InternalParquetRecordWriter: Flushing mem columnStore to file. allocated memory: 2064 10:40:04.133 Executor task launch worker for task 13 INFO FileOutputCommitter: Saved output of task 'attempt_20200701104003_0010_m_000000_13' to file:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/decimals_test 10:40:04.133 Executor task launch worker for task 14 INFO FileOutputCommitter: Saved output of task 'attempt_20200701104003_0010_m_000001_14' to file:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/decimals_test 10:40:04.133 Executor task launch worker for task 13 INFO SparkHadoopMapRedUtil: attempt_20200701104003_0010_m_000000_13: Committed 10:40:04.133 Executor task launch worker for task 14 INFO SparkHadoopMapRedUtil: attempt_20200701104003_0010_m_000001_14: Committed 10:40:04.135 Executor task launch worker for task 14 INFO Executor: Finished task 1.0 in stage 10.0 (TID 14). 2184 bytes result sent to driver 10:40:04.135 Executor task launch worker for task 13 INFO Executor: Finished task 0.0 in stage 10.0 (TID 13). 2184 bytes result sent to driver 10:40:04.136 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 10.0 (TID 14) in 70 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:04.138 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 10.0 (TID 13) in 74 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:04.138 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 10.0, whose tasks have all completed, from pool 10:40:04.139 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 10 (apply at OutcomeOf.scala:85) finished in 0.224 s 10:40:04.139 dag-scheduler-event-loop INFO DAGScheduler: Job 9 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:04.139 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 10: Stage finished 10:40:04.139 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 9 finished: apply at OutcomeOf.scala:85, took 0.228841 s 10:40:04.152 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileFormatWriter: Write Job 35e919ba-852f-4ac4-993d-974b21543af0 committed. 10:40:04.153 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileFormatWriter: Finished processing stats for write job 35e919ba-852f-4ac4-993d-974b21543af0. 10:40:04.167 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO InMemoryFileIndex: It took 2 ms to list leaf files for 1 paths. 10:40:04.206 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO InMemoryFileIndex: It took 2 ms to list leaf files for 1 paths. 10:40:04.287 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:04.287 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:04.342 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:04.342 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: 10:40:04.343 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: 10:40:04.343 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:04.393 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 16.496206 ms 10:40:04.450 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 38.158485 ms 10:40:04.463 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO MemoryStore: Block broadcast_14 stored as values in memory (estimated size 309.7 KiB, free 2.1 GiB) 10:40:04.477 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO MemoryStore: Block broadcast_14_piece0 stored as bytes in memory (estimated size 28.5 KiB, free 2.1 GiB) 10:40:04.477 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_14_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 28.5 KiB, free: 2.1 GiB) 10:40:04.479 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Created broadcast 14 from apply at OutcomeOf.scala:85 10:40:04.482 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceScanExec: Planning scan with bin packing, max size: 4195230 bytes, open cost is considered as scanning 4194304 bytes. 10:40:04.516 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 16.503268 ms 10:40:04.579 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:04.581 dag-scheduler-event-loop INFO DAGScheduler: Got job 10 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:04.581 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 11 (apply at OutcomeOf.scala:85) 10:40:04.581 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:04.581 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:04.582 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 11 (MapPartitionsRDD[40] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:04.586 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_15 stored as values in memory (estimated size 19.4 KiB, free 2.1 GiB) 10:40:04.589 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_15_piece0 stored as bytes in memory (estimated size 7.8 KiB, free 2.1 GiB) 10:40:04.590 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_15_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 7.8 KiB, free: 2.1 GiB) 10:40:04.590 dag-scheduler-event-loop INFO SparkContext: Created broadcast 15 from broadcast at DAGScheduler.scala:1293 10:40:04.591 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 11 (MapPartitionsRDD[40] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:04.591 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 11.0 with 2 tasks resource profile 0 10:40:04.593 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 11.0 (TID 15, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7900 bytes) taskResourceAssignments Map() 10:40:04.594 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 11.0 (TID 16, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7900 bytes) taskResourceAssignments Map() 10:40:04.594 Executor task launch worker for task 16 INFO Executor: Running task 1.0 in stage 11.0 (TID 16) 10:40:04.594 Executor task launch worker for task 15 INFO Executor: Running task 0.0 in stage 11.0 (TID 15) 10:40:04.658 Executor task launch worker for task 15 INFO CodeGenerator: Code generated in 11.507904 ms 10:40:04.662 Executor task launch worker for task 16 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/decimals_test/part-00000-dcf21525-ad27-4bba-a221-2aad2ac3d19e-c000.snappy.parquet, range: 0-925, partition values: [empty row] 10:40:04.664 Executor task launch worker for task 15 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/decimals_test/part-00001-dcf21525-ad27-4bba-a221-2aad2ac3d19e-c000.snappy.parquet, range: 0-927, partition values: [empty row] 10:40:04.780 Executor task launch worker for task 16 INFO CodecPool: Got brand-new decompressor [.snappy] 10:40:04.780 Executor task launch worker for task 15 INFO CodecPool: Got brand-new decompressor [.snappy] 10:40:04.796 Executor task launch worker for task 16 INFO Executor: Finished task 1.0 in stage 11.0 (TID 16). 1926 bytes result sent to driver 10:40:04.796 Executor task launch worker for task 15 INFO Executor: Finished task 0.0 in stage 11.0 (TID 15). 1926 bytes result sent to driver 10:40:04.800 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 11.0 (TID 16) in 207 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:04.802 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 11.0 (TID 15) in 209 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:04.802 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 11.0, whose tasks have all completed, from pool 10:40:04.803 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 11 (apply at OutcomeOf.scala:85) finished in 0.220 s 10:40:04.804 dag-scheduler-event-loop INFO DAGScheduler: Job 10 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:04.804 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 11: Stage finished 10:40:04.804 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 10 finished: apply at OutcomeOf.scala:85, took 0.224642 s 10:40:04.879 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:04.880 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 41 (apply at OutcomeOf.scala:85) as input to shuffle 1 10:40:04.881 dag-scheduler-event-loop INFO DAGScheduler: Got job 11 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:04.881 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 13 (apply at OutcomeOf.scala:85) 10:40:04.881 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 12) 10:40:04.881 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 12) 10:40:04.882 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 12 (MapPartitionsRDD[41] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:04.894 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_16 stored as values in memory (estimated size 22.0 KiB, free 2.1 GiB) 10:40:04.898 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_16_piece0 stored as bytes in memory (estimated size 9.2 KiB, free 2.1 GiB) 10:40:04.898 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_16_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 9.2 KiB, free: 2.1 GiB) 10:40:04.899 dag-scheduler-event-loop INFO SparkContext: Created broadcast 16 from broadcast at DAGScheduler.scala:1293 10:40:04.900 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 12 (MapPartitionsRDD[41] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:04.900 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 12.0 with 2 tasks resource profile 0 10:40:04.901 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 12.0 (TID 17, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7889 bytes) taskResourceAssignments Map() 10:40:04.902 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 12.0 (TID 18, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7889 bytes) taskResourceAssignments Map() 10:40:04.902 Executor task launch worker for task 17 INFO Executor: Running task 0.0 in stage 12.0 (TID 17) 10:40:04.902 Executor task launch worker for task 18 INFO Executor: Running task 1.0 in stage 12.0 (TID 18) 10:40:04.947 Executor task launch worker for task 18 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/decimals_test/part-00000-dcf21525-ad27-4bba-a221-2aad2ac3d19e-c000.snappy.parquet, range: 0-925, partition values: [empty row] 10:40:04.947 Executor task launch worker for task 17 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/decimals_test/part-00001-dcf21525-ad27-4bba-a221-2aad2ac3d19e-c000.snappy.parquet, range: 0-927, partition values: [empty row] 10:40:04.965 Executor task launch worker for task 17 INFO Executor: Finished task 0.0 in stage 12.0 (TID 17). 2005 bytes result sent to driver 10:40:04.968 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 12.0 (TID 17) in 67 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:04.979 Executor task launch worker for task 18 INFO Executor: Finished task 1.0 in stage 12.0 (TID 18). 2005 bytes result sent to driver 10:40:04.981 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 12.0 (TID 18) in 79 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:04.981 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 12.0, whose tasks have all completed, from pool 10:40:04.983 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 12 (apply at OutcomeOf.scala:85) finished in 0.099 s 10:40:04.983 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:04.983 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:04.983 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 13) 10:40:04.983 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:04.983 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 13 (MapPartitionsRDD[44] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:04.991 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_17 stored as values in memory (estimated size 20.5 KiB, free 2.1 GiB) 10:40:04.999 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_17_piece0 stored as bytes in memory (estimated size 10.1 KiB, free 2.1 GiB) 10:40:05.000 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_17_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 10.1 KiB, free: 2.1 GiB) 10:40:05.000 dag-scheduler-event-loop INFO SparkContext: Created broadcast 17 from broadcast at DAGScheduler.scala:1293 10:40:05.001 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 13 (MapPartitionsRDD[44] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:05.002 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 13.0 with 4 tasks resource profile 0 10:40:05.004 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 13.0 (TID 19, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:05.005 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 13.0 (TID 20, amp-jenkins-worker-04.amp, executor driver, partition 1, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:05.006 Executor task launch worker for task 19 INFO Executor: Running task 0.0 in stage 13.0 (TID 19) 10:40:05.006 Executor task launch worker for task 20 INFO Executor: Running task 1.0 in stage 13.0 (TID 20) 10:40:05.018 Executor task launch worker for task 20 INFO ShuffleBlockFetcherIterator: Getting 1 (129.0 B) non-empty blocks including 1 (129.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:05.018 Executor task launch worker for task 19 INFO ShuffleBlockFetcherIterator: Getting 1 (142.0 B) non-empty blocks including 1 (142.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:05.018 Executor task launch worker for task 20 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms 10:40:05.018 Executor task launch worker for task 19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms 10:40:05.056 Executor task launch worker for task 19 INFO CodeGenerator: Code generated in 13.630698 ms 10:40:05.127 Executor task launch worker for task 19 INFO Executor: Finished task 0.0 in stage 13.0 (TID 19). 3484 bytes result sent to driver 10:40:05.127 Executor task launch worker for task 20 INFO Executor: Finished task 1.0 in stage 13.0 (TID 20). 3475 bytes result sent to driver 10:40:05.130 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 2.0 in stage 13.0 (TID 21, amp-jenkins-worker-04.amp, executor driver, partition 2, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:05.131 Executor task launch worker for task 21 INFO Executor: Running task 2.0 in stage 13.0 (TID 21) 10:40:05.132 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 3.0 in stage 13.0 (TID 22, amp-jenkins-worker-04.amp, executor driver, partition 3, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:05.132 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 13.0 (TID 20) in 128 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:05.132 Executor task launch worker for task 22 INFO Executor: Running task 3.0 in stage 13.0 (TID 22) 10:40:05.132 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 13.0 (TID 19) in 128 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:05.138 Executor task launch worker for task 21 INFO ShuffleBlockFetcherIterator: Getting 1 (129.0 B) non-empty blocks including 1 (129.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:05.138 Executor task launch worker for task 21 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:05.142 Executor task launch worker for task 22 INFO ShuffleBlockFetcherIterator: Getting 1 (142.0 B) non-empty blocks including 1 (142.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:05.142 Executor task launch worker for task 22 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:05.171 Executor task launch worker for task 21 INFO Executor: Finished task 2.0 in stage 13.0 (TID 21). 3483 bytes result sent to driver 10:40:05.173 task-result-getter-2 INFO TaskSetManager: Finished task 2.0 in stage 13.0 (TID 21) in 42 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:05.185 Executor task launch worker for task 22 INFO Executor: Finished task 3.0 in stage 13.0 (TID 22). 3492 bytes result sent to driver 10:40:05.187 task-result-getter-0 INFO TaskSetManager: Finished task 3.0 in stage 13.0 (TID 22) in 56 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:05.187 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 13.0, whose tasks have all completed, from pool 10:40:05.188 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 13 (apply at OutcomeOf.scala:85) finished in 0.202 s 10:40:05.188 dag-scheduler-event-loop INFO DAGScheduler: Job 11 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:05.188 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 13: Stage finished 10:40:05.188 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 11 finished: apply at OutcomeOf.scala:85, took 0.309193 s 10:40:05.251 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:05.251 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:05.292 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:05.293 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: 10:40:05.293 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: 10:40:05.294 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:05.332 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 20.203513 ms 10:40:05.337 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO MemoryStore: Block broadcast_18 stored as values in memory (estimated size 309.7 KiB, free 2.1 GiB) 10:40:05.351 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO MemoryStore: Block broadcast_18_piece0 stored as bytes in memory (estimated size 28.5 KiB, free 2.1 GiB) 10:40:05.351 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_18_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 28.5 KiB, free: 2.1 GiB) 10:40:05.352 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Created broadcast 18 from apply at OutcomeOf.scala:85 10:40:05.353 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceScanExec: Planning scan with bin packing, max size: 4195230 bytes, open cost is considered as scanning 4194304 bytes. 10:40:05.390 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:05.391 dag-scheduler-event-loop INFO DAGScheduler: Got job 12 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:05.391 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 14 (apply at OutcomeOf.scala:85) 10:40:05.392 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:05.392 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:05.392 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 14 (MapPartitionsRDD[50] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:05.395 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_19 stored as values in memory (estimated size 17.9 KiB, free 2.1 GiB) 10:40:05.398 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_19_piece0 stored as bytes in memory (estimated size 7.9 KiB, free 2.1 GiB) 10:40:05.398 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_19_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 7.9 KiB, free: 2.1 GiB) 10:40:05.399 dag-scheduler-event-loop INFO SparkContext: Created broadcast 19 from broadcast at DAGScheduler.scala:1293 10:40:05.400 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 14 (MapPartitionsRDD[50] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:05.400 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 14.0 with 2 tasks resource profile 0 10:40:05.401 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 14.0 (TID 23, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7900 bytes) taskResourceAssignments Map() 10:40:05.401 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 14.0 (TID 24, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7900 bytes) taskResourceAssignments Map() 10:40:05.402 Executor task launch worker for task 23 INFO Executor: Running task 0.0 in stage 14.0 (TID 23) 10:40:05.402 Executor task launch worker for task 24 INFO Executor: Running task 1.0 in stage 14.0 (TID 24) 10:40:05.413 Executor task launch worker for task 24 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/decimals_test/part-00000-dcf21525-ad27-4bba-a221-2aad2ac3d19e-c000.snappy.parquet, range: 0-925, partition values: [empty row] 10:40:05.413 Executor task launch worker for task 23 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/decimals_test/part-00001-dcf21525-ad27-4bba-a221-2aad2ac3d19e-c000.snappy.parquet, range: 0-927, partition values: [empty row] 10:40:05.423 Executor task launch worker for task 24 INFO Executor: Finished task 1.0 in stage 14.0 (TID 24). 1926 bytes result sent to driver 10:40:05.423 Executor task launch worker for task 23 INFO Executor: Finished task 0.0 in stage 14.0 (TID 23). 1926 bytes result sent to driver 10:40:05.425 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 14.0 (TID 24) in 24 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:05.425 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 14.0 (TID 23) in 24 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:05.425 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 14.0, whose tasks have all completed, from pool 10:40:05.427 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 14 (apply at OutcomeOf.scala:85) finished in 0.033 s 10:40:05.427 dag-scheduler-event-loop INFO DAGScheduler: Job 12 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:05.427 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 14: Stage finished 10:40:05.427 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 12 finished: apply at OutcomeOf.scala:85, took 0.036654 s 10:40:05.455 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:05.458 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 51 (apply at OutcomeOf.scala:85) as input to shuffle 2 10:40:05.459 dag-scheduler-event-loop INFO DAGScheduler: Got job 13 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:05.459 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 16 (apply at OutcomeOf.scala:85) 10:40:05.459 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 15) 10:40:05.459 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 15) 10:40:05.460 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 15 (MapPartitionsRDD[51] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:05.467 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_20 stored as values in memory (estimated size 20.6 KiB, free 2.1 GiB) 10:40:05.470 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_20_piece0 stored as bytes in memory (estimated size 9.3 KiB, free 2.1 GiB) 10:40:05.471 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_20_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 9.3 KiB, free: 2.1 GiB) 10:40:05.471 dag-scheduler-event-loop INFO SparkContext: Created broadcast 20 from broadcast at DAGScheduler.scala:1293 10:40:05.473 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 15 (MapPartitionsRDD[51] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:05.473 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 15.0 with 2 tasks resource profile 0 10:40:05.475 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 15.0 (TID 25, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7889 bytes) taskResourceAssignments Map() 10:40:05.475 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 15.0 (TID 26, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7889 bytes) taskResourceAssignments Map() 10:40:05.476 Executor task launch worker for task 25 INFO Executor: Running task 0.0 in stage 15.0 (TID 25) 10:40:05.476 Executor task launch worker for task 26 INFO Executor: Running task 1.0 in stage 15.0 (TID 26) 10:40:05.487 Executor task launch worker for task 25 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/decimals_test/part-00001-dcf21525-ad27-4bba-a221-2aad2ac3d19e-c000.snappy.parquet, range: 0-927, partition values: [empty row] 10:40:05.491 Executor task launch worker for task 26 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/decimals_test/part-00000-dcf21525-ad27-4bba-a221-2aad2ac3d19e-c000.snappy.parquet, range: 0-925, partition values: [empty row] 10:40:05.502 Executor task launch worker for task 25 INFO Executor: Finished task 0.0 in stage 15.0 (TID 25). 2005 bytes result sent to driver 10:40:05.503 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 15.0 (TID 25) in 28 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:05.504 Executor task launch worker for task 26 INFO Executor: Finished task 1.0 in stage 15.0 (TID 26). 2005 bytes result sent to driver 10:40:05.505 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 15.0 (TID 26) in 30 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:05.505 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 15.0, whose tasks have all completed, from pool 10:40:05.506 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 15 (apply at OutcomeOf.scala:85) finished in 0.045 s 10:40:05.506 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:05.506 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:05.506 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 16) 10:40:05.506 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:05.507 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 16 (MapPartitionsRDD[54] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:05.512 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_21 stored as values in memory (estimated size 21.0 KiB, free 2.1 GiB) 10:40:05.515 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_21_piece0 stored as bytes in memory (estimated size 10.5 KiB, free 2.1 GiB) 10:40:05.516 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_21_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 10.5 KiB, free: 2.1 GiB) 10:40:05.517 dag-scheduler-event-loop INFO SparkContext: Created broadcast 21 from broadcast at DAGScheduler.scala:1293 10:40:05.518 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 16 (MapPartitionsRDD[54] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:05.518 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 16.0 with 4 tasks resource profile 0 10:40:05.520 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 16.0 (TID 27, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:05.520 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 16.0 (TID 28, amp-jenkins-worker-04.amp, executor driver, partition 1, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:05.521 Executor task launch worker for task 27 INFO Executor: Running task 0.0 in stage 16.0 (TID 27) 10:40:05.521 Executor task launch worker for task 28 INFO Executor: Running task 1.0 in stage 16.0 (TID 28) 10:40:05.529 Executor task launch worker for task 28 INFO ShuffleBlockFetcherIterator: Getting 1 (97.0 B) non-empty blocks including 1 (97.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:05.530 Executor task launch worker for task 27 INFO ShuffleBlockFetcherIterator: Getting 1 (106.0 B) non-empty blocks including 1 (106.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:05.530 Executor task launch worker for task 28 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:05.530 Executor task launch worker for task 27 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:05.563 Executor task launch worker for task 27 INFO Executor: Finished task 0.0 in stage 16.0 (TID 27). 3452 bytes result sent to driver 10:40:05.565 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 2.0 in stage 16.0 (TID 29, amp-jenkins-worker-04.amp, executor driver, partition 2, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:05.565 Executor task launch worker for task 29 INFO Executor: Running task 2.0 in stage 16.0 (TID 29) 10:40:05.566 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 16.0 (TID 27) in 45 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:05.571 Executor task launch worker for task 29 INFO ShuffleBlockFetcherIterator: Getting 1 (106.0 B) non-empty blocks including 1 (106.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:05.571 Executor task launch worker for task 29 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:05.572 Executor task launch worker for task 28 INFO Executor: Finished task 1.0 in stage 16.0 (TID 28). 3450 bytes result sent to driver 10:40:05.573 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 16.0 (TID 30, amp-jenkins-worker-04.amp, executor driver, partition 3, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:05.573 Executor task launch worker for task 30 INFO Executor: Running task 3.0 in stage 16.0 (TID 30) 10:40:05.573 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 16.0 (TID 28) in 53 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:05.581 Executor task launch worker for task 30 INFO ShuffleBlockFetcherIterator: Getting 1 (106.0 B) non-empty blocks including 1 (106.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:05.581 Executor task launch worker for task 30 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:05.599 Executor task launch worker for task 29 INFO Executor: Finished task 2.0 in stage 16.0 (TID 29). 3453 bytes result sent to driver 10:40:05.600 task-result-getter-2 INFO TaskSetManager: Finished task 2.0 in stage 16.0 (TID 29) in 36 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:05.607 Executor task launch worker for task 30 INFO Executor: Finished task 3.0 in stage 16.0 (TID 30). 3458 bytes result sent to driver 10:40:05.608 task-result-getter-0 INFO TaskSetManager: Finished task 3.0 in stage 16.0 (TID 30) in 35 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:05.609 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 16.0, whose tasks have all completed, from pool 10:40:05.610 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 16 (apply at OutcomeOf.scala:85) finished in 0.101 s 10:40:05.611 dag-scheduler-event-loop INFO DAGScheduler: Job 13 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:05.611 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 16: Stage finished 10:40:05.611 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 13 finished: apply at OutcomeOf.scala:85, took 0.155384 s 10:40:05.626 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:05.626 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:05.658 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 7.499916 ms 10:40:05.683 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:05.684 dag-scheduler-event-loop INFO DAGScheduler: Got job 14 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:05.684 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 17 (apply at OutcomeOf.scala:85) 10:40:05.684 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:05.684 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:05.684 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 17 (MapPartitionsRDD[56] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:05.686 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_22 stored as values in memory (estimated size 7.1 KiB, free 2.1 GiB) 10:40:05.689 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_22_piece0 stored as bytes in memory (estimated size 3.8 KiB, free 2.1 GiB) 10:40:05.690 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_22_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.8 KiB, free: 2.1 GiB) 10:40:05.690 dag-scheduler-event-loop INFO SparkContext: Created broadcast 22 from broadcast at DAGScheduler.scala:1293 10:40:05.691 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 17 (MapPartitionsRDD[56] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:05.691 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 17.0 with 1 tasks resource profile 0 10:40:05.693 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 17.0 (TID 31, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:05.693 Executor task launch worker for task 31 INFO Executor: Running task 0.0 in stage 17.0 (TID 31) 10:40:05.701 Executor task launch worker for task 31 INFO Executor: Finished task 0.0 in stage 17.0 (TID 31). 1403 bytes result sent to driver 10:40:05.703 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 17.0 (TID 31) in 10 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:05.703 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 17.0, whose tasks have all completed, from pool 10:40:05.703 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 17 (apply at OutcomeOf.scala:85) finished in 0.018 s 10:40:05.704 dag-scheduler-event-loop INFO DAGScheduler: Job 14 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:05.704 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 17: Stage finished 10:40:05.704 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 14 finished: apply at OutcomeOf.scala:85, took 0.020845 s 10:40:05.720 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:05.720 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:05.754 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 7.545546 ms 10:40:05.779 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:05.780 dag-scheduler-event-loop INFO DAGScheduler: Got job 15 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:05.781 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 18 (apply at OutcomeOf.scala:85) 10:40:05.781 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:05.781 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:05.781 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 18 (MapPartitionsRDD[58] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:05.783 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_23 stored as values in memory (estimated size 7.1 KiB, free 2.1 GiB) 10:40:05.786 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_23_piece0 stored as bytes in memory (estimated size 3.8 KiB, free 2.1 GiB) 10:40:05.787 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_23_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.8 KiB, free: 2.1 GiB) 10:40:05.791 dag-scheduler-event-loop INFO SparkContext: Created broadcast 23 from broadcast at DAGScheduler.scala:1293 10:40:05.791 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 18 (MapPartitionsRDD[58] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:05.791 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 18.0 with 1 tasks resource profile 0 10:40:05.793 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 18.0 (TID 32, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:05.793 Executor task launch worker for task 32 INFO Executor: Running task 0.0 in stage 18.0 (TID 32) 10:40:05.800 Executor task launch worker for task 32 INFO Executor: Finished task 0.0 in stage 18.0 (TID 32). 1403 bytes result sent to driver 10:40:05.801 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 18.0 (TID 32) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:05.801 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 18.0, whose tasks have all completed, from pool 10:40:05.802 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 18 (apply at OutcomeOf.scala:85) finished in 0.020 s 10:40:05.802 dag-scheduler-event-loop INFO DAGScheduler: Job 15 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:05.802 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 18: Stage finished 10:40:05.803 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 15 finished: apply at OutcomeOf.scala:85, took 0.023013 s 10:40:05.815 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:05.815 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:05.848 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 8.133544 ms 10:40:05.869 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:05.870 dag-scheduler-event-loop INFO DAGScheduler: Got job 16 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:05.870 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 19 (apply at OutcomeOf.scala:85) 10:40:05.870 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:05.870 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:05.871 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 19 (MapPartitionsRDD[60] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:05.874 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_24 stored as values in memory (estimated size 7.2 KiB, free 2.1 GiB) 10:40:05.879 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_24_piece0 stored as bytes in memory (estimated size 3.8 KiB, free 2.1 GiB) 10:40:05.880 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_24_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.8 KiB, free: 2.1 GiB) 10:40:05.881 dag-scheduler-event-loop INFO SparkContext: Created broadcast 24 from broadcast at DAGScheduler.scala:1293 10:40:05.899 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 19 (MapPartitionsRDD[60] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:05.900 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 19.0 with 1 tasks resource profile 0 10:40:05.901 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 19.0 (TID 33, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:05.902 Executor task launch worker for task 33 INFO Executor: Running task 0.0 in stage 19.0 (TID 33) 10:40:05.910 Executor task launch worker for task 33 INFO Executor: Finished task 0.0 in stage 19.0 (TID 33). 1403 bytes result sent to driver 10:40:05.912 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 19.0 (TID 33) in 10 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:05.912 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 19.0, whose tasks have all completed, from pool 10:40:05.912 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 19 (apply at OutcomeOf.scala:85) finished in 0.041 s 10:40:05.913 dag-scheduler-event-loop INFO DAGScheduler: Job 16 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:05.913 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 19: Stage finished 10:40:05.913 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 16 finished: apply at OutcomeOf.scala:85, took 0.043671 s 10:40:05.930 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:05.930 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:05.982 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 7.116398 ms 10:40:06.000 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:06.002 dag-scheduler-event-loop INFO DAGScheduler: Got job 17 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:06.002 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 20 (apply at OutcomeOf.scala:85) 10:40:06.002 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:06.003 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:06.003 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 20 (MapPartitionsRDD[62] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:06.006 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_25 stored as values in memory (estimated size 7.2 KiB, free 2.1 GiB) 10:40:06.009 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_25_piece0 stored as bytes in memory (estimated size 3.8 KiB, free 2.1 GiB) 10:40:06.009 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_25_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.8 KiB, free: 2.1 GiB) 10:40:06.010 dag-scheduler-event-loop INFO SparkContext: Created broadcast 25 from broadcast at DAGScheduler.scala:1293 10:40:06.010 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 20 (MapPartitionsRDD[62] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:06.011 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 20.0 with 1 tasks resource profile 0 10:40:06.012 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 20.0 (TID 34, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:06.013 Executor task launch worker for task 34 INFO Executor: Running task 0.0 in stage 20.0 (TID 34) 10:40:06.020 Executor task launch worker for task 34 INFO Executor: Finished task 0.0 in stage 20.0 (TID 34). 1420 bytes result sent to driver 10:40:06.022 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 20.0 (TID 34) in 10 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:06.022 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 20.0, whose tasks have all completed, from pool 10:40:06.023 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 20 (apply at OutcomeOf.scala:85) finished in 0.018 s 10:40:06.024 dag-scheduler-event-loop INFO DAGScheduler: Job 17 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:06.024 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 20: Stage finished 10:40:06.024 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 17 finished: apply at OutcomeOf.scala:85, took 0.022625 s 10:40:06.037 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.037 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.082 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:06.083 dag-scheduler-event-loop INFO DAGScheduler: Got job 18 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:06.083 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 21 (apply at OutcomeOf.scala:85) 10:40:06.083 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:06.083 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:06.084 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 21 (MapPartitionsRDD[64] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:06.086 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_26 stored as values in memory (estimated size 7.2 KiB, free 2.1 GiB) 10:40:06.089 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_26_piece0 stored as bytes in memory (estimated size 3.8 KiB, free 2.1 GiB) 10:40:06.090 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_26_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.8 KiB, free: 2.1 GiB) 10:40:06.090 dag-scheduler-event-loop INFO SparkContext: Created broadcast 26 from broadcast at DAGScheduler.scala:1293 10:40:06.091 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 21 (MapPartitionsRDD[64] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:06.091 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 21.0 with 1 tasks resource profile 0 10:40:06.095 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 21.0 (TID 35, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:06.096 Executor task launch worker for task 35 INFO Executor: Running task 0.0 in stage 21.0 (TID 35) 10:40:06.101 Executor task launch worker for task 35 INFO Executor: Finished task 0.0 in stage 21.0 (TID 35). 1420 bytes result sent to driver 10:40:06.102 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 21.0 (TID 35) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:06.103 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 21.0, whose tasks have all completed, from pool 10:40:06.103 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 21 (apply at OutcomeOf.scala:85) finished in 0.019 s 10:40:06.104 dag-scheduler-event-loop INFO DAGScheduler: Job 18 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:06.104 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 21: Stage finished 10:40:06.104 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 18 finished: apply at OutcomeOf.scala:85, took 0.022128 s 10:40:06.124 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.124 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.152 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 7.951258 ms 10:40:06.175 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_26_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.8 KiB, free: 2.1 GiB) 10:40:06.179 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_22_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.8 KiB, free: 2.1 GiB) 10:40:06.186 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_19_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 7.9 KiB, free: 2.1 GiB) 10:40:06.189 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:06.192 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_15_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 7.8 KiB, free: 2.1 GiB) 10:40:06.192 dag-scheduler-event-loop INFO DAGScheduler: Got job 19 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:06.192 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 22 (apply at OutcomeOf.scala:85) 10:40:06.192 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:06.193 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:06.193 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 22 (MapPartitionsRDD[66] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:06.195 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_16_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 9.2 KiB, free: 2.1 GiB) 10:40:06.195 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_27 stored as values in memory (estimated size 6.3 KiB, free 2.1 GiB) 10:40:06.199 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_10_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:06.199 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_27_piece0 stored as bytes in memory (estimated size 3.2 KiB, free 2.1 GiB) 10:40:06.199 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_27_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.2 KiB, free: 2.1 GiB) 10:40:06.199 dag-scheduler-event-loop INFO SparkContext: Created broadcast 27 from broadcast at DAGScheduler.scala:1293 10:40:06.200 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 22 (MapPartitionsRDD[66] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:06.200 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 22.0 with 1 tasks resource profile 0 10:40:06.202 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_21_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 10.5 KiB, free: 2.1 GiB) 10:40:06.202 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 22.0 (TID 36, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:06.203 Executor task launch worker for task 36 INFO Executor: Running task 0.0 in stage 22.0 (TID 36) 10:40:06.207 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_24_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.8 KiB, free: 2.1 GiB) 10:40:06.210 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_12_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:06.214 Executor task launch worker for task 36 INFO Executor: Finished task 0.0 in stage 22.0 (TID 36). 1400 bytes result sent to driver 10:40:06.216 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_25_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.8 KiB, free: 2.1 GiB) 10:40:06.217 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 22.0 (TID 36) in 14 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:06.217 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 22.0, whose tasks have all completed, from pool 10:40:06.217 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 22 (apply at OutcomeOf.scala:85) finished in 0.023 s 10:40:06.218 dag-scheduler-event-loop INFO DAGScheduler: Job 19 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:06.218 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 22: Stage finished 10:40:06.218 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 19 finished: apply at OutcomeOf.scala:85, took 0.029122 s 10:40:06.222 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_23_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.8 KiB, free: 2.1 GiB) 10:40:06.225 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_17_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 10.1 KiB, free: 2.1 GiB) 10:40:06.229 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_11_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:06.232 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_18_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 28.5 KiB, free: 2.1 GiB) 10:40:06.236 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_13_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 61.2 KiB, free: 2.1 GiB) 10:40:06.236 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.237 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.239 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_20_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 9.3 KiB, free: 2.1 GiB) 10:40:06.243 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_14_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 28.5 KiB, free: 2.1 GiB) 10:40:06.268 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 7.082988 ms 10:40:06.285 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:06.286 dag-scheduler-event-loop INFO DAGScheduler: Got job 20 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:06.286 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 23 (apply at OutcomeOf.scala:85) 10:40:06.286 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:06.286 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:06.286 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 23 (MapPartitionsRDD[68] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:06.289 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_28 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:06.291 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_28_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:06.291 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_28_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:06.292 dag-scheduler-event-loop INFO SparkContext: Created broadcast 28 from broadcast at DAGScheduler.scala:1293 10:40:06.292 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 23 (MapPartitionsRDD[68] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:06.293 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 23.0 with 1 tasks resource profile 0 10:40:06.294 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 23.0 (TID 37, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:06.295 Executor task launch worker for task 37 INFO Executor: Running task 0.0 in stage 23.0 (TID 37) 10:40:06.302 Executor task launch worker for task 37 INFO Executor: Finished task 0.0 in stage 23.0 (TID 37). 1404 bytes result sent to driver 10:40:06.303 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 23.0 (TID 37) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:06.303 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 23.0, whose tasks have all completed, from pool 10:40:06.303 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 23 (apply at OutcomeOf.scala:85) finished in 0.016 s 10:40:06.303 dag-scheduler-event-loop INFO DAGScheduler: Job 20 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:06.304 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 23: Stage finished 10:40:06.304 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 20 finished: apply at OutcomeOf.scala:85, took 0.018802 s 10:40:06.322 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.322 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.357 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:06.358 dag-scheduler-event-loop INFO DAGScheduler: Got job 21 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:06.358 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 24 (apply at OutcomeOf.scala:85) 10:40:06.358 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:06.359 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:06.359 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 24 (MapPartitionsRDD[70] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:06.361 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_29 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:06.363 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_29_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:06.363 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_29_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:06.364 dag-scheduler-event-loop INFO SparkContext: Created broadcast 29 from broadcast at DAGScheduler.scala:1293 10:40:06.364 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 24 (MapPartitionsRDD[70] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:06.364 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 24.0 with 1 tasks resource profile 0 10:40:06.366 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 24.0 (TID 38, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:06.367 Executor task launch worker for task 38 INFO Executor: Running task 0.0 in stage 24.0 (TID 38) 10:40:06.370 Executor task launch worker for task 38 INFO Executor: Finished task 0.0 in stage 24.0 (TID 38). 1404 bytes result sent to driver 10:40:06.372 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 24.0 (TID 38) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:06.372 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 24.0, whose tasks have all completed, from pool 10:40:06.373 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 24 (apply at OutcomeOf.scala:85) finished in 0.013 s 10:40:06.373 dag-scheduler-event-loop INFO DAGScheduler: Job 21 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:06.373 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 24: Stage finished 10:40:06.373 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 21 finished: apply at OutcomeOf.scala:85, took 0.015682 s 10:40:06.383 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.383 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.407 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 6.694375 ms 10:40:06.425 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:06.426 dag-scheduler-event-loop INFO DAGScheduler: Got job 22 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:06.426 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 25 (apply at OutcomeOf.scala:85) 10:40:06.426 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:06.426 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:06.426 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 25 (MapPartitionsRDD[72] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:06.428 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_30 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:06.431 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_30_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:06.431 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_30_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:06.432 dag-scheduler-event-loop INFO SparkContext: Created broadcast 30 from broadcast at DAGScheduler.scala:1293 10:40:06.432 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 25 (MapPartitionsRDD[72] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:06.432 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 25.0 with 1 tasks resource profile 0 10:40:06.434 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 25.0 (TID 39, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:06.434 Executor task launch worker for task 39 INFO Executor: Running task 0.0 in stage 25.0 (TID 39) 10:40:06.441 Executor task launch worker for task 39 INFO Executor: Finished task 0.0 in stage 25.0 (TID 39). 1404 bytes result sent to driver 10:40:06.444 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 25.0 (TID 39) in 11 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:06.445 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 25.0, whose tasks have all completed, from pool 10:40:06.446 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 25 (apply at OutcomeOf.scala:85) finished in 0.018 s 10:40:06.446 dag-scheduler-event-loop INFO DAGScheduler: Job 22 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:06.446 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 25: Stage finished 10:40:06.446 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 22 finished: apply at OutcomeOf.scala:85, took 0.021154 s 10:40:06.458 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.459 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.493 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 9.26169 ms 10:40:06.513 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:06.514 dag-scheduler-event-loop INFO DAGScheduler: Got job 23 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:06.514 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 26 (apply at OutcomeOf.scala:85) 10:40:06.514 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:06.514 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:06.515 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 26 (MapPartitionsRDD[74] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:06.517 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_31 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:06.519 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_31_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:06.520 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_31_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:06.520 dag-scheduler-event-loop INFO SparkContext: Created broadcast 31 from broadcast at DAGScheduler.scala:1293 10:40:06.521 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 26 (MapPartitionsRDD[74] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:06.521 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 26.0 with 1 tasks resource profile 0 10:40:06.522 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 26.0 (TID 40, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:06.523 Executor task launch worker for task 40 INFO Executor: Running task 0.0 in stage 26.0 (TID 40) 10:40:06.530 Executor task launch worker for task 40 INFO Executor: Finished task 0.0 in stage 26.0 (TID 40). 1404 bytes result sent to driver 10:40:06.531 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 26.0 (TID 40) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:06.531 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 26.0, whose tasks have all completed, from pool 10:40:06.532 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 26 (apply at OutcomeOf.scala:85) finished in 0.017 s 10:40:06.532 dag-scheduler-event-loop INFO DAGScheduler: Job 23 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:06.532 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 26: Stage finished 10:40:06.532 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 23 finished: apply at OutcomeOf.scala:85, took 0.019157 s 10:40:06.542 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.542 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.566 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 7.408419 ms 10:40:06.583 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:06.584 dag-scheduler-event-loop INFO DAGScheduler: Got job 24 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:06.584 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 27 (apply at OutcomeOf.scala:85) 10:40:06.584 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:06.584 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:06.585 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 27 (MapPartitionsRDD[76] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:06.587 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_32 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:06.589 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_32_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:06.589 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_32_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:06.590 dag-scheduler-event-loop INFO SparkContext: Created broadcast 32 from broadcast at DAGScheduler.scala:1293 10:40:06.590 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 27 (MapPartitionsRDD[76] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:06.590 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 27.0 with 1 tasks resource profile 0 10:40:06.592 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 27.0 (TID 41, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:06.592 Executor task launch worker for task 41 INFO Executor: Running task 0.0 in stage 27.0 (TID 41) 10:40:06.599 Executor task launch worker for task 41 INFO Executor: Finished task 0.0 in stage 27.0 (TID 41). 1404 bytes result sent to driver 10:40:06.600 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 27.0 (TID 41) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:06.600 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 27.0, whose tasks have all completed, from pool 10:40:06.600 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 27 (apply at OutcomeOf.scala:85) finished in 0.015 s 10:40:06.601 dag-scheduler-event-loop INFO DAGScheduler: Job 24 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:06.601 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 27: Stage finished 10:40:06.601 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 24 finished: apply at OutcomeOf.scala:85, took 0.017286 s 10:40:06.612 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.612 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.641 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 8.743903 ms 10:40:06.650 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:06.651 dag-scheduler-event-loop INFO DAGScheduler: Got job 25 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:06.651 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 28 (apply at OutcomeOf.scala:85) 10:40:06.651 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:06.651 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:06.652 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 28 (MapPartitionsRDD[78] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:06.654 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_33 stored as values in memory (estimated size 7.2 KiB, free 2.1 GiB) 10:40:06.656 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_33_piece0 stored as bytes in memory (estimated size 3.8 KiB, free 2.1 GiB) 10:40:06.657 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_33_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.8 KiB, free: 2.1 GiB) 10:40:06.657 dag-scheduler-event-loop INFO SparkContext: Created broadcast 33 from broadcast at DAGScheduler.scala:1293 10:40:06.658 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 28 (MapPartitionsRDD[78] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:06.658 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 28.0 with 1 tasks resource profile 0 10:40:06.659 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 28.0 (TID 42, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:06.660 Executor task launch worker for task 42 INFO Executor: Running task 0.0 in stage 28.0 (TID 42) 10:40:06.665 Executor task launch worker for task 42 INFO Executor: Finished task 0.0 in stage 28.0 (TID 42). 1416 bytes result sent to driver 10:40:06.666 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 28.0 (TID 42) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:06.666 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 28.0, whose tasks have all completed, from pool 10:40:06.667 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 28 (apply at OutcomeOf.scala:85) finished in 0.015 s 10:40:06.667 dag-scheduler-event-loop INFO DAGScheduler: Job 25 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:06.667 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 28: Stage finished 10:40:06.667 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 25 finished: apply at OutcomeOf.scala:85, took 0.016961 s 10:40:06.678 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.678 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.704 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 7.236452 ms 10:40:06.713 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:06.714 dag-scheduler-event-loop INFO DAGScheduler: Got job 26 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:06.714 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 29 (apply at OutcomeOf.scala:85) 10:40:06.714 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:06.714 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:06.715 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 29 (MapPartitionsRDD[80] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:06.717 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_34 stored as values in memory (estimated size 7.2 KiB, free 2.1 GiB) 10:40:06.720 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_34_piece0 stored as bytes in memory (estimated size 3.8 KiB, free 2.1 GiB) 10:40:06.720 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_34_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.8 KiB, free: 2.1 GiB) 10:40:06.721 dag-scheduler-event-loop INFO SparkContext: Created broadcast 34 from broadcast at DAGScheduler.scala:1293 10:40:06.721 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 29 (MapPartitionsRDD[80] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:06.722 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 29.0 with 1 tasks resource profile 0 10:40:06.723 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 29.0 (TID 43, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:06.723 Executor task launch worker for task 43 INFO Executor: Running task 0.0 in stage 29.0 (TID 43) 10:40:06.729 Executor task launch worker for task 43 INFO Executor: Finished task 0.0 in stage 29.0 (TID 43). 1420 bytes result sent to driver 10:40:06.730 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 29.0 (TID 43) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:06.731 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 29.0, whose tasks have all completed, from pool 10:40:06.731 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 29 (apply at OutcomeOf.scala:85) finished in 0.016 s 10:40:06.731 dag-scheduler-event-loop INFO DAGScheduler: Job 26 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:06.731 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 29: Stage finished 10:40:06.732 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 26 finished: apply at OutcomeOf.scala:85, took 0.018352 s 10:40:06.745 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.745 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.776 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 7.151257 ms 10:40:06.784 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:06.785 dag-scheduler-event-loop INFO DAGScheduler: Got job 27 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:06.785 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 30 (apply at OutcomeOf.scala:85) 10:40:06.785 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:06.786 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:06.786 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 30 (MapPartitionsRDD[82] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:06.788 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_35 stored as values in memory (estimated size 7.2 KiB, free 2.1 GiB) 10:40:06.790 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_35_piece0 stored as bytes in memory (estimated size 3.8 KiB, free 2.1 GiB) 10:40:06.790 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_35_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.8 KiB, free: 2.1 GiB) 10:40:06.791 dag-scheduler-event-loop INFO SparkContext: Created broadcast 35 from broadcast at DAGScheduler.scala:1293 10:40:06.791 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 30 (MapPartitionsRDD[82] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:06.791 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 30.0 with 1 tasks resource profile 0 10:40:06.792 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 30.0 (TID 44, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:06.793 Executor task launch worker for task 44 INFO Executor: Running task 0.0 in stage 30.0 (TID 44) 10:40:06.798 Executor task launch worker for task 44 INFO Executor: Finished task 0.0 in stage 30.0 (TID 44). 1420 bytes result sent to driver 10:40:06.799 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 30.0 (TID 44) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:06.799 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 30.0, whose tasks have all completed, from pool 10:40:06.800 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 30 (apply at OutcomeOf.scala:85) finished in 0.013 s 10:40:06.800 dag-scheduler-event-loop INFO DAGScheduler: Job 27 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:06.800 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 30: Stage finished 10:40:06.800 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 27 finished: apply at OutcomeOf.scala:85, took 0.015238 s 10:40:06.811 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.811 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.850 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.850 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:06.875 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:06.877 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: 10:40:06.877 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: 10:40:06.877 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:06.918 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 22.144919 ms 10:40:06.924 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO MemoryStore: Block broadcast_36 stored as values in memory (estimated size 309.9 KiB, free 2.1 GiB) 10:40:06.941 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO MemoryStore: Block broadcast_36_piece0 stored as bytes in memory (estimated size 28.5 KiB, free 2.1 GiB) 10:40:06.942 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_36_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 28.5 KiB, free: 2.1 GiB) 10:40:06.945 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Created broadcast 36 from apply at OutcomeOf.scala:85 10:40:06.947 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceScanExec: Planning scan with bin packing, max size: 4195230 bytes, open cost is considered as scanning 4194304 bytes. 10:40:06.968 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:06.969 dag-scheduler-event-loop INFO DAGScheduler: Got job 28 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:06.969 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 31 (apply at OutcomeOf.scala:85) 10:40:06.969 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:06.970 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:06.970 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 31 (MapPartitionsRDD[88] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:06.973 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_37 stored as values in memory (estimated size 18.4 KiB, free 2.1 GiB) 10:40:06.976 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_37_piece0 stored as bytes in memory (estimated size 7.5 KiB, free 2.1 GiB) 10:40:06.976 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_37_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 7.5 KiB, free: 2.1 GiB) 10:40:06.977 dag-scheduler-event-loop INFO SparkContext: Created broadcast 37 from broadcast at DAGScheduler.scala:1293 10:40:06.977 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 31 (MapPartitionsRDD[88] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:06.977 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 31.0 with 2 tasks resource profile 0 10:40:06.979 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 31.0 (TID 45, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7900 bytes) taskResourceAssignments Map() 10:40:06.979 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 31.0 (TID 46, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7900 bytes) taskResourceAssignments Map() 10:40:06.980 Executor task launch worker for task 45 INFO Executor: Running task 0.0 in stage 31.0 (TID 45) 10:40:06.980 Executor task launch worker for task 46 INFO Executor: Running task 1.0 in stage 31.0 (TID 46) 10:40:06.987 Executor task launch worker for task 45 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/decimals_test/part-00001-dcf21525-ad27-4bba-a221-2aad2ac3d19e-c000.snappy.parquet, range: 0-927, partition values: [empty row] 10:40:06.987 Executor task launch worker for task 46 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/decimals_test/part-00000-dcf21525-ad27-4bba-a221-2aad2ac3d19e-c000.snappy.parquet, range: 0-925, partition values: [empty row] 10:40:06.994 Executor task launch worker for task 45 INFO Executor: Finished task 0.0 in stage 31.0 (TID 45). 1926 bytes result sent to driver 10:40:06.995 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 31.0 (TID 45) in 16 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:06.996 Executor task launch worker for task 46 INFO Executor: Finished task 1.0 in stage 31.0 (TID 46). 1926 bytes result sent to driver 10:40:06.997 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 31.0 (TID 46) in 18 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:06.997 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 31.0, whose tasks have all completed, from pool 10:40:06.998 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 31 (apply at OutcomeOf.scala:85) finished in 0.027 s 10:40:06.998 dag-scheduler-event-loop INFO DAGScheduler: Job 28 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:06.998 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 31: Stage finished 10:40:06.999 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 28 finished: apply at OutcomeOf.scala:85, took 0.030156 s 10:40:07.013 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:07.014 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 89 (apply at OutcomeOf.scala:85) as input to shuffle 3 10:40:07.014 dag-scheduler-event-loop INFO DAGScheduler: Got job 29 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:07.015 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 33 (apply at OutcomeOf.scala:85) 10:40:07.015 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 32) 10:40:07.015 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 32) 10:40:07.016 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 32 (MapPartitionsRDD[89] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:07.020 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_38 stored as values in memory (estimated size 21.0 KiB, free 2.1 GiB) 10:40:07.048 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_38_piece0 stored as bytes in memory (estimated size 8.9 KiB, free 2.1 GiB) 10:40:07.049 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_38_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 8.9 KiB, free: 2.1 GiB) 10:40:07.049 dag-scheduler-event-loop INFO SparkContext: Created broadcast 38 from broadcast at DAGScheduler.scala:1293 10:40:07.050 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 32 (MapPartitionsRDD[89] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:07.050 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 32.0 with 2 tasks resource profile 0 10:40:07.052 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 32.0 (TID 47, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7889 bytes) taskResourceAssignments Map() 10:40:07.052 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 32.0 (TID 48, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7889 bytes) taskResourceAssignments Map() 10:40:07.053 Executor task launch worker for task 47 INFO Executor: Running task 0.0 in stage 32.0 (TID 47) 10:40:07.053 Executor task launch worker for task 48 INFO Executor: Running task 1.0 in stage 32.0 (TID 48) 10:40:07.061 Executor task launch worker for task 48 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/decimals_test/part-00000-dcf21525-ad27-4bba-a221-2aad2ac3d19e-c000.snappy.parquet, range: 0-925, partition values: [empty row] 10:40:07.061 Executor task launch worker for task 47 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/decimals_test/part-00001-dcf21525-ad27-4bba-a221-2aad2ac3d19e-c000.snappy.parquet, range: 0-927, partition values: [empty row] 10:40:07.071 Executor task launch worker for task 48 INFO Executor: Finished task 1.0 in stage 32.0 (TID 48). 2005 bytes result sent to driver 10:40:07.072 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 32.0 (TID 48) in 20 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:07.073 Executor task launch worker for task 47 INFO Executor: Finished task 0.0 in stage 32.0 (TID 47). 2005 bytes result sent to driver 10:40:07.075 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 32.0 (TID 47) in 22 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:07.075 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 32.0, whose tasks have all completed, from pool 10:40:07.076 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 32 (apply at OutcomeOf.scala:85) finished in 0.059 s 10:40:07.076 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:07.076 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:07.076 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 33) 10:40:07.076 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:07.077 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 33 (MapPartitionsRDD[92] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:07.080 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_39 stored as values in memory (estimated size 20.3 KiB, free 2.1 GiB) 10:40:07.083 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_39_piece0 stored as bytes in memory (estimated size 10.0 KiB, free 2.1 GiB) 10:40:07.084 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_39_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 10.0 KiB, free: 2.1 GiB) 10:40:07.084 dag-scheduler-event-loop INFO SparkContext: Created broadcast 39 from broadcast at DAGScheduler.scala:1293 10:40:07.085 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 33 (MapPartitionsRDD[92] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:07.085 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 33.0 with 4 tasks resource profile 0 10:40:07.087 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 33.0 (TID 49, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:07.087 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 33.0 (TID 50, amp-jenkins-worker-04.amp, executor driver, partition 1, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:07.087 Executor task launch worker for task 49 INFO Executor: Running task 0.0 in stage 33.0 (TID 49) 10:40:07.095 Executor task launch worker for task 49 INFO ShuffleBlockFetcherIterator: Getting 1 (129.0 B) non-empty blocks including 1 (129.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:07.095 Executor task launch worker for task 49 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:07.097 Executor task launch worker for task 50 INFO Executor: Running task 1.0 in stage 33.0 (TID 50) 10:40:07.102 Executor task launch worker for task 50 INFO ShuffleBlockFetcherIterator: Getting 1 (117.0 B) non-empty blocks including 1 (117.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:07.102 Executor task launch worker for task 50 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:07.138 Executor task launch worker for task 49 INFO Executor: Finished task 0.0 in stage 33.0 (TID 49). 3477 bytes result sent to driver 10:40:07.139 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 2.0 in stage 33.0 (TID 51, amp-jenkins-worker-04.amp, executor driver, partition 2, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:07.140 Executor task launch worker for task 51 INFO Executor: Running task 2.0 in stage 33.0 (TID 51) 10:40:07.140 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 33.0 (TID 49) in 54 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:07.145 Executor task launch worker for task 51 INFO ShuffleBlockFetcherIterator: Getting 1 (129.0 B) non-empty blocks including 1 (129.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:07.145 Executor task launch worker for task 51 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:07.172 Executor task launch worker for task 50 INFO Executor: Finished task 1.0 in stage 33.0 (TID 50). 3463 bytes result sent to driver 10:40:07.173 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 33.0 (TID 52, amp-jenkins-worker-04.amp, executor driver, partition 3, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:07.173 Executor task launch worker for task 52 INFO Executor: Running task 3.0 in stage 33.0 (TID 52) 10:40:07.173 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 33.0 (TID 50) in 86 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:07.177 Executor task launch worker for task 51 INFO Executor: Finished task 2.0 in stage 33.0 (TID 51). 3472 bytes result sent to driver 10:40:07.178 Executor task launch worker for task 52 INFO ShuffleBlockFetcherIterator: Getting 1 (129.0 B) non-empty blocks including 1 (129.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:07.178 Executor task launch worker for task 52 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:07.178 task-result-getter-3 INFO TaskSetManager: Finished task 2.0 in stage 33.0 (TID 51) in 39 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:07.213 Executor task launch worker for task 52 INFO Executor: Finished task 3.0 in stage 33.0 (TID 52). 3481 bytes result sent to driver 10:40:07.214 task-result-getter-1 INFO TaskSetManager: Finished task 3.0 in stage 33.0 (TID 52) in 42 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:07.214 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 33.0, whose tasks have all completed, from pool 10:40:07.214 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 33 (apply at OutcomeOf.scala:85) finished in 0.136 s 10:40:07.215 dag-scheduler-event-loop INFO DAGScheduler: Job 29 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:07.215 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 33: Stage finished 10:40:07.215 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 29 finished: apply at OutcomeOf.scala:85, took 0.202066 s 10:40:07.237 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:07.237 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:07.257 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:07.258 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: 10:40:07.258 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: 10:40:07.258 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:07.287 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 17.146647 ms 10:40:07.292 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO MemoryStore: Block broadcast_40 stored as values in memory (estimated size 309.9 KiB, free 2.1 GiB) 10:40:07.305 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO MemoryStore: Block broadcast_40_piece0 stored as bytes in memory (estimated size 28.5 KiB, free 2.1 GiB) 10:40:07.305 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_40_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 28.5 KiB, free: 2.1 GiB) 10:40:07.306 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Created broadcast 40 from apply at OutcomeOf.scala:85 10:40:07.307 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceScanExec: Planning scan with bin packing, max size: 4195230 bytes, open cost is considered as scanning 4194304 bytes. 10:40:07.321 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:07.322 dag-scheduler-event-loop INFO DAGScheduler: Got job 30 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:07.323 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 34 (apply at OutcomeOf.scala:85) 10:40:07.323 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:07.323 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:07.323 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 34 (MapPartitionsRDD[98] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:07.326 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_41 stored as values in memory (estimated size 17.9 KiB, free 2.1 GiB) 10:40:07.329 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_41_piece0 stored as bytes in memory (estimated size 7.9 KiB, free 2.1 GiB) 10:40:07.329 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_41_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 7.9 KiB, free: 2.1 GiB) 10:40:07.330 dag-scheduler-event-loop INFO SparkContext: Created broadcast 41 from broadcast at DAGScheduler.scala:1293 10:40:07.330 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 34 (MapPartitionsRDD[98] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:07.332 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 34.0 with 2 tasks resource profile 0 10:40:07.334 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 34.0 (TID 53, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7900 bytes) taskResourceAssignments Map() 10:40:07.334 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 34.0 (TID 54, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7900 bytes) taskResourceAssignments Map() 10:40:07.334 Executor task launch worker for task 53 INFO Executor: Running task 0.0 in stage 34.0 (TID 53) 10:40:07.334 Executor task launch worker for task 54 INFO Executor: Running task 1.0 in stage 34.0 (TID 54) 10:40:07.341 Executor task launch worker for task 53 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/decimals_test/part-00001-dcf21525-ad27-4bba-a221-2aad2ac3d19e-c000.snappy.parquet, range: 0-927, partition values: [empty row] 10:40:07.342 Executor task launch worker for task 54 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/decimals_test/part-00000-dcf21525-ad27-4bba-a221-2aad2ac3d19e-c000.snappy.parquet, range: 0-925, partition values: [empty row] 10:40:07.349 Executor task launch worker for task 54 INFO Executor: Finished task 1.0 in stage 34.0 (TID 54). 1926 bytes result sent to driver 10:40:07.350 Executor task launch worker for task 53 INFO Executor: Finished task 0.0 in stage 34.0 (TID 53). 1926 bytes result sent to driver 10:40:07.350 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 34.0 (TID 54) in 16 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:07.350 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 34.0 (TID 53) in 17 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:07.351 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 34.0, whose tasks have all completed, from pool 10:40:07.351 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 34 (apply at OutcomeOf.scala:85) finished in 0.027 s 10:40:07.351 dag-scheduler-event-loop INFO DAGScheduler: Job 30 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:07.351 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 34: Stage finished 10:40:07.352 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 30 finished: apply at OutcomeOf.scala:85, took 0.029904 s 10:40:07.365 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:07.366 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 99 (apply at OutcomeOf.scala:85) as input to shuffle 4 10:40:07.366 dag-scheduler-event-loop INFO DAGScheduler: Got job 31 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:07.366 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 36 (apply at OutcomeOf.scala:85) 10:40:07.366 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 35) 10:40:07.367 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 35) 10:40:07.367 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 35 (MapPartitionsRDD[99] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:07.370 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_42 stored as values in memory (estimated size 20.6 KiB, free 2.1 GiB) 10:40:07.372 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_42_piece0 stored as bytes in memory (estimated size 9.3 KiB, free 2.1 GiB) 10:40:07.373 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_42_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 9.3 KiB, free: 2.1 GiB) 10:40:07.373 dag-scheduler-event-loop INFO SparkContext: Created broadcast 42 from broadcast at DAGScheduler.scala:1293 10:40:07.373 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 35 (MapPartitionsRDD[99] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:07.373 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 35.0 with 2 tasks resource profile 0 10:40:07.374 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 35.0 (TID 55, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7889 bytes) taskResourceAssignments Map() 10:40:07.375 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 35.0 (TID 56, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7889 bytes) taskResourceAssignments Map() 10:40:07.375 Executor task launch worker for task 55 INFO Executor: Running task 0.0 in stage 35.0 (TID 55) 10:40:07.375 Executor task launch worker for task 56 INFO Executor: Running task 1.0 in stage 35.0 (TID 56) 10:40:07.380 Executor task launch worker for task 55 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/decimals_test/part-00001-dcf21525-ad27-4bba-a221-2aad2ac3d19e-c000.snappy.parquet, range: 0-927, partition values: [empty row] 10:40:07.384 Executor task launch worker for task 56 INFO FileScanRDD: Reading File path: file:///home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/spark-warehouse/org.apache.spark.sql.SQLQueryTestSuite/decimals_test/part-00000-dcf21525-ad27-4bba-a221-2aad2ac3d19e-c000.snappy.parquet, range: 0-925, partition values: [empty row] 10:40:07.396 Executor task launch worker for task 55 INFO Executor: Finished task 0.0 in stage 35.0 (TID 55). 2005 bytes result sent to driver 10:40:07.397 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 35.0 (TID 55) in 23 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:07.398 Executor task launch worker for task 56 INFO Executor: Finished task 1.0 in stage 35.0 (TID 56). 2005 bytes result sent to driver 10:40:07.399 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 35.0 (TID 56) in 25 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:07.399 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 35.0, whose tasks have all completed, from pool 10:40:07.400 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 35 (apply at OutcomeOf.scala:85) finished in 0.032 s 10:40:07.400 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:07.400 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:07.400 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 36) 10:40:07.400 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:07.400 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 36 (MapPartitionsRDD[102] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:07.403 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_43 stored as values in memory (estimated size 21.0 KiB, free 2.1 GiB) 10:40:07.406 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_43_piece0 stored as bytes in memory (estimated size 10.5 KiB, free 2.1 GiB) 10:40:07.407 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_43_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 10.5 KiB, free: 2.1 GiB) 10:40:07.407 dag-scheduler-event-loop INFO SparkContext: Created broadcast 43 from broadcast at DAGScheduler.scala:1293 10:40:07.408 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 36 (MapPartitionsRDD[102] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:07.408 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 36.0 with 4 tasks resource profile 0 10:40:07.409 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 36.0 (TID 57, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:07.409 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 36.0 (TID 58, amp-jenkins-worker-04.amp, executor driver, partition 1, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:07.410 Executor task launch worker for task 58 INFO Executor: Running task 1.0 in stage 36.0 (TID 58) 10:40:07.410 Executor task launch worker for task 57 INFO Executor: Running task 0.0 in stage 36.0 (TID 57) 10:40:07.415 Executor task launch worker for task 58 INFO ShuffleBlockFetcherIterator: Getting 1 (97.0 B) non-empty blocks including 1 (97.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:07.415 Executor task launch worker for task 57 INFO ShuffleBlockFetcherIterator: Getting 1 (97.0 B) non-empty blocks including 1 (97.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:07.415 Executor task launch worker for task 58 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:07.415 Executor task launch worker for task 57 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:07.444 Executor task launch worker for task 57 INFO Executor: Finished task 0.0 in stage 36.0 (TID 57). 3448 bytes result sent to driver 10:40:07.447 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 2.0 in stage 36.0 (TID 59, amp-jenkins-worker-04.amp, executor driver, partition 2, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:07.448 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 36.0 (TID 57) in 39 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:07.448 Executor task launch worker for task 59 INFO Executor: Running task 2.0 in stage 36.0 (TID 59) 10:40:07.454 Executor task launch worker for task 59 INFO ShuffleBlockFetcherIterator: Getting 1 (106.0 B) non-empty blocks including 1 (106.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:07.454 Executor task launch worker for task 59 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:07.484 Executor task launch worker for task 58 INFO Executor: Finished task 1.0 in stage 36.0 (TID 58). 3450 bytes result sent to driver 10:40:07.484 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 36.0 (TID 60, amp-jenkins-worker-04.amp, executor driver, partition 3, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:07.485 Executor task launch worker for task 60 INFO Executor: Running task 3.0 in stage 36.0 (TID 60) 10:40:07.485 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 36.0 (TID 58) in 76 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:07.490 Executor task launch worker for task 60 INFO ShuffleBlockFetcherIterator: Getting 1 (106.0 B) non-empty blocks including 1 (106.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:07.490 Executor task launch worker for task 60 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:07.490 Executor task launch worker for task 59 INFO Executor: Finished task 2.0 in stage 36.0 (TID 59). 3449 bytes result sent to driver 10:40:07.491 task-result-getter-3 INFO TaskSetManager: Finished task 2.0 in stage 36.0 (TID 59) in 44 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:07.518 Executor task launch worker for task 60 INFO Executor: Finished task 3.0 in stage 36.0 (TID 60). 3457 bytes result sent to driver 10:40:07.519 task-result-getter-1 INFO TaskSetManager: Finished task 3.0 in stage 36.0 (TID 60) in 35 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:07.519 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 36.0, whose tasks have all completed, from pool 10:40:07.519 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 36 (apply at OutcomeOf.scala:85) finished in 0.118 s 10:40:07.520 dag-scheduler-event-loop INFO DAGScheduler: Job 31 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:07.520 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 36: Stage finished 10:40:07.520 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 31 finished: apply at OutcomeOf.scala:85, took 0.154419 s 10:40:07.531 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:07.531 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:07.555 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:07.555 dag-scheduler-event-loop INFO DAGScheduler: Got job 32 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:07.556 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 37 (apply at OutcomeOf.scala:85) 10:40:07.556 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:07.556 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:07.556 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 37 (MapPartitionsRDD[104] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:07.557 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_44 stored as values in memory (estimated size 7.1 KiB, free 2.1 GiB) 10:40:07.559 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_44_piece0 stored as bytes in memory (estimated size 3.8 KiB, free 2.1 GiB) 10:40:07.560 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_44_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.8 KiB, free: 2.1 GiB) 10:40:07.560 dag-scheduler-event-loop INFO SparkContext: Created broadcast 44 from broadcast at DAGScheduler.scala:1293 10:40:07.560 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 37 (MapPartitionsRDD[104] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:07.561 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 37.0 with 1 tasks resource profile 0 10:40:07.562 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 37.0 (TID 61, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:07.562 Executor task launch worker for task 61 INFO Executor: Running task 0.0 in stage 37.0 (TID 61) 10:40:07.565 Executor task launch worker for task 61 INFO Executor: Finished task 0.0 in stage 37.0 (TID 61). 1360 bytes result sent to driver 10:40:07.566 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 37.0 (TID 61) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:07.566 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 37.0, whose tasks have all completed, from pool 10:40:07.566 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 37 (apply at OutcomeOf.scala:85) finished in 0.009 s 10:40:07.566 dag-scheduler-event-loop INFO DAGScheduler: Job 32 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:07.566 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 37: Stage finished 10:40:07.567 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 32 finished: apply at OutcomeOf.scala:85, took 0.011773 s 10:40:07.576 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:07.576 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:07.609 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:07.610 dag-scheduler-event-loop INFO DAGScheduler: Got job 33 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:07.610 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 38 (apply at OutcomeOf.scala:85) 10:40:07.610 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:07.610 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:07.610 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 38 (MapPartitionsRDD[106] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:07.612 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_45 stored as values in memory (estimated size 7.1 KiB, free 2.1 GiB) 10:40:07.614 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_45_piece0 stored as bytes in memory (estimated size 3.8 KiB, free 2.1 GiB) 10:40:07.614 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_45_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.8 KiB, free: 2.1 GiB) 10:40:07.614 dag-scheduler-event-loop INFO SparkContext: Created broadcast 45 from broadcast at DAGScheduler.scala:1293 10:40:07.615 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 38 (MapPartitionsRDD[106] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:07.615 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 38.0 with 1 tasks resource profile 0 10:40:07.616 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 38.0 (TID 62, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:07.616 Executor task launch worker for task 62 INFO Executor: Running task 0.0 in stage 38.0 (TID 62) 10:40:07.619 Executor task launch worker for task 62 INFO Executor: Finished task 0.0 in stage 38.0 (TID 62). 1360 bytes result sent to driver 10:40:07.620 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 38.0 (TID 62) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:07.620 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 38.0, whose tasks have all completed, from pool 10:40:07.621 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 38 (apply at OutcomeOf.scala:85) finished in 0.010 s 10:40:07.621 dag-scheduler-event-loop INFO DAGScheduler: Job 33 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:07.621 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 38: Stage finished 10:40:07.621 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 33 finished: apply at OutcomeOf.scala:85, took 0.012188 s 10:40:07.631 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:07.631 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:07.664 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:07.665 dag-scheduler-event-loop INFO DAGScheduler: Got job 34 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:07.665 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 39 (apply at OutcomeOf.scala:85) 10:40:07.665 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:07.665 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:07.666 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 39 (MapPartitionsRDD[108] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:07.668 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_46 stored as values in memory (estimated size 7.2 KiB, free 2.1 GiB) 10:40:07.670 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_46_piece0 stored as bytes in memory (estimated size 3.8 KiB, free 2.1 GiB) 10:40:07.670 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_46_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.8 KiB, free: 2.1 GiB) 10:40:07.671 dag-scheduler-event-loop INFO SparkContext: Created broadcast 46 from broadcast at DAGScheduler.scala:1293 10:40:07.674 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 39 (MapPartitionsRDD[108] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:07.675 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 39.0 with 1 tasks resource profile 0 10:40:07.676 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 39.0 (TID 63, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:07.677 Executor task launch worker for task 63 INFO Executor: Running task 0.0 in stage 39.0 (TID 63) 10:40:07.681 Executor task launch worker for task 63 INFO Executor: Finished task 0.0 in stage 39.0 (TID 63). 1403 bytes result sent to driver 10:40:07.682 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 39.0 (TID 63) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:07.682 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 39.0, whose tasks have all completed, from pool 10:40:07.682 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 39 (apply at OutcomeOf.scala:85) finished in 0.016 s 10:40:07.683 dag-scheduler-event-loop INFO DAGScheduler: Job 34 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:07.683 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 39: Stage finished 10:40:07.683 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 34 finished: apply at OutcomeOf.scala:85, took 0.018242 s 10:40:07.694 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:07.694 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:07.734 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 11.141916 ms 10:40:07.748 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:07.749 dag-scheduler-event-loop INFO DAGScheduler: Got job 35 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:07.749 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 40 (apply at OutcomeOf.scala:85) 10:40:07.749 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:07.749 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:07.750 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 40 (MapPartitionsRDD[110] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:07.752 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_47 stored as values in memory (estimated size 7.2 KiB, free 2.1 GiB) 10:40:07.755 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_47_piece0 stored as bytes in memory (estimated size 3.8 KiB, free 2.1 GiB) 10:40:07.755 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_47_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.8 KiB, free: 2.1 GiB) 10:40:07.756 dag-scheduler-event-loop INFO SparkContext: Created broadcast 47 from broadcast at DAGScheduler.scala:1293 10:40:07.756 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 40 (MapPartitionsRDD[110] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:07.756 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 40.0 with 1 tasks resource profile 0 10:40:07.758 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 40.0 (TID 64, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:07.758 Executor task launch worker for task 64 INFO Executor: Running task 0.0 in stage 40.0 (TID 64) 10:40:07.765 Executor task launch worker for task 64 INFO Executor: Finished task 0.0 in stage 40.0 (TID 64). 1416 bytes result sent to driver 10:40:07.766 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 40.0 (TID 64) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:07.766 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 40.0, whose tasks have all completed, from pool 10:40:07.767 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 40 (apply at OutcomeOf.scala:85) finished in 0.017 s 10:40:07.767 dag-scheduler-event-loop INFO DAGScheduler: Job 35 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:07.767 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 40: Stage finished 10:40:07.768 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 35 finished: apply at OutcomeOf.scala:85, took 0.019820 s 10:40:07.781 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:07.781 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:07.817 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 12.424011 ms 10:40:07.831 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:07.832 dag-scheduler-event-loop INFO DAGScheduler: Got job 36 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:07.832 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 41 (apply at OutcomeOf.scala:85) 10:40:07.832 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:07.833 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:07.833 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 41 (MapPartitionsRDD[112] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:07.835 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_48 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:07.837 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_48_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:07.838 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_48_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:07.838 dag-scheduler-event-loop INFO SparkContext: Created broadcast 48 from broadcast at DAGScheduler.scala:1293 10:40:07.838 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 41 (MapPartitionsRDD[112] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:07.838 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 41.0 with 1 tasks resource profile 0 10:40:07.839 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 41.0 (TID 65, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:07.840 Executor task launch worker for task 65 INFO Executor: Running task 0.0 in stage 41.0 (TID 65) 10:40:07.846 Executor task launch worker for task 65 INFO Executor: Finished task 0.0 in stage 41.0 (TID 65). 1404 bytes result sent to driver 10:40:07.847 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 41.0 (TID 65) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:07.847 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 41.0, whose tasks have all completed, from pool 10:40:07.847 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 41 (apply at OutcomeOf.scala:85) finished in 0.013 s 10:40:07.847 dag-scheduler-event-loop INFO DAGScheduler: Job 36 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:07.847 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 41: Stage finished 10:40:07.848 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 36 finished: apply at OutcomeOf.scala:85, took 0.016386 s 10:40:07.858 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:07.858 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:07.885 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:07.885 dag-scheduler-event-loop INFO DAGScheduler: Got job 37 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:07.885 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 42 (apply at OutcomeOf.scala:85) 10:40:07.885 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:07.885 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:07.886 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 42 (MapPartitionsRDD[114] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:07.887 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_49 stored as values in memory (estimated size 6.3 KiB, free 2.1 GiB) 10:40:07.890 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_49_piece0 stored as bytes in memory (estimated size 3.2 KiB, free 2.1 GiB) 10:40:07.890 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_49_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.2 KiB, free: 2.1 GiB) 10:40:07.891 dag-scheduler-event-loop INFO SparkContext: Created broadcast 49 from broadcast at DAGScheduler.scala:1293 10:40:07.892 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 42 (MapPartitionsRDD[114] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:07.892 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 42.0 with 1 tasks resource profile 0 10:40:07.893 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 42.0 (TID 66, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:07.893 Executor task launch worker for task 66 INFO Executor: Running task 0.0 in stage 42.0 (TID 66) 10:40:07.896 Executor task launch worker for task 66 INFO Executor: Finished task 0.0 in stage 42.0 (TID 66). 1400 bytes result sent to driver 10:40:07.897 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 42.0 (TID 66) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:07.897 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 42.0, whose tasks have all completed, from pool 10:40:07.897 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 42 (apply at OutcomeOf.scala:85) finished in 0.011 s 10:40:07.897 dag-scheduler-event-loop INFO DAGScheduler: Job 37 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:07.897 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 42: Stage finished 10:40:07.897 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 37 finished: apply at OutcomeOf.scala:85, took 0.012750 s 10:40:07.908 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:07.908 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:07.933 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:07.934 dag-scheduler-event-loop INFO DAGScheduler: Got job 38 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:07.934 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 43 (apply at OutcomeOf.scala:85) 10:40:07.934 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:07.934 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:07.934 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 43 (MapPartitionsRDD[116] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:07.936 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_50 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:07.940 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_50_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:07.940 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_50_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:07.941 dag-scheduler-event-loop INFO SparkContext: Created broadcast 50 from broadcast at DAGScheduler.scala:1293 10:40:07.941 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 43 (MapPartitionsRDD[116] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:07.941 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 43.0 with 1 tasks resource profile 0 10:40:07.942 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 43.0 (TID 67, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:07.942 Executor task launch worker for task 67 INFO Executor: Running task 0.0 in stage 43.0 (TID 67) 10:40:07.945 Executor task launch worker for task 67 INFO Executor: Finished task 0.0 in stage 43.0 (TID 67). 1404 bytes result sent to driver 10:40:07.946 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 43.0 (TID 67) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:07.946 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 43.0, whose tasks have all completed, from pool 10:40:07.946 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 43 (apply at OutcomeOf.scala:85) finished in 0.011 s 10:40:07.946 dag-scheduler-event-loop INFO DAGScheduler: Job 38 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:07.946 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 43: Stage finished 10:40:07.947 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 38 finished: apply at OutcomeOf.scala:85, took 0.013163 s 10:40:07.958 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:07.958 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:07.984 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:07.985 dag-scheduler-event-loop INFO DAGScheduler: Got job 39 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:07.985 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 44 (apply at OutcomeOf.scala:85) 10:40:07.985 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:07.985 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:07.985 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 44 (MapPartitionsRDD[118] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:07.987 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_51 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:07.989 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_51_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:07.990 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_51_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:07.990 dag-scheduler-event-loop INFO SparkContext: Created broadcast 51 from broadcast at DAGScheduler.scala:1293 10:40:07.990 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 44 (MapPartitionsRDD[118] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:07.991 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 44.0 with 1 tasks resource profile 0 10:40:07.991 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 44.0 (TID 68, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:07.992 Executor task launch worker for task 68 INFO Executor: Running task 0.0 in stage 44.0 (TID 68) 10:40:07.995 Executor task launch worker for task 68 INFO Executor: Finished task 0.0 in stage 44.0 (TID 68). 1404 bytes result sent to driver 10:40:07.996 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 44.0 (TID 68) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:07.996 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 44.0, whose tasks have all completed, from pool 10:40:07.997 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 44 (apply at OutcomeOf.scala:85) finished in 0.011 s 10:40:07.997 dag-scheduler-event-loop INFO DAGScheduler: Job 39 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:07.997 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 44: Stage finished 10:40:07.997 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 39 finished: apply at OutcomeOf.scala:85, took 0.012935 s 10:40:08.006 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.006 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.035 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:08.036 dag-scheduler-event-loop INFO DAGScheduler: Got job 40 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:08.036 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 45 (apply at OutcomeOf.scala:85) 10:40:08.036 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:08.036 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:08.036 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 45 (MapPartitionsRDD[120] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:08.038 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_52 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:08.042 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_52_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:08.042 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_52_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.043 dag-scheduler-event-loop INFO SparkContext: Created broadcast 52 from broadcast at DAGScheduler.scala:1293 10:40:08.043 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 45 (MapPartitionsRDD[120] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:08.044 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 45.0 with 1 tasks resource profile 0 10:40:08.045 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 45.0 (TID 69, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:08.045 Executor task launch worker for task 69 INFO Executor: Running task 0.0 in stage 45.0 (TID 69) 10:40:08.048 Executor task launch worker for task 69 INFO Executor: Finished task 0.0 in stage 45.0 (TID 69). 1404 bytes result sent to driver 10:40:08.049 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 45.0 (TID 69) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:08.049 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 45.0, whose tasks have all completed, from pool 10:40:08.049 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 45 (apply at OutcomeOf.scala:85) finished in 0.012 s 10:40:08.049 dag-scheduler-event-loop INFO DAGScheduler: Job 40 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:08.049 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 45: Stage finished 10:40:08.049 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 40 finished: apply at OutcomeOf.scala:85, took 0.014253 s 10:40:08.060 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.060 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.089 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 6.250043 ms 10:40:08.116 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_42_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 9.3 KiB, free: 2.1 GiB) 10:40:08.118 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:08.119 dag-scheduler-event-loop INFO DAGScheduler: Got job 41 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:08.119 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 46 (apply at OutcomeOf.scala:85) 10:40:08.119 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:08.119 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:08.119 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 46 (MapPartitionsRDD[122] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:08.120 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_39_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 10.0 KiB, free: 2.1 GiB) 10:40:08.121 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_53 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:08.123 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_43_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 10.5 KiB, free: 2.1 GiB) 10:40:08.123 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_53_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:08.123 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_53_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.124 dag-scheduler-event-loop INFO SparkContext: Created broadcast 53 from broadcast at DAGScheduler.scala:1293 10:40:08.125 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 46 (MapPartitionsRDD[122] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:08.125 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 46.0 with 1 tasks resource profile 0 10:40:08.126 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 46.0 (TID 70, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:08.126 Executor task launch worker for task 70 INFO Executor: Running task 0.0 in stage 46.0 (TID 70) 10:40:08.127 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_44_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.8 KiB, free: 2.1 GiB) 10:40:08.133 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_28_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.134 Executor task launch worker for task 70 INFO Executor: Finished task 0.0 in stage 46.0 (TID 70). 1404 bytes result sent to driver 10:40:08.135 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 46.0 (TID 70) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:08.135 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 46.0, whose tasks have all completed, from pool 10:40:08.135 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 46 (apply at OutcomeOf.scala:85) finished in 0.015 s 10:40:08.136 dag-scheduler-event-loop INFO DAGScheduler: Job 41 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:08.136 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 46: Stage finished 10:40:08.136 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 41 finished: apply at OutcomeOf.scala:85, took 0.018086 s 10:40:08.137 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_40_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 28.5 KiB, free: 2.1 GiB) 10:40:08.141 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_36_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 28.5 KiB, free: 2.1 GiB) 10:40:08.144 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_32_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.148 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_35_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.8 KiB, free: 2.1 GiB) 10:40:08.152 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_41_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 7.9 KiB, free: 2.1 GiB) 10:40:08.154 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.154 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_27_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.2 KiB, free: 2.1 GiB) 10:40:08.154 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.158 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_52_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.161 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_50_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.164 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_45_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.8 KiB, free: 2.1 GiB) 10:40:08.166 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_49_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.2 KiB, free: 2.1 GiB) 10:40:08.170 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_48_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.173 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_51_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.176 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_34_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.8 KiB, free: 2.1 GiB) 10:40:08.179 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_46_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.8 KiB, free: 2.1 GiB) 10:40:08.183 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_38_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 8.9 KiB, free: 2.1 GiB) 10:40:08.187 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_30_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.190 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_31_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.193 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_33_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.8 KiB, free: 2.1 GiB) 10:40:08.194 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_47_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.8 KiB, free: 2.1 GiB) 10:40:08.195 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_37_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 7.5 KiB, free: 2.1 GiB) 10:40:08.196 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_29_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.202 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:08.203 dag-scheduler-event-loop INFO DAGScheduler: Got job 42 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:08.203 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 47 (apply at OutcomeOf.scala:85) 10:40:08.203 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:08.203 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:08.203 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 47 (MapPartitionsRDD[124] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:08.205 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_54 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:08.207 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_54_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:08.207 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_54_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.207 dag-scheduler-event-loop INFO SparkContext: Created broadcast 54 from broadcast at DAGScheduler.scala:1293 10:40:08.208 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 47 (MapPartitionsRDD[124] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:08.208 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 47.0 with 1 tasks resource profile 0 10:40:08.209 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 47.0 (TID 71, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:08.209 Executor task launch worker for task 71 INFO Executor: Running task 0.0 in stage 47.0 (TID 71) 10:40:08.212 Executor task launch worker for task 71 INFO Executor: Finished task 0.0 in stage 47.0 (TID 71). 1361 bytes result sent to driver 10:40:08.212 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 47.0 (TID 71) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:08.212 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 47.0, whose tasks have all completed, from pool 10:40:08.213 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 47 (apply at OutcomeOf.scala:85) finished in 0.008 s 10:40:08.213 dag-scheduler-event-loop INFO DAGScheduler: Job 42 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:08.213 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 47: Stage finished 10:40:08.213 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 42 finished: apply at OutcomeOf.scala:85, took 0.010996 s 10:40:08.221 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.221 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.245 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 6.600061 ms 10:40:08.252 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:08.253 dag-scheduler-event-loop INFO DAGScheduler: Got job 43 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:08.253 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 48 (apply at OutcomeOf.scala:85) 10:40:08.253 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:08.253 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:08.253 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 48 (MapPartitionsRDD[126] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:08.255 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_55 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:08.257 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_55_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:08.258 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_55_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.258 dag-scheduler-event-loop INFO SparkContext: Created broadcast 55 from broadcast at DAGScheduler.scala:1293 10:40:08.258 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 48 (MapPartitionsRDD[126] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:08.258 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 48.0 with 1 tasks resource profile 0 10:40:08.259 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 48.0 (TID 72, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:08.260 Executor task launch worker for task 72 INFO Executor: Running task 0.0 in stage 48.0 (TID 72) 10:40:08.265 Executor task launch worker for task 72 INFO Executor: Finished task 0.0 in stage 48.0 (TID 72). 1404 bytes result sent to driver 10:40:08.265 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 48.0 (TID 72) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:08.265 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 48.0, whose tasks have all completed, from pool 10:40:08.266 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 48 (apply at OutcomeOf.scala:85) finished in 0.012 s 10:40:08.266 dag-scheduler-event-loop INFO DAGScheduler: Job 43 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:08.266 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 48: Stage finished 10:40:08.266 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 43 finished: apply at OutcomeOf.scala:85, took 0.013710 s 10:40:08.275 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.275 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.301 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 7.889944 ms 10:40:08.311 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:08.312 dag-scheduler-event-loop INFO DAGScheduler: Got job 44 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:08.312 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 49 (apply at OutcomeOf.scala:85) 10:40:08.312 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:08.313 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:08.313 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 49 (MapPartitionsRDD[128] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:08.316 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_56 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:08.319 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_56_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:08.320 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_56_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.320 dag-scheduler-event-loop INFO SparkContext: Created broadcast 56 from broadcast at DAGScheduler.scala:1293 10:40:08.321 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 49 (MapPartitionsRDD[128] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:08.321 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 49.0 with 1 tasks resource profile 0 10:40:08.322 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 49.0 (TID 73, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:08.323 Executor task launch worker for task 73 INFO Executor: Running task 0.0 in stage 49.0 (TID 73) 10:40:08.328 Executor task launch worker for task 73 INFO Executor: Finished task 0.0 in stage 49.0 (TID 73). 1404 bytes result sent to driver 10:40:08.329 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 49.0 (TID 73) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:08.329 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 49.0, whose tasks have all completed, from pool 10:40:08.329 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 49 (apply at OutcomeOf.scala:85) finished in 0.015 s 10:40:08.329 dag-scheduler-event-loop INFO DAGScheduler: Job 44 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:08.329 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 49: Stage finished 10:40:08.330 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 44 finished: apply at OutcomeOf.scala:85, took 0.018758 s 10:40:08.337 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.337 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.362 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 7.289841 ms 10:40:08.376 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:08.377 dag-scheduler-event-loop INFO DAGScheduler: Got job 45 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:08.377 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 50 (apply at OutcomeOf.scala:85) 10:40:08.377 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:08.377 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:08.377 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 50 (MapPartitionsRDD[130] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:08.379 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_57 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:08.380 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_57_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:08.381 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_57_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.381 dag-scheduler-event-loop INFO SparkContext: Created broadcast 57 from broadcast at DAGScheduler.scala:1293 10:40:08.381 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 50 (MapPartitionsRDD[130] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:08.381 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 50.0 with 1 tasks resource profile 0 10:40:08.382 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 50.0 (TID 74, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:08.383 Executor task launch worker for task 74 INFO Executor: Running task 0.0 in stage 50.0 (TID 74) 10:40:08.387 Executor task launch worker for task 74 INFO Executor: Finished task 0.0 in stage 50.0 (TID 74). 1404 bytes result sent to driver 10:40:08.388 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 50.0 (TID 74) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:08.389 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 50.0, whose tasks have all completed, from pool 10:40:08.389 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 50 (apply at OutcomeOf.scala:85) finished in 0.011 s 10:40:08.389 dag-scheduler-event-loop INFO DAGScheduler: Job 45 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:08.389 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 50: Stage finished 10:40:08.389 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 45 finished: apply at OutcomeOf.scala:85, took 0.012894 s 10:40:08.397 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.397 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.491 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== FINISHED o.a.s.sql.SQLQueryTestSuite: 'decimalArithmeticOperations.sql' ===== 10:40:08.537 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== TEST OUTPUT FOR o.a.s.sql.SQLQueryTestSuite: 'regexp-functions.sql' ===== 10:40:08.552 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.552 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.558 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.558 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.562 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.562 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.578 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.578 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.606 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 9.340949 ms 10:40:08.783 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:08.784 dag-scheduler-event-loop INFO DAGScheduler: Got job 46 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:08.784 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 51 (apply at OutcomeOf.scala:85) 10:40:08.784 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:08.784 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:08.784 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 51 (MapPartitionsRDD[133] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:08.786 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_58 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:08.788 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_58_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:08.789 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_58_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.789 dag-scheduler-event-loop INFO SparkContext: Created broadcast 58 from broadcast at DAGScheduler.scala:1293 10:40:08.790 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 51 (MapPartitionsRDD[133] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:08.790 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 51.0 with 1 tasks resource profile 0 10:40:08.790 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 51.0 (TID 75, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:08.791 Executor task launch worker for task 75 INFO Executor: Running task 0.0 in stage 51.0 (TID 75) 10:40:08.797 Executor task launch worker for task 75 INFO Executor: Finished task 0.0 in stage 51.0 (TID 75). 1412 bytes result sent to driver 10:40:08.798 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 51.0 (TID 75) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:08.798 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 51.0, whose tasks have all completed, from pool 10:40:08.799 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 51 (apply at OutcomeOf.scala:85) finished in 0.013 s 10:40:08.799 dag-scheduler-event-loop INFO DAGScheduler: Job 46 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:08.799 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 51: Stage finished 10:40:08.799 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 46 finished: apply at OutcomeOf.scala:85, took 0.015756 s 10:40:08.807 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.807 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.811 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.811 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.817 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.817 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.831 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.831 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.835 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.835 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.841 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.841 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.852 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.852 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.877 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:08.878 dag-scheduler-event-loop INFO DAGScheduler: Got job 47 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:08.878 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 52 (apply at OutcomeOf.scala:85) 10:40:08.878 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:08.878 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:08.878 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 52 (MapPartitionsRDD[135] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:08.880 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_59 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:08.882 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_59_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:08.882 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_59_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.883 dag-scheduler-event-loop INFO SparkContext: Created broadcast 59 from broadcast at DAGScheduler.scala:1293 10:40:08.883 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 52 (MapPartitionsRDD[135] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:08.883 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 52.0 with 1 tasks resource profile 0 10:40:08.884 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 52.0 (TID 76, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:08.884 Executor task launch worker for task 76 INFO Executor: Running task 0.0 in stage 52.0 (TID 76) 10:40:08.888 Executor task launch worker for task 76 INFO Executor: Finished task 0.0 in stage 52.0 (TID 76). 1412 bytes result sent to driver 10:40:08.889 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 52.0 (TID 76) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:08.889 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 52.0, whose tasks have all completed, from pool 10:40:08.889 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 52 (apply at OutcomeOf.scala:85) finished in 0.010 s 10:40:08.889 dag-scheduler-event-loop INFO DAGScheduler: Job 47 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:08.889 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 52: Stage finished 10:40:08.890 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 47 finished: apply at OutcomeOf.scala:85, took 0.012551 s 10:40:08.898 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.899 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.924 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:08.925 dag-scheduler-event-loop INFO DAGScheduler: Got job 48 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:08.925 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 53 (apply at OutcomeOf.scala:85) 10:40:08.925 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:08.925 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:08.925 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 53 (MapPartitionsRDD[137] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:08.926 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_60 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:08.928 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_60_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:08.929 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_60_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.929 dag-scheduler-event-loop INFO SparkContext: Created broadcast 60 from broadcast at DAGScheduler.scala:1293 10:40:08.929 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 53 (MapPartitionsRDD[137] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:08.930 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 53.0 with 1 tasks resource profile 0 10:40:08.931 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 53.0 (TID 77, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:08.931 Executor task launch worker for task 77 INFO Executor: Running task 0.0 in stage 53.0 (TID 77) 10:40:08.934 Executor task launch worker for task 77 INFO Executor: Finished task 0.0 in stage 53.0 (TID 77). 1369 bytes result sent to driver 10:40:08.934 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 53.0 (TID 77) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:08.934 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 53.0, whose tasks have all completed, from pool 10:40:08.935 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 53 (apply at OutcomeOf.scala:85) finished in 0.010 s 10:40:08.935 dag-scheduler-event-loop INFO DAGScheduler: Job 48 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:08.935 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 53: Stage finished 10:40:08.935 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 48 finished: apply at OutcomeOf.scala:85, took 0.011084 s 10:40:08.943 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.943 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:08.967 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:08.968 dag-scheduler-event-loop INFO DAGScheduler: Got job 49 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:08.968 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 54 (apply at OutcomeOf.scala:85) 10:40:08.969 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:08.969 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:08.969 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 54 (MapPartitionsRDD[139] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:08.971 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_61 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:08.974 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_61_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:08.974 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_61_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:08.975 dag-scheduler-event-loop INFO SparkContext: Created broadcast 61 from broadcast at DAGScheduler.scala:1293 10:40:08.975 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 54 (MapPartitionsRDD[139] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:08.975 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 54.0 with 1 tasks resource profile 0 10:40:08.977 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 54.0 (TID 78, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:08.977 Executor task launch worker for task 78 INFO Executor: Running task 0.0 in stage 54.0 (TID 78) 10:40:08.981 Executor task launch worker for task 78 INFO Executor: Finished task 0.0 in stage 54.0 (TID 78). 1412 bytes result sent to driver 10:40:08.981 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 54.0 (TID 78) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:08.982 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 54.0, whose tasks have all completed, from pool 10:40:08.983 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 54 (apply at OutcomeOf.scala:85) finished in 0.012 s 10:40:09.119 dag-scheduler-event-loop INFO DAGScheduler: Job 49 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:09.119 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 54: Stage finished 10:40:09.119 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 49 finished: apply at OutcomeOf.scala:85, took 0.151130 s 10:40:09.128 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.128 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.152 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:09.153 dag-scheduler-event-loop INFO DAGScheduler: Got job 50 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:09.153 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 55 (apply at OutcomeOf.scala:85) 10:40:09.154 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:09.154 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:09.154 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 55 (MapPartitionsRDD[141] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:09.156 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_62 stored as values in memory (estimated size 6.4 KiB, free 2.1 GiB) 10:40:09.158 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_62_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 10:40:09.159 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_62_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.3 KiB, free: 2.1 GiB) 10:40:09.159 dag-scheduler-event-loop INFO SparkContext: Created broadcast 62 from broadcast at DAGScheduler.scala:1293 10:40:09.160 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 55 (MapPartitionsRDD[141] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:09.160 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 55.0 with 1 tasks resource profile 0 10:40:09.161 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 55.0 (TID 79, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:09.161 Executor task launch worker for task 79 INFO Executor: Running task 0.0 in stage 55.0 (TID 79) 10:40:09.164 Executor task launch worker for task 79 INFO Executor: Finished task 0.0 in stage 55.0 (TID 79). 1369 bytes result sent to driver 10:40:09.164 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 55.0 (TID 79) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:09.165 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 55.0, whose tasks have all completed, from pool 10:40:09.165 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 55 (apply at OutcomeOf.scala:85) finished in 0.010 s 10:40:09.165 dag-scheduler-event-loop INFO DAGScheduler: Job 50 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:09.165 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 55: Stage finished 10:40:09.165 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 50 finished: apply at OutcomeOf.scala:85, took 0.012653 s 10:40:09.169 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== FINISHED o.a.s.sql.SQLQueryTestSuite: 'regexp-functions.sql' ===== 10:40:09.183 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== TEST OUTPUT FOR o.a.s.sql.SQLQueryTestSuite: 'explain-aqe.sql' ===== 10:40:09.191 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: Setting configs: set spark.sql.adaptive.enabled=true 10:40:09.200 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.200 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.214 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.214 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.224 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO InMemoryFileIndex: It took 0 ms to list leaf files for 0 paths. 10:40:09.235 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.235 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.244 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO InMemoryFileIndex: It took 0 ms to list leaf files for 0 paths. 10:40:09.256 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.256 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.270 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO InMemoryFileIndex: It took 0 ms to list leaf files for 0 paths. 10:40:09.282 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.283 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.292 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO InMemoryFileIndex: It took 0 ms to list leaf files for 0 paths. 10:40:09.301 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.301 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.322 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.323 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.341 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO InMemoryFileIndex: It took 0 ms to list leaf files for 1 paths. 10:40:09.407 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.407 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.511 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:09.770 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: IsNotNull(key),GreaterThan(key,0) 10:40:09.771 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: isnotnull(key#327),(key#327 > 0) 10:40:09.771 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:09.833 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.833 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:09.883 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.055 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.122 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:10.122 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: IsNotNull(key),GreaterThan(key,0) 10:40:10.122 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: isnotnull(key#327),(key#327 > 0) 10:40:10.123 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:10.145 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.145 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.187 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.226 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.309 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:10.310 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: IsNotNull(key),GreaterThan(key,0) 10:40:10.310 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: isnotnull(key#327),(key#327 > 0) 10:40:10.310 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:10.311 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:10.312 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: IsNotNull(key),GreaterThan(key,0) 10:40:10.312 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: isnotnull(key#327),(key#327 > 0) 10:40:10.312 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:10.339 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.340 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.365 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO InMemoryFileIndex: It took 1 ms to list leaf files for 1 paths. 10:40:10.389 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.389 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.543 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:10.543 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: IsNotNull(key) 10:40:10.543 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: isnotnull(key#327) 10:40:10.544 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:10.544 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:10.545 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: IsNotNull(key) 10:40:10.545 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: isnotnull(key#359) 10:40:10.545 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:10.578 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.579 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.597 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.597 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.624 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:10.624 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: 10:40:10.624 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: 10:40:10.625 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:10.625 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:10.625 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: IsNotNull(key) 10:40:10.625 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: isnotnull(key#359) 10:40:10.625 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:10.657 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.657 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.693 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO InMemoryFileIndex: It took 0 ms to list leaf files for 1 paths. 10:40:10.727 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.727 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.740 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.741 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.749 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.749 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:10.826 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.028 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.066 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.067 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.070 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.070 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.112 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.112 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.164 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:11.165 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: IsNotNull(key),IsNotNull(val),GreaterThan(val,3) 10:40:11.165 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: isnotnull(key#327),isnotnull(val#328),(key#327 = scalar-subquery#367 []),(val#328 > 3) 10:40:11.165 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:11.180 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:11.181 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: IsNotNull(key),IsNotNull(val),EqualTo(val,2) 10:40:11.181 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: isnotnull(key#359),isnotnull(val#360),(key#359 = scalar-subquery#366 []),(val#360 = 2) 10:40:11.182 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:11.185 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:11.186 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: IsNotNull(val),GreaterThan(val,0) 10:40:11.186 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: isnotnull(val#374),(val#374 > 0) 10:40:11.186 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:11.244 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.244 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.350 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.350 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.354 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.354 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.380 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.381 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.428 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.428 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.464 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.467 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.504 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:11.504 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: 10:40:11.504 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: ((key#327 = scalar-subquery#383 []) OR (cast(key#327 as double) = scalar-subquery#384 [])) 10:40:11.505 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:11.507 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:11.507 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: IsNotNull(val),GreaterThan(val,0) 10:40:11.508 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: isnotnull(val#360),(val#360 > 0) 10:40:11.508 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:11.511 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:11.511 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: IsNotNull(val),GreaterThan(val,0) 10:40:11.512 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: isnotnull(val#374),(val#374 > 0) 10:40:11.512 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:11.528 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.528 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.575 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.575 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.579 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.579 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.615 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.615 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.683 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_53_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:11.685 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_56_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:11.686 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_58_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:11.687 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_61_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:11.691 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_60_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:11.698 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_54_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:11.700 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_62_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:11.701 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_55_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:11.702 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_59_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:11.703 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_57_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.3 KiB, free: 2.1 GiB) 10:40:11.715 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.716 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.747 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.747 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.774 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:11.774 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: 10:40:11.774 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: 10:40:11.774 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct<> 10:40:11.776 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:11.776 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: 10:40:11.776 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: 10:40:11.776 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:11.779 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:11.779 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: 10:40:11.779 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: 10:40:11.779 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:11.797 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.798 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.847 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.847 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.900 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:11.920 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: IsNotNull(key),GreaterThan(key,10) 10:40:11.921 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: isnotnull(key#327),(key#327 > 10) 10:40:11.921 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:11.922 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:11.922 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: IsNotNull(key),GreaterThan(key,10) 10:40:11.922 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: isnotnull(key#425),(key#425 > 10) 10:40:11.922 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:11.936 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.936 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.997 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:11.997 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.070 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:12.071 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: IsNotNull(key),GreaterThan(key,10) 10:40:12.071 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: isnotnull(key#327),(key#327 > 10) 10:40:12.071 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:12.072 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:12.072 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: IsNotNull(key),GreaterThan(key,10) 10:40:12.072 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: isnotnull(key#436),(key#436 > 10) 10:40:12.072 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:12.086 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.086 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.100 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.101 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.120 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.120 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.149 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.149 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.176 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:12.176 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: 10:40:12.176 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: 10:40:12.176 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:12.194 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.194 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.213 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO InMemoryFileIndex: It took 2 ms to list leaf files for 1 paths. 10:40:12.230 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.230 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.252 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:12.252 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: 10:40:12.252 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: 10:40:12.252 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:12.263 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.263 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.280 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.280 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.300 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pruning directories with: 10:40:12.301 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Pushed Filters: 10:40:12.301 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Post-Scan Filters: 10:40:12.301 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO FileSourceStrategy: Output Data Schema: struct 10:40:12.311 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.311 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.329 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.329 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.348 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.348 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.366 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.366 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.400 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== FINISHED o.a.s.sql.SQLQueryTestSuite: 'explain-aqe.sql' ===== 10:40:12.421 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== TEST OUTPUT FOR o.a.s.sql.SQLQueryTestSuite: 'except.sql' ===== 10:40:12.453 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.454 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.506 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.506 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.542 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.542 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:12.671 broadcast-exchange-0 INFO CodeGenerator: Code generated in 23.602755 ms 10:40:12.704 broadcast-exchange-0 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:12.705 dag-scheduler-event-loop INFO DAGScheduler: Got job 51 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 2 output partitions 10:40:12.705 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 56 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:12.705 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:12.705 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:12.706 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 56 (MapPartitionsRDD[144] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:12.707 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_63 stored as values in memory (estimated size 4.4 KiB, free 2.1 GiB) 10:40:12.709 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_63_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 2.1 GiB) 10:40:12.710 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_63_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 2.4 KiB, free: 2.1 GiB) 10:40:12.710 dag-scheduler-event-loop INFO SparkContext: Created broadcast 63 from broadcast at DAGScheduler.scala:1293 10:40:12.711 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 56 (MapPartitionsRDD[144] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0, 1)) 10:40:12.711 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 56.0 with 2 tasks resource profile 0 10:40:12.712 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 56.0 (TID 80, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7590 bytes) taskResourceAssignments Map() 10:40:12.712 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 56.0 (TID 81, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7631 bytes) taskResourceAssignments Map() 10:40:12.712 Executor task launch worker for task 80 INFO Executor: Running task 0.0 in stage 56.0 (TID 80) 10:40:12.712 Executor task launch worker for task 81 INFO Executor: Running task 1.0 in stage 56.0 (TID 81) 10:40:12.713 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 41.444318 ms 10:40:12.721 Executor task launch worker for task 80 INFO Executor: Finished task 0.0 in stage 56.0 (TID 80). 1356 bytes result sent to driver 10:40:12.723 Executor task launch worker for task 81 INFO Executor: Finished task 1.0 in stage 56.0 (TID 81). 1368 bytes result sent to driver 10:40:12.723 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 56.0 (TID 80) in 11 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:12.723 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 56.0 (TID 81) in 11 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:12.723 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 56.0, whose tasks have all completed, from pool 10:40:12.724 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 56 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.018 s 10:40:12.724 dag-scheduler-event-loop INFO DAGScheduler: Job 51 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:12.724 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 56: Stage finished 10:40:12.724 broadcast-exchange-0 INFO DAGScheduler: Job 51 finished: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266, took 0.019837 s 10:40:12.746 broadcast-exchange-0 INFO CodeGenerator: Code generated in 8.413657 ms 10:40:12.780 broadcast-exchange-0 INFO MemoryStore: Block broadcast_64 stored as values in memory (estimated size 64.0 MiB, free 2.1 GiB) 10:40:12.785 broadcast-exchange-0 INFO MemoryStore: Block broadcast_64_piece0 stored as bytes in memory (estimated size 300.0 B, free 2.1 GiB) 10:40:12.785 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_64_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 300.0 B, free: 2.1 GiB) 10:40:12.785 broadcast-exchange-0 INFO SparkContext: Created broadcast 64 from $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:12.817 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 23.090233 ms 10:40:12.826 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 7.789972 ms 10:40:12.863 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:12.864 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 147 (apply at OutcomeOf.scala:85) as input to shuffle 5 10:40:12.864 dag-scheduler-event-loop INFO DAGScheduler: Got job 52 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:12.864 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 58 (apply at OutcomeOf.scala:85) 10:40:12.864 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 57) 10:40:12.864 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 57) 10:40:12.864 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 57 (MapPartitionsRDD[147] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:12.867 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_65 stored as values in memory (estimated size 22.9 KiB, free 2.1 GiB) 10:40:12.870 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_65_piece0 stored as bytes in memory (estimated size 10.3 KiB, free 2.1 GiB) 10:40:12.870 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_65_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 10.3 KiB, free: 2.1 GiB) 10:40:12.870 dag-scheduler-event-loop INFO SparkContext: Created broadcast 65 from broadcast at DAGScheduler.scala:1293 10:40:12.871 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 57 (MapPartitionsRDD[147] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:12.871 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 57.0 with 2 tasks resource profile 0 10:40:12.872 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 57.0 (TID 82, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7579 bytes) taskResourceAssignments Map() 10:40:12.872 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 57.0 (TID 83, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7579 bytes) taskResourceAssignments Map() 10:40:12.872 Executor task launch worker for task 82 INFO Executor: Running task 0.0 in stage 57.0 (TID 82) 10:40:12.872 Executor task launch worker for task 83 INFO Executor: Running task 1.0 in stage 57.0 (TID 83) 10:40:12.900 Executor task launch worker for task 83 INFO CodeGenerator: Code generated in 14.949976 ms 10:40:12.909 Executor task launch worker for task 83 INFO CodeGenerator: Code generated in 5.302629 ms 10:40:12.978 Executor task launch worker for task 83 INFO Executor: Finished task 1.0 in stage 57.0 (TID 83). 2544 bytes result sent to driver 10:40:12.978 Executor task launch worker for task 82 INFO Executor: Finished task 0.0 in stage 57.0 (TID 82). 2544 bytes result sent to driver 10:40:12.979 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 57.0 (TID 83) in 107 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:12.979 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 57.0 (TID 82) in 107 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:12.980 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 57.0, whose tasks have all completed, from pool 10:40:12.980 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 57 (apply at OutcomeOf.scala:85) finished in 0.115 s 10:40:12.980 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:12.980 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:12.980 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 58) 10:40:12.980 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:12.981 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 58 (MapPartitionsRDD[150] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:12.984 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_66 stored as values in memory (estimated size 21.9 KiB, free 2.1 GiB) 10:40:12.986 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_66_piece0 stored as bytes in memory (estimated size 10.0 KiB, free 2.1 GiB) 10:40:12.986 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_66_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 10.0 KiB, free: 2.1 GiB) 10:40:12.987 dag-scheduler-event-loop INFO SparkContext: Created broadcast 66 from broadcast at DAGScheduler.scala:1293 10:40:12.987 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 58 (MapPartitionsRDD[150] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:12.987 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 58.0 with 4 tasks resource profile 0 10:40:12.988 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 58.0 (TID 84, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:12.989 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 58.0 (TID 85, amp-jenkins-worker-04.amp, executor driver, partition 3, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:12.989 Executor task launch worker for task 84 INFO Executor: Running task 0.0 in stage 58.0 (TID 84) 10:40:12.989 Executor task launch worker for task 85 INFO Executor: Running task 3.0 in stage 58.0 (TID 85) 10:40:12.994 Executor task launch worker for task 84 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:12.994 Executor task launch worker for task 85 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:12.994 Executor task launch worker for task 84 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:12.994 Executor task launch worker for task 85 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:13.050 Executor task launch worker for task 85 INFO Executor: Finished task 3.0 in stage 58.0 (TID 85). 3786 bytes result sent to driver 10:40:13.050 Executor task launch worker for task 84 INFO Executor: Finished task 0.0 in stage 58.0 (TID 84). 3786 bytes result sent to driver 10:40:13.051 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 58.0 (TID 86, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:13.052 Executor task launch worker for task 86 INFO Executor: Running task 1.0 in stage 58.0 (TID 86) 10:40:13.052 task-result-getter-1 INFO TaskSetManager: Finished task 3.0 in stage 58.0 (TID 85) in 63 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:13.052 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 2.0 in stage 58.0 (TID 87, amp-jenkins-worker-04.amp, executor driver, partition 2, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:13.052 Executor task launch worker for task 87 INFO Executor: Running task 2.0 in stage 58.0 (TID 87) 10:40:13.052 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 58.0 (TID 84) in 64 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:13.057 Executor task launch worker for task 86 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:13.057 Executor task launch worker for task 87 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:13.057 Executor task launch worker for task 86 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:13.057 Executor task launch worker for task 87 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:13.063 Executor task launch worker for task 86 INFO Executor: Finished task 1.0 in stage 58.0 (TID 86). 3757 bytes result sent to driver 10:40:13.063 Executor task launch worker for task 87 INFO Executor: Finished task 2.0 in stage 58.0 (TID 87). 3757 bytes result sent to driver 10:40:13.064 task-result-getter-3 INFO TaskSetManager: Finished task 2.0 in stage 58.0 (TID 87) in 12 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:13.064 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 58.0 (TID 86) in 13 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:13.064 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 58.0, whose tasks have all completed, from pool 10:40:13.065 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 58 (apply at OutcomeOf.scala:85) finished in 0.083 s 10:40:13.065 dag-scheduler-event-loop INFO DAGScheduler: Job 52 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:13.065 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 58: Stage finished 10:40:13.065 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 52 finished: apply at OutcomeOf.scala:85, took 0.202528 s 10:40:13.086 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:13.086 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:13.149 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 13.383057 ms 10:40:13.173 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:13.186 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 153 (apply at OutcomeOf.scala:85) as input to shuffle 6 10:40:13.187 dag-scheduler-event-loop INFO DAGScheduler: Got job 53 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:13.187 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 60 (apply at OutcomeOf.scala:85) 10:40:13.187 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 59) 10:40:13.187 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 59) 10:40:13.187 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 59 (MapPartitionsRDD[153] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:13.189 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_67 stored as values in memory (estimated size 18.2 KiB, free 2.1 GiB) 10:40:13.192 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_67_piece0 stored as bytes in memory (estimated size 8.5 KiB, free 2.1 GiB) 10:40:13.193 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_67_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 8.5 KiB, free: 2.1 GiB) 10:40:13.193 dag-scheduler-event-loop INFO SparkContext: Created broadcast 67 from broadcast at DAGScheduler.scala:1293 10:40:13.194 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 59 (MapPartitionsRDD[153] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:13.194 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 59.0 with 2 tasks resource profile 0 10:40:13.195 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 59.0 (TID 88, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7579 bytes) taskResourceAssignments Map() 10:40:13.195 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 59.0 (TID 89, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7579 bytes) taskResourceAssignments Map() 10:40:13.196 Executor task launch worker for task 89 INFO Executor: Running task 1.0 in stage 59.0 (TID 89) 10:40:13.196 Executor task launch worker for task 88 INFO Executor: Running task 0.0 in stage 59.0 (TID 88) 10:40:13.272 Executor task launch worker for task 88 INFO Executor: Finished task 0.0 in stage 59.0 (TID 88). 2195 bytes result sent to driver 10:40:13.273 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 59.0 (TID 88) in 78 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:13.274 Executor task launch worker for task 89 INFO Executor: Finished task 1.0 in stage 59.0 (TID 89). 2195 bytes result sent to driver 10:40:13.275 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 59.0 (TID 89) in 80 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:13.275 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 59.0, whose tasks have all completed, from pool 10:40:13.275 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 59 (apply at OutcomeOf.scala:85) finished in 0.087 s 10:40:13.275 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:13.275 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:13.275 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 60) 10:40:13.275 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:13.276 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 60 (MapPartitionsRDD[156] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:13.281 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_68 stored as values in memory (estimated size 18.5 KiB, free 2.1 GiB) 10:40:13.284 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_68_piece0 stored as bytes in memory (estimated size 8.7 KiB, free 2.1 GiB) 10:40:13.287 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_68_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 8.7 KiB, free: 2.1 GiB) 10:40:13.288 dag-scheduler-event-loop INFO SparkContext: Created broadcast 68 from broadcast at DAGScheduler.scala:1293 10:40:13.288 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 60 (MapPartitionsRDD[156] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:13.288 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 60.0 with 4 tasks resource profile 0 10:40:13.289 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 60.0 (TID 90, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:13.289 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 60.0 (TID 91, amp-jenkins-worker-04.amp, executor driver, partition 1, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:13.289 Executor task launch worker for task 90 INFO Executor: Running task 0.0 in stage 60.0 (TID 90) 10:40:13.289 Executor task launch worker for task 91 INFO Executor: Running task 1.0 in stage 60.0 (TID 91) 10:40:13.293 Executor task launch worker for task 90 INFO ShuffleBlockFetcherIterator: Getting 2 (144.0 B) non-empty blocks including 2 (144.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:13.293 Executor task launch worker for task 91 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:13.294 Executor task launch worker for task 90 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:13.294 Executor task launch worker for task 91 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:13.343 Executor task launch worker for task 90 INFO Executor: Finished task 0.0 in stage 60.0 (TID 90). 3454 bytes result sent to driver 10:40:13.343 Executor task launch worker for task 91 INFO Executor: Finished task 1.0 in stage 60.0 (TID 91). 3437 bytes result sent to driver 10:40:13.344 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 2.0 in stage 60.0 (TID 92, amp-jenkins-worker-04.amp, executor driver, partition 2, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:13.344 Executor task launch worker for task 92 INFO Executor: Running task 2.0 in stage 60.0 (TID 92) 10:40:13.345 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 60.0 (TID 93, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:13.345 Executor task launch worker for task 93 INFO Executor: Running task 3.0 in stage 60.0 (TID 93) 10:40:13.345 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 60.0 (TID 90) in 56 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:13.345 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 60.0 (TID 91) in 56 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:13.347 Executor task launch worker for task 92 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:13.347 Executor task launch worker for task 93 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:13.347 Executor task launch worker for task 92 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:13.347 Executor task launch worker for task 93 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:13.351 Executor task launch worker for task 92 INFO Executor: Finished task 2.0 in stage 60.0 (TID 92). 3408 bytes result sent to driver 10:40:13.351 Executor task launch worker for task 93 INFO Executor: Finished task 3.0 in stage 60.0 (TID 93). 3408 bytes result sent to driver 10:40:13.352 task-result-getter-1 INFO TaskSetManager: Finished task 2.0 in stage 60.0 (TID 92) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:13.352 task-result-getter-2 INFO TaskSetManager: Finished task 3.0 in stage 60.0 (TID 93) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:13.352 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 60.0, whose tasks have all completed, from pool 10:40:13.353 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 60 (apply at OutcomeOf.scala:85) finished in 0.074 s 10:40:13.353 dag-scheduler-event-loop INFO DAGScheduler: Job 53 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:13.353 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 60: Stage finished 10:40:13.353 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 53 finished: apply at OutcomeOf.scala:85, took 0.167708 s 10:40:13.374 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:13.374 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:13.435 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 14.6855 ms 10:40:13.451 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:13.452 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 159 (apply at OutcomeOf.scala:85) as input to shuffle 7 10:40:13.453 dag-scheduler-event-loop INFO DAGScheduler: Got job 54 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:13.453 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 62 (apply at OutcomeOf.scala:85) 10:40:13.453 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 61) 10:40:13.453 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 61) 10:40:13.453 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 61 (MapPartitionsRDD[159] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:13.456 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_69 stored as values in memory (estimated size 18.2 KiB, free 2.1 GiB) 10:40:13.458 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_69_piece0 stored as bytes in memory (estimated size 8.5 KiB, free 2.1 GiB) 10:40:13.458 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_69_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 8.5 KiB, free: 2.1 GiB) 10:40:13.459 dag-scheduler-event-loop INFO SparkContext: Created broadcast 69 from broadcast at DAGScheduler.scala:1293 10:40:13.459 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 61 (MapPartitionsRDD[159] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:13.459 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 61.0 with 2 tasks resource profile 0 10:40:13.460 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 61.0 (TID 94, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7579 bytes) taskResourceAssignments Map() 10:40:13.461 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 61.0 (TID 95, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7579 bytes) taskResourceAssignments Map() 10:40:13.461 Executor task launch worker for task 94 INFO Executor: Running task 0.0 in stage 61.0 (TID 94) 10:40:13.461 Executor task launch worker for task 95 INFO Executor: Running task 1.0 in stage 61.0 (TID 95) 10:40:13.472 Executor task launch worker for task 95 INFO Executor: Finished task 1.0 in stage 61.0 (TID 95). 2066 bytes result sent to driver 10:40:13.472 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 61.0 (TID 95) in 12 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:13.496 Executor task launch worker for task 94 INFO Executor: Finished task 0.0 in stage 61.0 (TID 94). 2195 bytes result sent to driver 10:40:13.497 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 61.0 (TID 94) in 37 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:13.497 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 61.0, whose tasks have all completed, from pool 10:40:13.497 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 61 (apply at OutcomeOf.scala:85) finished in 0.043 s 10:40:13.498 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:13.498 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:13.498 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 62) 10:40:13.498 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:13.498 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 62 (MapPartitionsRDD[162] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:13.500 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_70 stored as values in memory (estimated size 18.8 KiB, free 2.1 GiB) 10:40:13.502 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_70_piece0 stored as bytes in memory (estimated size 8.8 KiB, free 2.1 GiB) 10:40:13.503 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_70_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 8.8 KiB, free: 2.1 GiB) 10:40:13.503 dag-scheduler-event-loop INFO SparkContext: Created broadcast 70 from broadcast at DAGScheduler.scala:1293 10:40:13.503 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 62 (MapPartitionsRDD[162] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:13.503 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 62.0 with 4 tasks resource profile 0 10:40:13.504 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 62.0 (TID 96, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:13.505 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 62.0 (TID 97, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:13.505 Executor task launch worker for task 97 INFO Executor: Running task 1.0 in stage 62.0 (TID 97) 10:40:13.507 Executor task launch worker for task 96 INFO Executor: Running task 0.0 in stage 62.0 (TID 96) 10:40:13.508 Executor task launch worker for task 97 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:13.508 Executor task launch worker for task 97 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:13.509 Executor task launch worker for task 96 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:13.509 Executor task launch worker for task 96 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:13.511 Executor task launch worker for task 97 INFO Executor: Finished task 1.0 in stage 62.0 (TID 97). 3408 bytes result sent to driver 10:40:13.511 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 2.0 in stage 62.0 (TID 98, amp-jenkins-worker-04.amp, executor driver, partition 2, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:13.512 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 62.0 (TID 97) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:13.512 Executor task launch worker for task 98 INFO Executor: Running task 2.0 in stage 62.0 (TID 98) 10:40:13.515 Executor task launch worker for task 98 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:13.515 Executor task launch worker for task 98 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:13.519 Executor task launch worker for task 98 INFO Executor: Finished task 2.0 in stage 62.0 (TID 98). 3408 bytes result sent to driver 10:40:13.520 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 62.0 (TID 99, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:13.520 Executor task launch worker for task 99 INFO Executor: Running task 3.0 in stage 62.0 (TID 99) 10:40:13.521 task-result-getter-2 INFO TaskSetManager: Finished task 2.0 in stage 62.0 (TID 98) in 10 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:13.524 Executor task launch worker for task 99 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:13.524 Executor task launch worker for task 99 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:13.527 Executor task launch worker for task 99 INFO Executor: Finished task 3.0 in stage 62.0 (TID 99). 3408 bytes result sent to driver 10:40:13.528 task-result-getter-3 INFO TaskSetManager: Finished task 3.0 in stage 62.0 (TID 99) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:13.535 Executor task launch worker for task 96 INFO Executor: Finished task 0.0 in stage 62.0 (TID 96). 3437 bytes result sent to driver 10:40:13.536 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 62.0 (TID 96) in 32 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:13.536 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 62.0, whose tasks have all completed, from pool 10:40:13.537 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 62 (apply at OutcomeOf.scala:85) finished in 0.038 s 10:40:13.537 dag-scheduler-event-loop INFO DAGScheduler: Job 54 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:13.537 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 62: Stage finished 10:40:13.537 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 54 finished: apply at OutcomeOf.scala:85, took 0.085898 s 10:40:13.558 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:13.558 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:13.657 broadcast-exchange-1 INFO CodeGenerator: Code generated in 8.925736 ms 10:40:13.663 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 13.571975 ms 10:40:13.669 broadcast-exchange-1 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:13.669 dag-scheduler-event-loop INFO DAGScheduler: Got job 55 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 2 output partitions 10:40:13.670 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 63 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:13.670 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:13.670 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:13.670 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 63 (MapPartitionsRDD[165] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:13.672 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_71 stored as values in memory (estimated size 7.5 KiB, free 2.1 GiB) 10:40:13.674 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_71_piece0 stored as bytes in memory (estimated size 3.7 KiB, free 2.1 GiB) 10:40:13.674 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_71_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.7 KiB, free: 2.1 GiB) 10:40:13.674 dag-scheduler-event-loop INFO SparkContext: Created broadcast 71 from broadcast at DAGScheduler.scala:1293 10:40:13.675 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 63 (MapPartitionsRDD[165] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0, 1)) 10:40:13.675 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 63.0 with 2 tasks resource profile 0 10:40:13.676 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 63.0 (TID 100, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7590 bytes) taskResourceAssignments Map() 10:40:13.676 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 63.0 (TID 101, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7590 bytes) taskResourceAssignments Map() 10:40:13.676 Executor task launch worker for task 100 INFO Executor: Running task 0.0 in stage 63.0 (TID 100) 10:40:13.676 Executor task launch worker for task 101 INFO Executor: Running task 1.0 in stage 63.0 (TID 101) 10:40:13.682 Executor task launch worker for task 100 INFO Executor: Finished task 0.0 in stage 63.0 (TID 100). 1477 bytes result sent to driver 10:40:13.682 Executor task launch worker for task 101 INFO Executor: Finished task 1.0 in stage 63.0 (TID 101). 1477 bytes result sent to driver 10:40:13.683 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 63.0 (TID 100) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:13.683 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 63.0 (TID 101) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:13.683 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 63.0, whose tasks have all completed, from pool 10:40:13.683 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 63 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.012 s 10:40:13.684 dag-scheduler-event-loop INFO DAGScheduler: Job 55 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:13.684 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 63: Stage finished 10:40:13.684 broadcast-exchange-1 INFO DAGScheduler: Job 55 finished: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266, took 0.014868 s 10:40:13.690 broadcast-exchange-1 INFO CodeGenerator: Code generated in 4.963656 ms 10:40:13.704 broadcast-exchange-1 INFO MemoryStore: Block broadcast_72 stored as values in memory (estimated size 64.0 MiB, free 2.0 GiB) 10:40:13.706 broadcast-exchange-1 INFO MemoryStore: Block broadcast_72_piece0 stored as bytes in memory (estimated size 202.0 B, free 2.0 GiB) 10:40:13.706 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_72_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 202.0 B, free: 2.1 GiB) 10:40:13.707 broadcast-exchange-1 INFO SparkContext: Created broadcast 72 from $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:13.734 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 21.485195 ms 10:40:13.755 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:13.756 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 168 (apply at OutcomeOf.scala:85) as input to shuffle 8 10:40:13.756 dag-scheduler-event-loop INFO DAGScheduler: Got job 56 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:13.756 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 65 (apply at OutcomeOf.scala:85) 10:40:13.756 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 64) 10:40:13.756 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 64) 10:40:13.756 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 64 (MapPartitionsRDD[168] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:13.759 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_73 stored as values in memory (estimated size 23.8 KiB, free 2.0 GiB) 10:40:13.762 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_73_piece0 stored as bytes in memory (estimated size 10.7 KiB, free 2.0 GiB) 10:40:13.762 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_73_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 10.7 KiB, free: 2.1 GiB) 10:40:13.762 dag-scheduler-event-loop INFO SparkContext: Created broadcast 73 from broadcast at DAGScheduler.scala:1293 10:40:13.763 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 64 (MapPartitionsRDD[168] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:13.763 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 64.0 with 2 tasks resource profile 0 10:40:13.764 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 64.0 (TID 102, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7579 bytes) taskResourceAssignments Map() 10:40:13.764 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 64.0 (TID 103, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7620 bytes) taskResourceAssignments Map() 10:40:13.764 Executor task launch worker for task 102 INFO Executor: Running task 0.0 in stage 64.0 (TID 102) 10:40:13.764 Executor task launch worker for task 103 INFO Executor: Running task 1.0 in stage 64.0 (TID 103) 10:40:13.969 Executor task launch worker for task 103 INFO Executor: Finished task 1.0 in stage 64.0 (TID 103). 2730 bytes result sent to driver 10:40:13.970 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 64.0 (TID 103) in 206 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:14.508 Executor task launch worker for task 102 INFO Executor: Finished task 0.0 in stage 64.0 (TID 102). 2730 bytes result sent to driver 10:40:14.509 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 64.0 (TID 102) in 744 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:14.509 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 64.0, whose tasks have all completed, from pool 10:40:14.509 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 64 (apply at OutcomeOf.scala:85) finished in 0.752 s 10:40:14.509 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:14.509 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:14.509 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 65) 10:40:14.509 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:14.510 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 65 (MapPartitionsRDD[171] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:14.512 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_74 stored as values in memory (estimated size 21.9 KiB, free 2.0 GiB) 10:40:14.597 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_74_piece0 stored as bytes in memory (estimated size 10.2 KiB, free 2.0 GiB) 10:40:14.597 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_74_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 10.2 KiB, free: 2.1 GiB) 10:40:14.598 dag-scheduler-event-loop INFO SparkContext: Created broadcast 74 from broadcast at DAGScheduler.scala:1293 10:40:14.598 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 65 (MapPartitionsRDD[171] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:14.598 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 65.0 with 4 tasks resource profile 0 10:40:14.599 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 65.0 (TID 104, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:14.600 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 65.0 (TID 105, amp-jenkins-worker-04.amp, executor driver, partition 1, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:14.600 Executor task launch worker for task 104 INFO Executor: Running task 0.0 in stage 65.0 (TID 104) 10:40:14.600 Executor task launch worker for task 105 INFO Executor: Running task 1.0 in stage 65.0 (TID 105) 10:40:14.604 Executor task launch worker for task 105 INFO ShuffleBlockFetcherIterator: Getting 2 (144.0 B) non-empty blocks including 2 (144.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:14.604 Executor task launch worker for task 104 INFO ShuffleBlockFetcherIterator: Getting 2 (144.0 B) non-empty blocks including 2 (144.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:14.604 Executor task launch worker for task 105 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:14.604 Executor task launch worker for task 104 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:14.636 Executor task launch worker for task 104 INFO Executor: Finished task 0.0 in stage 65.0 (TID 104). 3972 bytes result sent to driver 10:40:14.637 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 2.0 in stage 65.0 (TID 106, amp-jenkins-worker-04.amp, executor driver, partition 2, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:14.637 Executor task launch worker for task 106 INFO Executor: Running task 2.0 in stage 65.0 (TID 106) 10:40:14.637 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 65.0 (TID 104) in 38 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:14.641 Executor task launch worker for task 106 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:14.641 Executor task launch worker for task 106 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:14.643 Executor task launch worker for task 105 INFO Executor: Finished task 1.0 in stage 65.0 (TID 105). 3972 bytes result sent to driver 10:40:14.644 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 3.0 in stage 65.0 (TID 107, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:14.644 Executor task launch worker for task 107 INFO Executor: Running task 3.0 in stage 65.0 (TID 107) 10:40:14.645 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 65.0 (TID 105) in 46 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:14.645 Executor task launch worker for task 106 INFO Executor: Finished task 2.0 in stage 65.0 (TID 106). 3943 bytes result sent to driver 10:40:14.645 task-result-getter-3 INFO TaskSetManager: Finished task 2.0 in stage 65.0 (TID 106) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:14.862 Executor task launch worker for task 107 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:14.862 Executor task launch worker for task 107 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:14.865 Executor task launch worker for task 107 INFO Executor: Finished task 3.0 in stage 65.0 (TID 107). 3943 bytes result sent to driver 10:40:14.866 task-result-getter-0 INFO TaskSetManager: Finished task 3.0 in stage 65.0 (TID 107) in 222 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:14.866 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 65.0, whose tasks have all completed, from pool 10:40:14.866 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 65 (apply at OutcomeOf.scala:85) finished in 0.356 s 10:40:14.866 dag-scheduler-event-loop INFO DAGScheduler: Job 56 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:14.866 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 65: Stage finished 10:40:14.867 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 56 finished: apply at OutcomeOf.scala:85, took 1.111751 s 10:40:14.899 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:14.899 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:16.213 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_74_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 10.2 KiB, free: 2.1 GiB) 10:40:16.214 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_70_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 8.8 KiB, free: 2.1 GiB) 10:40:16.216 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_66_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 10.0 KiB, free: 2.1 GiB) 10:40:16.217 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_71_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.7 KiB, free: 2.1 GiB) 10:40:16.219 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_69_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 8.5 KiB, free: 2.1 GiB) 10:40:16.221 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_68_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 8.7 KiB, free: 2.1 GiB) 10:40:16.222 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_63_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 2.4 KiB, free: 2.1 GiB) 10:40:16.223 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_64_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 300.0 B, free: 2.1 GiB) 10:40:16.224 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_65_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 10.3 KiB, free: 2.1 GiB) 10:40:16.225 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_67_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 8.5 KiB, free: 2.1 GiB) 10:40:16.226 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_73_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 10.7 KiB, free: 2.1 GiB) 10:40:16.246 broadcast-exchange-2 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:16.246 dag-scheduler-event-loop INFO DAGScheduler: Got job 57 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 2 output partitions 10:40:16.246 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 66 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:16.247 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:16.247 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:16.247 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 66 (MapPartitionsRDD[174] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:16.248 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_75 stored as values in memory (estimated size 4.4 KiB, free 2.1 GiB) 10:40:16.251 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_75_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 2.1 GiB) 10:40:16.251 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_75_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 2.4 KiB, free: 2.1 GiB) 10:40:16.251 dag-scheduler-event-loop INFO SparkContext: Created broadcast 75 from broadcast at DAGScheduler.scala:1293 10:40:16.251 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 66 (MapPartitionsRDD[174] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0, 1)) 10:40:16.251 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 66.0 with 2 tasks resource profile 0 10:40:16.252 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 66.0 (TID 108, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7590 bytes) taskResourceAssignments Map() 10:40:16.252 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 66.0 (TID 109, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7590 bytes) taskResourceAssignments Map() 10:40:16.252 Executor task launch worker for task 108 INFO Executor: Running task 0.0 in stage 66.0 (TID 108) 10:40:16.252 Executor task launch worker for task 109 INFO Executor: Running task 1.0 in stage 66.0 (TID 109) 10:40:16.255 Executor task launch worker for task 109 INFO Executor: Finished task 1.0 in stage 66.0 (TID 109). 1322 bytes result sent to driver 10:40:16.255 Executor task launch worker for task 108 INFO Executor: Finished task 0.0 in stage 66.0 (TID 108). 1313 bytes result sent to driver 10:40:16.256 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 66.0 (TID 109) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:16.256 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 66.0 (TID 108) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:16.256 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 66.0, whose tasks have all completed, from pool 10:40:16.256 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 66 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.009 s 10:40:16.256 dag-scheduler-event-loop INFO DAGScheduler: Job 57 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:16.256 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 66: Stage finished 10:40:16.257 broadcast-exchange-2 INFO DAGScheduler: Job 57 finished: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266, took 0.010655 s 10:40:16.262 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 22.0273 ms 10:40:16.271 broadcast-exchange-2 INFO CodeGenerator: Code generated in 7.070134 ms 10:40:16.292 broadcast-exchange-2 INFO MemoryStore: Block broadcast_76 stored as values in memory (estimated size 64.0 MiB, free 2.0 GiB) 10:40:16.294 broadcast-exchange-2 INFO MemoryStore: Block broadcast_76_piece0 stored as bytes in memory (estimated size 287.0 B, free 2.0 GiB) 10:40:16.345 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_76_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 287.0 B, free: 2.1 GiB) 10:40:16.345 broadcast-exchange-2 INFO SparkContext: Created broadcast 76 from $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:16.365 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 15.344642 ms 10:40:16.386 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:16.387 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 177 (apply at OutcomeOf.scala:85) as input to shuffle 9 10:40:16.387 dag-scheduler-event-loop INFO DAGScheduler: Got job 58 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:16.387 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 68 (apply at OutcomeOf.scala:85) 10:40:16.387 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 67) 10:40:16.387 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 67) 10:40:16.388 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 67 (MapPartitionsRDD[177] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:16.389 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_77 stored as values in memory (estimated size 24.6 KiB, free 2.0 GiB) 10:40:16.391 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_77_piece0 stored as bytes in memory (estimated size 10.9 KiB, free 2.0 GiB) 10:40:16.391 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_77_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 10.9 KiB, free: 2.1 GiB) 10:40:16.392 dag-scheduler-event-loop INFO SparkContext: Created broadcast 77 from broadcast at DAGScheduler.scala:1293 10:40:16.392 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 67 (MapPartitionsRDD[177] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:16.392 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 67.0 with 2 tasks resource profile 0 10:40:16.393 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 67.0 (TID 110, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7579 bytes) taskResourceAssignments Map() 10:40:16.393 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 67.0 (TID 111, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7620 bytes) taskResourceAssignments Map() 10:40:16.393 Executor task launch worker for task 110 INFO Executor: Running task 0.0 in stage 67.0 (TID 110) 10:40:16.393 Executor task launch worker for task 111 INFO Executor: Running task 1.0 in stage 67.0 (TID 111) 10:40:16.412 Executor task launch worker for task 111 INFO CodeGenerator: Code generated in 11.434134 ms 10:40:16.418 Executor task launch worker for task 110 INFO Executor: Finished task 0.0 in stage 67.0 (TID 110). 2477 bytes result sent to driver 10:40:16.418 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 67.0 (TID 110) in 25 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:16.450 Executor task launch worker for task 111 INFO Executor: Finished task 1.0 in stage 67.0 (TID 111). 2606 bytes result sent to driver 10:40:16.450 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 67.0 (TID 111) in 57 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:16.450 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 67.0, whose tasks have all completed, from pool 10:40:16.451 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 67 (apply at OutcomeOf.scala:85) finished in 0.063 s 10:40:16.451 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:16.451 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:16.451 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 68) 10:40:16.451 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:16.451 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 68 (MapPartitionsRDD[180] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:16.454 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_78 stored as values in memory (estimated size 22.8 KiB, free 2.0 GiB) 10:40:16.456 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_78_piece0 stored as bytes in memory (estimated size 10.3 KiB, free 2.0 GiB) 10:40:16.456 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_78_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 10.3 KiB, free: 2.1 GiB) 10:40:16.457 dag-scheduler-event-loop INFO SparkContext: Created broadcast 78 from broadcast at DAGScheduler.scala:1293 10:40:16.457 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 68 (MapPartitionsRDD[180] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:16.457 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 68.0 with 4 tasks resource profile 0 10:40:16.458 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 2.0 in stage 68.0 (TID 112, amp-jenkins-worker-04.amp, executor driver, partition 2, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:16.458 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 68.0 (TID 113, amp-jenkins-worker-04.amp, executor driver, partition 3, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:16.458 Executor task launch worker for task 112 INFO Executor: Running task 2.0 in stage 68.0 (TID 112) 10:40:16.458 Executor task launch worker for task 113 INFO Executor: Running task 3.0 in stage 68.0 (TID 113) 10:40:16.463 Executor task launch worker for task 113 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:16.463 Executor task launch worker for task 112 INFO ShuffleBlockFetcherIterator: Getting 1 (60.0 B) non-empty blocks including 1 (60.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:16.463 Executor task launch worker for task 113 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:16.463 Executor task launch worker for task 112 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:16.486 Executor task launch worker for task 113 INFO Executor: Finished task 3.0 in stage 68.0 (TID 113). 3848 bytes result sent to driver 10:40:16.487 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 68.0 (TID 114, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:16.487 Executor task launch worker for task 114 INFO Executor: Running task 0.0 in stage 68.0 (TID 114) 10:40:16.487 task-result-getter-1 INFO TaskSetManager: Finished task 3.0 in stage 68.0 (TID 113) in 29 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:16.490 Executor task launch worker for task 114 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:16.490 Executor task launch worker for task 114 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:16.494 Executor task launch worker for task 114 INFO Executor: Finished task 0.0 in stage 68.0 (TID 114). 3819 bytes result sent to driver 10:40:16.495 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 68.0 (TID 115, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:16.496 Executor task launch worker for task 115 INFO Executor: Running task 1.0 in stage 68.0 (TID 115) 10:40:16.496 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 68.0 (TID 114) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:16.499 Executor task launch worker for task 115 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:16.499 Executor task launch worker for task 115 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:16.503 Executor task launch worker for task 115 INFO Executor: Finished task 1.0 in stage 68.0 (TID 115). 3819 bytes result sent to driver 10:40:16.504 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 68.0 (TID 115) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:16.516 Executor task launch worker for task 112 INFO Executor: Finished task 2.0 in stage 68.0 (TID 112). 3837 bytes result sent to driver 10:40:16.516 task-result-getter-0 INFO TaskSetManager: Finished task 2.0 in stage 68.0 (TID 112) in 58 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:16.516 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 68.0, whose tasks have all completed, from pool 10:40:16.517 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 68 (apply at OutcomeOf.scala:85) finished in 0.064 s 10:40:16.517 dag-scheduler-event-loop INFO DAGScheduler: Job 58 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:16.517 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 68: Stage finished 10:40:16.520 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 58 finished: apply at OutcomeOf.scala:85, took 0.131108 s 10:40:16.565 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:16.565 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:16.577 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:16.577 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:16.601 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:16.601 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:16.739 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:16.739 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:16.847 subquery-0 INFO CodeGenerator: Code generated in 10.146824 ms 10:40:16.847 broadcast-exchange-3 INFO CodeGenerator: Code generated in 12.404703 ms 10:40:16.886 broadcast-exchange-3 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:16.887 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 187 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) as input to shuffle 11 10:40:16.888 dag-scheduler-event-loop INFO DAGScheduler: Got job 59 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 4 output partitions 10:40:16.888 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 70 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:16.888 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 69) 10:40:16.888 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 69) 10:40:16.888 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 69 (MapPartitionsRDD[187] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:16.894 subquery-0 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:16.896 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_79 stored as values in memory (estimated size 15.0 KiB, free 2.0 GiB) 10:40:16.899 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_79_piece0 stored as bytes in memory (estimated size 7.3 KiB, free 2.0 GiB) 10:40:16.899 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_79_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 7.3 KiB, free: 2.1 GiB) 10:40:16.899 dag-scheduler-event-loop INFO SparkContext: Created broadcast 79 from broadcast at DAGScheduler.scala:1293 10:40:16.900 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 69 (MapPartitionsRDD[187] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0, 1)) 10:40:16.900 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 69.0 with 2 tasks resource profile 0 10:40:16.900 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 69.0 (TID 116, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7579 bytes) taskResourceAssignments Map() 10:40:16.900 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 188 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) as input to shuffle 10 10:40:16.901 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 69.0 (TID 117, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7620 bytes) taskResourceAssignments Map() 10:40:16.901 dag-scheduler-event-loop INFO DAGScheduler: Got job 60 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 1 output partitions 10:40:16.901 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 72 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:16.901 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 71) 10:40:16.901 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 71) 10:40:16.901 Executor task launch worker for task 117 INFO Executor: Running task 1.0 in stage 69.0 (TID 117) 10:40:16.901 Executor task launch worker for task 116 INFO Executor: Running task 0.0 in stage 69.0 (TID 116) 10:40:16.901 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 71 (MapPartitionsRDD[188] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:16.905 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_80 stored as values in memory (estimated size 11.9 KiB, free 2.0 GiB) 10:40:16.907 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_80_piece0 stored as bytes in memory (estimated size 6.0 KiB, free 2.0 GiB) 10:40:16.909 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_80_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 6.0 KiB, free: 2.1 GiB) 10:40:16.910 dag-scheduler-event-loop INFO SparkContext: Created broadcast 80 from broadcast at DAGScheduler.scala:1293 10:40:16.910 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 71 (MapPartitionsRDD[188] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0, 1)) 10:40:16.911 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 71.0 with 2 tasks resource profile 0 10:40:16.919 Executor task launch worker for task 116 INFO CodeGenerator: Code generated in 7.872609 ms 10:40:16.949 Executor task launch worker for task 116 INFO CodeGenerator: Code generated in 27.1249 ms 10:40:17.000 Executor task launch worker for task 117 INFO CodeGenerator: Code generated in 6.387768 ms 10:40:17.018 Executor task launch worker for task 117 INFO CodeGenerator: Code generated in 6.951345 ms 10:40:17.027 Executor task launch worker for task 117 INFO CodeGenerator: Code generated in 5.90677 ms 10:40:17.037 Executor task launch worker for task 117 INFO CodeGenerator: Code generated in 7.2601 ms 10:40:17.059 Executor task launch worker for task 116 INFO CodeGenerator: Code generated in 13.694315 ms 10:40:17.081 Executor task launch worker for task 116 INFO Executor: Finished task 0.0 in stage 69.0 (TID 116). 2082 bytes result sent to driver 10:40:17.081 Executor task launch worker for task 117 INFO Executor: Finished task 1.0 in stage 69.0 (TID 117). 2082 bytes result sent to driver 10:40:17.082 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 71.0 (TID 118, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7579 bytes) taskResourceAssignments Map() 10:40:17.082 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 69.0 (TID 116) in 182 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:17.082 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 71.0 (TID 119, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7620 bytes) taskResourceAssignments Map() 10:40:17.083 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 69.0 (TID 117) in 183 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:17.083 Executor task launch worker for task 118 INFO Executor: Running task 0.0 in stage 71.0 (TID 118) 10:40:17.083 Executor task launch worker for task 119 INFO Executor: Running task 1.0 in stage 71.0 (TID 119) 10:40:17.083 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 69.0, whose tasks have all completed, from pool 10:40:17.083 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 69 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.188 s 10:40:17.083 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:17.083 dag-scheduler-event-loop INFO DAGScheduler: running: Set(ShuffleMapStage 71) 10:40:17.083 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 70, ResultStage 72) 10:40:17.083 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:17.083 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 70 (MapPartitionsRDD[195] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:17.087 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_81 stored as values in memory (estimated size 16.5 KiB, free 2.0 GiB) 10:40:17.090 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_81_piece0 stored as bytes in memory (estimated size 7.9 KiB, free 2.0 GiB) 10:40:17.090 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_81_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 7.9 KiB, free: 2.1 GiB) 10:40:17.091 dag-scheduler-event-loop INFO SparkContext: Created broadcast 81 from broadcast at DAGScheduler.scala:1293 10:40:17.092 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 70 (MapPartitionsRDD[195] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:17.092 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 70.0 with 4 tasks resource profile 0 10:40:17.093 Executor task launch worker for task 119 INFO Executor: Finished task 1.0 in stage 71.0 (TID 119). 1764 bytes result sent to driver 10:40:17.094 Executor task launch worker for task 118 INFO Executor: Finished task 0.0 in stage 71.0 (TID 118). 1764 bytes result sent to driver 10:40:17.094 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 70.0 (TID 120, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:17.094 Executor task launch worker for task 120 INFO Executor: Running task 0.0 in stage 70.0 (TID 120) 10:40:17.094 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 71.0 (TID 119) in 12 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:17.095 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 70.0 (TID 121, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:17.095 Executor task launch worker for task 121 INFO Executor: Running task 1.0 in stage 70.0 (TID 121) 10:40:17.095 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 71.0 (TID 118) in 14 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:17.095 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 71.0, whose tasks have all completed, from pool 10:40:17.096 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 71 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.192 s 10:40:17.096 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:17.096 dag-scheduler-event-loop INFO DAGScheduler: running: Set(ResultStage 70) 10:40:17.096 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 72) 10:40:17.096 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:17.096 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 72 (MapPartitionsRDD[192] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:17.098 Executor task launch worker for task 121 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:17.099 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_82 stored as values in memory (estimated size 11.5 KiB, free 2.0 GiB) 10:40:17.098 Executor task launch worker for task 120 INFO ShuffleBlockFetcherIterator: Getting 2 (177.0 B) non-empty blocks including 2 (177.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:17.100 Executor task launch worker for task 121 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms 10:40:17.100 Executor task launch worker for task 120 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms 10:40:17.102 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_82_piece0 stored as bytes in memory (estimated size 5.7 KiB, free 2.0 GiB) 10:40:17.103 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_82_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.7 KiB, free: 2.1 GiB) 10:40:17.103 dag-scheduler-event-loop INFO SparkContext: Created broadcast 82 from broadcast at DAGScheduler.scala:1293 10:40:17.104 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 72 (MapPartitionsRDD[192] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0)) 10:40:17.104 Executor task launch worker for task 121 INFO Executor: Finished task 1.0 in stage 70.0 (TID 121). 3233 bytes result sent to driver 10:40:17.104 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 72.0 with 1 tasks resource profile 0 10:40:17.105 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 2.0 in stage 70.0 (TID 122, amp-jenkins-worker-04.amp, executor driver, partition 2, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:17.105 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 70.0 (TID 121) in 10 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:17.105 Executor task launch worker for task 122 INFO Executor: Running task 2.0 in stage 70.0 (TID 122) 10:40:17.109 Executor task launch worker for task 122 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:17.109 Executor task launch worker for task 122 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:17.112 Executor task launch worker for task 122 INFO Executor: Finished task 2.0 in stage 70.0 (TID 122). 3233 bytes result sent to driver 10:40:17.113 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 70.0 (TID 123, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:17.113 Executor task launch worker for task 123 INFO Executor: Running task 3.0 in stage 70.0 (TID 123) 10:40:17.113 task-result-getter-2 INFO TaskSetManager: Finished task 2.0 in stage 70.0 (TID 122) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:17.117 Executor task launch worker for task 123 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:17.117 Executor task launch worker for task 123 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:17.120 Executor task launch worker for task 123 INFO Executor: Finished task 3.0 in stage 70.0 (TID 123). 3233 bytes result sent to driver 10:40:17.121 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 72.0 (TID 124, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:17.122 task-result-getter-3 INFO TaskSetManager: Finished task 3.0 in stage 70.0 (TID 123) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:17.122 Executor task launch worker for task 124 INFO Executor: Running task 0.0 in stage 72.0 (TID 124) 10:40:17.123 Executor task launch worker for task 120 INFO CodeGenerator: Code generated in 8.249326 ms 10:40:17.125 Executor task launch worker for task 124 INFO ShuffleBlockFetcherIterator: Getting 2 (144.0 B) non-empty blocks including 2 (144.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:17.125 Executor task launch worker for task 124 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:17.140 Executor task launch worker for task 124 INFO CodeGenerator: Code generated in 7.47556 ms 10:40:17.145 Executor task launch worker for task 124 INFO Executor: Finished task 0.0 in stage 72.0 (TID 124). 2696 bytes result sent to driver 10:40:17.146 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 72.0 (TID 124) in 25 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:17.146 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 72.0, whose tasks have all completed, from pool 10:40:17.146 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 72 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.049 s 10:40:17.147 dag-scheduler-event-loop INFO DAGScheduler: Job 60 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:17.147 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 72: Stage finished 10:40:17.147 subquery-0 INFO DAGScheduler: Job 60 finished: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266, took 0.253072 s 10:40:17.149 Executor task launch worker for task 120 INFO CodeGenerator: Code generated in 6.61049 ms 10:40:17.162 Executor task launch worker for task 120 INFO Executor: Finished task 0.0 in stage 70.0 (TID 120). 3277 bytes result sent to driver 10:40:17.162 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 70.0 (TID 120) in 68 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:17.162 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 70.0, whose tasks have all completed, from pool 10:40:17.163 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 70 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.078 s 10:40:17.163 dag-scheduler-event-loop INFO DAGScheduler: Job 59 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:17.163 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 70: Stage finished 10:40:17.164 broadcast-exchange-3 INFO DAGScheduler: Job 59 finished: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266, took 0.276950 s 10:40:17.169 broadcast-exchange-4 INFO CodeGenerator: Code generated in 7.783095 ms 10:40:17.173 broadcast-exchange-3 INFO CodeGenerator: Code generated in 6.615578 ms 10:40:17.173 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 12.998295 ms 10:40:17.182 broadcast-exchange-4 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:17.183 dag-scheduler-event-loop INFO DAGScheduler: Got job 61 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 2 output partitions 10:40:17.183 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 73 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:17.183 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:17.183 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:17.184 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 73 (MapPartitionsRDD[198] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:17.186 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_83 stored as values in memory (estimated size 6.9 KiB, free 2.0 GiB) 10:40:17.187 broadcast-exchange-3 INFO MemoryStore: Block broadcast_84 stored as values in memory (estimated size 64.0 MiB, free 1992.2 MiB) 10:40:17.188 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_83_piece0 stored as bytes in memory (estimated size 3.5 KiB, free 1992.2 MiB) 10:40:17.188 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_83_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.5 KiB, free: 2.1 GiB) 10:40:17.189 dag-scheduler-event-loop INFO SparkContext: Created broadcast 83 from broadcast at DAGScheduler.scala:1293 10:40:17.189 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 73 (MapPartitionsRDD[198] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0, 1)) 10:40:17.189 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 73.0 with 2 tasks resource profile 0 10:40:17.190 broadcast-exchange-3 INFO MemoryStore: Block broadcast_84_piece0 stored as bytes in memory (estimated size 217.0 B, free 1992.2 MiB) 10:40:17.190 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_84_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 217.0 B, free: 2.1 GiB) 10:40:17.190 broadcast-exchange-3 INFO SparkContext: Created broadcast 84 from $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:17.191 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 73.0 (TID 125, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7590 bytes) taskResourceAssignments Map() 10:40:17.191 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 73.0 (TID 126, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7590 bytes) taskResourceAssignments Map() 10:40:17.192 Executor task launch worker for task 126 INFO Executor: Running task 1.0 in stage 73.0 (TID 126) 10:40:17.192 Executor task launch worker for task 125 INFO Executor: Running task 0.0 in stage 73.0 (TID 125) 10:40:17.196 Executor task launch worker for task 125 INFO Executor: Finished task 0.0 in stage 73.0 (TID 125). 1474 bytes result sent to driver 10:40:17.196 Executor task launch worker for task 126 INFO Executor: Finished task 1.0 in stage 73.0 (TID 126). 1474 bytes result sent to driver 10:40:17.197 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 73.0 (TID 125) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:17.197 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 73.0 (TID 126) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:17.197 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 73.0, whose tasks have all completed, from pool 10:40:17.198 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 73 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.014 s 10:40:17.198 dag-scheduler-event-loop INFO DAGScheduler: Job 61 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:17.198 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 73: Stage finished 10:40:17.198 broadcast-exchange-4 INFO DAGScheduler: Job 61 finished: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266, took 0.016252 s 10:40:17.208 broadcast-exchange-4 INFO CodeGenerator: Code generated in 5.108603 ms 10:40:17.219 broadcast-exchange-4 INFO MemoryStore: Block broadcast_85 stored as values in memory (estimated size 64.0 MiB, free 1928.2 MiB) 10:40:17.221 broadcast-exchange-4 INFO MemoryStore: Block broadcast_85_piece0 stored as bytes in memory (estimated size 181.0 B, free 1928.2 MiB) 10:40:17.221 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_85_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 181.0 B, free: 2.1 GiB) 10:40:17.221 broadcast-exchange-4 INFO SparkContext: Created broadcast 85 from $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:17.241 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 14.820446 ms 10:40:17.266 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:17.267 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 201 (apply at OutcomeOf.scala:85) as input to shuffle 12 10:40:17.267 dag-scheduler-event-loop INFO DAGScheduler: Got job 62 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:17.267 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 75 (apply at OutcomeOf.scala:85) 10:40:17.267 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 74) 10:40:17.267 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 74) 10:40:17.267 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 74 (MapPartitionsRDD[201] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:17.270 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_86 stored as values in memory (estimated size 34.4 KiB, free 1928.2 MiB) 10:40:17.273 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_86_piece0 stored as bytes in memory (estimated size 15.1 KiB, free 1928.2 MiB) 10:40:17.273 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_86_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 15.1 KiB, free: 2.1 GiB) 10:40:17.274 dag-scheduler-event-loop INFO SparkContext: Created broadcast 86 from broadcast at DAGScheduler.scala:1293 10:40:17.274 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 74 (MapPartitionsRDD[201] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:17.274 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 74.0 with 2 tasks resource profile 0 10:40:17.275 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 74.0 (TID 127, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7579 bytes) taskResourceAssignments Map() 10:40:17.276 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 74.0 (TID 128, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7579 bytes) taskResourceAssignments Map() 10:40:17.277 Executor task launch worker for task 128 INFO Executor: Running task 1.0 in stage 74.0 (TID 128) 10:40:17.277 Executor task launch worker for task 127 INFO Executor: Running task 0.0 in stage 74.0 (TID 127) 10:40:17.350 Executor task launch worker for task 127 INFO Executor: Finished task 0.0 in stage 74.0 (TID 127). 5571 bytes result sent to driver 10:40:17.350 Executor task launch worker for task 128 INFO Executor: Finished task 1.0 in stage 74.0 (TID 128). 5571 bytes result sent to driver 10:40:17.351 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 74.0 (TID 128) in 76 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:17.351 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 74.0 (TID 127) in 76 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:17.351 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 74.0, whose tasks have all completed, from pool 10:40:17.353 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 74 (apply at OutcomeOf.scala:85) finished in 0.085 s 10:40:17.353 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:17.353 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:17.353 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 75) 10:40:17.353 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:17.354 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 75 (MapPartitionsRDD[204] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:17.358 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_87 stored as values in memory (estimated size 30.4 KiB, free 1928.1 MiB) 10:40:17.361 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_87_piece0 stored as bytes in memory (estimated size 13.2 KiB, free 1928.1 MiB) 10:40:17.361 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_87_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 13.2 KiB, free: 2.1 GiB) 10:40:17.362 dag-scheduler-event-loop INFO SparkContext: Created broadcast 87 from broadcast at DAGScheduler.scala:1293 10:40:17.362 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 75 (MapPartitionsRDD[204] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:17.362 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 75.0 with 4 tasks resource profile 0 10:40:17.363 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 75.0 (TID 129, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:17.364 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 2.0 in stage 75.0 (TID 130, amp-jenkins-worker-04.amp, executor driver, partition 2, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:17.364 Executor task launch worker for task 130 INFO Executor: Running task 2.0 in stage 75.0 (TID 130) 10:40:17.364 Executor task launch worker for task 129 INFO Executor: Running task 0.0 in stage 75.0 (TID 129) 10:40:17.369 Executor task launch worker for task 130 INFO ShuffleBlockFetcherIterator: Getting 1 (60.0 B) non-empty blocks including 1 (60.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:17.369 Executor task launch worker for task 129 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:17.369 Executor task launch worker for task 130 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:17.369 Executor task launch worker for task 129 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:17.400 Executor task launch worker for task 129 INFO Executor: Finished task 0.0 in stage 75.0 (TID 129). 6704 bytes result sent to driver 10:40:17.401 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 75.0 (TID 131, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:17.401 Executor task launch worker for task 131 INFO Executor: Running task 1.0 in stage 75.0 (TID 131) 10:40:17.401 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 75.0 (TID 129) in 38 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:17.405 Executor task launch worker for task 131 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:17.405 Executor task launch worker for task 131 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:17.409 Executor task launch worker for task 131 INFO Executor: Finished task 1.0 in stage 75.0 (TID 131). 6678 bytes result sent to driver 10:40:17.410 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 75.0 (TID 132, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:17.410 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 75.0 (TID 131) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:17.410 Executor task launch worker for task 132 INFO Executor: Running task 3.0 in stage 75.0 (TID 132) 10:40:17.410 Executor task launch worker for task 130 INFO Executor: Finished task 2.0 in stage 75.0 (TID 130). 6689 bytes result sent to driver 10:40:17.411 task-result-getter-0 INFO TaskSetManager: Finished task 2.0 in stage 75.0 (TID 130) in 47 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:17.414 Executor task launch worker for task 132 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:17.414 Executor task launch worker for task 132 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:17.417 Executor task launch worker for task 132 INFO Executor: Finished task 3.0 in stage 75.0 (TID 132). 6678 bytes result sent to driver 10:40:17.417 task-result-getter-1 INFO TaskSetManager: Finished task 3.0 in stage 75.0 (TID 132) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:17.417 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 75.0, whose tasks have all completed, from pool 10:40:17.418 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 75 (apply at OutcomeOf.scala:85) finished in 0.063 s 10:40:17.418 dag-scheduler-event-loop INFO DAGScheduler: Job 62 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:17.418 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 75: Stage finished 10:40:17.418 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 62 finished: apply at OutcomeOf.scala:85, took 0.152617 s 10:40:17.466 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:17.466 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:17.478 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:17.478 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:17.508 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:17.509 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:17.741 broadcast-exchange-5 INFO CodeGenerator: Code generated in 13.088729 ms 10:40:17.747 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 16.614611 ms 10:40:17.752 broadcast-exchange-5 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:17.753 dag-scheduler-event-loop INFO DAGScheduler: Got job 63 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 2 output partitions 10:40:17.753 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 76 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:17.753 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:17.753 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:17.754 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 76 (MapPartitionsRDD[207] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:17.756 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_88 stored as values in memory (estimated size 6.8 KiB, free 1928.1 MiB) 10:40:17.758 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_88_piece0 stored as bytes in memory (estimated size 3.4 KiB, free 1928.1 MiB) 10:40:17.758 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_88_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.4 KiB, free: 2.1 GiB) 10:40:17.758 dag-scheduler-event-loop INFO SparkContext: Created broadcast 88 from broadcast at DAGScheduler.scala:1293 10:40:17.758 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 76 (MapPartitionsRDD[207] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0, 1)) 10:40:17.758 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 76.0 with 2 tasks resource profile 0 10:40:17.759 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 76.0 (TID 133, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7590 bytes) taskResourceAssignments Map() 10:40:17.760 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 76.0 (TID 134, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7590 bytes) taskResourceAssignments Map() 10:40:17.760 Executor task launch worker for task 133 INFO Executor: Running task 0.0 in stage 76.0 (TID 133) 10:40:17.760 Executor task launch worker for task 134 INFO Executor: Running task 1.0 in stage 76.0 (TID 134) 10:40:17.765 Executor task launch worker for task 134 INFO Executor: Finished task 1.0 in stage 76.0 (TID 134). 1477 bytes result sent to driver 10:40:17.766 Executor task launch worker for task 133 INFO Executor: Finished task 0.0 in stage 76.0 (TID 133). 1490 bytes result sent to driver 10:40:17.766 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 76.0 (TID 134) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:17.766 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 76.0 (TID 133) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:17.766 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 76.0, whose tasks have all completed, from pool 10:40:17.766 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 76 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.012 s 10:40:17.767 dag-scheduler-event-loop INFO DAGScheduler: Job 63 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:17.767 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 76: Stage finished 10:40:17.767 broadcast-exchange-5 INFO DAGScheduler: Job 63 finished: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266, took 0.014470 s 10:40:17.780 broadcast-exchange-5 INFO MemoryStore: Block broadcast_89 stored as values in memory (estimated size 64.0 MiB, free 1864.1 MiB) 10:40:17.782 broadcast-exchange-5 INFO MemoryStore: Block broadcast_89_piece0 stored as bytes in memory (estimated size 230.0 B, free 1864.1 MiB) 10:40:17.782 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_89_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 230.0 B, free: 2.1 GiB) 10:40:17.783 broadcast-exchange-5 INFO SparkContext: Created broadcast 89 from $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:17.801 broadcast-exchange-6 INFO CodeGenerator: Code generated in 15.83862 ms 10:40:17.867 broadcast-exchange-6 INFO CodeGenerator: Code generated in 46.243753 ms 10:40:17.890 broadcast-exchange-6 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:17.891 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 210 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) as input to shuffle 13 10:40:17.891 dag-scheduler-event-loop INFO DAGScheduler: Got job 64 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 4 output partitions 10:40:17.891 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 78 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:17.891 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 77) 10:40:17.891 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 77) 10:40:17.892 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 77 (MapPartitionsRDD[210] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:17.894 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_90 stored as values in memory (estimated size 23.0 KiB, free 1864.1 MiB) 10:40:17.897 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_90_piece0 stored as bytes in memory (estimated size 10.6 KiB, free 1864.1 MiB) 10:40:17.897 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_90_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 10.6 KiB, free: 2.1 GiB) 10:40:17.897 dag-scheduler-event-loop INFO SparkContext: Created broadcast 90 from broadcast at DAGScheduler.scala:1293 10:40:17.898 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 77 (MapPartitionsRDD[210] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0, 1)) 10:40:17.898 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 77.0 with 2 tasks resource profile 0 10:40:17.899 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 77.0 (TID 135, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7579 bytes) taskResourceAssignments Map() 10:40:17.899 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 77.0 (TID 136, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7620 bytes) taskResourceAssignments Map() 10:40:17.899 Executor task launch worker for task 135 INFO Executor: Running task 0.0 in stage 77.0 (TID 135) 10:40:17.899 Executor task launch worker for task 136 INFO Executor: Running task 1.0 in stage 77.0 (TID 136) 10:40:17.916 Executor task launch worker for task 135 INFO CodeGenerator: Code generated in 6.701043 ms 10:40:19.851 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_82_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.7 KiB, free: 2.1 GiB) 10:40:19.852 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_86_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 15.1 KiB, free: 2.1 GiB) 10:40:19.853 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_85_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 181.0 B, free: 2.1 GiB) 10:40:19.853 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_84_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 217.0 B, free: 2.1 GiB) 10:40:19.854 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_79_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 7.3 KiB, free: 2.1 GiB) 10:40:19.855 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_76_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 287.0 B, free: 2.1 GiB) 10:40:19.856 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_83_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.5 KiB, free: 2.1 GiB) 10:40:19.857 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_72_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 202.0 B, free: 2.1 GiB) 10:40:19.858 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_80_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 6.0 KiB, free: 2.1 GiB) 10:40:19.859 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_75_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 2.4 KiB, free: 2.1 GiB) 10:40:19.861 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_81_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 7.9 KiB, free: 2.1 GiB) 10:40:19.863 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_78_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 10.3 KiB, free: 2.1 GiB) 10:40:19.864 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_77_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 10.9 KiB, free: 2.1 GiB) 10:40:19.865 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_87_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 13.2 KiB, free: 2.1 GiB) 10:40:19.866 Executor task launch worker for task 136 INFO Executor: Finished task 1.0 in stage 77.0 (TID 136). 2238 bytes result sent to driver 10:40:19.866 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_88_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.4 KiB, free: 2.1 GiB) 10:40:19.866 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 77.0 (TID 136) in 1967 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:19.889 Executor task launch worker for task 135 INFO Executor: Finished task 0.0 in stage 77.0 (TID 135). 2238 bytes result sent to driver 10:40:19.890 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 77.0 (TID 135) in 1990 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:19.890 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 77.0, whose tasks have all completed, from pool 10:40:19.890 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 77 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 1.998 s 10:40:19.890 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:19.890 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:19.891 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 78) 10:40:19.891 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:19.891 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 78 (MapPartitionsRDD[213] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:19.894 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_91 stored as values in memory (estimated size 27.1 KiB, free 2.1 GiB) 10:40:19.896 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_91_piece0 stored as bytes in memory (estimated size 12.2 KiB, free 2.1 GiB) 10:40:19.897 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_91_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 12.2 KiB, free: 2.1 GiB) 10:40:19.897 dag-scheduler-event-loop INFO SparkContext: Created broadcast 91 from broadcast at DAGScheduler.scala:1293 10:40:19.897 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 78 (MapPartitionsRDD[213] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:19.898 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 78.0 with 4 tasks resource profile 0 10:40:19.899 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 78.0 (TID 137, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:19.899 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 78.0 (TID 138, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:19.899 Executor task launch worker for task 137 INFO Executor: Running task 0.0 in stage 78.0 (TID 137) 10:40:19.899 Executor task launch worker for task 138 INFO Executor: Running task 1.0 in stage 78.0 (TID 138) 10:40:19.903 Executor task launch worker for task 138 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:19.904 Executor task launch worker for task 137 INFO ShuffleBlockFetcherIterator: Getting 2 (160.0 B) non-empty blocks including 2 (160.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:19.904 Executor task launch worker for task 138 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:19.904 Executor task launch worker for task 137 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:19.910 Executor task launch worker for task 138 INFO Executor: Finished task 1.0 in stage 78.0 (TID 138). 4005 bytes result sent to driver 10:40:19.911 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 2.0 in stage 78.0 (TID 139, amp-jenkins-worker-04.amp, executor driver, partition 2, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:19.911 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 78.0 (TID 138) in 12 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:19.911 Executor task launch worker for task 139 INFO Executor: Running task 2.0 in stage 78.0 (TID 139) 10:40:19.915 Executor task launch worker for task 139 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:19.915 Executor task launch worker for task 139 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:19.919 Executor task launch worker for task 139 INFO Executor: Finished task 2.0 in stage 78.0 (TID 139). 4005 bytes result sent to driver 10:40:19.920 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 78.0 (TID 140, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:19.920 task-result-getter-3 INFO TaskSetManager: Finished task 2.0 in stage 78.0 (TID 139) in 10 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:19.920 Executor task launch worker for task 140 INFO Executor: Running task 3.0 in stage 78.0 (TID 140) 10:40:19.925 Executor task launch worker for task 140 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:19.925 Executor task launch worker for task 140 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:19.928 Executor task launch worker for task 137 INFO Executor: Finished task 0.0 in stage 78.0 (TID 137). 4031 bytes result sent to driver 10:40:19.929 Executor task launch worker for task 140 INFO Executor: Finished task 3.0 in stage 78.0 (TID 140). 4005 bytes result sent to driver 10:40:19.929 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 78.0 (TID 137) in 31 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:19.929 task-result-getter-1 INFO TaskSetManager: Finished task 3.0 in stage 78.0 (TID 140) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:19.929 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 78.0, whose tasks have all completed, from pool 10:40:19.930 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 78 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.038 s 10:40:19.930 dag-scheduler-event-loop INFO DAGScheduler: Job 64 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:19.930 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 78: Stage finished 10:40:19.930 broadcast-exchange-6 INFO DAGScheduler: Job 64 finished: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266, took 2.040510 s 10:40:19.941 broadcast-exchange-6 INFO CodeGenerator: Code generated in 7.109101 ms 10:40:19.954 broadcast-exchange-6 INFO MemoryStore: Block broadcast_92 stored as values in memory (estimated size 64.0 MiB, free 2.0 GiB) 10:40:19.956 broadcast-exchange-6 INFO MemoryStore: Block broadcast_92_piece0 stored as bytes in memory (estimated size 177.0 B, free 2.0 GiB) 10:40:19.956 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_92_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 177.0 B, free: 2.1 GiB) 10:40:19.956 broadcast-exchange-6 INFO SparkContext: Created broadcast 92 from $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:19.966 broadcast-exchange-7 INFO CodeGenerator: Code generated in 7.535279 ms 10:40:19.974 broadcast-exchange-7 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:19.975 dag-scheduler-event-loop INFO DAGScheduler: Got job 65 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 2 output partitions 10:40:19.975 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 79 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:19.975 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:19.975 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:19.976 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 79 (MapPartitionsRDD[216] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:19.977 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_93 stored as values in memory (estimated size 9.2 KiB, free 2.0 GiB) 10:40:19.980 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_93_piece0 stored as bytes in memory (estimated size 4.4 KiB, free 2.0 GiB) 10:40:19.981 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_93_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 4.4 KiB, free: 2.1 GiB) 10:40:19.981 dag-scheduler-event-loop INFO SparkContext: Created broadcast 93 from broadcast at DAGScheduler.scala:1293 10:40:19.981 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 79 (MapPartitionsRDD[216] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0, 1)) 10:40:19.981 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 79.0 with 2 tasks resource profile 0 10:40:19.983 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 79.0 (TID 141, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7590 bytes) taskResourceAssignments Map() 10:40:19.983 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 79.0 (TID 142, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7590 bytes) taskResourceAssignments Map() 10:40:19.983 Executor task launch worker for task 142 INFO Executor: Running task 1.0 in stage 79.0 (TID 142) 10:40:19.983 Executor task launch worker for task 141 INFO Executor: Running task 0.0 in stage 79.0 (TID 141) 10:40:19.989 Executor task launch worker for task 142 INFO Executor: Finished task 1.0 in stage 79.0 (TID 142). 1582 bytes result sent to driver 10:40:19.989 Executor task launch worker for task 141 INFO Executor: Finished task 0.0 in stage 79.0 (TID 141). 1582 bytes result sent to driver 10:40:19.989 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 79.0 (TID 142) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:19.989 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 79.0 (TID 141) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:19.989 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 79.0, whose tasks have all completed, from pool 10:40:19.990 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 79 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.014 s 10:40:19.991 dag-scheduler-event-loop INFO DAGScheduler: Job 65 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:19.991 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 79: Stage finished 10:40:19.991 broadcast-exchange-7 INFO DAGScheduler: Job 65 finished: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266, took 0.016379 s 10:40:20.004 broadcast-exchange-7 INFO MemoryStore: Block broadcast_94 stored as values in memory (estimated size 64.0 MiB, free 1992.3 MiB) 10:40:20.005 broadcast-exchange-7 INFO MemoryStore: Block broadcast_94_piece0 stored as bytes in memory (estimated size 212.0 B, free 1992.3 MiB) 10:40:20.006 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_94_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 212.0 B, free: 2.1 GiB) 10:40:20.017 broadcast-exchange-7 INFO SparkContext: Created broadcast 94 from $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:20.059 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 27.644525 ms 10:40:20.114 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 44.584706 ms 10:40:20.155 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:20.156 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 219 (apply at OutcomeOf.scala:85) as input to shuffle 14 10:40:20.156 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 222 (apply at OutcomeOf.scala:85) as input to shuffle 15 10:40:20.157 dag-scheduler-event-loop INFO DAGScheduler: Got job 66 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:20.157 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 82 (apply at OutcomeOf.scala:85) 10:40:20.157 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 81) 10:40:20.157 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 81) 10:40:20.157 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 80 (MapPartitionsRDD[219] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:20.160 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_95 stored as values in memory (estimated size 23.0 KiB, free 1992.3 MiB) 10:40:20.163 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_95_piece0 stored as bytes in memory (estimated size 10.6 KiB, free 1992.3 MiB) 10:40:20.164 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_95_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 10.6 KiB, free: 2.1 GiB) 10:40:20.165 dag-scheduler-event-loop INFO SparkContext: Created broadcast 95 from broadcast at DAGScheduler.scala:1293 10:40:20.166 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 80 (MapPartitionsRDD[219] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:20.166 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 80.0 with 2 tasks resource profile 0 10:40:20.167 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 80.0 (TID 143, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7579 bytes) taskResourceAssignments Map() 10:40:20.167 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 80.0 (TID 144, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7620 bytes) taskResourceAssignments Map() 10:40:20.168 Executor task launch worker for task 143 INFO Executor: Running task 0.0 in stage 80.0 (TID 143) 10:40:20.168 Executor task launch worker for task 144 INFO Executor: Running task 1.0 in stage 80.0 (TID 144) 10:40:20.221 Executor task launch worker for task 143 INFO Executor: Finished task 0.0 in stage 80.0 (TID 143). 2195 bytes result sent to driver 10:40:20.222 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 80.0 (TID 143) in 55 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:20.227 Executor task launch worker for task 144 INFO Executor: Finished task 1.0 in stage 80.0 (TID 144). 2195 bytes result sent to driver 10:40:20.228 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 80.0 (TID 144) in 61 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:20.228 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 80.0, whose tasks have all completed, from pool 10:40:20.229 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 80 (apply at OutcomeOf.scala:85) finished in 0.071 s 10:40:20.229 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:20.229 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:20.229 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ShuffleMapStage 81, ResultStage 82) 10:40:20.229 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:20.229 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 81 (MapPartitionsRDD[222] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:20.234 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_96 stored as values in memory (estimated size 38.6 KiB, free 1992.2 MiB) 10:40:20.236 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_96_piece0 stored as bytes in memory (estimated size 16.8 KiB, free 1992.2 MiB) 10:40:20.237 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_96_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 16.8 KiB, free: 2.1 GiB) 10:40:20.237 dag-scheduler-event-loop INFO SparkContext: Created broadcast 96 from broadcast at DAGScheduler.scala:1293 10:40:20.238 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ShuffleMapStage 81 (MapPartitionsRDD[222] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:20.238 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 81.0 with 4 tasks resource profile 0 10:40:20.239 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 81.0 (TID 145, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7314 bytes) taskResourceAssignments Map() 10:40:20.240 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 81.0 (TID 146, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7314 bytes) taskResourceAssignments Map() 10:40:20.240 Executor task launch worker for task 145 INFO Executor: Running task 0.0 in stage 81.0 (TID 145) 10:40:20.240 Executor task launch worker for task 146 INFO Executor: Running task 1.0 in stage 81.0 (TID 146) 10:40:20.246 Executor task launch worker for task 146 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:20.246 Executor task launch worker for task 145 INFO ShuffleBlockFetcherIterator: Getting 2 (160.0 B) non-empty blocks including 2 (160.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:20.246 Executor task launch worker for task 146 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:20.246 Executor task launch worker for task 145 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:20.261 Executor task launch worker for task 146 INFO CodeGenerator: Code generated in 11.591438 ms 10:40:20.267 Executor task launch worker for task 146 INFO Executor: Finished task 1.0 in stage 81.0 (TID 146). 6852 bytes result sent to driver 10:40:20.268 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 2.0 in stage 81.0 (TID 147, amp-jenkins-worker-04.amp, executor driver, partition 2, PROCESS_LOCAL, 7314 bytes) taskResourceAssignments Map() 10:40:20.268 Executor task launch worker for task 147 INFO Executor: Running task 2.0 in stage 81.0 (TID 147) 10:40:20.268 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 81.0 (TID 146) in 29 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:20.272 Executor task launch worker for task 147 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:20.273 Executor task launch worker for task 147 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:20.280 Executor task launch worker for task 147 INFO Executor: Finished task 2.0 in stage 81.0 (TID 147). 6852 bytes result sent to driver 10:40:20.280 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 81.0 (TID 148, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7314 bytes) taskResourceAssignments Map() 10:40:20.281 Executor task launch worker for task 148 INFO Executor: Running task 3.0 in stage 81.0 (TID 148) 10:40:20.281 task-result-getter-3 INFO TaskSetManager: Finished task 2.0 in stage 81.0 (TID 147) in 14 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:20.284 Executor task launch worker for task 148 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:20.285 Executor task launch worker for task 148 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:20.291 Executor task launch worker for task 148 INFO Executor: Finished task 3.0 in stage 81.0 (TID 148). 6852 bytes result sent to driver 10:40:20.292 task-result-getter-0 INFO TaskSetManager: Finished task 3.0 in stage 81.0 (TID 148) in 12 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:20.312 Executor task launch worker for task 145 INFO Executor: Finished task 0.0 in stage 81.0 (TID 145). 6981 bytes result sent to driver 10:40:20.312 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 81.0 (TID 145) in 73 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:20.313 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 81.0, whose tasks have all completed, from pool 10:40:20.313 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 81 (apply at OutcomeOf.scala:85) finished in 0.082 s 10:40:20.314 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:20.314 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:20.314 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 82) 10:40:20.314 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:20.314 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 82 (MapPartitionsRDD[225] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:20.317 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_97 stored as values in memory (estimated size 32.9 KiB, free 1992.2 MiB) 10:40:20.319 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_97_piece0 stored as bytes in memory (estimated size 14.4 KiB, free 1992.2 MiB) 10:40:20.319 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_97_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 14.4 KiB, free: 2.1 GiB) 10:40:20.320 dag-scheduler-event-loop INFO SparkContext: Created broadcast 97 from broadcast at DAGScheduler.scala:1293 10:40:20.320 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 82 (MapPartitionsRDD[225] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:20.320 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 82.0 with 4 tasks resource profile 0 10:40:20.321 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 82.0 (TID 149, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:20.321 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 82.0 (TID 150, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:20.322 Executor task launch worker for task 149 INFO Executor: Running task 0.0 in stage 82.0 (TID 149) 10:40:20.322 Executor task launch worker for task 150 INFO Executor: Running task 1.0 in stage 82.0 (TID 150) 10:40:20.327 Executor task launch worker for task 149 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:20.327 Executor task launch worker for task 149 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:20.329 Executor task launch worker for task 150 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:20.329 Executor task launch worker for task 150 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:20.333 Executor task launch worker for task 150 INFO Executor: Finished task 1.0 in stage 82.0 (TID 150). 7787 bytes result sent to driver 10:40:20.333 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 2.0 in stage 82.0 (TID 151, amp-jenkins-worker-04.amp, executor driver, partition 2, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:20.334 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 82.0 (TID 150) in 13 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:20.334 Executor task launch worker for task 151 INFO Executor: Running task 2.0 in stage 82.0 (TID 151) 10:40:20.337 Executor task launch worker for task 151 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:20.338 Executor task launch worker for task 151 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:20.341 Executor task launch worker for task 151 INFO Executor: Finished task 2.0 in stage 82.0 (TID 151). 7787 bytes result sent to driver 10:40:20.342 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 82.0 (TID 152, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:20.342 Executor task launch worker for task 152 INFO Executor: Running task 3.0 in stage 82.0 (TID 152) 10:40:20.342 task-result-getter-3 INFO TaskSetManager: Finished task 2.0 in stage 82.0 (TID 151) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:20.346 Executor task launch worker for task 152 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:20.346 Executor task launch worker for task 152 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:20.349 Executor task launch worker for task 152 INFO Executor: Finished task 3.0 in stage 82.0 (TID 152). 7787 bytes result sent to driver 10:40:20.350 task-result-getter-0 INFO TaskSetManager: Finished task 3.0 in stage 82.0 (TID 152) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:20.352 Executor task launch worker for task 149 INFO Executor: Finished task 0.0 in stage 82.0 (TID 149). 7813 bytes result sent to driver 10:40:20.353 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 82.0 (TID 149) in 32 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:20.353 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 82.0, whose tasks have all completed, from pool 10:40:20.353 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 82 (apply at OutcomeOf.scala:85) finished in 0.038 s 10:40:20.353 dag-scheduler-event-loop INFO DAGScheduler: Job 66 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:20.354 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 82: Stage finished 10:40:20.354 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 66 finished: apply at OutcomeOf.scala:85, took 0.198381 s 10:40:20.358 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== FINISHED o.a.s.sql.SQLQueryTestSuite: 'except.sql' ===== 10:40:20.383 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== TEST OUTPUT FOR o.a.s.sql.SQLQueryTestSuite: 'count.sql' ===== 10:40:20.399 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:20.399 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:20.466 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:20.467 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:20.558 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 9.856696 ms 10:40:20.579 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 10.652205 ms 10:40:20.586 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 6.090889 ms 10:40:20.601 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:20.601 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 228 (apply at OutcomeOf.scala:85) as input to shuffle 16 10:40:20.602 dag-scheduler-event-loop INFO DAGScheduler: Got job 67 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:20.602 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 84 (apply at OutcomeOf.scala:85) 10:40:20.602 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 83) 10:40:20.602 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 83) 10:40:20.602 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 83 (MapPartitionsRDD[228] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:20.605 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_98 stored as values in memory (estimated size 13.1 KiB, free 1992.1 MiB) 10:40:20.608 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_98_piece0 stored as bytes in memory (estimated size 6.3 KiB, free 1992.1 MiB) 10:40:20.608 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_98_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 6.3 KiB, free: 2.1 GiB) 10:40:20.608 dag-scheduler-event-loop INFO SparkContext: Created broadcast 98 from broadcast at DAGScheduler.scala:1293 10:40:20.609 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 83 (MapPartitionsRDD[228] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:20.609 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 83.0 with 2 tasks resource profile 0 10:40:20.610 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 83.0 (TID 153, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7604 bytes) taskResourceAssignments Map() 10:40:20.610 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 83.0 (TID 154, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7645 bytes) taskResourceAssignments Map() 10:40:20.610 Executor task launch worker for task 153 INFO Executor: Running task 0.0 in stage 83.0 (TID 153) 10:40:20.610 Executor task launch worker for task 154 INFO Executor: Running task 1.0 in stage 83.0 (TID 154) 10:40:20.619 Executor task launch worker for task 154 INFO Executor: Finished task 1.0 in stage 83.0 (TID 154). 1849 bytes result sent to driver 10:40:20.619 Executor task launch worker for task 153 INFO Executor: Finished task 0.0 in stage 83.0 (TID 153). 1849 bytes result sent to driver 10:40:20.620 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 83.0 (TID 154) in 10 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:20.620 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 83.0 (TID 153) in 10 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:20.620 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 83.0, whose tasks have all completed, from pool 10:40:20.621 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 83 (apply at OutcomeOf.scala:85) finished in 0.018 s 10:40:20.621 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:20.621 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:20.621 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 84) 10:40:20.621 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:20.621 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 84 (MapPartitionsRDD[231] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:20.623 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_99 stored as values in memory (estimated size 11.4 KiB, free 1992.1 MiB) 10:40:20.625 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_99_piece0 stored as bytes in memory (estimated size 5.4 KiB, free 1992.1 MiB) 10:40:20.626 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_99_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.4 KiB, free: 2.1 GiB) 10:40:20.626 dag-scheduler-event-loop INFO SparkContext: Created broadcast 99 from broadcast at DAGScheduler.scala:1293 10:40:20.626 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 84 (MapPartitionsRDD[231] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:20.626 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 84.0 with 1 tasks resource profile 0 10:40:20.627 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 84.0 (TID 155, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:20.628 Executor task launch worker for task 155 INFO Executor: Running task 0.0 in stage 84.0 (TID 155) 10:40:20.631 Executor task launch worker for task 155 INFO ShuffleBlockFetcherIterator: Getting 2 (138.0 B) non-empty blocks including 2 (138.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:20.631 Executor task launch worker for task 155 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:20.635 Executor task launch worker for task 155 INFO Executor: Finished task 0.0 in stage 84.0 (TID 155). 2662 bytes result sent to driver 10:40:20.636 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 84.0 (TID 155) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:20.636 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 84.0, whose tasks have all completed, from pool 10:40:20.636 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 84 (apply at OutcomeOf.scala:85) finished in 0.014 s 10:40:20.636 dag-scheduler-event-loop INFO DAGScheduler: Job 67 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:20.636 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 84: Stage finished 10:40:20.637 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 67 finished: apply at OutcomeOf.scala:85, took 0.035719 s 10:40:20.654 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:20.654 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:20.757 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 13.633684 ms 10:40:20.834 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 44.20901 ms 10:40:20.884 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 36.852692 ms 10:40:20.933 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:20.934 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 234 (apply at OutcomeOf.scala:85) as input to shuffle 17 10:40:20.934 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 237 (apply at OutcomeOf.scala:85) as input to shuffle 18 10:40:20.934 dag-scheduler-event-loop INFO DAGScheduler: Got job 68 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:20.934 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 87 (apply at OutcomeOf.scala:85) 10:40:20.934 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 86) 10:40:20.934 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 86) 10:40:20.935 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 85 (MapPartitionsRDD[234] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:20.937 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_100 stored as values in memory (estimated size 26.0 KiB, free 1992.1 MiB) 10:40:20.939 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_100_piece0 stored as bytes in memory (estimated size 10.5 KiB, free 1992.1 MiB) 10:40:20.939 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_100_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 10.5 KiB, free: 2.1 GiB) 10:40:20.940 dag-scheduler-event-loop INFO SparkContext: Created broadcast 100 from broadcast at DAGScheduler.scala:1293 10:40:20.940 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 85 (MapPartitionsRDD[234] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:20.941 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 85.0 with 2 tasks resource profile 0 10:40:20.943 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 85.0 (TID 156, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7604 bytes) taskResourceAssignments Map() 10:40:20.943 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 85.0 (TID 157, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7645 bytes) taskResourceAssignments Map() 10:40:20.943 Executor task launch worker for task 156 INFO Executor: Running task 0.0 in stage 85.0 (TID 156) 10:40:20.943 Executor task launch worker for task 157 INFO Executor: Running task 1.0 in stage 85.0 (TID 157) 10:40:20.966 Executor task launch worker for task 157 INFO CodeGenerator: Code generated in 11.796241 ms 10:40:20.978 Executor task launch worker for task 157 INFO CodeGenerator: Code generated in 8.606461 ms 10:40:21.012 Executor task launch worker for task 156 INFO Executor: Finished task 0.0 in stage 85.0 (TID 156). 2195 bytes result sent to driver 10:40:21.012 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 85.0 (TID 156) in 70 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:21.022 Executor task launch worker for task 157 INFO Executor: Finished task 1.0 in stage 85.0 (TID 157). 2195 bytes result sent to driver 10:40:21.022 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 85.0 (TID 157) in 79 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:21.022 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 85.0, whose tasks have all completed, from pool 10:40:21.023 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 85 (apply at OutcomeOf.scala:85) finished in 0.088 s 10:40:21.023 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:21.023 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:21.023 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ShuffleMapStage 86, ResultStage 87) 10:40:21.023 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:21.023 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 86 (MapPartitionsRDD[237] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:21.027 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_101 stored as values in memory (estimated size 36.6 KiB, free 1992.0 MiB) 10:40:21.029 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_101_piece0 stored as bytes in memory (estimated size 15.5 KiB, free 1992.0 MiB) 10:40:21.029 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_101_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 15.5 KiB, free: 2.1 GiB) 10:40:21.030 dag-scheduler-event-loop INFO SparkContext: Created broadcast 101 from broadcast at DAGScheduler.scala:1293 10:40:21.030 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ShuffleMapStage 86 (MapPartitionsRDD[237] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:21.030 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 86.0 with 4 tasks resource profile 0 10:40:21.031 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 86.0 (TID 158, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7314 bytes) taskResourceAssignments Map() 10:40:21.031 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 86.0 (TID 159, amp-jenkins-worker-04.amp, executor driver, partition 1, NODE_LOCAL, 7314 bytes) taskResourceAssignments Map() 10:40:21.031 Executor task launch worker for task 158 INFO Executor: Running task 0.0 in stage 86.0 (TID 158) 10:40:21.031 Executor task launch worker for task 159 INFO Executor: Running task 1.0 in stage 86.0 (TID 159) 10:40:21.039 Executor task launch worker for task 158 INFO ShuffleBlockFetcherIterator: Getting 2 (169.0 B) non-empty blocks including 2 (169.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:21.039 Executor task launch worker for task 159 INFO ShuffleBlockFetcherIterator: Getting 2 (360.0 B) non-empty blocks including 2 (360.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:21.039 Executor task launch worker for task 159 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:21.039 Executor task launch worker for task 158 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:21.076 Executor task launch worker for task 159 INFO Executor: Finished task 1.0 in stage 86.0 (TID 159). 3963 bytes result sent to driver 10:40:21.077 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 2.0 in stage 86.0 (TID 160, amp-jenkins-worker-04.amp, executor driver, partition 2, NODE_LOCAL, 7314 bytes) taskResourceAssignments Map() 10:40:21.077 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 86.0 (TID 159) in 46 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:21.077 Executor task launch worker for task 160 INFO Executor: Running task 2.0 in stage 86.0 (TID 160) 10:40:21.083 Executor task launch worker for task 160 INFO ShuffleBlockFetcherIterator: Getting 2 (146.0 B) non-empty blocks including 2 (146.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:21.083 Executor task launch worker for task 160 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:21.085 Executor task launch worker for task 158 INFO Executor: Finished task 0.0 in stage 86.0 (TID 158). 3963 bytes result sent to driver 10:40:21.086 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 86.0 (TID 161, amp-jenkins-worker-04.amp, executor driver, partition 3, NODE_LOCAL, 7314 bytes) taskResourceAssignments Map() 10:40:21.086 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 86.0 (TID 158) in 55 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:21.086 Executor task launch worker for task 161 INFO Executor: Running task 3.0 in stage 86.0 (TID 161) 10:40:21.091 Executor task launch worker for task 161 INFO ShuffleBlockFetcherIterator: Getting 2 (183.0 B) non-empty blocks including 2 (183.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:21.091 Executor task launch worker for task 161 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:21.116 Executor task launch worker for task 160 INFO Executor: Finished task 2.0 in stage 86.0 (TID 160). 3963 bytes result sent to driver 10:40:21.117 task-result-getter-1 INFO TaskSetManager: Finished task 2.0 in stage 86.0 (TID 160) in 41 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:21.125 Executor task launch worker for task 161 INFO Executor: Finished task 3.0 in stage 86.0 (TID 161). 3963 bytes result sent to driver 10:40:21.125 task-result-getter-2 INFO TaskSetManager: Finished task 3.0 in stage 86.0 (TID 161) in 40 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:21.125 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 86.0, whose tasks have all completed, from pool 10:40:21.126 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 86 (apply at OutcomeOf.scala:85) finished in 0.101 s 10:40:21.126 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:21.126 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:21.126 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 87) 10:40:21.126 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:21.126 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 87 (MapPartitionsRDD[240] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:21.128 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_102 stored as values in memory (estimated size 12.0 KiB, free 1992.0 MiB) 10:40:21.130 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_102_piece0 stored as bytes in memory (estimated size 5.5 KiB, free 1992.0 MiB) 10:40:21.131 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_102_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.5 KiB, free: 2.1 GiB) 10:40:21.131 dag-scheduler-event-loop INFO SparkContext: Created broadcast 102 from broadcast at DAGScheduler.scala:1293 10:40:21.131 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 87 (MapPartitionsRDD[240] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:21.131 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 87.0 with 1 tasks resource profile 0 10:40:21.132 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 87.0 (TID 162, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:21.132 Executor task launch worker for task 162 INFO Executor: Running task 0.0 in stage 87.0 (TID 162) 10:40:21.135 Executor task launch worker for task 162 INFO ShuffleBlockFetcherIterator: Getting 4 (272.0 B) non-empty blocks including 4 (272.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:21.135 Executor task launch worker for task 162 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:21.139 Executor task launch worker for task 162 INFO Executor: Finished task 0.0 in stage 87.0 (TID 162). 2662 bytes result sent to driver 10:40:21.139 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 87.0 (TID 162) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:21.139 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 87.0, whose tasks have all completed, from pool 10:40:21.140 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 87 (apply at OutcomeOf.scala:85) finished in 0.013 s 10:40:21.140 dag-scheduler-event-loop INFO DAGScheduler: Job 68 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:21.140 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 87: Stage finished 10:40:21.140 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 68 finished: apply at OutcomeOf.scala:85, took 0.207208 s 10:40:21.161 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.161 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.218 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 14.574123 ms 10:40:21.347 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 48.967484 ms 10:40:21.412 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:21.431 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 243 (apply at OutcomeOf.scala:85) as input to shuffle 19 10:40:21.447 dag-scheduler-event-loop INFO DAGScheduler: Got job 69 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:21.447 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 89 (apply at OutcomeOf.scala:85) 10:40:21.447 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 88) 10:40:21.447 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 88) 10:40:21.447 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 88 (MapPartitionsRDD[243] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:21.449 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_103 stored as values in memory (estimated size 11.4 KiB, free 1992.0 MiB) 10:40:21.451 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_103_piece0 stored as bytes in memory (estimated size 5.8 KiB, free 1992.0 MiB) 10:40:21.451 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_103_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.8 KiB, free: 2.1 GiB) 10:40:21.451 dag-scheduler-event-loop INFO SparkContext: Created broadcast 103 from broadcast at DAGScheduler.scala:1293 10:40:21.451 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 88 (MapPartitionsRDD[243] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:21.451 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 88.0 with 2 tasks resource profile 0 10:40:21.452 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 88.0 (TID 163, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7604 bytes) taskResourceAssignments Map() 10:40:21.453 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 88.0 (TID 164, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7645 bytes) taskResourceAssignments Map() 10:40:21.453 Executor task launch worker for task 163 INFO Executor: Running task 0.0 in stage 88.0 (TID 163) 10:40:21.453 Executor task launch worker for task 164 INFO Executor: Running task 1.0 in stage 88.0 (TID 164) 10:40:21.461 Executor task launch worker for task 163 INFO Executor: Finished task 0.0 in stage 88.0 (TID 163). 1849 bytes result sent to driver 10:40:21.461 Executor task launch worker for task 164 INFO Executor: Finished task 1.0 in stage 88.0 (TID 164). 1849 bytes result sent to driver 10:40:21.462 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 88.0 (TID 163) in 10 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:21.462 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 88.0 (TID 164) in 10 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:21.462 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 88.0, whose tasks have all completed, from pool 10:40:21.462 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 88 (apply at OutcomeOf.scala:85) finished in 0.014 s 10:40:21.463 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:21.463 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:21.463 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 89) 10:40:21.463 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:21.463 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 89 (MapPartitionsRDD[246] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:21.465 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_104 stored as values in memory (estimated size 10.5 KiB, free 1992.0 MiB) 10:40:21.467 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_104_piece0 stored as bytes in memory (estimated size 5.2 KiB, free 1992.0 MiB) 10:40:21.467 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_104_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.2 KiB, free: 2.1 GiB) 10:40:21.467 dag-scheduler-event-loop INFO SparkContext: Created broadcast 104 from broadcast at DAGScheduler.scala:1293 10:40:21.468 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 89 (MapPartitionsRDD[246] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:21.468 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 89.0 with 1 tasks resource profile 0 10:40:21.469 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 89.0 (TID 165, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:21.469 Executor task launch worker for task 165 INFO Executor: Running task 0.0 in stage 89.0 (TID 165) 10:40:21.472 Executor task launch worker for task 165 INFO ShuffleBlockFetcherIterator: Getting 2 (120.0 B) non-empty blocks including 2 (120.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:21.472 Executor task launch worker for task 165 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:21.475 Executor task launch worker for task 165 INFO Executor: Finished task 0.0 in stage 89.0 (TID 165). 2646 bytes result sent to driver 10:40:21.476 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 89.0 (TID 165) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:21.476 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 89.0, whose tasks have all completed, from pool 10:40:21.477 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 89 (apply at OutcomeOf.scala:85) finished in 0.012 s 10:40:21.477 dag-scheduler-event-loop INFO DAGScheduler: Job 69 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:21.477 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 89: Stage finished 10:40:21.477 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 69 finished: apply at OutcomeOf.scala:85, took 0.064827 s 10:40:21.492 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.492 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.535 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 8.206817 ms 10:40:21.553 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 13.748054 ms 10:40:21.573 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 16.439401 ms 10:40:21.598 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:21.600 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 249 (apply at OutcomeOf.scala:85) as input to shuffle 20 10:40:21.600 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 252 (apply at OutcomeOf.scala:85) as input to shuffle 21 10:40:21.600 dag-scheduler-event-loop INFO DAGScheduler: Got job 70 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:21.600 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 92 (apply at OutcomeOf.scala:85) 10:40:21.600 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 91) 10:40:21.600 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 91) 10:40:21.601 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 90 (MapPartitionsRDD[249] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:21.603 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_105 stored as values in memory (estimated size 15.8 KiB, free 1992.0 MiB) 10:40:21.606 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_105_piece0 stored as bytes in memory (estimated size 7.6 KiB, free 1992.0 MiB) 10:40:21.606 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_105_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 7.6 KiB, free: 2.1 GiB) 10:40:21.607 dag-scheduler-event-loop INFO SparkContext: Created broadcast 105 from broadcast at DAGScheduler.scala:1293 10:40:21.607 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 90 (MapPartitionsRDD[249] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:21.607 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 90.0 with 2 tasks resource profile 0 10:40:21.609 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 90.0 (TID 166, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7604 bytes) taskResourceAssignments Map() 10:40:21.609 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 90.0 (TID 167, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7645 bytes) taskResourceAssignments Map() 10:40:21.609 Executor task launch worker for task 166 INFO Executor: Running task 0.0 in stage 90.0 (TID 166) 10:40:21.609 Executor task launch worker for task 167 INFO Executor: Running task 1.0 in stage 90.0 (TID 167) 10:40:21.644 Executor task launch worker for task 166 INFO CodeGenerator: Code generated in 21.714668 ms 10:40:21.690 Executor task launch worker for task 166 INFO Executor: Finished task 0.0 in stage 90.0 (TID 166). 2133 bytes result sent to driver 10:40:21.691 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 90.0 (TID 166) in 82 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:21.694 Executor task launch worker for task 167 INFO Executor: Finished task 1.0 in stage 90.0 (TID 167). 2133 bytes result sent to driver 10:40:21.695 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 90.0 (TID 167) in 86 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:21.695 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 90.0, whose tasks have all completed, from pool 10:40:21.695 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 90 (apply at OutcomeOf.scala:85) finished in 0.093 s 10:40:21.695 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:21.695 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:21.695 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ShuffleMapStage 91, ResultStage 92) 10:40:21.695 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:21.696 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 91 (MapPartitionsRDD[252] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:21.698 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_106 stored as values in memory (estimated size 24.0 KiB, free 1991.9 MiB) 10:40:21.700 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_106_piece0 stored as bytes in memory (estimated size 11.0 KiB, free 1991.9 MiB) 10:40:21.700 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_106_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 11.0 KiB, free: 2.1 GiB) 10:40:21.701 dag-scheduler-event-loop INFO SparkContext: Created broadcast 106 from broadcast at DAGScheduler.scala:1293 10:40:21.701 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ShuffleMapStage 91 (MapPartitionsRDD[252] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:21.701 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 91.0 with 4 tasks resource profile 0 10:40:21.702 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 91.0 (TID 168, amp-jenkins-worker-04.amp, executor driver, partition 1, NODE_LOCAL, 7314 bytes) taskResourceAssignments Map() 10:40:21.702 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 2.0 in stage 91.0 (TID 169, amp-jenkins-worker-04.amp, executor driver, partition 2, NODE_LOCAL, 7314 bytes) taskResourceAssignments Map() 10:40:21.702 Executor task launch worker for task 169 INFO Executor: Running task 2.0 in stage 91.0 (TID 169) 10:40:21.702 Executor task launch worker for task 168 INFO Executor: Running task 1.0 in stage 91.0 (TID 168) 10:40:21.707 Executor task launch worker for task 169 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:21.707 Executor task launch worker for task 169 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:21.707 Executor task launch worker for task 168 INFO ShuffleBlockFetcherIterator: Getting 1 (80.0 B) non-empty blocks including 1 (80.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:21.707 Executor task launch worker for task 168 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:21.760 Executor task launch worker for task 169 INFO Executor: Finished task 2.0 in stage 91.0 (TID 169). 3901 bytes result sent to driver 10:40:21.760 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 91.0 (TID 170, amp-jenkins-worker-04.amp, executor driver, partition 3, NODE_LOCAL, 7314 bytes) taskResourceAssignments Map() 10:40:21.761 task-result-getter-1 INFO TaskSetManager: Finished task 2.0 in stage 91.0 (TID 169) in 59 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:21.761 Executor task launch worker for task 170 INFO Executor: Running task 3.0 in stage 91.0 (TID 170) 10:40:21.766 Executor task launch worker for task 170 INFO ShuffleBlockFetcherIterator: Getting 2 (140.0 B) non-empty blocks including 2 (140.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:21.766 Executor task launch worker for task 170 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:21.772 Executor task launch worker for task 168 INFO Executor: Finished task 1.0 in stage 91.0 (TID 168). 3901 bytes result sent to driver 10:40:21.772 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 91.0 (TID 171, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7314 bytes) taskResourceAssignments Map() 10:40:21.773 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 91.0 (TID 168) in 71 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:21.773 Executor task launch worker for task 171 INFO Executor: Running task 0.0 in stage 91.0 (TID 171) 10:40:21.777 Executor task launch worker for task 171 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:21.777 Executor task launch worker for task 171 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:21.781 Executor task launch worker for task 171 INFO Executor: Finished task 0.0 in stage 91.0 (TID 171). 3901 bytes result sent to driver 10:40:21.781 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 91.0 (TID 171) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:21.794 Executor task launch worker for task 170 INFO Executor: Finished task 3.0 in stage 91.0 (TID 170). 3901 bytes result sent to driver 10:40:21.795 task-result-getter-0 INFO TaskSetManager: Finished task 3.0 in stage 91.0 (TID 170) in 35 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:21.795 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 91.0, whose tasks have all completed, from pool 10:40:21.796 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 91 (apply at OutcomeOf.scala:85) finished in 0.098 s 10:40:21.796 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:21.796 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:21.796 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 92) 10:40:21.796 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:21.796 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 92 (MapPartitionsRDD[255] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:21.798 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_107 stored as values in memory (estimated size 10.6 KiB, free 1991.9 MiB) 10:40:21.801 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_107_piece0 stored as bytes in memory (estimated size 5.2 KiB, free 1991.9 MiB) 10:40:21.801 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_107_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.2 KiB, free: 2.1 GiB) 10:40:21.801 dag-scheduler-event-loop INFO SparkContext: Created broadcast 107 from broadcast at DAGScheduler.scala:1293 10:40:21.802 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 92 (MapPartitionsRDD[255] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:21.802 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 92.0 with 1 tasks resource profile 0 10:40:21.803 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 92.0 (TID 172, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:21.803 Executor task launch worker for task 172 INFO Executor: Running task 0.0 in stage 92.0 (TID 172) 10:40:21.806 Executor task launch worker for task 172 INFO ShuffleBlockFetcherIterator: Getting 4 (240.0 B) non-empty blocks including 4 (240.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:21.806 Executor task launch worker for task 172 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:21.810 Executor task launch worker for task 172 INFO Executor: Finished task 0.0 in stage 92.0 (TID 172). 2646 bytes result sent to driver 10:40:21.811 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 92.0 (TID 172) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:21.811 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 92.0, whose tasks have all completed, from pool 10:40:21.811 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 92 (apply at OutcomeOf.scala:85) finished in 0.014 s 10:40:21.811 dag-scheduler-event-loop INFO DAGScheduler: Job 70 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:21.811 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 92: Stage finished 10:40:21.811 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 70 finished: apply at OutcomeOf.scala:85, took 0.212751 s 10:40:21.814 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== FINISHED o.a.s.sql.SQLQueryTestSuite: 'count.sql' ===== 10:40:21.835 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== TEST OUTPUT FOR o.a.s.sql.SQLQueryTestSuite: 'datetime-formatting-invalid.sql' ===== 10:40:21.849 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.849 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.867 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.867 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.879 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.879 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.883 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.884 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.893 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.893 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.897 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.897 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.902 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.902 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.911 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.911 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.916 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.916 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.920 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.920 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.930 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.930 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.934 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.934 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.947 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.947 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.951 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.951 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.961 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.961 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.966 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.966 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.976 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.976 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.980 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.980 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.990 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.990 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.994 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:21.994 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.004 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.004 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.008 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.008 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.019 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.019 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.025 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.025 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.036 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.036 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.040 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.040 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.052 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.052 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.056 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.056 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.065 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.065 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.069 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.069 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.079 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.079 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.083 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.083 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.095 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.095 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.099 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.099 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.109 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.109 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.114 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.114 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.123 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.123 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.127 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.127 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.137 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.137 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.141 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.141 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.145 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.145 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.154 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.154 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.158 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.159 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.171 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.171 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.176 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.177 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.183 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.183 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.200 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.201 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.208 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.208 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.224 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.225 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.232 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.232 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.239 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.239 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.255 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.255 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.262 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.262 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.268 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.269 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.283 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.283 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.292 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.292 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.301 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.301 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.319 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.319 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.325 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.326 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.332 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.332 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.347 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.347 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.355 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.355 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.362 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.362 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.379 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.379 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.387 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.387 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.394 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.394 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.409 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.409 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.415 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.415 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.424 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.424 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.428 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.428 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.438 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.438 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.442 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.442 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.452 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.452 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.456 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.456 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.465 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.465 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.469 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.469 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.473 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.473 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.485 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.485 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.489 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.489 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.492 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.493 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.502 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.502 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.506 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.506 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.510 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.510 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.519 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.519 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.523 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.523 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.527 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.527 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.537 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.537 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.541 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.541 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.544 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.544 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.557 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== FINISHED o.a.s.sql.SQLQueryTestSuite: 'datetime-formatting-invalid.sql' ===== 10:40:22.570 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== TEST OUTPUT FOR o.a.s.sql.SQLQueryTestSuite: 'query_regex_column.sql' ===== 10:40:22.579 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.579 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.594 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.594 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.612 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.612 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.956 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.960 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.978 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:22.978 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:23.427 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 8.917234 ms 10:40:23.435 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 7.155091 ms 10:40:23.448 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:23.448 dag-scheduler-event-loop INFO DAGScheduler: Got job 71 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:23.448 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 93 (apply at OutcomeOf.scala:85) 10:40:23.448 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:23.448 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:23.449 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 93 (MapPartitionsRDD[258] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:23.450 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_108 stored as values in memory (estimated size 7.0 KiB, free 1991.9 MiB) 10:40:23.459 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_108_piece0 stored as bytes in memory (estimated size 3.4 KiB, free 1991.9 MiB) 10:40:23.460 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_108_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.4 KiB, free: 2.1 GiB) 10:40:23.460 dag-scheduler-event-loop INFO SparkContext: Created broadcast 108 from broadcast at DAGScheduler.scala:1293 10:40:23.460 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 93 (MapPartitionsRDD[258] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:23.460 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 93.0 with 2 tasks resource profile 0 10:40:23.461 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 93.0 (TID 173, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:23.461 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 93.0 (TID 174, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:23.462 Executor task launch worker for task 173 INFO Executor: Running task 0.0 in stage 93.0 (TID 173) 10:40:23.466 Executor task launch worker for task 173 INFO Executor: Finished task 0.0 in stage 93.0 (TID 173). 1478 bytes result sent to driver 10:40:23.466 Executor task launch worker for task 174 INFO Executor: Running task 1.0 in stage 93.0 (TID 174) 10:40:23.468 Executor task launch worker for task 174 INFO Executor: Finished task 1.0 in stage 93.0 (TID 174). 1405 bytes result sent to driver 10:40:23.469 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 93.0 (TID 173) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:23.469 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 93.0 (TID 174) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:23.469 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 93.0, whose tasks have all completed, from pool 10:40:23.471 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 93 (apply at OutcomeOf.scala:85) finished in 0.022 s 10:40:23.471 dag-scheduler-event-loop INFO DAGScheduler: Job 71 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:23.471 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 93: Stage finished 10:40:23.476 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 71 finished: apply at OutcomeOf.scala:85, took 0.027905 s 10:40:23.489 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:23.489 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:23.827 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:23.827 dag-scheduler-event-loop INFO DAGScheduler: Got job 72 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:23.827 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 94 (apply at OutcomeOf.scala:85) 10:40:23.827 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:23.827 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:23.828 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 94 (MapPartitionsRDD[261] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:23.829 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_109 stored as values in memory (estimated size 7.0 KiB, free 1991.9 MiB) 10:40:23.938 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_109_piece0 stored as bytes in memory (estimated size 3.4 KiB, free 1991.9 MiB) 10:40:23.939 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_109_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.4 KiB, free: 2.1 GiB) 10:40:23.939 dag-scheduler-event-loop INFO SparkContext: Created broadcast 109 from broadcast at DAGScheduler.scala:1293 10:40:23.939 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 94 (MapPartitionsRDD[261] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:23.939 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 94.0 with 2 tasks resource profile 0 10:40:23.941 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 94.0 (TID 175, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:23.941 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 94.0 (TID 176, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:23.941 Executor task launch worker for task 175 INFO Executor: Running task 0.0 in stage 94.0 (TID 175) 10:40:23.941 Executor task launch worker for task 176 INFO Executor: Running task 1.0 in stage 94.0 (TID 176) 10:40:23.945 Executor task launch worker for task 175 INFO Executor: Finished task 0.0 in stage 94.0 (TID 175). 1478 bytes result sent to driver 10:40:23.945 Executor task launch worker for task 176 INFO Executor: Finished task 1.0 in stage 94.0 (TID 176). 1405 bytes result sent to driver 10:40:23.946 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 94.0 (TID 175) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:23.946 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 94.0 (TID 176) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:23.946 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 94.0, whose tasks have all completed, from pool 10:40:23.946 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 94 (apply at OutcomeOf.scala:85) finished in 0.118 s 10:40:23.947 dag-scheduler-event-loop INFO DAGScheduler: Job 72 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:23.947 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 94: Stage finished 10:40:23.947 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 72 finished: apply at OutcomeOf.scala:85, took 0.120002 s 10:40:23.967 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:23.967 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:24.018 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:24.019 dag-scheduler-event-loop INFO DAGScheduler: Got job 73 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:24.019 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 95 (apply at OutcomeOf.scala:85) 10:40:24.019 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:24.019 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:24.019 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 95 (MapPartitionsRDD[264] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:24.020 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_110 stored as values in memory (estimated size 7.0 KiB, free 1991.9 MiB) 10:40:24.024 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_110_piece0 stored as bytes in memory (estimated size 3.4 KiB, free 1991.9 MiB) 10:40:24.024 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_110_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.4 KiB, free: 2.1 GiB) 10:40:24.025 dag-scheduler-event-loop INFO SparkContext: Created broadcast 110 from broadcast at DAGScheduler.scala:1293 10:40:24.025 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 95 (MapPartitionsRDD[264] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:24.025 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 95.0 with 2 tasks resource profile 0 10:40:24.026 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 95.0 (TID 177, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:24.026 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 95.0 (TID 178, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:24.027 Executor task launch worker for task 177 INFO Executor: Running task 0.0 in stage 95.0 (TID 177) 10:40:24.027 Executor task launch worker for task 178 INFO Executor: Running task 1.0 in stage 95.0 (TID 178) 10:40:24.030 Executor task launch worker for task 178 INFO Executor: Finished task 1.0 in stage 95.0 (TID 178). 1405 bytes result sent to driver 10:40:24.030 Executor task launch worker for task 177 INFO Executor: Finished task 0.0 in stage 95.0 (TID 177). 1435 bytes result sent to driver 10:40:24.031 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 95.0 (TID 178) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:24.031 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 95.0 (TID 177) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:24.031 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 95.0, whose tasks have all completed, from pool 10:40:24.031 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 95 (apply at OutcomeOf.scala:85) finished in 0.011 s 10:40:24.031 dag-scheduler-event-loop INFO DAGScheduler: Job 73 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:24.032 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 95: Stage finished 10:40:24.032 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 73 finished: apply at OutcomeOf.scala:85, took 0.013436 s 10:40:24.041 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:24.041 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:24.095 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:24.096 dag-scheduler-event-loop INFO DAGScheduler: Got job 74 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:24.096 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 96 (apply at OutcomeOf.scala:85) 10:40:24.096 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:24.096 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:24.096 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 96 (MapPartitionsRDD[267] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:24.098 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_111 stored as values in memory (estimated size 7.0 KiB, free 1991.9 MiB) 10:40:24.316 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_111_piece0 stored as bytes in memory (estimated size 3.4 KiB, free 1991.9 MiB) 10:40:24.316 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_111_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.4 KiB, free: 2.1 GiB) 10:40:24.317 dag-scheduler-event-loop INFO SparkContext: Created broadcast 111 from broadcast at DAGScheduler.scala:1293 10:40:24.317 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 96 (MapPartitionsRDD[267] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:24.317 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 96.0 with 2 tasks resource profile 0 10:40:24.318 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 96.0 (TID 179, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:24.318 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 96.0 (TID 180, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:24.319 Executor task launch worker for task 179 INFO Executor: Running task 0.0 in stage 96.0 (TID 179) 10:40:24.319 Executor task launch worker for task 180 INFO Executor: Running task 1.0 in stage 96.0 (TID 180) 10:40:24.322 Executor task launch worker for task 179 INFO Executor: Finished task 0.0 in stage 96.0 (TID 179). 1478 bytes result sent to driver 10:40:24.322 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 96.0 (TID 179) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:24.331 Executor task launch worker for task 180 INFO Executor: Finished task 1.0 in stage 96.0 (TID 180). 1448 bytes result sent to driver 10:40:24.332 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 96.0 (TID 180) in 14 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:24.332 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 96.0, whose tasks have all completed, from pool 10:40:24.333 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 96 (apply at OutcomeOf.scala:85) finished in 0.235 s 10:40:24.333 dag-scheduler-event-loop INFO DAGScheduler: Job 74 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:24.333 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 96: Stage finished 10:40:24.333 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 74 finished: apply at OutcomeOf.scala:85, took 0.237626 s 10:40:24.347 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:24.347 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:24.504 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 15.963616 ms 10:40:24.540 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:24.541 dag-scheduler-event-loop INFO DAGScheduler: Got job 75 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:24.541 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 97 (apply at OutcomeOf.scala:85) 10:40:24.541 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:24.541 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:24.542 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 97 (MapPartitionsRDD[270] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:24.543 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_112 stored as values in memory (estimated size 6.8 KiB, free 1991.9 MiB) 10:40:24.547 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_112_piece0 stored as bytes in memory (estimated size 3.4 KiB, free 1991.9 MiB) 10:40:24.548 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_112_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.4 KiB, free: 2.1 GiB) 10:40:24.548 dag-scheduler-event-loop INFO SparkContext: Created broadcast 112 from broadcast at DAGScheduler.scala:1293 10:40:24.548 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 97 (MapPartitionsRDD[270] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:24.548 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 97.0 with 2 tasks resource profile 0 10:40:24.549 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 97.0 (TID 181, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:24.550 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 97.0 (TID 182, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:24.550 Executor task launch worker for task 181 INFO Executor: Running task 0.0 in stage 97.0 (TID 181) 10:40:24.550 Executor task launch worker for task 182 INFO Executor: Running task 1.0 in stage 97.0 (TID 182) 10:40:24.555 Executor task launch worker for task 181 INFO Executor: Finished task 0.0 in stage 97.0 (TID 181). 1469 bytes result sent to driver 10:40:24.555 Executor task launch worker for task 182 INFO Executor: Finished task 1.0 in stage 97.0 (TID 182). 1462 bytes result sent to driver 10:40:24.556 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 97.0 (TID 182) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:24.556 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 97.0 (TID 181) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:24.556 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 97.0, whose tasks have all completed, from pool 10:40:24.556 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 97 (apply at OutcomeOf.scala:85) finished in 0.014 s 10:40:24.556 dag-scheduler-event-loop INFO DAGScheduler: Job 75 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:24.557 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 97: Stage finished 10:40:24.557 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 75 finished: apply at OutcomeOf.scala:85, took 0.016132 s 10:40:24.565 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:24.565 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:24.610 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:24.610 dag-scheduler-event-loop INFO DAGScheduler: Got job 76 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:24.611 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 98 (apply at OutcomeOf.scala:85) 10:40:24.611 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:24.611 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:24.611 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 98 (MapPartitionsRDD[273] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:24.612 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_113 stored as values in memory (estimated size 6.8 KiB, free 1991.9 MiB) 10:40:24.885 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_113_piece0 stored as bytes in memory (estimated size 3.4 KiB, free 1991.8 MiB) 10:40:24.886 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_113_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.4 KiB, free: 2.1 GiB) 10:40:24.886 dag-scheduler-event-loop INFO SparkContext: Created broadcast 113 from broadcast at DAGScheduler.scala:1293 10:40:24.886 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 98 (MapPartitionsRDD[273] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:24.886 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 98.0 with 2 tasks resource profile 0 10:40:24.887 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 98.0 (TID 183, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:24.888 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 98.0 (TID 184, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:24.888 Executor task launch worker for task 183 INFO Executor: Running task 0.0 in stage 98.0 (TID 183) 10:40:24.888 Executor task launch worker for task 184 INFO Executor: Running task 1.0 in stage 98.0 (TID 184) 10:40:24.891 Executor task launch worker for task 184 INFO Executor: Finished task 1.0 in stage 98.0 (TID 184). 1419 bytes result sent to driver 10:40:24.891 Executor task launch worker for task 183 INFO Executor: Finished task 0.0 in stage 98.0 (TID 183). 1469 bytes result sent to driver 10:40:24.892 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 98.0 (TID 184) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:24.893 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 98.0 (TID 183) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:24.893 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 98.0, whose tasks have all completed, from pool 10:40:24.893 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 98 (apply at OutcomeOf.scala:85) finished in 0.282 s 10:40:24.893 dag-scheduler-event-loop INFO DAGScheduler: Job 76 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:24.893 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 98: Stage finished 10:40:24.893 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 76 finished: apply at OutcomeOf.scala:85, took 0.283347 s 10:40:24.901 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:24.901 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:25.030 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 6.547471 ms 10:40:25.042 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:25.043 dag-scheduler-event-loop INFO DAGScheduler: Got job 77 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:25.043 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 99 (apply at OutcomeOf.scala:85) 10:40:25.043 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:25.043 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:25.044 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 99 (MapPartitionsRDD[276] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:25.045 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_114 stored as values in memory (estimated size 6.9 KiB, free 1991.8 MiB) 10:40:25.163 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_114_piece0 stored as bytes in memory (estimated size 3.4 KiB, free 1991.8 MiB) 10:40:25.164 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_114_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.4 KiB, free: 2.1 GiB) 10:40:25.164 dag-scheduler-event-loop INFO SparkContext: Created broadcast 114 from broadcast at DAGScheduler.scala:1293 10:40:25.165 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 99 (MapPartitionsRDD[276] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:25.165 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 99.0 with 2 tasks resource profile 0 10:40:25.166 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 99.0 (TID 185, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:25.166 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 99.0 (TID 186, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:25.166 Executor task launch worker for task 185 INFO Executor: Running task 0.0 in stage 99.0 (TID 185) 10:40:25.166 Executor task launch worker for task 186 INFO Executor: Running task 1.0 in stage 99.0 (TID 186) 10:40:25.170 Executor task launch worker for task 186 INFO Executor: Finished task 1.0 in stage 99.0 (TID 186). 1469 bytes result sent to driver 10:40:25.170 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 99.0 (TID 186) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:25.257 Executor task launch worker for task 185 INFO Executor: Finished task 0.0 in stage 99.0 (TID 185). 1469 bytes result sent to driver 10:40:25.258 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 99.0 (TID 185) in 93 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:25.258 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 99.0, whose tasks have all completed, from pool 10:40:25.258 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 99 (apply at OutcomeOf.scala:85) finished in 0.214 s 10:40:25.259 dag-scheduler-event-loop INFO DAGScheduler: Job 77 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:25.259 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 99: Stage finished 10:40:25.259 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 77 finished: apply at OutcomeOf.scala:85, took 0.216492 s 10:40:25.269 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:25.269 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:25.324 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:25.325 dag-scheduler-event-loop INFO DAGScheduler: Got job 78 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:25.325 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 100 (apply at OutcomeOf.scala:85) 10:40:25.325 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:25.325 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:25.325 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 100 (MapPartitionsRDD[279] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:25.327 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_115 stored as values in memory (estimated size 6.9 KiB, free 1991.8 MiB) 10:40:25.448 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_115_piece0 stored as bytes in memory (estimated size 3.4 KiB, free 1991.8 MiB) 10:40:25.448 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_115_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.4 KiB, free: 2.1 GiB) 10:40:25.449 dag-scheduler-event-loop INFO SparkContext: Created broadcast 115 from broadcast at DAGScheduler.scala:1293 10:40:25.449 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 100 (MapPartitionsRDD[279] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:25.449 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 100.0 with 2 tasks resource profile 0 10:40:25.451 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 100.0 (TID 187, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:25.451 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 100.0 (TID 188, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:25.451 Executor task launch worker for task 187 INFO Executor: Running task 0.0 in stage 100.0 (TID 187) 10:40:25.454 Executor task launch worker for task 188 INFO Executor: Running task 1.0 in stage 100.0 (TID 188) 10:40:25.456 Executor task launch worker for task 187 INFO Executor: Finished task 0.0 in stage 100.0 (TID 187). 1469 bytes result sent to driver 10:40:25.458 Executor task launch worker for task 188 INFO Executor: Finished task 1.0 in stage 100.0 (TID 188). 1469 bytes result sent to driver 10:40:25.459 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 100.0 (TID 188) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:25.459 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 100.0 (TID 187) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:25.459 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 100.0, whose tasks have all completed, from pool 10:40:25.460 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 100 (apply at OutcomeOf.scala:85) finished in 0.134 s 10:40:25.460 dag-scheduler-event-loop INFO DAGScheduler: Job 78 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:25.460 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 100: Stage finished 10:40:25.461 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 78 finished: apply at OutcomeOf.scala:85, took 0.136119 s 10:40:25.469 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:25.470 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:25.512 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 4.323363 ms 10:40:25.522 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:25.523 dag-scheduler-event-loop INFO DAGScheduler: Got job 79 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:25.523 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 101 (apply at OutcomeOf.scala:85) 10:40:25.523 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:25.523 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:25.523 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 101 (MapPartitionsRDD[282] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:25.524 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_116 stored as values in memory (estimated size 5.9 KiB, free 1991.8 MiB) 10:40:25.528 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_116_piece0 stored as bytes in memory (estimated size 3.1 KiB, free 1991.8 MiB) 10:40:25.528 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_116_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.1 KiB, free: 2.1 GiB) 10:40:25.528 dag-scheduler-event-loop INFO SparkContext: Created broadcast 116 from broadcast at DAGScheduler.scala:1293 10:40:25.528 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 101 (MapPartitionsRDD[282] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:25.528 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 101.0 with 2 tasks resource profile 0 10:40:25.529 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 101.0 (TID 189, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:25.529 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 101.0 (TID 190, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:25.529 Executor task launch worker for task 189 INFO Executor: Running task 0.0 in stage 101.0 (TID 189) 10:40:25.529 Executor task launch worker for task 190 INFO Executor: Running task 1.0 in stage 101.0 (TID 190) 10:40:25.537 Executor task launch worker for task 189 INFO Executor: Finished task 0.0 in stage 101.0 (TID 189). 1392 bytes result sent to driver 10:40:25.537 Executor task launch worker for task 190 INFO Executor: Finished task 1.0 in stage 101.0 (TID 190). 1392 bytes result sent to driver 10:40:25.538 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 101.0 (TID 189) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:25.538 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 101.0 (TID 190) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:25.538 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 101.0, whose tasks have all completed, from pool 10:40:25.538 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 101 (apply at OutcomeOf.scala:85) finished in 0.015 s 10:40:25.538 dag-scheduler-event-loop INFO DAGScheduler: Job 79 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:25.539 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 101: Stage finished 10:40:25.539 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 79 finished: apply at OutcomeOf.scala:85, took 0.016376 s 10:40:25.545 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:25.545 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:25.770 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:25.771 dag-scheduler-event-loop INFO DAGScheduler: Got job 80 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:25.771 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 102 (apply at OutcomeOf.scala:85) 10:40:25.771 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:25.771 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:25.771 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 102 (MapPartitionsRDD[285] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:25.772 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_117 stored as values in memory (estimated size 5.9 KiB, free 1991.8 MiB) 10:40:25.861 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_117_piece0 stored as bytes in memory (estimated size 3.1 KiB, free 1991.8 MiB) 10:40:25.861 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_117_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.1 KiB, free: 2.1 GiB) 10:40:25.861 dag-scheduler-event-loop INFO SparkContext: Created broadcast 117 from broadcast at DAGScheduler.scala:1293 10:40:25.862 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 102 (MapPartitionsRDD[285] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:25.862 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 102.0 with 2 tasks resource profile 0 10:40:25.863 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 102.0 (TID 191, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:25.863 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 102.0 (TID 192, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:25.863 Executor task launch worker for task 191 INFO Executor: Running task 0.0 in stage 102.0 (TID 191) 10:40:25.863 Executor task launch worker for task 192 INFO Executor: Running task 1.0 in stage 102.0 (TID 192) 10:40:25.866 Executor task launch worker for task 191 INFO Executor: Finished task 0.0 in stage 102.0 (TID 191). 1392 bytes result sent to driver 10:40:25.866 Executor task launch worker for task 192 INFO Executor: Finished task 1.0 in stage 102.0 (TID 192). 1349 bytes result sent to driver 10:40:25.867 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 102.0 (TID 191) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:25.867 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 102.0 (TID 192) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:25.867 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 102.0, whose tasks have all completed, from pool 10:40:25.868 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 102 (apply at OutcomeOf.scala:85) finished in 0.095 s 10:40:25.868 dag-scheduler-event-loop INFO DAGScheduler: Job 80 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:25.868 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 102: Stage finished 10:40:25.868 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 80 finished: apply at OutcomeOf.scala:85, took 0.097348 s 10:40:25.885 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:25.885 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:26.162 broadcast-exchange-8 INFO CodeGenerator: Code generated in 5.369337 ms 10:40:26.280 broadcast-exchange-8 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:26.280 dag-scheduler-event-loop INFO DAGScheduler: Got job 81 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 2 output partitions 10:40:26.280 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 103 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:26.280 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:26.280 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:26.281 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 103 (MapPartitionsRDD[288] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:26.282 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_118 stored as values in memory (estimated size 7.0 KiB, free 1991.8 MiB) 10:40:26.285 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_118_piece0 stored as bytes in memory (estimated size 3.4 KiB, free 1991.8 MiB) 10:40:26.285 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_118_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.4 KiB, free: 2.1 GiB) 10:40:26.286 dag-scheduler-event-loop INFO SparkContext: Created broadcast 118 from broadcast at DAGScheduler.scala:1293 10:40:26.286 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 103 (MapPartitionsRDD[288] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0, 1)) 10:40:26.286 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 103.0 with 2 tasks resource profile 0 10:40:26.287 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 103.0 (TID 193, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:26.287 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 103.0 (TID 194, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:26.287 Executor task launch worker for task 193 INFO Executor: Running task 0.0 in stage 103.0 (TID 193) 10:40:26.287 Executor task launch worker for task 194 INFO Executor: Running task 1.0 in stage 103.0 (TID 194) 10:40:26.292 Executor task launch worker for task 194 INFO Executor: Finished task 1.0 in stage 103.0 (TID 194). 1470 bytes result sent to driver 10:40:26.292 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 103.0 (TID 194) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:26.409 Executor task launch worker for task 193 INFO Executor: Finished task 0.0 in stage 103.0 (TID 193). 1496 bytes result sent to driver 10:40:26.410 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 103.0 (TID 193) in 123 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:26.410 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 103.0, whose tasks have all completed, from pool 10:40:26.410 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 103 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.129 s 10:40:26.410 dag-scheduler-event-loop INFO DAGScheduler: Job 81 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:26.410 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 103: Stage finished 10:40:26.410 broadcast-exchange-8 INFO DAGScheduler: Job 81 finished: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266, took 0.130680 s 10:40:26.422 broadcast-exchange-8 INFO CodeGenerator: Code generated in 5.585366 ms 10:40:26.429 broadcast-exchange-8 INFO MemoryStore: Block broadcast_119 stored as values in memory (estimated size 1024.0 KiB, free 1990.8 MiB) 10:40:27.128 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_107_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.2 KiB, free: 2.1 GiB) 10:40:27.128 broadcast-exchange-8 INFO MemoryStore: Block broadcast_119_piece0 stored as bytes in memory (estimated size 264.0 B, free 1990.8 MiB) 10:40:27.128 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_119_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 264.0 B, free: 2.1 GiB) 10:40:27.129 broadcast-exchange-8 INFO SparkContext: Created broadcast 119 from $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:27.129 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_103_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.8 KiB, free: 2.1 GiB) 10:40:27.142 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_108_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.4 KiB, free: 2.1 GiB) 10:40:27.151 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_101_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 15.5 KiB, free: 2.1 GiB) 10:40:27.152 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_105_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 7.6 KiB, free: 2.1 GiB) 10:40:27.154 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_110_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.4 KiB, free: 2.1 GiB) 10:40:27.156 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_115_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.4 KiB, free: 2.1 GiB) 10:40:27.156 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 22.588374 ms 10:40:27.158 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_104_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.2 KiB, free: 2.1 GiB) 10:40:27.161 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_95_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 10.6 KiB, free: 2.1 GiB) 10:40:27.163 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_93_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 4.4 KiB, free: 2.1 GiB) 10:40:27.166 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_102_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.5 KiB, free: 2.1 GiB) 10:40:27.168 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_91_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 12.2 KiB, free: 2.1 GiB) 10:40:27.171 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 13.594261 ms 10:40:27.177 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_96_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 16.8 KiB, free: 2.1 GiB) 10:40:27.179 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_97_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 14.4 KiB, free: 2.1 GiB) 10:40:27.181 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_89_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 230.0 B, free: 2.1 GiB) 10:40:27.192 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:27.192 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_114_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.4 KiB, free: 2.1 GiB) 10:40:27.193 dag-scheduler-event-loop INFO DAGScheduler: Got job 82 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:27.193 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 104 (apply at OutcomeOf.scala:85) 10:40:27.193 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:27.193 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:27.193 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 104 (MapPartitionsRDD[291] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:27.197 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_109_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.4 KiB, free: 2.1 GiB) 10:40:27.198 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_120 stored as values in memory (estimated size 9.0 KiB, free 2.0 GiB) 10:40:27.201 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_120_piece0 stored as bytes in memory (estimated size 4.3 KiB, free 2.0 GiB) 10:40:27.202 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_120_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 4.3 KiB, free: 2.1 GiB) 10:40:27.202 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_98_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 6.3 KiB, free: 2.1 GiB) 10:40:27.202 dag-scheduler-event-loop INFO SparkContext: Created broadcast 120 from broadcast at DAGScheduler.scala:1293 10:40:27.203 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 104 (MapPartitionsRDD[291] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:27.203 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 104.0 with 2 tasks resource profile 0 10:40:27.204 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 104.0 (TID 195, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7687 bytes) taskResourceAssignments Map() 10:40:27.204 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 104.0 (TID 196, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7687 bytes) taskResourceAssignments Map() 10:40:27.205 Executor task launch worker for task 196 INFO Executor: Running task 1.0 in stage 104.0 (TID 196) 10:40:27.205 Executor task launch worker for task 195 INFO Executor: Running task 0.0 in stage 104.0 (TID 195) 10:40:27.210 Executor task launch worker for task 196 INFO Executor: Finished task 1.0 in stage 104.0 (TID 196). 1553 bytes result sent to driver 10:40:27.211 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 104.0 (TID 196) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:27.212 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_90_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 10.6 KiB, free: 2.1 GiB) 10:40:27.213 Executor task launch worker for task 195 INFO Executor: Finished task 0.0 in stage 104.0 (TID 195). 1653 bytes result sent to driver 10:40:27.213 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 104.0 (TID 195) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:27.213 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 104.0, whose tasks have all completed, from pool 10:40:27.214 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_117_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.1 KiB, free: 2.1 GiB) 10:40:27.215 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 104 (apply at OutcomeOf.scala:85) finished in 0.021 s 10:40:27.215 dag-scheduler-event-loop INFO DAGScheduler: Job 82 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:27.215 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 104: Stage finished 10:40:27.215 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 82 finished: apply at OutcomeOf.scala:85, took 0.023239 s 10:40:27.216 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_106_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 11.0 KiB, free: 2.1 GiB) 10:40:27.219 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_92_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 177.0 B, free: 2.1 GiB) 10:40:27.222 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_112_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.4 KiB, free: 2.1 GiB) 10:40:27.223 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_111_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.4 KiB, free: 2.1 GiB) 10:40:27.226 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_94_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 212.0 B, free: 2.1 GiB) 10:40:27.228 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_116_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.1 KiB, free: 2.1 GiB) 10:40:27.229 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_118_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.4 KiB, free: 2.1 GiB) 10:40:27.230 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_99_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.4 KiB, free: 2.1 GiB) 10:40:27.231 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_113_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.4 KiB, free: 2.1 GiB) 10:40:27.233 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_100_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 10.5 KiB, free: 2.1 GiB) 10:40:27.236 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.236 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.296 broadcast-exchange-9 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:27.297 dag-scheduler-event-loop INFO DAGScheduler: Got job 83 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 2 output partitions 10:40:27.297 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 105 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:27.297 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:27.297 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:27.297 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 105 (MapPartitionsRDD[294] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:27.299 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_121 stored as values in memory (estimated size 7.0 KiB, free 2.1 GiB) 10:40:27.303 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_121_piece0 stored as bytes in memory (estimated size 3.4 KiB, free 2.1 GiB) 10:40:27.303 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_121_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.4 KiB, free: 2.1 GiB) 10:40:27.304 dag-scheduler-event-loop INFO SparkContext: Created broadcast 121 from broadcast at DAGScheduler.scala:1293 10:40:27.304 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 105 (MapPartitionsRDD[294] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0, 1)) 10:40:27.304 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 105.0 with 2 tasks resource profile 0 10:40:27.305 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 105.0 (TID 197, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:27.305 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 105.0 (TID 198, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7663 bytes) taskResourceAssignments Map() 10:40:27.305 Executor task launch worker for task 198 INFO Executor: Running task 1.0 in stage 105.0 (TID 198) 10:40:27.305 Executor task launch worker for task 197 INFO Executor: Running task 0.0 in stage 105.0 (TID 197) 10:40:27.308 Executor task launch worker for task 198 INFO Executor: Finished task 1.0 in stage 105.0 (TID 198). 1427 bytes result sent to driver 10:40:27.308 Executor task launch worker for task 197 INFO Executor: Finished task 0.0 in stage 105.0 (TID 197). 1453 bytes result sent to driver 10:40:27.309 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 105.0 (TID 198) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:27.309 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 105.0 (TID 197) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:27.309 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 105.0, whose tasks have all completed, from pool 10:40:27.310 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 105 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.011 s 10:40:27.310 dag-scheduler-event-loop INFO DAGScheduler: Job 83 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:27.310 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 105: Stage finished 10:40:27.310 broadcast-exchange-9 INFO DAGScheduler: Job 83 finished: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266, took 0.014209 s 10:40:27.314 broadcast-exchange-9 INFO MemoryStore: Block broadcast_122 stored as values in memory (estimated size 1024.0 KiB, free 2.1 GiB) 10:40:27.315 broadcast-exchange-9 INFO MemoryStore: Block broadcast_122_piece0 stored as bytes in memory (estimated size 264.0 B, free 2.1 GiB) 10:40:27.316 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_122_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 264.0 B, free: 2.1 GiB) 10:40:27.316 broadcast-exchange-9 INFO SparkContext: Created broadcast 122 from $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:27.328 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:27.328 dag-scheduler-event-loop INFO DAGScheduler: Got job 84 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:27.328 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 106 (apply at OutcomeOf.scala:85) 10:40:27.329 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:27.329 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:27.329 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 106 (MapPartitionsRDD[297] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:27.331 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_123 stored as values in memory (estimated size 9.0 KiB, free 2.1 GiB) 10:40:27.333 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_123_piece0 stored as bytes in memory (estimated size 4.3 KiB, free 2.1 GiB) 10:40:27.333 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_123_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 4.3 KiB, free: 2.1 GiB) 10:40:27.334 dag-scheduler-event-loop INFO SparkContext: Created broadcast 123 from broadcast at DAGScheduler.scala:1293 10:40:27.334 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 106 (MapPartitionsRDD[297] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:27.334 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 106.0 with 2 tasks resource profile 0 10:40:27.335 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 106.0 (TID 199, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7687 bytes) taskResourceAssignments Map() 10:40:27.336 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 106.0 (TID 200, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7687 bytes) taskResourceAssignments Map() 10:40:27.336 Executor task launch worker for task 199 INFO Executor: Running task 0.0 in stage 106.0 (TID 199) 10:40:27.336 Executor task launch worker for task 200 INFO Executor: Running task 1.0 in stage 106.0 (TID 200) 10:40:27.339 Executor task launch worker for task 199 INFO Executor: Finished task 0.0 in stage 106.0 (TID 199). 1653 bytes result sent to driver 10:40:27.339 Executor task launch worker for task 200 INFO Executor: Finished task 1.0 in stage 106.0 (TID 200). 1553 bytes result sent to driver 10:40:27.340 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 106.0 (TID 199) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:27.340 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 106.0 (TID 200) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:27.340 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 106.0, whose tasks have all completed, from pool 10:40:27.341 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 106 (apply at OutcomeOf.scala:85) finished in 0.012 s 10:40:27.341 dag-scheduler-event-loop INFO DAGScheduler: Job 84 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:27.341 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 106: Stage finished 10:40:27.341 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 84 finished: apply at OutcomeOf.scala:85, took 0.013598 s 10:40:27.347 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.348 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.365 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.365 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.382 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.382 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.398 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 4.361011 ms 10:40:27.403 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.403 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.422 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 4.513335 ms 10:40:27.430 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:27.431 dag-scheduler-event-loop INFO DAGScheduler: Got job 85 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:27.431 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 107 (apply at OutcomeOf.scala:85) 10:40:27.431 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:27.431 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:27.432 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 107 (MapPartitionsRDD[300] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:27.433 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_124 stored as values in memory (estimated size 6.3 KiB, free 2.1 GiB) 10:40:27.436 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_124_piece0 stored as bytes in memory (estimated size 3.2 KiB, free 2.1 GiB) 10:40:27.436 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_124_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.2 KiB, free: 2.1 GiB) 10:40:27.436 dag-scheduler-event-loop INFO SparkContext: Created broadcast 124 from broadcast at DAGScheduler.scala:1293 10:40:27.437 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 107 (MapPartitionsRDD[300] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:27.437 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 107.0 with 2 tasks resource profile 0 10:40:27.438 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 107.0 (TID 201, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7574 bytes) taskResourceAssignments Map() 10:40:27.438 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 107.0 (TID 202, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7574 bytes) taskResourceAssignments Map() 10:40:27.438 Executor task launch worker for task 201 INFO Executor: Running task 0.0 in stage 107.0 (TID 201) 10:40:27.438 Executor task launch worker for task 202 INFO Executor: Running task 1.0 in stage 107.0 (TID 202) 10:40:27.442 Executor task launch worker for task 201 INFO Executor: Finished task 0.0 in stage 107.0 (TID 201). 1410 bytes result sent to driver 10:40:27.442 Executor task launch worker for task 202 INFO Executor: Finished task 1.0 in stage 107.0 (TID 202). 1410 bytes result sent to driver 10:40:27.443 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 107.0 (TID 201) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:27.443 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 107.0 (TID 202) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:27.443 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 107.0, whose tasks have all completed, from pool 10:40:27.444 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 107 (apply at OutcomeOf.scala:85) finished in 0.012 s 10:40:27.444 dag-scheduler-event-loop INFO DAGScheduler: Job 85 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:27.444 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 107: Stage finished 10:40:27.444 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 85 finished: apply at OutcomeOf.scala:85, took 0.013886 s 10:40:27.451 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.451 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.473 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 4.981762 ms 10:40:27.481 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:27.482 dag-scheduler-event-loop INFO DAGScheduler: Got job 86 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:27.483 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 108 (apply at OutcomeOf.scala:85) 10:40:27.483 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:27.483 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:27.483 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 108 (MapPartitionsRDD[303] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:27.485 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_125 stored as values in memory (estimated size 6.7 KiB, free 2.1 GiB) 10:40:27.486 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_125_piece0 stored as bytes in memory (estimated size 3.4 KiB, free 2.1 GiB) 10:40:27.486 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_125_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.4 KiB, free: 2.1 GiB) 10:40:27.486 dag-scheduler-event-loop INFO SparkContext: Created broadcast 125 from broadcast at DAGScheduler.scala:1293 10:40:27.487 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 108 (MapPartitionsRDD[303] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:27.487 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 108.0 with 2 tasks resource profile 0 10:40:27.488 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 108.0 (TID 203, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7574 bytes) taskResourceAssignments Map() 10:40:27.488 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 108.0 (TID 204, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7574 bytes) taskResourceAssignments Map() 10:40:27.488 Executor task launch worker for task 204 INFO Executor: Running task 1.0 in stage 108.0 (TID 204) 10:40:27.488 Executor task launch worker for task 203 INFO Executor: Running task 0.0 in stage 108.0 (TID 203) 10:40:27.492 Executor task launch worker for task 203 INFO Executor: Finished task 0.0 in stage 108.0 (TID 203). 1448 bytes result sent to driver 10:40:27.492 Executor task launch worker for task 204 INFO Executor: Finished task 1.0 in stage 108.0 (TID 204). 1479 bytes result sent to driver 10:40:27.492 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 108.0 (TID 203) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:27.493 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 108.0 (TID 204) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:27.493 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 108.0, whose tasks have all completed, from pool 10:40:27.493 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 108 (apply at OutcomeOf.scala:85) finished in 0.010 s 10:40:27.493 dag-scheduler-event-loop INFO DAGScheduler: Job 86 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:27.493 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 108: Stage finished 10:40:27.494 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 86 finished: apply at OutcomeOf.scala:85, took 0.011794 s 10:40:27.500 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.500 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.527 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 6.22229 ms 10:40:27.537 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:27.538 dag-scheduler-event-loop INFO DAGScheduler: Got job 87 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:27.538 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 109 (apply at OutcomeOf.scala:85) 10:40:27.538 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:27.538 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:27.538 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 109 (MapPartitionsRDD[306] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:27.540 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_126 stored as values in memory (estimated size 6.8 KiB, free 2.1 GiB) 10:40:27.541 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_126_piece0 stored as bytes in memory (estimated size 3.4 KiB, free 2.1 GiB) 10:40:27.541 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_126_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.4 KiB, free: 2.1 GiB) 10:40:27.542 dag-scheduler-event-loop INFO SparkContext: Created broadcast 126 from broadcast at DAGScheduler.scala:1293 10:40:27.542 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 109 (MapPartitionsRDD[306] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:27.542 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 109.0 with 2 tasks resource profile 0 10:40:27.543 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 109.0 (TID 205, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7574 bytes) taskResourceAssignments Map() 10:40:27.543 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 109.0 (TID 206, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7574 bytes) taskResourceAssignments Map() 10:40:27.543 Executor task launch worker for task 205 INFO Executor: Running task 0.0 in stage 109.0 (TID 205) 10:40:27.543 Executor task launch worker for task 206 INFO Executor: Running task 1.0 in stage 109.0 (TID 206) 10:40:27.547 Executor task launch worker for task 205 INFO Executor: Finished task 0.0 in stage 109.0 (TID 205). 1448 bytes result sent to driver 10:40:27.547 Executor task launch worker for task 206 INFO Executor: Finished task 1.0 in stage 109.0 (TID 206). 1472 bytes result sent to driver 10:40:27.548 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 109.0 (TID 205) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:27.548 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 109.0 (TID 206) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:27.548 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 109.0, whose tasks have all completed, from pool 10:40:27.548 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 109 (apply at OutcomeOf.scala:85) finished in 0.009 s 10:40:27.548 dag-scheduler-event-loop INFO DAGScheduler: Job 87 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:27.548 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 109: Stage finished 10:40:27.549 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 87 finished: apply at OutcomeOf.scala:85, took 0.011170 s 10:40:27.556 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.556 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.587 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 7.97538 ms 10:40:27.597 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 6.668122 ms 10:40:27.608 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:27.609 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 309 (apply at OutcomeOf.scala:85) as input to shuffle 22 10:40:27.609 dag-scheduler-event-loop INFO DAGScheduler: Got job 88 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:27.609 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 111 (apply at OutcomeOf.scala:85) 10:40:27.609 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 110) 10:40:27.610 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 110) 10:40:27.610 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 110 (MapPartitionsRDD[309] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:27.612 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_127 stored as values in memory (estimated size 10.8 KiB, free 2.1 GiB) 10:40:27.614 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_127_piece0 stored as bytes in memory (estimated size 5.5 KiB, free 2.1 GiB) 10:40:27.614 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_127_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.5 KiB, free: 2.1 GiB) 10:40:27.614 dag-scheduler-event-loop INFO SparkContext: Created broadcast 127 from broadcast at DAGScheduler.scala:1293 10:40:27.615 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 110 (MapPartitionsRDD[309] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:27.615 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 110.0 with 2 tasks resource profile 0 10:40:27.616 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 110.0 (TID 207, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7563 bytes) taskResourceAssignments Map() 10:40:27.616 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 110.0 (TID 208, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7563 bytes) taskResourceAssignments Map() 10:40:27.616 Executor task launch worker for task 207 INFO Executor: Running task 0.0 in stage 110.0 (TID 207) 10:40:27.616 Executor task launch worker for task 208 INFO Executor: Running task 1.0 in stage 110.0 (TID 208) 10:40:27.623 Executor task launch worker for task 208 INFO Executor: Finished task 1.0 in stage 110.0 (TID 208). 1849 bytes result sent to driver 10:40:27.623 Executor task launch worker for task 207 INFO Executor: Finished task 0.0 in stage 110.0 (TID 207). 1849 bytes result sent to driver 10:40:27.624 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 110.0 (TID 208) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:27.624 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 110.0 (TID 207) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:27.624 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 110.0, whose tasks have all completed, from pool 10:40:27.624 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 110 (apply at OutcomeOf.scala:85) finished in 0.013 s 10:40:27.625 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:27.625 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:27.625 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 111) 10:40:27.625 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:27.625 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 111 (MapPartitionsRDD[312] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:27.627 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_128 stored as values in memory (estimated size 11.0 KiB, free 2.1 GiB) 10:40:27.628 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_128_piece0 stored as bytes in memory (estimated size 5.4 KiB, free 2.1 GiB) 10:40:27.628 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_128_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.4 KiB, free: 2.1 GiB) 10:40:27.629 dag-scheduler-event-loop INFO SparkContext: Created broadcast 128 from broadcast at DAGScheduler.scala:1293 10:40:27.629 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 111 (MapPartitionsRDD[312] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:27.629 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 111.0 with 1 tasks resource profile 0 10:40:27.630 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 111.0 (TID 209, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:27.631 Executor task launch worker for task 209 INFO Executor: Running task 0.0 in stage 111.0 (TID 209) 10:40:27.634 Executor task launch worker for task 209 INFO ShuffleBlockFetcherIterator: Getting 2 (120.0 B) non-empty blocks including 2 (120.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:27.634 Executor task launch worker for task 209 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:27.638 Executor task launch worker for task 209 INFO Executor: Finished task 0.0 in stage 111.0 (TID 209). 2648 bytes result sent to driver 10:40:27.639 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 111.0 (TID 209) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:27.639 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 111.0, whose tasks have all completed, from pool 10:40:27.640 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 111 (apply at OutcomeOf.scala:85) finished in 0.014 s 10:40:27.640 dag-scheduler-event-loop INFO DAGScheduler: Job 88 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:27.640 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 111: Stage finished 10:40:27.640 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 88 finished: apply at OutcomeOf.scala:85, took 0.032259 s 10:40:27.652 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.652 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.707 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:27.708 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 315 (apply at OutcomeOf.scala:85) as input to shuffle 23 10:40:27.708 dag-scheduler-event-loop INFO DAGScheduler: Got job 89 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:27.708 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 113 (apply at OutcomeOf.scala:85) 10:40:27.708 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 112) 10:40:27.708 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 112) 10:40:27.709 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 112 (MapPartitionsRDD[315] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:27.710 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_129 stored as values in memory (estimated size 10.8 KiB, free 2.1 GiB) 10:40:27.711 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_129_piece0 stored as bytes in memory (estimated size 5.5 KiB, free 2.1 GiB) 10:40:27.712 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_129_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.5 KiB, free: 2.1 GiB) 10:40:27.712 dag-scheduler-event-loop INFO SparkContext: Created broadcast 129 from broadcast at DAGScheduler.scala:1293 10:40:27.712 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 112 (MapPartitionsRDD[315] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:27.712 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 112.0 with 2 tasks resource profile 0 10:40:27.713 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 112.0 (TID 210, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7563 bytes) taskResourceAssignments Map() 10:40:27.713 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 112.0 (TID 211, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7563 bytes) taskResourceAssignments Map() 10:40:27.714 Executor task launch worker for task 210 INFO Executor: Running task 0.0 in stage 112.0 (TID 210) 10:40:27.714 Executor task launch worker for task 211 INFO Executor: Running task 1.0 in stage 112.0 (TID 211) 10:40:27.719 Executor task launch worker for task 210 INFO Executor: Finished task 0.0 in stage 112.0 (TID 210). 1849 bytes result sent to driver 10:40:27.719 Executor task launch worker for task 211 INFO Executor: Finished task 1.0 in stage 112.0 (TID 211). 1849 bytes result sent to driver 10:40:27.720 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 112.0 (TID 210) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:27.720 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 112.0 (TID 211) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:27.720 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 112.0, whose tasks have all completed, from pool 10:40:27.720 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 112 (apply at OutcomeOf.scala:85) finished in 0.011 s 10:40:27.720 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:27.720 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:27.720 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 113) 10:40:27.720 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:27.721 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 113 (MapPartitionsRDD[318] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:27.722 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_130 stored as values in memory (estimated size 11.0 KiB, free 2.1 GiB) 10:40:27.723 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_130_piece0 stored as bytes in memory (estimated size 5.4 KiB, free 2.1 GiB) 10:40:27.724 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_130_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.4 KiB, free: 2.1 GiB) 10:40:27.724 dag-scheduler-event-loop INFO SparkContext: Created broadcast 130 from broadcast at DAGScheduler.scala:1293 10:40:27.724 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 113 (MapPartitionsRDD[318] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:27.724 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 113.0 with 1 tasks resource profile 0 10:40:27.726 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 113.0 (TID 212, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:27.726 Executor task launch worker for task 212 INFO Executor: Running task 0.0 in stage 113.0 (TID 212) 10:40:27.728 Executor task launch worker for task 212 INFO ShuffleBlockFetcherIterator: Getting 2 (120.0 B) non-empty blocks including 2 (120.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:27.728 Executor task launch worker for task 212 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:27.731 Executor task launch worker for task 212 INFO Executor: Finished task 0.0 in stage 113.0 (TID 212). 2648 bytes result sent to driver 10:40:27.731 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 113.0 (TID 212) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:27.731 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 113.0, whose tasks have all completed, from pool 10:40:27.732 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 113 (apply at OutcomeOf.scala:85) finished in 0.011 s 10:40:27.732 dag-scheduler-event-loop INFO DAGScheduler: Job 89 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:27.732 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 113: Stage finished 10:40:27.732 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 89 finished: apply at OutcomeOf.scala:85, took 0.024950 s 10:40:27.742 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.742 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.786 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 9.475768 ms 10:40:27.801 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:27.802 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 321 (apply at OutcomeOf.scala:85) as input to shuffle 24 10:40:27.802 dag-scheduler-event-loop INFO DAGScheduler: Got job 90 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:27.802 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 115 (apply at OutcomeOf.scala:85) 10:40:27.802 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 114) 10:40:27.802 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 114) 10:40:27.802 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 114 (MapPartitionsRDD[321] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:27.804 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_131 stored as values in memory (estimated size 10.8 KiB, free 2.1 GiB) 10:40:27.805 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_131_piece0 stored as bytes in memory (estimated size 5.5 KiB, free 2.1 GiB) 10:40:27.805 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_131_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.5 KiB, free: 2.1 GiB) 10:40:27.805 dag-scheduler-event-loop INFO SparkContext: Created broadcast 131 from broadcast at DAGScheduler.scala:1293 10:40:27.806 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 114 (MapPartitionsRDD[321] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:27.806 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 114.0 with 2 tasks resource profile 0 10:40:27.807 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 114.0 (TID 213, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7563 bytes) taskResourceAssignments Map() 10:40:27.807 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 114.0 (TID 214, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7563 bytes) taskResourceAssignments Map() 10:40:27.807 Executor task launch worker for task 213 INFO Executor: Running task 0.0 in stage 114.0 (TID 213) 10:40:27.807 Executor task launch worker for task 214 INFO Executor: Running task 1.0 in stage 114.0 (TID 214) 10:40:27.824 Executor task launch worker for task 213 INFO Executor: Finished task 0.0 in stage 114.0 (TID 213). 1849 bytes result sent to driver 10:40:27.824 Executor task launch worker for task 214 INFO Executor: Finished task 1.0 in stage 114.0 (TID 214). 1849 bytes result sent to driver 10:40:27.825 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 114.0 (TID 213) in 19 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:27.825 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 114.0 (TID 214) in 18 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:27.825 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 114.0, whose tasks have all completed, from pool 10:40:27.826 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 114 (apply at OutcomeOf.scala:85) finished in 0.023 s 10:40:27.826 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:27.826 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:27.826 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 115) 10:40:27.826 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:27.826 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 115 (MapPartitionsRDD[324] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:27.828 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_132 stored as values in memory (estimated size 11.0 KiB, free 2.1 GiB) 10:40:27.829 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_132_piece0 stored as bytes in memory (estimated size 5.4 KiB, free 2.1 GiB) 10:40:27.829 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_132_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.4 KiB, free: 2.1 GiB) 10:40:27.829 dag-scheduler-event-loop INFO SparkContext: Created broadcast 132 from broadcast at DAGScheduler.scala:1293 10:40:27.830 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 115 (MapPartitionsRDD[324] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:27.830 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 115.0 with 1 tasks resource profile 0 10:40:27.831 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 115.0 (TID 215, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:27.831 Executor task launch worker for task 215 INFO Executor: Running task 0.0 in stage 115.0 (TID 215) 10:40:27.834 Executor task launch worker for task 215 INFO ShuffleBlockFetcherIterator: Getting 2 (120.0 B) non-empty blocks including 2 (120.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:27.834 Executor task launch worker for task 215 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:27.836 Executor task launch worker for task 215 INFO Executor: Finished task 0.0 in stage 115.0 (TID 215). 2648 bytes result sent to driver 10:40:27.837 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 115.0 (TID 215) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:27.837 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 115.0, whose tasks have all completed, from pool 10:40:27.837 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 115 (apply at OutcomeOf.scala:85) finished in 0.010 s 10:40:27.837 dag-scheduler-event-loop INFO DAGScheduler: Job 90 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:27.837 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 115: Stage finished 10:40:27.838 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 90 finished: apply at OutcomeOf.scala:85, took 0.036573 s 10:40:27.847 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.847 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:27.885 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 11.479058 ms 10:40:27.916 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 26.703781 ms 10:40:27.942 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:27.950 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 327 (apply at OutcomeOf.scala:85) as input to shuffle 25 10:40:27.951 dag-scheduler-event-loop INFO DAGScheduler: Got job 91 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:27.951 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 117 (apply at OutcomeOf.scala:85) 10:40:27.951 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 116) 10:40:27.951 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 116) 10:40:27.951 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 116 (MapPartitionsRDD[327] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:27.953 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_133 stored as values in memory (estimated size 22.2 KiB, free 2.1 GiB) 10:40:27.954 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_133_piece0 stored as bytes in memory (estimated size 10.5 KiB, free 2.1 GiB) 10:40:27.955 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_133_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 10.5 KiB, free: 2.1 GiB) 10:40:27.955 dag-scheduler-event-loop INFO SparkContext: Created broadcast 133 from broadcast at DAGScheduler.scala:1293 10:40:27.956 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 116 (MapPartitionsRDD[327] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:27.956 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 116.0 with 2 tasks resource profile 0 10:40:27.957 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 116.0 (TID 216, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7563 bytes) taskResourceAssignments Map() 10:40:27.957 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 116.0 (TID 217, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7563 bytes) taskResourceAssignments Map() 10:40:27.957 Executor task launch worker for task 216 INFO Executor: Running task 0.0 in stage 116.0 (TID 216) 10:40:27.957 Executor task launch worker for task 217 INFO Executor: Running task 1.0 in stage 116.0 (TID 217) 10:40:27.978 Executor task launch worker for task 217 INFO CodeGenerator: Code generated in 13.130218 ms 10:40:27.994 Executor task launch worker for task 216 INFO CodeGenerator: Code generated in 12.638969 ms 10:40:28.038 Executor task launch worker for task 217 INFO CodeGenerator: Code generated in 6.536675 ms 10:40:28.060 Executor task launch worker for task 217 INFO Executor: Finished task 1.0 in stage 116.0 (TID 217). 2133 bytes result sent to driver 10:40:28.060 Executor task launch worker for task 216 INFO Executor: Finished task 0.0 in stage 116.0 (TID 216). 2133 bytes result sent to driver 10:40:28.060 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 116.0 (TID 217) in 103 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:28.060 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 116.0 (TID 216) in 104 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:28.060 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 116.0, whose tasks have all completed, from pool 10:40:28.061 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 116 (apply at OutcomeOf.scala:85) finished in 0.109 s 10:40:28.061 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:28.061 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:28.061 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 117) 10:40:28.061 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:28.062 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 117 (MapPartitionsRDD[330] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:28.064 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_134 stored as values in memory (estimated size 21.4 KiB, free 2.1 GiB) 10:40:28.065 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_134_piece0 stored as bytes in memory (estimated size 10.0 KiB, free 2.1 GiB) 10:40:28.066 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_134_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 10.0 KiB, free: 2.1 GiB) 10:40:28.066 dag-scheduler-event-loop INFO SparkContext: Created broadcast 134 from broadcast at DAGScheduler.scala:1293 10:40:28.066 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 117 (MapPartitionsRDD[330] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:28.066 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 117.0 with 4 tasks resource profile 0 10:40:28.068 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 2.0 in stage 117.0 (TID 218, amp-jenkins-worker-04.amp, executor driver, partition 2, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:28.068 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 117.0 (TID 219, amp-jenkins-worker-04.amp, executor driver, partition 3, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:28.068 Executor task launch worker for task 219 INFO Executor: Running task 3.0 in stage 117.0 (TID 219) 10:40:28.068 Executor task launch worker for task 218 INFO Executor: Running task 2.0 in stage 117.0 (TID 218) 10:40:28.071 Executor task launch worker for task 218 INFO ShuffleBlockFetcherIterator: Getting 1 (60.0 B) non-empty blocks including 1 (60.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:28.071 Executor task launch worker for task 219 INFO ShuffleBlockFetcherIterator: Getting 2 (132.0 B) non-empty blocks including 2 (132.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:28.071 Executor task launch worker for task 218 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:28.071 Executor task launch worker for task 219 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:28.115 Executor task launch worker for task 218 INFO Executor: Finished task 2.0 in stage 117.0 (TID 218). 3363 bytes result sent to driver 10:40:28.116 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 117.0 (TID 220, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:28.116 Executor task launch worker for task 220 INFO Executor: Running task 0.0 in stage 117.0 (TID 220) 10:40:28.116 task-result-getter-2 INFO TaskSetManager: Finished task 2.0 in stage 117.0 (TID 218) in 49 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:28.120 Executor task launch worker for task 220 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:28.120 Executor task launch worker for task 220 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:28.123 Executor task launch worker for task 220 INFO Executor: Finished task 0.0 in stage 117.0 (TID 220). 3346 bytes result sent to driver 10:40:28.124 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 117.0 (TID 221, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:28.125 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 117.0 (TID 220) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:28.127 Executor task launch worker for task 219 INFO Executor: Finished task 3.0 in stage 117.0 (TID 219). 3373 bytes result sent to driver 10:40:28.132 Executor task launch worker for task 221 INFO Executor: Running task 1.0 in stage 117.0 (TID 221) 10:40:28.133 task-result-getter-0 INFO TaskSetManager: Finished task 3.0 in stage 117.0 (TID 219) in 65 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:28.135 Executor task launch worker for task 221 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:28.136 Executor task launch worker for task 221 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:28.140 Executor task launch worker for task 221 INFO Executor: Finished task 1.0 in stage 117.0 (TID 221). 3346 bytes result sent to driver 10:40:28.140 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 117.0 (TID 221) in 16 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:28.140 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 117.0, whose tasks have all completed, from pool 10:40:28.141 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 117 (apply at OutcomeOf.scala:85) finished in 0.078 s 10:40:28.141 dag-scheduler-event-loop INFO DAGScheduler: Job 91 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:28.141 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 117: Stage finished 10:40:28.141 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 91 finished: apply at OutcomeOf.scala:85, took 0.191712 s 10:40:28.166 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== FINISHED o.a.s.sql.SQLQueryTestSuite: 'query_regex_column.sql' ===== 10:40:28.181 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== TEST OUTPUT FOR o.a.s.sql.SQLQueryTestSuite: 'table-valued-functions.sql' ===== 10:40:28.207 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.207 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.233 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 11.082373 ms 10:40:28.247 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:28.247 dag-scheduler-event-loop INFO DAGScheduler: Got job 92 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:28.247 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 118 (apply at OutcomeOf.scala:85) 10:40:28.247 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:28.247 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:28.248 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 118 (MapPartitionsRDD[334] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:28.249 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_135 stored as values in memory (estimated size 9.6 KiB, free 2.1 GiB) 10:40:28.251 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_135_piece0 stored as bytes in memory (estimated size 4.5 KiB, free 2.1 GiB) 10:40:28.251 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_135_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 4.5 KiB, free: 2.1 GiB) 10:40:28.251 dag-scheduler-event-loop INFO SparkContext: Created broadcast 135 from broadcast at DAGScheduler.scala:1293 10:40:28.252 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 118 (MapPartitionsRDD[334] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:28.252 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 118.0 with 2 tasks resource profile 0 10:40:28.257 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 118.0 (TID 222, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.257 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 118.0 (TID 223, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.258 Executor task launch worker for task 222 INFO Executor: Running task 0.0 in stage 118.0 (TID 222) 10:40:28.258 Executor task launch worker for task 223 INFO Executor: Running task 1.0 in stage 118.0 (TID 223) 10:40:28.265 Executor task launch worker for task 222 INFO Executor: Finished task 0.0 in stage 118.0 (TID 222). 1449 bytes result sent to driver 10:40:28.265 Executor task launch worker for task 223 INFO Executor: Finished task 1.0 in stage 118.0 (TID 223). 1463 bytes result sent to driver 10:40:28.266 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 118.0 (TID 222) in 14 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:28.266 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 118.0 (TID 223) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:28.266 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 118.0, whose tasks have all completed, from pool 10:40:28.267 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 118 (apply at OutcomeOf.scala:85) finished in 0.019 s 10:40:28.267 dag-scheduler-event-loop INFO DAGScheduler: Job 92 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:28.267 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 118: Stage finished 10:40:28.267 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 92 finished: apply at OutcomeOf.scala:85, took 0.020147 s 10:40:28.273 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.273 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.293 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 10.098876 ms 10:40:28.301 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:28.302 dag-scheduler-event-loop INFO DAGScheduler: Got job 93 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:28.302 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 119 (apply at OutcomeOf.scala:85) 10:40:28.302 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:28.302 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:28.302 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 119 (MapPartitionsRDD[338] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:28.304 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_136 stored as values in memory (estimated size 9.6 KiB, free 2.1 GiB) 10:40:28.305 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_136_piece0 stored as bytes in memory (estimated size 4.5 KiB, free 2.1 GiB) 10:40:28.305 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_136_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 4.5 KiB, free: 2.1 GiB) 10:40:28.306 dag-scheduler-event-loop INFO SparkContext: Created broadcast 136 from broadcast at DAGScheduler.scala:1293 10:40:28.306 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 119 (MapPartitionsRDD[338] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:28.306 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 119.0 with 2 tasks resource profile 0 10:40:28.307 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 119.0 (TID 224, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.307 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 119.0 (TID 225, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.307 Executor task launch worker for task 225 INFO Executor: Running task 1.0 in stage 119.0 (TID 225) 10:40:28.307 Executor task launch worker for task 224 INFO Executor: Running task 0.0 in stage 119.0 (TID 224) 10:40:28.311 Executor task launch worker for task 225 INFO Executor: Finished task 1.0 in stage 119.0 (TID 225). 1463 bytes result sent to driver 10:40:28.311 Executor task launch worker for task 224 INFO Executor: Finished task 0.0 in stage 119.0 (TID 224). 1453 bytes result sent to driver 10:40:28.312 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 119.0 (TID 225) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:28.312 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 119.0 (TID 224) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:28.312 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 119.0, whose tasks have all completed, from pool 10:40:28.312 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 119 (apply at OutcomeOf.scala:85) finished in 0.009 s 10:40:28.312 dag-scheduler-event-loop INFO DAGScheduler: Job 93 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:28.312 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 119: Stage finished 10:40:28.312 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 93 finished: apply at OutcomeOf.scala:85, took 0.010802 s 10:40:28.318 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.318 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.338 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 9.190925 ms 10:40:28.346 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:28.347 dag-scheduler-event-loop INFO DAGScheduler: Got job 94 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:28.347 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 120 (apply at OutcomeOf.scala:85) 10:40:28.347 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:28.347 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:28.347 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 120 (MapPartitionsRDD[342] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:28.348 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_137 stored as values in memory (estimated size 9.6 KiB, free 2.1 GiB) 10:40:28.350 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_137_piece0 stored as bytes in memory (estimated size 4.5 KiB, free 2.1 GiB) 10:40:28.350 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_137_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 4.5 KiB, free: 2.1 GiB) 10:40:28.351 dag-scheduler-event-loop INFO SparkContext: Created broadcast 137 from broadcast at DAGScheduler.scala:1293 10:40:28.351 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 120 (MapPartitionsRDD[342] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:28.351 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 120.0 with 2 tasks resource profile 0 10:40:28.352 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 120.0 (TID 226, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.352 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 120.0 (TID 227, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.353 Executor task launch worker for task 226 INFO Executor: Running task 0.0 in stage 120.0 (TID 226) 10:40:28.353 Executor task launch worker for task 227 INFO Executor: Running task 1.0 in stage 120.0 (TID 227) 10:40:28.356 Executor task launch worker for task 227 INFO Executor: Finished task 1.0 in stage 120.0 (TID 227). 1463 bytes result sent to driver 10:40:28.356 Executor task launch worker for task 226 INFO Executor: Finished task 0.0 in stage 120.0 (TID 226). 1449 bytes result sent to driver 10:40:28.357 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 120.0 (TID 227) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:28.357 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 120.0 (TID 226) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:28.357 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 120.0, whose tasks have all completed, from pool 10:40:28.358 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 120 (apply at OutcomeOf.scala:85) finished in 0.009 s 10:40:28.358 dag-scheduler-event-loop INFO DAGScheduler: Job 94 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:28.358 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 120: Stage finished 10:40:28.358 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 94 finished: apply at OutcomeOf.scala:85, took 0.011549 s 10:40:28.364 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.364 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.385 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 9.79162 ms 10:40:28.398 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:28.398 dag-scheduler-event-loop INFO DAGScheduler: Got job 95 (apply at OutcomeOf.scala:85) with 200 output partitions 10:40:28.398 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 121 (apply at OutcomeOf.scala:85) 10:40:28.398 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:28.399 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:28.399 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 121 (MapPartitionsRDD[346] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:28.402 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_138 stored as values in memory (estimated size 9.6 KiB, free 2.1 GiB) 10:40:28.403 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_138_piece0 stored as bytes in memory (estimated size 4.5 KiB, free 2.1 GiB) 10:40:28.404 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_138_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 4.5 KiB, free: 2.1 GiB) 10:40:28.404 dag-scheduler-event-loop INFO SparkContext: Created broadcast 138 from broadcast at DAGScheduler.scala:1293 10:40:28.405 dag-scheduler-event-loop INFO DAGScheduler: Submitting 200 missing tasks from ResultStage 121 (MapPartitionsRDD[346] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)) 10:40:28.406 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 121.0 with 200 tasks resource profile 0 10:40:28.407 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 121.0 (TID 228, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.407 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 121.0 (TID 229, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.407 Executor task launch worker for task 228 INFO Executor: Running task 0.0 in stage 121.0 (TID 228) 10:40:28.407 Executor task launch worker for task 229 INFO Executor: Running task 1.0 in stage 121.0 (TID 229) 10:40:28.412 Executor task launch worker for task 229 INFO Executor: Finished task 1.0 in stage 121.0 (TID 229). 1386 bytes result sent to driver 10:40:28.412 Executor task launch worker for task 228 INFO Executor: Finished task 0.0 in stage 121.0 (TID 228). 1386 bytes result sent to driver 10:40:28.412 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 2.0 in stage 121.0 (TID 230, amp-jenkins-worker-04.amp, executor driver, partition 2, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.412 Executor task launch worker for task 230 INFO Executor: Running task 2.0 in stage 121.0 (TID 230) 10:40:28.412 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 121.0 (TID 229) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/200) 10:40:28.412 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 121.0 (TID 231, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.413 Executor task launch worker for task 231 INFO Executor: Running task 3.0 in stage 121.0 (TID 231) 10:40:28.413 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 121.0 (TID 228) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (2/200) 10:40:28.414 Executor task launch worker for task 230 INFO Executor: Finished task 2.0 in stage 121.0 (TID 230). 1343 bytes result sent to driver 10:40:28.414 Executor task launch worker for task 231 INFO Executor: Finished task 3.0 in stage 121.0 (TID 231). 1300 bytes result sent to driver 10:40:28.415 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 4.0 in stage 121.0 (TID 232, amp-jenkins-worker-04.amp, executor driver, partition 4, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.415 task-result-getter-2 INFO TaskSetManager: Finished task 2.0 in stage 121.0 (TID 230) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (3/200) 10:40:28.415 Executor task launch worker for task 232 INFO Executor: Running task 4.0 in stage 121.0 (TID 232) 10:40:28.415 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 5.0 in stage 121.0 (TID 233, amp-jenkins-worker-04.amp, executor driver, partition 5, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.415 Executor task launch worker for task 233 INFO Executor: Running task 5.0 in stage 121.0 (TID 233) 10:40:28.415 task-result-getter-1 INFO TaskSetManager: Finished task 3.0 in stage 121.0 (TID 231) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (4/200) 10:40:28.417 Executor task launch worker for task 232 INFO Executor: Finished task 4.0 in stage 121.0 (TID 232). 1343 bytes result sent to driver 10:40:28.417 Executor task launch worker for task 233 INFO Executor: Finished task 5.0 in stage 121.0 (TID 233). 1343 bytes result sent to driver 10:40:28.418 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 6.0 in stage 121.0 (TID 234, amp-jenkins-worker-04.amp, executor driver, partition 6, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.418 task-result-getter-0 INFO TaskSetManager: Finished task 4.0 in stage 121.0 (TID 232) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (5/200) 10:40:28.418 Executor task launch worker for task 234 INFO Executor: Running task 6.0 in stage 121.0 (TID 234) 10:40:28.418 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 7.0 in stage 121.0 (TID 235, amp-jenkins-worker-04.amp, executor driver, partition 7, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.418 task-result-getter-3 INFO TaskSetManager: Finished task 5.0 in stage 121.0 (TID 233) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (6/200) 10:40:28.418 Executor task launch worker for task 235 INFO Executor: Running task 7.0 in stage 121.0 (TID 235) 10:40:28.420 Executor task launch worker for task 235 INFO Executor: Finished task 7.0 in stage 121.0 (TID 235). 1300 bytes result sent to driver 10:40:28.420 Executor task launch worker for task 234 INFO Executor: Finished task 6.0 in stage 121.0 (TID 234). 1343 bytes result sent to driver 10:40:28.420 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 8.0 in stage 121.0 (TID 236, amp-jenkins-worker-04.amp, executor driver, partition 8, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.420 task-result-getter-2 INFO TaskSetManager: Finished task 7.0 in stage 121.0 (TID 235) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (7/200) 10:40:28.420 Executor task launch worker for task 236 INFO Executor: Running task 8.0 in stage 121.0 (TID 236) 10:40:28.421 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 9.0 in stage 121.0 (TID 237, amp-jenkins-worker-04.amp, executor driver, partition 9, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.421 task-result-getter-1 INFO TaskSetManager: Finished task 6.0 in stage 121.0 (TID 234) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (8/200) 10:40:28.421 Executor task launch worker for task 237 INFO Executor: Running task 9.0 in stage 121.0 (TID 237) 10:40:28.422 Executor task launch worker for task 237 INFO Executor: Finished task 9.0 in stage 121.0 (TID 237). 1300 bytes result sent to driver 10:40:28.423 Executor task launch worker for task 236 INFO Executor: Finished task 8.0 in stage 121.0 (TID 236). 1343 bytes result sent to driver 10:40:28.423 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 10.0 in stage 121.0 (TID 238, amp-jenkins-worker-04.amp, executor driver, partition 10, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.423 Executor task launch worker for task 238 INFO Executor: Running task 10.0 in stage 121.0 (TID 238) 10:40:28.423 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 11.0 in stage 121.0 (TID 239, amp-jenkins-worker-04.amp, executor driver, partition 11, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.423 task-result-getter-0 INFO TaskSetManager: Finished task 9.0 in stage 121.0 (TID 237) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (9/200) 10:40:28.423 Executor task launch worker for task 239 INFO Executor: Running task 11.0 in stage 121.0 (TID 239) 10:40:28.423 task-result-getter-3 INFO TaskSetManager: Finished task 8.0 in stage 121.0 (TID 236) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (10/200) 10:40:28.425 Executor task launch worker for task 238 INFO Executor: Finished task 10.0 in stage 121.0 (TID 238). 1343 bytes result sent to driver 10:40:28.425 Executor task launch worker for task 239 INFO Executor: Finished task 11.0 in stage 121.0 (TID 239). 1343 bytes result sent to driver 10:40:28.426 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 12.0 in stage 121.0 (TID 240, amp-jenkins-worker-04.amp, executor driver, partition 12, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.426 Executor task launch worker for task 240 INFO Executor: Running task 12.0 in stage 121.0 (TID 240) 10:40:28.426 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 13.0 in stage 121.0 (TID 241, amp-jenkins-worker-04.amp, executor driver, partition 13, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.426 task-result-getter-2 INFO TaskSetManager: Finished task 10.0 in stage 121.0 (TID 238) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (11/200) 10:40:28.426 Executor task launch worker for task 241 INFO Executor: Running task 13.0 in stage 121.0 (TID 241) 10:40:28.426 task-result-getter-1 INFO TaskSetManager: Finished task 11.0 in stage 121.0 (TID 239) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (12/200) 10:40:28.428 Executor task launch worker for task 240 INFO Executor: Finished task 12.0 in stage 121.0 (TID 240). 1300 bytes result sent to driver 10:40:28.428 Executor task launch worker for task 241 INFO Executor: Finished task 13.0 in stage 121.0 (TID 241). 1300 bytes result sent to driver 10:40:28.428 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 14.0 in stage 121.0 (TID 242, amp-jenkins-worker-04.amp, executor driver, partition 14, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.428 task-result-getter-0 INFO TaskSetManager: Finished task 12.0 in stage 121.0 (TID 240) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (13/200) 10:40:28.428 Executor task launch worker for task 242 INFO Executor: Running task 14.0 in stage 121.0 (TID 242) 10:40:28.428 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 15.0 in stage 121.0 (TID 243, amp-jenkins-worker-04.amp, executor driver, partition 15, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.429 Executor task launch worker for task 243 INFO Executor: Running task 15.0 in stage 121.0 (TID 243) 10:40:28.429 task-result-getter-3 INFO TaskSetManager: Finished task 13.0 in stage 121.0 (TID 241) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (14/200) 10:40:28.430 Executor task launch worker for task 242 INFO Executor: Finished task 14.0 in stage 121.0 (TID 242). 1300 bytes result sent to driver 10:40:28.430 Executor task launch worker for task 243 INFO Executor: Finished task 15.0 in stage 121.0 (TID 243). 1300 bytes result sent to driver 10:40:28.430 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 16.0 in stage 121.0 (TID 244, amp-jenkins-worker-04.amp, executor driver, partition 16, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.431 Executor task launch worker for task 244 INFO Executor: Running task 16.0 in stage 121.0 (TID 244) 10:40:28.431 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 17.0 in stage 121.0 (TID 245, amp-jenkins-worker-04.amp, executor driver, partition 17, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.431 task-result-getter-2 INFO TaskSetManager: Finished task 14.0 in stage 121.0 (TID 242) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (15/200) 10:40:28.431 Executor task launch worker for task 245 INFO Executor: Running task 17.0 in stage 121.0 (TID 245) 10:40:28.431 task-result-getter-1 INFO TaskSetManager: Finished task 15.0 in stage 121.0 (TID 243) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (16/200) 10:40:28.432 Executor task launch worker for task 244 INFO Executor: Finished task 16.0 in stage 121.0 (TID 244). 1300 bytes result sent to driver 10:40:28.432 Executor task launch worker for task 245 INFO Executor: Finished task 17.0 in stage 121.0 (TID 245). 1300 bytes result sent to driver 10:40:28.433 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 18.0 in stage 121.0 (TID 246, amp-jenkins-worker-04.amp, executor driver, partition 18, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.433 Executor task launch worker for task 246 INFO Executor: Running task 18.0 in stage 121.0 (TID 246) 10:40:28.433 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 19.0 in stage 121.0 (TID 247, amp-jenkins-worker-04.amp, executor driver, partition 19, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.433 task-result-getter-0 INFO TaskSetManager: Finished task 16.0 in stage 121.0 (TID 244) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (17/200) 10:40:28.433 Executor task launch worker for task 247 INFO Executor: Running task 19.0 in stage 121.0 (TID 247) 10:40:28.433 task-result-getter-3 INFO TaskSetManager: Finished task 17.0 in stage 121.0 (TID 245) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (18/200) 10:40:28.435 Executor task launch worker for task 247 INFO Executor: Finished task 19.0 in stage 121.0 (TID 247). 1353 bytes result sent to driver 10:40:28.435 Executor task launch worker for task 246 INFO Executor: Finished task 18.0 in stage 121.0 (TID 246). 1300 bytes result sent to driver 10:40:28.435 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 20.0 in stage 121.0 (TID 248, amp-jenkins-worker-04.amp, executor driver, partition 20, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.435 task-result-getter-2 INFO TaskSetManager: Finished task 19.0 in stage 121.0 (TID 247) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (19/200) 10:40:28.435 Executor task launch worker for task 248 INFO Executor: Running task 20.0 in stage 121.0 (TID 248) 10:40:28.435 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 21.0 in stage 121.0 (TID 249, amp-jenkins-worker-04.amp, executor driver, partition 21, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.436 Executor task launch worker for task 249 INFO Executor: Running task 21.0 in stage 121.0 (TID 249) 10:40:28.436 task-result-getter-1 INFO TaskSetManager: Finished task 18.0 in stage 121.0 (TID 246) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (20/200) 10:40:28.437 Executor task launch worker for task 248 INFO Executor: Finished task 20.0 in stage 121.0 (TID 248). 1343 bytes result sent to driver 10:40:28.438 Executor task launch worker for task 249 INFO Executor: Finished task 21.0 in stage 121.0 (TID 249). 1300 bytes result sent to driver 10:40:28.438 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 22.0 in stage 121.0 (TID 250, amp-jenkins-worker-04.amp, executor driver, partition 22, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.438 task-result-getter-0 INFO TaskSetManager: Finished task 20.0 in stage 121.0 (TID 248) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (21/200) 10:40:28.438 Executor task launch worker for task 250 INFO Executor: Running task 22.0 in stage 121.0 (TID 250) 10:40:28.438 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 23.0 in stage 121.0 (TID 251, amp-jenkins-worker-04.amp, executor driver, partition 23, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.439 Executor task launch worker for task 251 INFO Executor: Running task 23.0 in stage 121.0 (TID 251) 10:40:28.439 task-result-getter-3 INFO TaskSetManager: Finished task 21.0 in stage 121.0 (TID 249) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (22/200) 10:40:28.441 Executor task launch worker for task 251 INFO Executor: Finished task 23.0 in stage 121.0 (TID 251). 1300 bytes result sent to driver 10:40:28.441 Executor task launch worker for task 250 INFO Executor: Finished task 22.0 in stage 121.0 (TID 250). 1343 bytes result sent to driver 10:40:28.441 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 24.0 in stage 121.0 (TID 252, amp-jenkins-worker-04.amp, executor driver, partition 24, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.441 Executor task launch worker for task 252 INFO Executor: Running task 24.0 in stage 121.0 (TID 252) 10:40:28.441 task-result-getter-2 INFO TaskSetManager: Finished task 23.0 in stage 121.0 (TID 251) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (23/200) 10:40:28.441 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 25.0 in stage 121.0 (TID 253, amp-jenkins-worker-04.amp, executor driver, partition 25, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.442 Executor task launch worker for task 253 INFO Executor: Running task 25.0 in stage 121.0 (TID 253) 10:40:28.442 task-result-getter-1 INFO TaskSetManager: Finished task 22.0 in stage 121.0 (TID 250) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (24/200) 10:40:28.444 Executor task launch worker for task 253 INFO Executor: Finished task 25.0 in stage 121.0 (TID 253). 1343 bytes result sent to driver 10:40:28.444 Executor task launch worker for task 252 INFO Executor: Finished task 24.0 in stage 121.0 (TID 252). 1343 bytes result sent to driver 10:40:28.445 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 26.0 in stage 121.0 (TID 254, amp-jenkins-worker-04.amp, executor driver, partition 26, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.445 task-result-getter-0 INFO TaskSetManager: Finished task 25.0 in stage 121.0 (TID 253) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (25/200) 10:40:28.445 Executor task launch worker for task 254 INFO Executor: Running task 26.0 in stage 121.0 (TID 254) 10:40:28.445 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 27.0 in stage 121.0 (TID 255, amp-jenkins-worker-04.amp, executor driver, partition 27, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.445 Executor task launch worker for task 255 INFO Executor: Running task 27.0 in stage 121.0 (TID 255) 10:40:28.446 task-result-getter-3 INFO TaskSetManager: Finished task 24.0 in stage 121.0 (TID 252) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (26/200) 10:40:28.447 Executor task launch worker for task 255 INFO Executor: Finished task 27.0 in stage 121.0 (TID 255). 1300 bytes result sent to driver 10:40:28.447 Executor task launch worker for task 254 INFO Executor: Finished task 26.0 in stage 121.0 (TID 254). 1300 bytes result sent to driver 10:40:28.447 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 28.0 in stage 121.0 (TID 256, amp-jenkins-worker-04.amp, executor driver, partition 28, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.447 Executor task launch worker for task 256 INFO Executor: Running task 28.0 in stage 121.0 (TID 256) 10:40:28.448 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 29.0 in stage 121.0 (TID 257, amp-jenkins-worker-04.amp, executor driver, partition 29, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.448 task-result-getter-2 INFO TaskSetManager: Finished task 27.0 in stage 121.0 (TID 255) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (27/200) 10:40:28.448 Executor task launch worker for task 257 INFO Executor: Running task 29.0 in stage 121.0 (TID 257) 10:40:28.448 task-result-getter-1 INFO TaskSetManager: Finished task 26.0 in stage 121.0 (TID 254) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (28/200) 10:40:28.449 Executor task launch worker for task 256 INFO Executor: Finished task 28.0 in stage 121.0 (TID 256). 1300 bytes result sent to driver 10:40:28.449 Executor task launch worker for task 257 INFO Executor: Finished task 29.0 in stage 121.0 (TID 257). 1300 bytes result sent to driver 10:40:28.450 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 30.0 in stage 121.0 (TID 258, amp-jenkins-worker-04.amp, executor driver, partition 30, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.450 Executor task launch worker for task 258 INFO Executor: Running task 30.0 in stage 121.0 (TID 258) 10:40:28.450 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 31.0 in stage 121.0 (TID 259, amp-jenkins-worker-04.amp, executor driver, partition 31, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.450 task-result-getter-0 INFO TaskSetManager: Finished task 28.0 in stage 121.0 (TID 256) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (29/200) 10:40:28.450 task-result-getter-3 INFO TaskSetManager: Finished task 29.0 in stage 121.0 (TID 257) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (30/200) 10:40:28.450 Executor task launch worker for task 259 INFO Executor: Running task 31.0 in stage 121.0 (TID 259) 10:40:28.453 Executor task launch worker for task 258 INFO Executor: Finished task 30.0 in stage 121.0 (TID 258). 1343 bytes result sent to driver 10:40:28.453 Executor task launch worker for task 259 INFO Executor: Finished task 31.0 in stage 121.0 (TID 259). 1343 bytes result sent to driver 10:40:28.453 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 32.0 in stage 121.0 (TID 260, amp-jenkins-worker-04.amp, executor driver, partition 32, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.453 Executor task launch worker for task 260 INFO Executor: Running task 32.0 in stage 121.0 (TID 260) 10:40:28.453 task-result-getter-2 INFO TaskSetManager: Finished task 30.0 in stage 121.0 (TID 258) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (31/200) 10:40:28.453 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 33.0 in stage 121.0 (TID 261, amp-jenkins-worker-04.amp, executor driver, partition 33, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.454 task-result-getter-1 INFO TaskSetManager: Finished task 31.0 in stage 121.0 (TID 259) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (32/200) 10:40:28.454 Executor task launch worker for task 261 INFO Executor: Running task 33.0 in stage 121.0 (TID 261) 10:40:28.456 Executor task launch worker for task 261 INFO Executor: Finished task 33.0 in stage 121.0 (TID 261). 1343 bytes result sent to driver 10:40:28.456 Executor task launch worker for task 260 INFO Executor: Finished task 32.0 in stage 121.0 (TID 260). 1343 bytes result sent to driver 10:40:28.456 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 34.0 in stage 121.0 (TID 262, amp-jenkins-worker-04.amp, executor driver, partition 34, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.456 Executor task launch worker for task 262 INFO Executor: Running task 34.0 in stage 121.0 (TID 262) 10:40:28.457 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 35.0 in stage 121.0 (TID 263, amp-jenkins-worker-04.amp, executor driver, partition 35, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.457 task-result-getter-0 INFO TaskSetManager: Finished task 33.0 in stage 121.0 (TID 261) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (33/200) 10:40:28.457 Executor task launch worker for task 263 INFO Executor: Running task 35.0 in stage 121.0 (TID 263) 10:40:28.457 task-result-getter-3 INFO TaskSetManager: Finished task 32.0 in stage 121.0 (TID 260) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (34/200) 10:40:28.458 Executor task launch worker for task 262 INFO Executor: Finished task 34.0 in stage 121.0 (TID 262). 1300 bytes result sent to driver 10:40:28.458 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 36.0 in stage 121.0 (TID 264, amp-jenkins-worker-04.amp, executor driver, partition 36, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.459 Executor task launch worker for task 264 INFO Executor: Running task 36.0 in stage 121.0 (TID 264) 10:40:28.459 task-result-getter-2 INFO TaskSetManager: Finished task 34.0 in stage 121.0 (TID 262) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (35/200) 10:40:28.459 Executor task launch worker for task 263 INFO Executor: Finished task 35.0 in stage 121.0 (TID 263). 1343 bytes result sent to driver 10:40:28.459 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 37.0 in stage 121.0 (TID 265, amp-jenkins-worker-04.amp, executor driver, partition 37, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.459 Executor task launch worker for task 265 INFO Executor: Running task 37.0 in stage 121.0 (TID 265) 10:40:28.459 task-result-getter-1 INFO TaskSetManager: Finished task 35.0 in stage 121.0 (TID 263) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (36/200) 10:40:28.461 Executor task launch worker for task 264 INFO Executor: Finished task 36.0 in stage 121.0 (TID 264). 1343 bytes result sent to driver 10:40:28.461 Executor task launch worker for task 265 INFO Executor: Finished task 37.0 in stage 121.0 (TID 265). 1300 bytes result sent to driver 10:40:28.462 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 38.0 in stage 121.0 (TID 266, amp-jenkins-worker-04.amp, executor driver, partition 38, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.462 Executor task launch worker for task 266 INFO Executor: Running task 38.0 in stage 121.0 (TID 266) 10:40:28.462 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 39.0 in stage 121.0 (TID 267, amp-jenkins-worker-04.amp, executor driver, partition 39, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.462 task-result-getter-0 INFO TaskSetManager: Finished task 36.0 in stage 121.0 (TID 264) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (37/200) 10:40:28.462 Executor task launch worker for task 267 INFO Executor: Running task 39.0 in stage 121.0 (TID 267) 10:40:28.462 task-result-getter-3 INFO TaskSetManager: Finished task 37.0 in stage 121.0 (TID 265) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (38/200) 10:40:28.464 Executor task launch worker for task 267 INFO Executor: Finished task 39.0 in stage 121.0 (TID 267). 1360 bytes result sent to driver 10:40:28.464 Executor task launch worker for task 266 INFO Executor: Finished task 38.0 in stage 121.0 (TID 266). 1343 bytes result sent to driver 10:40:28.464 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 40.0 in stage 121.0 (TID 268, amp-jenkins-worker-04.amp, executor driver, partition 40, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.464 Executor task launch worker for task 268 INFO Executor: Running task 40.0 in stage 121.0 (TID 268) 10:40:28.464 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 41.0 in stage 121.0 (TID 269, amp-jenkins-worker-04.amp, executor driver, partition 41, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.464 task-result-getter-2 INFO TaskSetManager: Finished task 39.0 in stage 121.0 (TID 267) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (39/200) 10:40:28.464 Executor task launch worker for task 269 INFO Executor: Running task 41.0 in stage 121.0 (TID 269) 10:40:28.464 task-result-getter-1 INFO TaskSetManager: Finished task 38.0 in stage 121.0 (TID 266) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (40/200) 10:40:28.466 Executor task launch worker for task 269 INFO Executor: Finished task 41.0 in stage 121.0 (TID 269). 1300 bytes result sent to driver 10:40:28.466 Executor task launch worker for task 268 INFO Executor: Finished task 40.0 in stage 121.0 (TID 268). 1300 bytes result sent to driver 10:40:28.466 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 42.0 in stage 121.0 (TID 270, amp-jenkins-worker-04.amp, executor driver, partition 42, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.466 Executor task launch worker for task 270 INFO Executor: Running task 42.0 in stage 121.0 (TID 270) 10:40:28.466 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 43.0 in stage 121.0 (TID 271, amp-jenkins-worker-04.amp, executor driver, partition 43, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.466 task-result-getter-0 INFO TaskSetManager: Finished task 41.0 in stage 121.0 (TID 269) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (41/200) 10:40:28.466 Executor task launch worker for task 271 INFO Executor: Running task 43.0 in stage 121.0 (TID 271) 10:40:28.466 task-result-getter-3 INFO TaskSetManager: Finished task 40.0 in stage 121.0 (TID 268) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (42/200) 10:40:28.468 Executor task launch worker for task 270 INFO Executor: Finished task 42.0 in stage 121.0 (TID 270). 1300 bytes result sent to driver 10:40:28.468 Executor task launch worker for task 271 INFO Executor: Finished task 43.0 in stage 121.0 (TID 271). 1300 bytes result sent to driver 10:40:28.468 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 44.0 in stage 121.0 (TID 272, amp-jenkins-worker-04.amp, executor driver, partition 44, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.468 Executor task launch worker for task 272 INFO Executor: Running task 44.0 in stage 121.0 (TID 272) 10:40:28.468 task-result-getter-2 INFO TaskSetManager: Finished task 42.0 in stage 121.0 (TID 270) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (43/200) 10:40:28.468 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 45.0 in stage 121.0 (TID 273, amp-jenkins-worker-04.amp, executor driver, partition 45, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.468 Executor task launch worker for task 273 INFO Executor: Running task 45.0 in stage 121.0 (TID 273) 10:40:28.468 task-result-getter-1 INFO TaskSetManager: Finished task 43.0 in stage 121.0 (TID 271) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (44/200) 10:40:28.470 Executor task launch worker for task 273 INFO Executor: Finished task 45.0 in stage 121.0 (TID 273). 1300 bytes result sent to driver 10:40:28.470 Executor task launch worker for task 272 INFO Executor: Finished task 44.0 in stage 121.0 (TID 272). 1300 bytes result sent to driver 10:40:28.470 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 46.0 in stage 121.0 (TID 274, amp-jenkins-worker-04.amp, executor driver, partition 46, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.470 Executor task launch worker for task 274 INFO Executor: Running task 46.0 in stage 121.0 (TID 274) 10:40:28.470 task-result-getter-0 INFO TaskSetManager: Finished task 45.0 in stage 121.0 (TID 273) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (45/200) 10:40:28.470 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 47.0 in stage 121.0 (TID 275, amp-jenkins-worker-04.amp, executor driver, partition 47, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.470 Executor task launch worker for task 275 INFO Executor: Running task 47.0 in stage 121.0 (TID 275) 10:40:28.470 task-result-getter-3 INFO TaskSetManager: Finished task 44.0 in stage 121.0 (TID 272) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (46/200) 10:40:28.471 Executor task launch worker for task 274 INFO Executor: Finished task 46.0 in stage 121.0 (TID 274). 1300 bytes result sent to driver 10:40:28.472 Executor task launch worker for task 275 INFO Executor: Finished task 47.0 in stage 121.0 (TID 275). 1300 bytes result sent to driver 10:40:28.472 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 48.0 in stage 121.0 (TID 276, amp-jenkins-worker-04.amp, executor driver, partition 48, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.472 Executor task launch worker for task 276 INFO Executor: Running task 48.0 in stage 121.0 (TID 276) 10:40:28.472 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 49.0 in stage 121.0 (TID 277, amp-jenkins-worker-04.amp, executor driver, partition 49, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.472 task-result-getter-2 INFO TaskSetManager: Finished task 46.0 in stage 121.0 (TID 274) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (47/200) 10:40:28.472 Executor task launch worker for task 277 INFO Executor: Running task 49.0 in stage 121.0 (TID 277) 10:40:28.472 task-result-getter-1 INFO TaskSetManager: Finished task 47.0 in stage 121.0 (TID 275) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (48/200) 10:40:28.473 Executor task launch worker for task 276 INFO Executor: Finished task 48.0 in stage 121.0 (TID 276). 1300 bytes result sent to driver 10:40:28.473 Executor task launch worker for task 277 INFO Executor: Finished task 49.0 in stage 121.0 (TID 277). 1300 bytes result sent to driver 10:40:28.474 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 50.0 in stage 121.0 (TID 278, amp-jenkins-worker-04.amp, executor driver, partition 50, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.474 Executor task launch worker for task 278 INFO Executor: Running task 50.0 in stage 121.0 (TID 278) 10:40:28.474 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 51.0 in stage 121.0 (TID 279, amp-jenkins-worker-04.amp, executor driver, partition 51, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.474 Executor task launch worker for task 279 INFO Executor: Running task 51.0 in stage 121.0 (TID 279) 10:40:28.474 task-result-getter-3 INFO TaskSetManager: Finished task 49.0 in stage 121.0 (TID 277) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (49/200) 10:40:28.474 task-result-getter-0 INFO TaskSetManager: Finished task 48.0 in stage 121.0 (TID 276) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (50/200) 10:40:28.475 Executor task launch worker for task 278 INFO Executor: Finished task 50.0 in stage 121.0 (TID 278). 1300 bytes result sent to driver 10:40:28.475 Executor task launch worker for task 279 INFO Executor: Finished task 51.0 in stage 121.0 (TID 279). 1300 bytes result sent to driver 10:40:28.475 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 52.0 in stage 121.0 (TID 280, amp-jenkins-worker-04.amp, executor driver, partition 52, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.475 Executor task launch worker for task 280 INFO Executor: Running task 52.0 in stage 121.0 (TID 280) 10:40:28.476 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 53.0 in stage 121.0 (TID 281, amp-jenkins-worker-04.amp, executor driver, partition 53, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.476 task-result-getter-2 INFO TaskSetManager: Finished task 50.0 in stage 121.0 (TID 278) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (51/200) 10:40:28.476 Executor task launch worker for task 281 INFO Executor: Running task 53.0 in stage 121.0 (TID 281) 10:40:28.476 task-result-getter-1 INFO TaskSetManager: Finished task 51.0 in stage 121.0 (TID 279) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (52/200) 10:40:28.477 Executor task launch worker for task 280 INFO Executor: Finished task 52.0 in stage 121.0 (TID 280). 1300 bytes result sent to driver 10:40:28.477 Executor task launch worker for task 281 INFO Executor: Finished task 53.0 in stage 121.0 (TID 281). 1300 bytes result sent to driver 10:40:28.477 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 54.0 in stage 121.0 (TID 282, amp-jenkins-worker-04.amp, executor driver, partition 54, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.477 Executor task launch worker for task 282 INFO Executor: Running task 54.0 in stage 121.0 (TID 282) 10:40:28.477 task-result-getter-3 INFO TaskSetManager: Finished task 52.0 in stage 121.0 (TID 280) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (53/200) 10:40:28.477 task-result-getter-0 INFO TaskSetManager: Finished task 53.0 in stage 121.0 (TID 281) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (54/200) 10:40:28.478 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 55.0 in stage 121.0 (TID 283, amp-jenkins-worker-04.amp, executor driver, partition 55, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.478 Executor task launch worker for task 283 INFO Executor: Running task 55.0 in stage 121.0 (TID 283) 10:40:28.479 Executor task launch worker for task 282 INFO Executor: Finished task 54.0 in stage 121.0 (TID 282). 1300 bytes result sent to driver 10:40:28.479 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 56.0 in stage 121.0 (TID 284, amp-jenkins-worker-04.amp, executor driver, partition 56, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.479 Executor task launch worker for task 284 INFO Executor: Running task 56.0 in stage 121.0 (TID 284) 10:40:28.479 task-result-getter-2 INFO TaskSetManager: Finished task 54.0 in stage 121.0 (TID 282) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (55/200) 10:40:28.479 Executor task launch worker for task 283 INFO Executor: Finished task 55.0 in stage 121.0 (TID 283). 1300 bytes result sent to driver 10:40:28.479 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 57.0 in stage 121.0 (TID 285, amp-jenkins-worker-04.amp, executor driver, partition 57, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.479 Executor task launch worker for task 285 INFO Executor: Running task 57.0 in stage 121.0 (TID 285) 10:40:28.479 task-result-getter-1 INFO TaskSetManager: Finished task 55.0 in stage 121.0 (TID 283) in 1 ms on amp-jenkins-worker-04.amp (executor driver) (56/200) 10:40:28.480 Executor task launch worker for task 284 INFO Executor: Finished task 56.0 in stage 121.0 (TID 284). 1300 bytes result sent to driver 10:40:28.480 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 58.0 in stage 121.0 (TID 286, amp-jenkins-worker-04.amp, executor driver, partition 58, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.480 Executor task launch worker for task 286 INFO Executor: Running task 58.0 in stage 121.0 (TID 286) 10:40:28.481 task-result-getter-3 INFO TaskSetManager: Finished task 56.0 in stage 121.0 (TID 284) in 1 ms on amp-jenkins-worker-04.amp (executor driver) (57/200) 10:40:28.481 Executor task launch worker for task 285 INFO Executor: Finished task 57.0 in stage 121.0 (TID 285). 1300 bytes result sent to driver 10:40:28.481 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 59.0 in stage 121.0 (TID 287, amp-jenkins-worker-04.amp, executor driver, partition 59, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.481 Executor task launch worker for task 287 INFO Executor: Running task 59.0 in stage 121.0 (TID 287) 10:40:28.481 task-result-getter-0 INFO TaskSetManager: Finished task 57.0 in stage 121.0 (TID 285) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (58/200) 10:40:28.482 Executor task launch worker for task 286 INFO Executor: Finished task 58.0 in stage 121.0 (TID 286). 1300 bytes result sent to driver 10:40:28.482 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 60.0 in stage 121.0 (TID 288, amp-jenkins-worker-04.amp, executor driver, partition 60, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.482 Executor task launch worker for task 288 INFO Executor: Running task 60.0 in stage 121.0 (TID 288) 10:40:28.482 task-result-getter-2 INFO TaskSetManager: Finished task 58.0 in stage 121.0 (TID 286) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (59/200) 10:40:28.483 Executor task launch worker for task 287 INFO Executor: Finished task 59.0 in stage 121.0 (TID 287). 1360 bytes result sent to driver 10:40:28.483 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 61.0 in stage 121.0 (TID 289, amp-jenkins-worker-04.amp, executor driver, partition 61, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.483 Executor task launch worker for task 289 INFO Executor: Running task 61.0 in stage 121.0 (TID 289) 10:40:28.483 task-result-getter-1 INFO TaskSetManager: Finished task 59.0 in stage 121.0 (TID 287) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (60/200) 10:40:28.483 Executor task launch worker for task 288 INFO Executor: Finished task 60.0 in stage 121.0 (TID 288). 1300 bytes result sent to driver 10:40:28.484 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 62.0 in stage 121.0 (TID 290, amp-jenkins-worker-04.amp, executor driver, partition 62, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.484 Executor task launch worker for task 290 INFO Executor: Running task 62.0 in stage 121.0 (TID 290) 10:40:28.484 task-result-getter-3 INFO TaskSetManager: Finished task 60.0 in stage 121.0 (TID 288) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (61/200) 10:40:28.484 Executor task launch worker for task 289 INFO Executor: Finished task 61.0 in stage 121.0 (TID 289). 1300 bytes result sent to driver 10:40:28.484 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 63.0 in stage 121.0 (TID 291, amp-jenkins-worker-04.amp, executor driver, partition 63, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.484 Executor task launch worker for task 291 INFO Executor: Running task 63.0 in stage 121.0 (TID 291) 10:40:28.484 task-result-getter-0 INFO TaskSetManager: Finished task 61.0 in stage 121.0 (TID 289) in 1 ms on amp-jenkins-worker-04.amp (executor driver) (62/200) 10:40:28.485 Executor task launch worker for task 290 INFO Executor: Finished task 62.0 in stage 121.0 (TID 290). 1300 bytes result sent to driver 10:40:28.485 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 64.0 in stage 121.0 (TID 292, amp-jenkins-worker-04.amp, executor driver, partition 64, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.485 Executor task launch worker for task 292 INFO Executor: Running task 64.0 in stage 121.0 (TID 292) 10:40:28.485 task-result-getter-2 INFO TaskSetManager: Finished task 62.0 in stage 121.0 (TID 290) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (63/200) 10:40:28.486 Executor task launch worker for task 291 INFO Executor: Finished task 63.0 in stage 121.0 (TID 291). 1300 bytes result sent to driver 10:40:28.486 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 65.0 in stage 121.0 (TID 293, amp-jenkins-worker-04.amp, executor driver, partition 65, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.486 Executor task launch worker for task 293 INFO Executor: Running task 65.0 in stage 121.0 (TID 293) 10:40:28.486 task-result-getter-1 INFO TaskSetManager: Finished task 63.0 in stage 121.0 (TID 291) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (64/200) 10:40:28.487 Executor task launch worker for task 292 INFO Executor: Finished task 64.0 in stage 121.0 (TID 292). 1300 bytes result sent to driver 10:40:28.487 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 66.0 in stage 121.0 (TID 294, amp-jenkins-worker-04.amp, executor driver, partition 66, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.487 Executor task launch worker for task 294 INFO Executor: Running task 66.0 in stage 121.0 (TID 294) 10:40:28.487 task-result-getter-3 INFO TaskSetManager: Finished task 64.0 in stage 121.0 (TID 292) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (65/200) 10:40:28.488 Executor task launch worker for task 293 INFO Executor: Finished task 65.0 in stage 121.0 (TID 293). 1300 bytes result sent to driver 10:40:28.488 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 67.0 in stage 121.0 (TID 295, amp-jenkins-worker-04.amp, executor driver, partition 67, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.488 Executor task launch worker for task 295 INFO Executor: Running task 67.0 in stage 121.0 (TID 295) 10:40:28.488 task-result-getter-0 INFO TaskSetManager: Finished task 65.0 in stage 121.0 (TID 293) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (66/200) 10:40:28.488 Executor task launch worker for task 294 INFO Executor: Finished task 66.0 in stage 121.0 (TID 294). 1300 bytes result sent to driver 10:40:28.488 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 68.0 in stage 121.0 (TID 296, amp-jenkins-worker-04.amp, executor driver, partition 68, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.488 Executor task launch worker for task 296 INFO Executor: Running task 68.0 in stage 121.0 (TID 296) 10:40:28.489 task-result-getter-2 INFO TaskSetManager: Finished task 66.0 in stage 121.0 (TID 294) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (67/200) 10:40:28.489 Executor task launch worker for task 295 INFO Executor: Finished task 67.0 in stage 121.0 (TID 295). 1300 bytes result sent to driver 10:40:28.489 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 69.0 in stage 121.0 (TID 297, amp-jenkins-worker-04.amp, executor driver, partition 69, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.489 Executor task launch worker for task 297 INFO Executor: Running task 69.0 in stage 121.0 (TID 297) 10:40:28.489 task-result-getter-1 INFO TaskSetManager: Finished task 67.0 in stage 121.0 (TID 295) in 1 ms on amp-jenkins-worker-04.amp (executor driver) (68/200) 10:40:28.490 Executor task launch worker for task 296 INFO Executor: Finished task 68.0 in stage 121.0 (TID 296). 1300 bytes result sent to driver 10:40:28.490 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 70.0 in stage 121.0 (TID 298, amp-jenkins-worker-04.amp, executor driver, partition 70, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.490 Executor task launch worker for task 298 INFO Executor: Running task 70.0 in stage 121.0 (TID 298) 10:40:28.490 task-result-getter-3 INFO TaskSetManager: Finished task 68.0 in stage 121.0 (TID 296) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (69/200) 10:40:28.491 Executor task launch worker for task 297 INFO Executor: Finished task 69.0 in stage 121.0 (TID 297). 1300 bytes result sent to driver 10:40:28.491 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 71.0 in stage 121.0 (TID 299, amp-jenkins-worker-04.amp, executor driver, partition 71, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.491 Executor task launch worker for task 299 INFO Executor: Running task 71.0 in stage 121.0 (TID 299) 10:40:28.491 task-result-getter-0 INFO TaskSetManager: Finished task 69.0 in stage 121.0 (TID 297) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (70/200) 10:40:28.492 Executor task launch worker for task 298 INFO Executor: Finished task 70.0 in stage 121.0 (TID 298). 1300 bytes result sent to driver 10:40:28.492 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 72.0 in stage 121.0 (TID 300, amp-jenkins-worker-04.amp, executor driver, partition 72, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.492 Executor task launch worker for task 300 INFO Executor: Running task 72.0 in stage 121.0 (TID 300) 10:40:28.492 task-result-getter-2 INFO TaskSetManager: Finished task 70.0 in stage 121.0 (TID 298) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (71/200) 10:40:28.492 Executor task launch worker for task 299 INFO Executor: Finished task 71.0 in stage 121.0 (TID 299). 1300 bytes result sent to driver 10:40:28.492 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 73.0 in stage 121.0 (TID 301, amp-jenkins-worker-04.amp, executor driver, partition 73, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.493 Executor task launch worker for task 301 INFO Executor: Running task 73.0 in stage 121.0 (TID 301) 10:40:28.493 task-result-getter-1 INFO TaskSetManager: Finished task 71.0 in stage 121.0 (TID 299) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (72/200) 10:40:28.493 Executor task launch worker for task 300 INFO Executor: Finished task 72.0 in stage 121.0 (TID 300). 1300 bytes result sent to driver 10:40:28.493 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 74.0 in stage 121.0 (TID 302, amp-jenkins-worker-04.amp, executor driver, partition 74, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.493 Executor task launch worker for task 302 INFO Executor: Running task 74.0 in stage 121.0 (TID 302) 10:40:28.493 task-result-getter-3 INFO TaskSetManager: Finished task 72.0 in stage 121.0 (TID 300) in 1 ms on amp-jenkins-worker-04.amp (executor driver) (73/200) 10:40:28.494 Executor task launch worker for task 301 INFO Executor: Finished task 73.0 in stage 121.0 (TID 301). 1300 bytes result sent to driver 10:40:28.494 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 75.0 in stage 121.0 (TID 303, amp-jenkins-worker-04.amp, executor driver, partition 75, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.494 Executor task launch worker for task 303 INFO Executor: Running task 75.0 in stage 121.0 (TID 303) 10:40:28.495 task-result-getter-0 INFO TaskSetManager: Finished task 73.0 in stage 121.0 (TID 301) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (74/200) 10:40:28.495 Executor task launch worker for task 302 INFO Executor: Finished task 74.0 in stage 121.0 (TID 302). 1300 bytes result sent to driver 10:40:28.495 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 76.0 in stage 121.0 (TID 304, amp-jenkins-worker-04.amp, executor driver, partition 76, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.495 Executor task launch worker for task 304 INFO Executor: Running task 76.0 in stage 121.0 (TID 304) 10:40:28.495 task-result-getter-2 INFO TaskSetManager: Finished task 74.0 in stage 121.0 (TID 302) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (75/200) 10:40:28.496 Executor task launch worker for task 304 INFO Executor: Finished task 76.0 in stage 121.0 (TID 304). 1300 bytes result sent to driver 10:40:28.496 Executor task launch worker for task 303 INFO Executor: Finished task 75.0 in stage 121.0 (TID 303). 1300 bytes result sent to driver 10:40:28.496 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 77.0 in stage 121.0 (TID 305, amp-jenkins-worker-04.amp, executor driver, partition 77, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.497 Executor task launch worker for task 305 INFO Executor: Running task 77.0 in stage 121.0 (TID 305) 10:40:28.497 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 78.0 in stage 121.0 (TID 306, amp-jenkins-worker-04.amp, executor driver, partition 78, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.497 task-result-getter-1 INFO TaskSetManager: Finished task 76.0 in stage 121.0 (TID 304) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (76/200) 10:40:28.497 Executor task launch worker for task 306 INFO Executor: Running task 78.0 in stage 121.0 (TID 306) 10:40:28.497 task-result-getter-3 INFO TaskSetManager: Finished task 75.0 in stage 121.0 (TID 303) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (77/200) 10:40:28.498 Executor task launch worker for task 305 INFO Executor: Finished task 77.0 in stage 121.0 (TID 305). 1300 bytes result sent to driver 10:40:28.498 Executor task launch worker for task 306 INFO Executor: Finished task 78.0 in stage 121.0 (TID 306). 1300 bytes result sent to driver 10:40:28.498 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 79.0 in stage 121.0 (TID 307, amp-jenkins-worker-04.amp, executor driver, partition 79, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.498 Executor task launch worker for task 307 INFO Executor: Running task 79.0 in stage 121.0 (TID 307) 10:40:28.498 task-result-getter-0 INFO TaskSetManager: Finished task 77.0 in stage 121.0 (TID 305) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (78/200) 10:40:28.498 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 80.0 in stage 121.0 (TID 308, amp-jenkins-worker-04.amp, executor driver, partition 80, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.498 Executor task launch worker for task 308 INFO Executor: Running task 80.0 in stage 121.0 (TID 308) 10:40:28.499 task-result-getter-2 INFO TaskSetManager: Finished task 78.0 in stage 121.0 (TID 306) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (79/200) 10:40:28.500 Executor task launch worker for task 307 INFO Executor: Finished task 79.0 in stage 121.0 (TID 307). 1360 bytes result sent to driver 10:40:28.500 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 81.0 in stage 121.0 (TID 309, amp-jenkins-worker-04.amp, executor driver, partition 81, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.500 Executor task launch worker for task 308 INFO Executor: Finished task 80.0 in stage 121.0 (TID 308). 1300 bytes result sent to driver 10:40:28.500 Executor task launch worker for task 309 INFO Executor: Running task 81.0 in stage 121.0 (TID 309) 10:40:28.500 task-result-getter-1 INFO TaskSetManager: Finished task 79.0 in stage 121.0 (TID 307) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (80/200) 10:40:28.500 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 82.0 in stage 121.0 (TID 310, amp-jenkins-worker-04.amp, executor driver, partition 82, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.500 Executor task launch worker for task 310 INFO Executor: Running task 82.0 in stage 121.0 (TID 310) 10:40:28.500 task-result-getter-3 INFO TaskSetManager: Finished task 80.0 in stage 121.0 (TID 308) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (81/200) 10:40:28.501 Executor task launch worker for task 309 INFO Executor: Finished task 81.0 in stage 121.0 (TID 309). 1300 bytes result sent to driver 10:40:28.501 Executor task launch worker for task 310 INFO Executor: Finished task 82.0 in stage 121.0 (TID 310). 1300 bytes result sent to driver 10:40:28.501 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 83.0 in stage 121.0 (TID 311, amp-jenkins-worker-04.amp, executor driver, partition 83, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.502 Executor task launch worker for task 311 INFO Executor: Running task 83.0 in stage 121.0 (TID 311) 10:40:28.502 task-result-getter-0 INFO TaskSetManager: Finished task 81.0 in stage 121.0 (TID 309) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (82/200) 10:40:28.502 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 84.0 in stage 121.0 (TID 312, amp-jenkins-worker-04.amp, executor driver, partition 84, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.502 Executor task launch worker for task 312 INFO Executor: Running task 84.0 in stage 121.0 (TID 312) 10:40:28.502 task-result-getter-2 INFO TaskSetManager: Finished task 82.0 in stage 121.0 (TID 310) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (83/200) 10:40:28.503 Executor task launch worker for task 311 INFO Executor: Finished task 83.0 in stage 121.0 (TID 311). 1300 bytes result sent to driver 10:40:28.503 Executor task launch worker for task 312 INFO Executor: Finished task 84.0 in stage 121.0 (TID 312). 1300 bytes result sent to driver 10:40:28.503 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 85.0 in stage 121.0 (TID 313, amp-jenkins-worker-04.amp, executor driver, partition 85, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.503 Executor task launch worker for task 313 INFO Executor: Running task 85.0 in stage 121.0 (TID 313) 10:40:28.503 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 86.0 in stage 121.0 (TID 314, amp-jenkins-worker-04.amp, executor driver, partition 86, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.503 Executor task launch worker for task 314 INFO Executor: Running task 86.0 in stage 121.0 (TID 314) 10:40:28.503 task-result-getter-3 INFO TaskSetManager: Finished task 84.0 in stage 121.0 (TID 312) in 1 ms on amp-jenkins-worker-04.amp (executor driver) (84/200) 10:40:28.504 task-result-getter-1 INFO TaskSetManager: Finished task 83.0 in stage 121.0 (TID 311) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (85/200) 10:40:28.505 Executor task launch worker for task 314 INFO Executor: Finished task 86.0 in stage 121.0 (TID 314). 1300 bytes result sent to driver 10:40:28.505 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 87.0 in stage 121.0 (TID 315, amp-jenkins-worker-04.amp, executor driver, partition 87, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.505 Executor task launch worker for task 315 INFO Executor: Running task 87.0 in stage 121.0 (TID 315) 10:40:28.505 task-result-getter-0 INFO TaskSetManager: Finished task 86.0 in stage 121.0 (TID 314) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (86/200) 10:40:28.505 Executor task launch worker for task 313 INFO Executor: Finished task 85.0 in stage 121.0 (TID 313). 1300 bytes result sent to driver 10:40:28.505 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 88.0 in stage 121.0 (TID 316, amp-jenkins-worker-04.amp, executor driver, partition 88, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.505 Executor task launch worker for task 316 INFO Executor: Running task 88.0 in stage 121.0 (TID 316) 10:40:28.505 task-result-getter-2 INFO TaskSetManager: Finished task 85.0 in stage 121.0 (TID 313) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (87/200) 10:40:28.507 Executor task launch worker for task 316 INFO Executor: Finished task 88.0 in stage 121.0 (TID 316). 1300 bytes result sent to driver 10:40:28.507 Executor task launch worker for task 315 INFO Executor: Finished task 87.0 in stage 121.0 (TID 315). 1300 bytes result sent to driver 10:40:28.507 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 89.0 in stage 121.0 (TID 317, amp-jenkins-worker-04.amp, executor driver, partition 89, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.507 Executor task launch worker for task 317 INFO Executor: Running task 89.0 in stage 121.0 (TID 317) 10:40:28.507 task-result-getter-3 INFO TaskSetManager: Finished task 88.0 in stage 121.0 (TID 316) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (88/200) 10:40:28.507 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 90.0 in stage 121.0 (TID 318, amp-jenkins-worker-04.amp, executor driver, partition 90, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.507 Executor task launch worker for task 318 INFO Executor: Running task 90.0 in stage 121.0 (TID 318) 10:40:28.507 task-result-getter-1 INFO TaskSetManager: Finished task 87.0 in stage 121.0 (TID 315) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (89/200) 10:40:28.509 Executor task launch worker for task 317 INFO Executor: Finished task 89.0 in stage 121.0 (TID 317). 1300 bytes result sent to driver 10:40:28.509 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 91.0 in stage 121.0 (TID 319, amp-jenkins-worker-04.amp, executor driver, partition 91, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.509 Executor task launch worker for task 319 INFO Executor: Running task 91.0 in stage 121.0 (TID 319) 10:40:28.509 task-result-getter-0 INFO TaskSetManager: Finished task 89.0 in stage 121.0 (TID 317) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (90/200) 10:40:28.509 Executor task launch worker for task 318 INFO Executor: Finished task 90.0 in stage 121.0 (TID 318). 1300 bytes result sent to driver 10:40:28.509 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 92.0 in stage 121.0 (TID 320, amp-jenkins-worker-04.amp, executor driver, partition 92, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.509 Executor task launch worker for task 320 INFO Executor: Running task 92.0 in stage 121.0 (TID 320) 10:40:28.510 task-result-getter-2 INFO TaskSetManager: Finished task 90.0 in stage 121.0 (TID 318) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (91/200) 10:40:28.511 Executor task launch worker for task 320 INFO Executor: Finished task 92.0 in stage 121.0 (TID 320). 1300 bytes result sent to driver 10:40:28.511 Executor task launch worker for task 319 INFO Executor: Finished task 91.0 in stage 121.0 (TID 319). 1300 bytes result sent to driver 10:40:28.511 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 93.0 in stage 121.0 (TID 321, amp-jenkins-worker-04.amp, executor driver, partition 93, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.511 Executor task launch worker for task 321 INFO Executor: Running task 93.0 in stage 121.0 (TID 321) 10:40:28.511 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 94.0 in stage 121.0 (TID 322, amp-jenkins-worker-04.amp, executor driver, partition 94, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.512 task-result-getter-3 INFO TaskSetManager: Finished task 92.0 in stage 121.0 (TID 320) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (92/200) 10:40:28.512 Executor task launch worker for task 322 INFO Executor: Running task 94.0 in stage 121.0 (TID 322) 10:40:28.512 task-result-getter-1 INFO TaskSetManager: Finished task 91.0 in stage 121.0 (TID 319) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (93/200) 10:40:28.513 Executor task launch worker for task 321 INFO Executor: Finished task 93.0 in stage 121.0 (TID 321). 1300 bytes result sent to driver 10:40:28.513 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 95.0 in stage 121.0 (TID 323, amp-jenkins-worker-04.amp, executor driver, partition 95, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.513 Executor task launch worker for task 322 INFO Executor: Finished task 94.0 in stage 121.0 (TID 322). 1300 bytes result sent to driver 10:40:28.513 Executor task launch worker for task 323 INFO Executor: Running task 95.0 in stage 121.0 (TID 323) 10:40:28.513 task-result-getter-0 INFO TaskSetManager: Finished task 93.0 in stage 121.0 (TID 321) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (94/200) 10:40:28.513 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 96.0 in stage 121.0 (TID 324, amp-jenkins-worker-04.amp, executor driver, partition 96, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.513 Executor task launch worker for task 324 INFO Executor: Running task 96.0 in stage 121.0 (TID 324) 10:40:28.513 task-result-getter-2 INFO TaskSetManager: Finished task 94.0 in stage 121.0 (TID 322) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (95/200) 10:40:28.515 Executor task launch worker for task 323 INFO Executor: Finished task 95.0 in stage 121.0 (TID 323). 1300 bytes result sent to driver 10:40:28.515 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 97.0 in stage 121.0 (TID 325, amp-jenkins-worker-04.amp, executor driver, partition 97, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.515 Executor task launch worker for task 325 INFO Executor: Running task 97.0 in stage 121.0 (TID 325) 10:40:28.515 task-result-getter-3 INFO TaskSetManager: Finished task 95.0 in stage 121.0 (TID 323) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (96/200) 10:40:28.515 Executor task launch worker for task 324 INFO Executor: Finished task 96.0 in stage 121.0 (TID 324). 1343 bytes result sent to driver 10:40:28.516 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 98.0 in stage 121.0 (TID 326, amp-jenkins-worker-04.amp, executor driver, partition 98, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.516 Executor task launch worker for task 326 INFO Executor: Running task 98.0 in stage 121.0 (TID 326) 10:40:28.516 task-result-getter-1 INFO TaskSetManager: Finished task 96.0 in stage 121.0 (TID 324) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (97/200) 10:40:28.517 Executor task launch worker for task 325 INFO Executor: Finished task 97.0 in stage 121.0 (TID 325). 1300 bytes result sent to driver 10:40:28.517 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 99.0 in stage 121.0 (TID 327, amp-jenkins-worker-04.amp, executor driver, partition 99, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.517 Executor task launch worker for task 327 INFO Executor: Running task 99.0 in stage 121.0 (TID 327) 10:40:28.517 task-result-getter-0 INFO TaskSetManager: Finished task 97.0 in stage 121.0 (TID 325) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (98/200) 10:40:28.517 Executor task launch worker for task 326 INFO Executor: Finished task 98.0 in stage 121.0 (TID 326). 1300 bytes result sent to driver 10:40:28.518 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 100.0 in stage 121.0 (TID 328, amp-jenkins-worker-04.amp, executor driver, partition 100, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.518 Executor task launch worker for task 328 INFO Executor: Running task 100.0 in stage 121.0 (TID 328) 10:40:28.518 task-result-getter-2 INFO TaskSetManager: Finished task 98.0 in stage 121.0 (TID 326) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (99/200) 10:40:28.519 Executor task launch worker for task 327 INFO Executor: Finished task 99.0 in stage 121.0 (TID 327). 1360 bytes result sent to driver 10:40:28.519 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 101.0 in stage 121.0 (TID 329, amp-jenkins-worker-04.amp, executor driver, partition 101, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.519 Executor task launch worker for task 329 INFO Executor: Running task 101.0 in stage 121.0 (TID 329) 10:40:28.519 task-result-getter-3 INFO TaskSetManager: Finished task 99.0 in stage 121.0 (TID 327) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (100/200) 10:40:28.519 Executor task launch worker for task 328 INFO Executor: Finished task 100.0 in stage 121.0 (TID 328). 1300 bytes result sent to driver 10:40:28.519 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 102.0 in stage 121.0 (TID 330, amp-jenkins-worker-04.amp, executor driver, partition 102, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.520 Executor task launch worker for task 330 INFO Executor: Running task 102.0 in stage 121.0 (TID 330) 10:40:28.520 task-result-getter-1 INFO TaskSetManager: Finished task 100.0 in stage 121.0 (TID 328) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (101/200) 10:40:28.521 Executor task launch worker for task 330 INFO Executor: Finished task 102.0 in stage 121.0 (TID 330). 1300 bytes result sent to driver 10:40:28.521 Executor task launch worker for task 329 INFO Executor: Finished task 101.0 in stage 121.0 (TID 329). 1343 bytes result sent to driver 10:40:28.521 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 103.0 in stage 121.0 (TID 331, amp-jenkins-worker-04.amp, executor driver, partition 103, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.521 Executor task launch worker for task 331 INFO Executor: Running task 103.0 in stage 121.0 (TID 331) 10:40:28.521 task-result-getter-0 INFO TaskSetManager: Finished task 102.0 in stage 121.0 (TID 330) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (102/200) 10:40:28.522 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 104.0 in stage 121.0 (TID 332, amp-jenkins-worker-04.amp, executor driver, partition 104, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.522 Executor task launch worker for task 332 INFO Executor: Running task 104.0 in stage 121.0 (TID 332) 10:40:28.522 task-result-getter-2 INFO TaskSetManager: Finished task 101.0 in stage 121.0 (TID 329) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (103/200) 10:40:28.523 Executor task launch worker for task 332 INFO Executor: Finished task 104.0 in stage 121.0 (TID 332). 1300 bytes result sent to driver 10:40:28.523 Executor task launch worker for task 331 INFO Executor: Finished task 103.0 in stage 121.0 (TID 331). 1343 bytes result sent to driver 10:40:28.523 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 105.0 in stage 121.0 (TID 333, amp-jenkins-worker-04.amp, executor driver, partition 105, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.524 Executor task launch worker for task 333 INFO Executor: Running task 105.0 in stage 121.0 (TID 333) 10:40:28.524 task-result-getter-3 INFO TaskSetManager: Finished task 104.0 in stage 121.0 (TID 332) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (104/200) 10:40:28.524 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 106.0 in stage 121.0 (TID 334, amp-jenkins-worker-04.amp, executor driver, partition 106, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.524 Executor task launch worker for task 334 INFO Executor: Running task 106.0 in stage 121.0 (TID 334) 10:40:28.524 task-result-getter-1 INFO TaskSetManager: Finished task 103.0 in stage 121.0 (TID 331) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (105/200) 10:40:28.526 Executor task launch worker for task 333 INFO Executor: Finished task 105.0 in stage 121.0 (TID 333). 1343 bytes result sent to driver 10:40:28.526 Executor task launch worker for task 334 INFO Executor: Finished task 106.0 in stage 121.0 (TID 334). 1343 bytes result sent to driver 10:40:28.526 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 107.0 in stage 121.0 (TID 335, amp-jenkins-worker-04.amp, executor driver, partition 107, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.526 Executor task launch worker for task 335 INFO Executor: Running task 107.0 in stage 121.0 (TID 335) 10:40:28.526 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 108.0 in stage 121.0 (TID 336, amp-jenkins-worker-04.amp, executor driver, partition 108, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.526 task-result-getter-0 INFO TaskSetManager: Finished task 105.0 in stage 121.0 (TID 333) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (106/200) 10:40:28.526 Executor task launch worker for task 336 INFO Executor: Running task 108.0 in stage 121.0 (TID 336) 10:40:28.526 task-result-getter-2 INFO TaskSetManager: Finished task 106.0 in stage 121.0 (TID 334) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (107/200) 10:40:28.528 Executor task launch worker for task 335 INFO Executor: Finished task 107.0 in stage 121.0 (TID 335). 1343 bytes result sent to driver 10:40:28.528 Executor task launch worker for task 336 INFO Executor: Finished task 108.0 in stage 121.0 (TID 336). 1343 bytes result sent to driver 10:40:28.529 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 109.0 in stage 121.0 (TID 337, amp-jenkins-worker-04.amp, executor driver, partition 109, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.529 Executor task launch worker for task 337 INFO Executor: Running task 109.0 in stage 121.0 (TID 337) 10:40:28.529 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 110.0 in stage 121.0 (TID 338, amp-jenkins-worker-04.amp, executor driver, partition 110, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.529 Executor task launch worker for task 338 INFO Executor: Running task 110.0 in stage 121.0 (TID 338) 10:40:28.529 task-result-getter-3 INFO TaskSetManager: Finished task 107.0 in stage 121.0 (TID 335) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (108/200) 10:40:28.529 task-result-getter-3 INFO TaskSetManager: Finished task 108.0 in stage 121.0 (TID 336) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (109/200) 10:40:28.531 Executor task launch worker for task 337 INFO Executor: Finished task 109.0 in stage 121.0 (TID 337). 1386 bytes result sent to driver 10:40:28.531 Executor task launch worker for task 338 INFO Executor: Finished task 110.0 in stage 121.0 (TID 338). 1343 bytes result sent to driver 10:40:28.532 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 111.0 in stage 121.0 (TID 339, amp-jenkins-worker-04.amp, executor driver, partition 111, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.532 Executor task launch worker for task 339 INFO Executor: Running task 111.0 in stage 121.0 (TID 339) 10:40:28.532 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 112.0 in stage 121.0 (TID 340, amp-jenkins-worker-04.amp, executor driver, partition 112, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.532 Executor task launch worker for task 340 INFO Executor: Running task 112.0 in stage 121.0 (TID 340) 10:40:28.533 task-result-getter-1 INFO TaskSetManager: Finished task 109.0 in stage 121.0 (TID 337) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (110/200) 10:40:28.534 task-result-getter-0 INFO TaskSetManager: Finished task 110.0 in stage 121.0 (TID 338) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (111/200) 10:40:28.535 Executor task launch worker for task 340 INFO Executor: Finished task 112.0 in stage 121.0 (TID 340). 1386 bytes result sent to driver 10:40:28.535 Executor task launch worker for task 339 INFO Executor: Finished task 111.0 in stage 121.0 (TID 339). 1386 bytes result sent to driver 10:40:28.536 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 113.0 in stage 121.0 (TID 341, amp-jenkins-worker-04.amp, executor driver, partition 113, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.536 Executor task launch worker for task 341 INFO Executor: Running task 113.0 in stage 121.0 (TID 341) 10:40:28.536 task-result-getter-3 INFO TaskSetManager: Finished task 112.0 in stage 121.0 (TID 340) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (112/200) 10:40:28.536 task-result-getter-2 INFO TaskSetManager: Finished task 111.0 in stage 121.0 (TID 339) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (113/200) 10:40:28.537 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 114.0 in stage 121.0 (TID 342, amp-jenkins-worker-04.amp, executor driver, partition 114, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.537 Executor task launch worker for task 342 INFO Executor: Running task 114.0 in stage 121.0 (TID 342) 10:40:28.538 Executor task launch worker for task 341 INFO Executor: Finished task 113.0 in stage 121.0 (TID 341). 1343 bytes result sent to driver 10:40:28.538 task-result-getter-1 INFO TaskSetManager: Finished task 113.0 in stage 121.0 (TID 341) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (114/200) 10:40:28.539 Executor task launch worker for task 342 INFO Executor: Finished task 114.0 in stage 121.0 (TID 342). 1343 bytes result sent to driver 10:40:28.539 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 115.0 in stage 121.0 (TID 343, amp-jenkins-worker-04.amp, executor driver, partition 115, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.539 Executor task launch worker for task 343 INFO Executor: Running task 115.0 in stage 121.0 (TID 343) 10:40:28.539 task-result-getter-0 INFO TaskSetManager: Finished task 114.0 in stage 121.0 (TID 342) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (115/200) 10:40:28.540 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 116.0 in stage 121.0 (TID 344, amp-jenkins-worker-04.amp, executor driver, partition 116, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.540 Executor task launch worker for task 344 INFO Executor: Running task 116.0 in stage 121.0 (TID 344) 10:40:28.541 Executor task launch worker for task 343 INFO Executor: Finished task 115.0 in stage 121.0 (TID 343). 1343 bytes result sent to driver 10:40:28.541 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 117.0 in stage 121.0 (TID 345, amp-jenkins-worker-04.amp, executor driver, partition 117, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.541 Executor task launch worker for task 345 INFO Executor: Running task 117.0 in stage 121.0 (TID 345) 10:40:28.542 task-result-getter-3 INFO TaskSetManager: Finished task 115.0 in stage 121.0 (TID 343) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (116/200) 10:40:28.543 Executor task launch worker for task 345 INFO Executor: Finished task 117.0 in stage 121.0 (TID 345). 1300 bytes result sent to driver 10:40:28.543 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 118.0 in stage 121.0 (TID 346, amp-jenkins-worker-04.amp, executor driver, partition 118, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.544 Executor task launch worker for task 346 INFO Executor: Running task 118.0 in stage 121.0 (TID 346) 10:40:28.544 task-result-getter-2 INFO TaskSetManager: Finished task 117.0 in stage 121.0 (TID 345) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (117/200) 10:40:28.546 Executor task launch worker for task 346 INFO Executor: Finished task 118.0 in stage 121.0 (TID 346). 1343 bytes result sent to driver 10:40:28.546 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 119.0 in stage 121.0 (TID 347, amp-jenkins-worker-04.amp, executor driver, partition 119, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.546 task-result-getter-1 INFO TaskSetManager: Finished task 118.0 in stage 121.0 (TID 346) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (118/200) 10:40:28.546 Executor task launch worker for task 347 INFO Executor: Running task 119.0 in stage 121.0 (TID 347) 10:40:28.547 Executor task launch worker for task 344 INFO Executor: Finished task 116.0 in stage 121.0 (TID 344). 1343 bytes result sent to driver 10:40:28.548 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 120.0 in stage 121.0 (TID 348, amp-jenkins-worker-04.amp, executor driver, partition 120, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.548 task-result-getter-0 INFO TaskSetManager: Finished task 116.0 in stage 121.0 (TID 344) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (119/200) 10:40:28.548 Executor task launch worker for task 348 INFO Executor: Running task 120.0 in stage 121.0 (TID 348) 10:40:28.548 Executor task launch worker for task 347 INFO Executor: Finished task 119.0 in stage 121.0 (TID 347). 1403 bytes result sent to driver 10:40:28.549 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 121.0 in stage 121.0 (TID 349, amp-jenkins-worker-04.amp, executor driver, partition 121, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.549 task-result-getter-3 INFO TaskSetManager: Finished task 119.0 in stage 121.0 (TID 347) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (120/200) 10:40:28.549 Executor task launch worker for task 349 INFO Executor: Running task 121.0 in stage 121.0 (TID 349) 10:40:28.550 Executor task launch worker for task 348 INFO Executor: Finished task 120.0 in stage 121.0 (TID 348). 1300 bytes result sent to driver 10:40:28.550 task-result-getter-2 INFO TaskSetManager: Finished task 120.0 in stage 121.0 (TID 348) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (121/200) 10:40:28.550 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 122.0 in stage 121.0 (TID 350, amp-jenkins-worker-04.amp, executor driver, partition 122, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.551 Executor task launch worker for task 350 INFO Executor: Running task 122.0 in stage 121.0 (TID 350) 10:40:28.551 Executor task launch worker for task 349 INFO Executor: Finished task 121.0 in stage 121.0 (TID 349). 1343 bytes result sent to driver 10:40:28.552 Executor task launch worker for task 350 INFO Executor: Finished task 122.0 in stage 121.0 (TID 350). 1300 bytes result sent to driver 10:40:28.553 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 123.0 in stage 121.0 (TID 351, amp-jenkins-worker-04.amp, executor driver, partition 123, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.553 Executor task launch worker for task 351 INFO Executor: Running task 123.0 in stage 121.0 (TID 351) 10:40:28.553 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 124.0 in stage 121.0 (TID 352, amp-jenkins-worker-04.amp, executor driver, partition 124, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.553 task-result-getter-1 INFO TaskSetManager: Finished task 121.0 in stage 121.0 (TID 349) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (122/200) 10:40:28.553 task-result-getter-0 INFO TaskSetManager: Finished task 122.0 in stage 121.0 (TID 350) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (123/200) 10:40:28.553 Executor task launch worker for task 352 INFO Executor: Running task 124.0 in stage 121.0 (TID 352) 10:40:28.554 Executor task launch worker for task 351 INFO Executor: Finished task 123.0 in stage 121.0 (TID 351). 1300 bytes result sent to driver 10:40:28.555 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 125.0 in stage 121.0 (TID 353, amp-jenkins-worker-04.amp, executor driver, partition 125, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.555 Executor task launch worker for task 353 INFO Executor: Running task 125.0 in stage 121.0 (TID 353) 10:40:28.555 task-result-getter-3 INFO TaskSetManager: Finished task 123.0 in stage 121.0 (TID 351) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (124/200) 10:40:28.557 Executor task launch worker for task 353 INFO Executor: Finished task 125.0 in stage 121.0 (TID 353). 1343 bytes result sent to driver 10:40:28.557 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 126.0 in stage 121.0 (TID 354, amp-jenkins-worker-04.amp, executor driver, partition 126, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.557 Executor task launch worker for task 354 INFO Executor: Running task 126.0 in stage 121.0 (TID 354) 10:40:28.557 task-result-getter-2 INFO TaskSetManager: Finished task 125.0 in stage 121.0 (TID 353) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (125/200) 10:40:28.557 Executor task launch worker for task 352 INFO Executor: Finished task 124.0 in stage 121.0 (TID 352). 1343 bytes result sent to driver 10:40:28.558 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 127.0 in stage 121.0 (TID 355, amp-jenkins-worker-04.amp, executor driver, partition 127, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.558 task-result-getter-1 INFO TaskSetManager: Finished task 124.0 in stage 121.0 (TID 352) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (126/200) 10:40:28.559 Executor task launch worker for task 355 INFO Executor: Running task 127.0 in stage 121.0 (TID 355) 10:40:28.560 Executor task launch worker for task 354 INFO Executor: Finished task 126.0 in stage 121.0 (TID 354). 1343 bytes result sent to driver 10:40:28.560 task-result-getter-0 INFO TaskSetManager: Finished task 126.0 in stage 121.0 (TID 354) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (127/200) 10:40:28.560 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 128.0 in stage 121.0 (TID 356, amp-jenkins-worker-04.amp, executor driver, partition 128, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.560 Executor task launch worker for task 356 INFO Executor: Running task 128.0 in stage 121.0 (TID 356) 10:40:28.561 Executor task launch worker for task 355 INFO Executor: Finished task 127.0 in stage 121.0 (TID 355). 1343 bytes result sent to driver 10:40:28.561 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 129.0 in stage 121.0 (TID 357, amp-jenkins-worker-04.amp, executor driver, partition 129, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.561 task-result-getter-3 INFO TaskSetManager: Finished task 127.0 in stage 121.0 (TID 355) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (128/200) 10:40:28.561 Executor task launch worker for task 357 INFO Executor: Running task 129.0 in stage 121.0 (TID 357) 10:40:28.562 Executor task launch worker for task 356 INFO Executor: Finished task 128.0 in stage 121.0 (TID 356). 1300 bytes result sent to driver 10:40:28.562 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 130.0 in stage 121.0 (TID 358, amp-jenkins-worker-04.amp, executor driver, partition 130, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.562 task-result-getter-2 INFO TaskSetManager: Finished task 128.0 in stage 121.0 (TID 356) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (129/200) 10:40:28.563 Executor task launch worker for task 358 INFO Executor: Running task 130.0 in stage 121.0 (TID 358) 10:40:28.564 Executor task launch worker for task 357 INFO Executor: Finished task 129.0 in stage 121.0 (TID 357). 1343 bytes result sent to driver 10:40:28.564 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 131.0 in stage 121.0 (TID 359, amp-jenkins-worker-04.amp, executor driver, partition 131, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.564 task-result-getter-1 INFO TaskSetManager: Finished task 129.0 in stage 121.0 (TID 357) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (130/200) 10:40:28.564 Executor task launch worker for task 359 INFO Executor: Running task 131.0 in stage 121.0 (TID 359) 10:40:28.564 Executor task launch worker for task 358 INFO Executor: Finished task 130.0 in stage 121.0 (TID 358). 1300 bytes result sent to driver 10:40:28.565 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 132.0 in stage 121.0 (TID 360, amp-jenkins-worker-04.amp, executor driver, partition 132, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.565 task-result-getter-0 INFO TaskSetManager: Finished task 130.0 in stage 121.0 (TID 358) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (131/200) 10:40:28.565 Executor task launch worker for task 360 INFO Executor: Running task 132.0 in stage 121.0 (TID 360) 10:40:28.567 Executor task launch worker for task 360 INFO Executor: Finished task 132.0 in stage 121.0 (TID 360). 1300 bytes result sent to driver 10:40:28.567 Executor task launch worker for task 359 INFO Executor: Finished task 131.0 in stage 121.0 (TID 359). 1343 bytes result sent to driver 10:40:28.567 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 133.0 in stage 121.0 (TID 361, amp-jenkins-worker-04.amp, executor driver, partition 133, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.568 task-result-getter-3 INFO TaskSetManager: Finished task 132.0 in stage 121.0 (TID 360) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (132/200) 10:40:28.568 Executor task launch worker for task 361 INFO Executor: Running task 133.0 in stage 121.0 (TID 361) 10:40:28.568 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 134.0 in stage 121.0 (TID 362, amp-jenkins-worker-04.amp, executor driver, partition 134, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.568 task-result-getter-2 INFO TaskSetManager: Finished task 131.0 in stage 121.0 (TID 359) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (133/200) 10:40:28.569 Executor task launch worker for task 362 INFO Executor: Running task 134.0 in stage 121.0 (TID 362) 10:40:28.571 Executor task launch worker for task 362 INFO Executor: Finished task 134.0 in stage 121.0 (TID 362). 1343 bytes result sent to driver 10:40:28.571 Executor task launch worker for task 361 INFO Executor: Finished task 133.0 in stage 121.0 (TID 361). 1386 bytes result sent to driver 10:40:28.572 task-result-getter-1 INFO TaskSetManager: Finished task 134.0 in stage 121.0 (TID 362) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (134/200) 10:40:28.572 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 135.0 in stage 121.0 (TID 363, amp-jenkins-worker-04.amp, executor driver, partition 135, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.572 Executor task launch worker for task 363 INFO Executor: Running task 135.0 in stage 121.0 (TID 363) 10:40:28.572 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 136.0 in stage 121.0 (TID 364, amp-jenkins-worker-04.amp, executor driver, partition 136, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.572 Executor task launch worker for task 364 INFO Executor: Running task 136.0 in stage 121.0 (TID 364) 10:40:28.572 task-result-getter-0 INFO TaskSetManager: Finished task 133.0 in stage 121.0 (TID 361) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (135/200) 10:40:28.575 Executor task launch worker for task 364 INFO Executor: Finished task 136.0 in stage 121.0 (TID 364). 1386 bytes result sent to driver 10:40:28.575 Executor task launch worker for task 363 INFO Executor: Finished task 135.0 in stage 121.0 (TID 363). 1386 bytes result sent to driver 10:40:28.575 task-result-getter-3 INFO TaskSetManager: Finished task 136.0 in stage 121.0 (TID 364) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (136/200) 10:40:28.576 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 137.0 in stage 121.0 (TID 365, amp-jenkins-worker-04.amp, executor driver, partition 137, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.576 Executor task launch worker for task 365 INFO Executor: Running task 137.0 in stage 121.0 (TID 365) 10:40:28.576 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 138.0 in stage 121.0 (TID 366, amp-jenkins-worker-04.amp, executor driver, partition 138, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.576 Executor task launch worker for task 366 INFO Executor: Running task 138.0 in stage 121.0 (TID 366) 10:40:28.576 task-result-getter-2 INFO TaskSetManager: Finished task 135.0 in stage 121.0 (TID 363) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (137/200) 10:40:28.579 Executor task launch worker for task 366 INFO Executor: Finished task 138.0 in stage 121.0 (TID 366). 1343 bytes result sent to driver 10:40:28.579 Executor task launch worker for task 365 INFO Executor: Finished task 137.0 in stage 121.0 (TID 365). 1343 bytes result sent to driver 10:40:28.579 task-result-getter-1 INFO TaskSetManager: Finished task 138.0 in stage 121.0 (TID 366) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (138/200) 10:40:28.580 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 139.0 in stage 121.0 (TID 367, amp-jenkins-worker-04.amp, executor driver, partition 139, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.580 Executor task launch worker for task 367 INFO Executor: Running task 139.0 in stage 121.0 (TID 367) 10:40:28.580 task-result-getter-0 INFO TaskSetManager: Finished task 137.0 in stage 121.0 (TID 365) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (139/200) 10:40:28.580 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 140.0 in stage 121.0 (TID 368, amp-jenkins-worker-04.amp, executor driver, partition 140, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.581 Executor task launch worker for task 368 INFO Executor: Running task 140.0 in stage 121.0 (TID 368) 10:40:28.584 Executor task launch worker for task 368 INFO Executor: Finished task 140.0 in stage 121.0 (TID 368). 1343 bytes result sent to driver 10:40:28.584 Executor task launch worker for task 367 INFO Executor: Finished task 139.0 in stage 121.0 (TID 367). 1446 bytes result sent to driver 10:40:28.584 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 141.0 in stage 121.0 (TID 369, amp-jenkins-worker-04.amp, executor driver, partition 141, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.584 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 142.0 in stage 121.0 (TID 370, amp-jenkins-worker-04.amp, executor driver, partition 142, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.584 Executor task launch worker for task 369 INFO Executor: Running task 141.0 in stage 121.0 (TID 369) 10:40:28.585 task-result-getter-3 INFO TaskSetManager: Finished task 140.0 in stage 121.0 (TID 368) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (140/200) 10:40:28.585 task-result-getter-2 INFO TaskSetManager: Finished task 139.0 in stage 121.0 (TID 367) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (141/200) 10:40:28.588 Executor task launch worker for task 370 INFO Executor: Running task 142.0 in stage 121.0 (TID 370) 10:40:28.589 Executor task launch worker for task 369 INFO Executor: Finished task 141.0 in stage 121.0 (TID 369). 1386 bytes result sent to driver 10:40:28.589 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 143.0 in stage 121.0 (TID 371, amp-jenkins-worker-04.amp, executor driver, partition 143, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.590 Executor task launch worker for task 371 INFO Executor: Running task 143.0 in stage 121.0 (TID 371) 10:40:28.590 task-result-getter-1 INFO TaskSetManager: Finished task 141.0 in stage 121.0 (TID 369) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (142/200) 10:40:28.590 Executor task launch worker for task 370 INFO Executor: Finished task 142.0 in stage 121.0 (TID 370). 1343 bytes result sent to driver 10:40:28.590 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 144.0 in stage 121.0 (TID 372, amp-jenkins-worker-04.amp, executor driver, partition 144, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.590 Executor task launch worker for task 372 INFO Executor: Running task 144.0 in stage 121.0 (TID 372) 10:40:28.591 task-result-getter-0 INFO TaskSetManager: Finished task 142.0 in stage 121.0 (TID 370) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (143/200) 10:40:28.592 Executor task launch worker for task 371 INFO Executor: Finished task 143.0 in stage 121.0 (TID 371). 1343 bytes result sent to driver 10:40:28.592 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 145.0 in stage 121.0 (TID 373, amp-jenkins-worker-04.amp, executor driver, partition 145, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.592 Executor task launch worker for task 373 INFO Executor: Running task 145.0 in stage 121.0 (TID 373) 10:40:28.592 task-result-getter-3 INFO TaskSetManager: Finished task 143.0 in stage 121.0 (TID 371) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (144/200) 10:40:28.592 Executor task launch worker for task 372 INFO Executor: Finished task 144.0 in stage 121.0 (TID 372). 1343 bytes result sent to driver 10:40:28.593 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 146.0 in stage 121.0 (TID 374, amp-jenkins-worker-04.amp, executor driver, partition 146, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.594 Executor task launch worker for task 374 INFO Executor: Running task 146.0 in stage 121.0 (TID 374) 10:40:28.594 task-result-getter-2 INFO TaskSetManager: Finished task 144.0 in stage 121.0 (TID 372) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (145/200) 10:40:28.594 Executor task launch worker for task 373 INFO Executor: Finished task 145.0 in stage 121.0 (TID 373). 1343 bytes result sent to driver 10:40:28.594 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 147.0 in stage 121.0 (TID 375, amp-jenkins-worker-04.amp, executor driver, partition 147, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.594 Executor task launch worker for task 375 INFO Executor: Running task 147.0 in stage 121.0 (TID 375) 10:40:28.594 task-result-getter-1 INFO TaskSetManager: Finished task 145.0 in stage 121.0 (TID 373) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (146/200) 10:40:28.596 Executor task launch worker for task 375 INFO Executor: Finished task 147.0 in stage 121.0 (TID 375). 1300 bytes result sent to driver 10:40:28.596 Executor task launch worker for task 374 INFO Executor: Finished task 146.0 in stage 121.0 (TID 374). 1343 bytes result sent to driver 10:40:28.596 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 148.0 in stage 121.0 (TID 376, amp-jenkins-worker-04.amp, executor driver, partition 148, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.596 Executor task launch worker for task 376 INFO Executor: Running task 148.0 in stage 121.0 (TID 376) 10:40:28.596 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 149.0 in stage 121.0 (TID 377, amp-jenkins-worker-04.amp, executor driver, partition 149, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.596 Executor task launch worker for task 377 INFO Executor: Running task 149.0 in stage 121.0 (TID 377) 10:40:28.596 task-result-getter-3 INFO TaskSetManager: Finished task 146.0 in stage 121.0 (TID 374) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (147/200) 10:40:28.596 task-result-getter-0 INFO TaskSetManager: Finished task 147.0 in stage 121.0 (TID 375) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (148/200) 10:40:28.598 Executor task launch worker for task 377 INFO Executor: Finished task 149.0 in stage 121.0 (TID 377). 1300 bytes result sent to driver 10:40:28.598 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 150.0 in stage 121.0 (TID 378, amp-jenkins-worker-04.amp, executor driver, partition 150, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.598 Executor task launch worker for task 376 INFO Executor: Finished task 148.0 in stage 121.0 (TID 376). 1343 bytes result sent to driver 10:40:28.598 task-result-getter-2 INFO TaskSetManager: Finished task 149.0 in stage 121.0 (TID 377) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (149/200) 10:40:28.598 Executor task launch worker for task 378 INFO Executor: Running task 150.0 in stage 121.0 (TID 378) 10:40:28.598 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 151.0 in stage 121.0 (TID 379, amp-jenkins-worker-04.amp, executor driver, partition 151, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.598 Executor task launch worker for task 379 INFO Executor: Running task 151.0 in stage 121.0 (TID 379) 10:40:28.598 task-result-getter-1 INFO TaskSetManager: Finished task 148.0 in stage 121.0 (TID 376) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (150/200) 10:40:28.600 Executor task launch worker for task 378 INFO Executor: Finished task 150.0 in stage 121.0 (TID 378). 1300 bytes result sent to driver 10:40:28.600 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 152.0 in stage 121.0 (TID 380, amp-jenkins-worker-04.amp, executor driver, partition 152, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.600 task-result-getter-3 INFO TaskSetManager: Finished task 150.0 in stage 121.0 (TID 378) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (151/200) 10:40:28.600 Executor task launch worker for task 380 INFO Executor: Running task 152.0 in stage 121.0 (TID 380) 10:40:28.600 Executor task launch worker for task 379 INFO Executor: Finished task 151.0 in stage 121.0 (TID 379). 1300 bytes result sent to driver 10:40:28.600 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 153.0 in stage 121.0 (TID 381, amp-jenkins-worker-04.amp, executor driver, partition 153, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.600 Executor task launch worker for task 381 INFO Executor: Running task 153.0 in stage 121.0 (TID 381) 10:40:28.601 task-result-getter-0 INFO TaskSetManager: Finished task 151.0 in stage 121.0 (TID 379) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (152/200) 10:40:28.601 Executor task launch worker for task 380 INFO Executor: Finished task 152.0 in stage 121.0 (TID 380). 1300 bytes result sent to driver 10:40:28.602 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 154.0 in stage 121.0 (TID 382, amp-jenkins-worker-04.amp, executor driver, partition 154, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.602 Executor task launch worker for task 382 INFO Executor: Running task 154.0 in stage 121.0 (TID 382) 10:40:28.602 task-result-getter-2 INFO TaskSetManager: Finished task 152.0 in stage 121.0 (TID 380) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (153/200) 10:40:28.602 Executor task launch worker for task 381 INFO Executor: Finished task 153.0 in stage 121.0 (TID 381). 1343 bytes result sent to driver 10:40:28.603 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 155.0 in stage 121.0 (TID 383, amp-jenkins-worker-04.amp, executor driver, partition 155, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.603 task-result-getter-1 INFO TaskSetManager: Finished task 153.0 in stage 121.0 (TID 381) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (154/200) 10:40:28.603 Executor task launch worker for task 382 INFO Executor: Finished task 154.0 in stage 121.0 (TID 382). 1300 bytes result sent to driver 10:40:28.604 Executor task launch worker for task 383 INFO Executor: Running task 155.0 in stage 121.0 (TID 383) 10:40:28.604 task-result-getter-3 INFO TaskSetManager: Finished task 154.0 in stage 121.0 (TID 382) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (155/200) 10:40:28.605 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 156.0 in stage 121.0 (TID 384, amp-jenkins-worker-04.amp, executor driver, partition 156, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.605 Executor task launch worker for task 384 INFO Executor: Running task 156.0 in stage 121.0 (TID 384) 10:40:28.607 Executor task launch worker for task 383 INFO Executor: Finished task 155.0 in stage 121.0 (TID 383). 1343 bytes result sent to driver 10:40:28.607 Executor task launch worker for task 384 INFO Executor: Finished task 156.0 in stage 121.0 (TID 384). 1300 bytes result sent to driver 10:40:28.607 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 157.0 in stage 121.0 (TID 385, amp-jenkins-worker-04.amp, executor driver, partition 157, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.607 task-result-getter-0 INFO TaskSetManager: Finished task 156.0 in stage 121.0 (TID 384) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (156/200) 10:40:28.607 Executor task launch worker for task 385 INFO Executor: Running task 157.0 in stage 121.0 (TID 385) 10:40:28.609 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 158.0 in stage 121.0 (TID 386, amp-jenkins-worker-04.amp, executor driver, partition 158, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.609 Executor task launch worker for task 386 INFO Executor: Running task 158.0 in stage 121.0 (TID 386) 10:40:28.609 task-result-getter-2 INFO TaskSetManager: Finished task 155.0 in stage 121.0 (TID 383) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (157/200) 10:40:28.610 Executor task launch worker for task 385 INFO Executor: Finished task 157.0 in stage 121.0 (TID 385). 1386 bytes result sent to driver 10:40:28.610 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 159.0 in stage 121.0 (TID 387, amp-jenkins-worker-04.amp, executor driver, partition 159, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.611 Executor task launch worker for task 386 INFO Executor: Finished task 158.0 in stage 121.0 (TID 386). 1300 bytes result sent to driver 10:40:28.611 Executor task launch worker for task 387 INFO Executor: Running task 159.0 in stage 121.0 (TID 387) 10:40:28.611 task-result-getter-1 INFO TaskSetManager: Finished task 157.0 in stage 121.0 (TID 385) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (158/200) 10:40:28.611 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 160.0 in stage 121.0 (TID 388, amp-jenkins-worker-04.amp, executor driver, partition 160, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.611 Executor task launch worker for task 388 INFO Executor: Running task 160.0 in stage 121.0 (TID 388) 10:40:28.611 task-result-getter-3 INFO TaskSetManager: Finished task 158.0 in stage 121.0 (TID 386) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (159/200) 10:40:28.613 Executor task launch worker for task 388 INFO Executor: Finished task 160.0 in stage 121.0 (TID 388). 1300 bytes result sent to driver 10:40:28.613 Executor task launch worker for task 387 INFO Executor: Finished task 159.0 in stage 121.0 (TID 387). 1403 bytes result sent to driver 10:40:28.613 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 161.0 in stage 121.0 (TID 389, amp-jenkins-worker-04.amp, executor driver, partition 161, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.613 Executor task launch worker for task 389 INFO Executor: Running task 161.0 in stage 121.0 (TID 389) 10:40:28.613 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 162.0 in stage 121.0 (TID 390, amp-jenkins-worker-04.amp, executor driver, partition 162, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.614 task-result-getter-0 INFO TaskSetManager: Finished task 160.0 in stage 121.0 (TID 388) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (160/200) 10:40:28.614 task-result-getter-2 INFO TaskSetManager: Finished task 159.0 in stage 121.0 (TID 387) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (161/200) 10:40:28.614 Executor task launch worker for task 390 INFO Executor: Running task 162.0 in stage 121.0 (TID 390) 10:40:28.615 Executor task launch worker for task 390 INFO Executor: Finished task 162.0 in stage 121.0 (TID 390). 1300 bytes result sent to driver 10:40:28.615 Executor task launch worker for task 389 INFO Executor: Finished task 161.0 in stage 121.0 (TID 389). 1300 bytes result sent to driver 10:40:28.616 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 163.0 in stage 121.0 (TID 391, amp-jenkins-worker-04.amp, executor driver, partition 163, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.616 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 164.0 in stage 121.0 (TID 392, amp-jenkins-worker-04.amp, executor driver, partition 164, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.616 Executor task launch worker for task 392 INFO Executor: Running task 164.0 in stage 121.0 (TID 392) 10:40:28.616 task-result-getter-3 INFO TaskSetManager: Finished task 161.0 in stage 121.0 (TID 389) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (162/200) 10:40:28.616 task-result-getter-1 INFO TaskSetManager: Finished task 162.0 in stage 121.0 (TID 390) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (163/200) 10:40:28.616 Executor task launch worker for task 391 INFO Executor: Running task 163.0 in stage 121.0 (TID 391) 10:40:28.619 Executor task launch worker for task 392 INFO Executor: Finished task 164.0 in stage 121.0 (TID 392). 1343 bytes result sent to driver 10:40:28.619 Executor task launch worker for task 391 INFO Executor: Finished task 163.0 in stage 121.0 (TID 391). 1343 bytes result sent to driver 10:40:28.619 task-result-getter-0 INFO TaskSetManager: Finished task 164.0 in stage 121.0 (TID 392) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (164/200) 10:40:28.619 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 165.0 in stage 121.0 (TID 393, amp-jenkins-worker-04.amp, executor driver, partition 165, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.619 Executor task launch worker for task 393 INFO Executor: Running task 165.0 in stage 121.0 (TID 393) 10:40:28.619 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 166.0 in stage 121.0 (TID 394, amp-jenkins-worker-04.amp, executor driver, partition 166, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.620 Executor task launch worker for task 394 INFO Executor: Running task 166.0 in stage 121.0 (TID 394) 10:40:28.620 task-result-getter-2 INFO TaskSetManager: Finished task 163.0 in stage 121.0 (TID 391) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (165/200) 10:40:28.622 Executor task launch worker for task 393 INFO Executor: Finished task 165.0 in stage 121.0 (TID 393). 1343 bytes result sent to driver 10:40:28.622 Executor task launch worker for task 394 INFO Executor: Finished task 166.0 in stage 121.0 (TID 394). 1343 bytes result sent to driver 10:40:28.622 task-result-getter-3 INFO TaskSetManager: Finished task 165.0 in stage 121.0 (TID 393) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (166/200) 10:40:28.622 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 167.0 in stage 121.0 (TID 395, amp-jenkins-worker-04.amp, executor driver, partition 167, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.622 Executor task launch worker for task 395 INFO Executor: Running task 167.0 in stage 121.0 (TID 395) 10:40:28.623 task-result-getter-1 INFO TaskSetManager: Finished task 166.0 in stage 121.0 (TID 394) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (167/200) 10:40:28.623 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 168.0 in stage 121.0 (TID 396, amp-jenkins-worker-04.amp, executor driver, partition 168, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.623 Executor task launch worker for task 396 INFO Executor: Running task 168.0 in stage 121.0 (TID 396) 10:40:28.625 Executor task launch worker for task 396 INFO Executor: Finished task 168.0 in stage 121.0 (TID 396). 1300 bytes result sent to driver 10:40:28.625 Executor task launch worker for task 395 INFO Executor: Finished task 167.0 in stage 121.0 (TID 395). 1343 bytes result sent to driver 10:40:28.625 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 169.0 in stage 121.0 (TID 397, amp-jenkins-worker-04.amp, executor driver, partition 169, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.625 Executor task launch worker for task 397 INFO Executor: Running task 169.0 in stage 121.0 (TID 397) 10:40:28.625 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 170.0 in stage 121.0 (TID 398, amp-jenkins-worker-04.amp, executor driver, partition 170, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.625 Executor task launch worker for task 398 INFO Executor: Running task 170.0 in stage 121.0 (TID 398) 10:40:28.625 task-result-getter-2 INFO TaskSetManager: Finished task 167.0 in stage 121.0 (TID 395) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (168/200) 10:40:28.625 task-result-getter-0 INFO TaskSetManager: Finished task 168.0 in stage 121.0 (TID 396) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (169/200) 10:40:28.627 Executor task launch worker for task 397 INFO Executor: Finished task 169.0 in stage 121.0 (TID 397). 1300 bytes result sent to driver 10:40:28.627 Executor task launch worker for task 398 INFO Executor: Finished task 170.0 in stage 121.0 (TID 398). 1300 bytes result sent to driver 10:40:28.627 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 171.0 in stage 121.0 (TID 399, amp-jenkins-worker-04.amp, executor driver, partition 171, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.628 Executor task launch worker for task 399 INFO Executor: Running task 171.0 in stage 121.0 (TID 399) 10:40:28.628 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 172.0 in stage 121.0 (TID 400, amp-jenkins-worker-04.amp, executor driver, partition 172, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.628 task-result-getter-3 INFO TaskSetManager: Finished task 169.0 in stage 121.0 (TID 397) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (170/200) 10:40:28.628 Executor task launch worker for task 400 INFO Executor: Running task 172.0 in stage 121.0 (TID 400) 10:40:28.628 task-result-getter-1 INFO TaskSetManager: Finished task 170.0 in stage 121.0 (TID 398) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (171/200) 10:40:28.629 Executor task launch worker for task 399 INFO Executor: Finished task 171.0 in stage 121.0 (TID 399). 1300 bytes result sent to driver 10:40:28.630 Executor task launch worker for task 400 INFO Executor: Finished task 172.0 in stage 121.0 (TID 400). 1300 bytes result sent to driver 10:40:28.630 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 173.0 in stage 121.0 (TID 401, amp-jenkins-worker-04.amp, executor driver, partition 173, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.630 Executor task launch worker for task 401 INFO Executor: Running task 173.0 in stage 121.0 (TID 401) 10:40:28.630 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 174.0 in stage 121.0 (TID 402, amp-jenkins-worker-04.amp, executor driver, partition 174, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.630 task-result-getter-2 INFO TaskSetManager: Finished task 171.0 in stage 121.0 (TID 399) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (172/200) 10:40:28.630 Executor task launch worker for task 402 INFO Executor: Running task 174.0 in stage 121.0 (TID 402) 10:40:28.630 task-result-getter-0 INFO TaskSetManager: Finished task 172.0 in stage 121.0 (TID 400) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (173/200) 10:40:28.632 Executor task launch worker for task 402 INFO Executor: Finished task 174.0 in stage 121.0 (TID 402). 1300 bytes result sent to driver 10:40:28.632 Executor task launch worker for task 401 INFO Executor: Finished task 173.0 in stage 121.0 (TID 401). 1343 bytes result sent to driver 10:40:28.632 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 175.0 in stage 121.0 (TID 403, amp-jenkins-worker-04.amp, executor driver, partition 175, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.632 Executor task launch worker for task 403 INFO Executor: Running task 175.0 in stage 121.0 (TID 403) 10:40:28.632 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 176.0 in stage 121.0 (TID 404, amp-jenkins-worker-04.amp, executor driver, partition 176, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.632 Executor task launch worker for task 404 INFO Executor: Running task 176.0 in stage 121.0 (TID 404) 10:40:28.632 task-result-getter-1 INFO TaskSetManager: Finished task 173.0 in stage 121.0 (TID 401) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (174/200) 10:40:28.632 task-result-getter-3 INFO TaskSetManager: Finished task 174.0 in stage 121.0 (TID 402) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (175/200) 10:40:28.634 Executor task launch worker for task 403 INFO Executor: Finished task 175.0 in stage 121.0 (TID 403). 1300 bytes result sent to driver 10:40:28.634 Executor task launch worker for task 404 INFO Executor: Finished task 176.0 in stage 121.0 (TID 404). 1300 bytes result sent to driver 10:40:28.634 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 177.0 in stage 121.0 (TID 405, amp-jenkins-worker-04.amp, executor driver, partition 177, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.634 Executor task launch worker for task 405 INFO Executor: Running task 177.0 in stage 121.0 (TID 405) 10:40:28.634 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 178.0 in stage 121.0 (TID 406, amp-jenkins-worker-04.amp, executor driver, partition 178, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.634 Executor task launch worker for task 406 INFO Executor: Running task 178.0 in stage 121.0 (TID 406) 10:40:28.634 task-result-getter-0 INFO TaskSetManager: Finished task 176.0 in stage 121.0 (TID 404) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (176/200) 10:40:28.634 task-result-getter-2 INFO TaskSetManager: Finished task 175.0 in stage 121.0 (TID 403) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (177/200) 10:40:28.636 Executor task launch worker for task 405 INFO Executor: Finished task 177.0 in stage 121.0 (TID 405). 1300 bytes result sent to driver 10:40:28.636 Executor task launch worker for task 406 INFO Executor: Finished task 178.0 in stage 121.0 (TID 406). 1300 bytes result sent to driver 10:40:28.636 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 179.0 in stage 121.0 (TID 407, amp-jenkins-worker-04.amp, executor driver, partition 179, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.636 Executor task launch worker for task 407 INFO Executor: Running task 179.0 in stage 121.0 (TID 407) 10:40:28.636 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 180.0 in stage 121.0 (TID 408, amp-jenkins-worker-04.amp, executor driver, partition 180, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.637 Executor task launch worker for task 408 INFO Executor: Running task 180.0 in stage 121.0 (TID 408) 10:40:28.637 task-result-getter-3 INFO TaskSetManager: Finished task 178.0 in stage 121.0 (TID 406) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (178/200) 10:40:28.637 task-result-getter-1 INFO TaskSetManager: Finished task 177.0 in stage 121.0 (TID 405) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (179/200) 10:40:28.638 Executor task launch worker for task 408 INFO Executor: Finished task 180.0 in stage 121.0 (TID 408). 1300 bytes result sent to driver 10:40:28.638 Executor task launch worker for task 407 INFO Executor: Finished task 179.0 in stage 121.0 (TID 407). 1360 bytes result sent to driver 10:40:28.638 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 181.0 in stage 121.0 (TID 409, amp-jenkins-worker-04.amp, executor driver, partition 181, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.639 Executor task launch worker for task 409 INFO Executor: Running task 181.0 in stage 121.0 (TID 409) 10:40:28.639 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 182.0 in stage 121.0 (TID 410, amp-jenkins-worker-04.amp, executor driver, partition 182, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.639 task-result-getter-0 INFO TaskSetManager: Finished task 180.0 in stage 121.0 (TID 408) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (180/200) 10:40:28.639 Executor task launch worker for task 410 INFO Executor: Running task 182.0 in stage 121.0 (TID 410) 10:40:28.639 task-result-getter-2 INFO TaskSetManager: Finished task 179.0 in stage 121.0 (TID 407) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (181/200) 10:40:28.640 Executor task launch worker for task 410 INFO Executor: Finished task 182.0 in stage 121.0 (TID 410). 1300 bytes result sent to driver 10:40:28.640 Executor task launch worker for task 409 INFO Executor: Finished task 181.0 in stage 121.0 (TID 409). 1300 bytes result sent to driver 10:40:28.640 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 183.0 in stage 121.0 (TID 411, amp-jenkins-worker-04.amp, executor driver, partition 183, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.641 Executor task launch worker for task 411 INFO Executor: Running task 183.0 in stage 121.0 (TID 411) 10:40:28.641 task-result-getter-3 INFO TaskSetManager: Finished task 182.0 in stage 121.0 (TID 410) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (182/200) 10:40:28.641 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 184.0 in stage 121.0 (TID 412, amp-jenkins-worker-04.amp, executor driver, partition 184, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.641 Executor task launch worker for task 412 INFO Executor: Running task 184.0 in stage 121.0 (TID 412) 10:40:28.641 task-result-getter-1 INFO TaskSetManager: Finished task 181.0 in stage 121.0 (TID 409) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (183/200) 10:40:28.642 Executor task launch worker for task 411 INFO Executor: Finished task 183.0 in stage 121.0 (TID 411). 1300 bytes result sent to driver 10:40:28.642 Executor task launch worker for task 412 INFO Executor: Finished task 184.0 in stage 121.0 (TID 412). 1300 bytes result sent to driver 10:40:28.642 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 185.0 in stage 121.0 (TID 413, amp-jenkins-worker-04.amp, executor driver, partition 185, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.642 Executor task launch worker for task 413 INFO Executor: Running task 185.0 in stage 121.0 (TID 413) 10:40:28.642 task-result-getter-0 INFO TaskSetManager: Finished task 183.0 in stage 121.0 (TID 411) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (184/200) 10:40:28.642 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 186.0 in stage 121.0 (TID 414, amp-jenkins-worker-04.amp, executor driver, partition 186, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.643 Executor task launch worker for task 414 INFO Executor: Running task 186.0 in stage 121.0 (TID 414) 10:40:28.643 task-result-getter-2 INFO TaskSetManager: Finished task 184.0 in stage 121.0 (TID 412) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (185/200) 10:40:28.644 Executor task launch worker for task 413 INFO Executor: Finished task 185.0 in stage 121.0 (TID 413). 1300 bytes result sent to driver 10:40:28.644 Executor task launch worker for task 414 INFO Executor: Finished task 186.0 in stage 121.0 (TID 414). 1300 bytes result sent to driver 10:40:28.645 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 187.0 in stage 121.0 (TID 415, amp-jenkins-worker-04.amp, executor driver, partition 187, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.645 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 188.0 in stage 121.0 (TID 416, amp-jenkins-worker-04.amp, executor driver, partition 188, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.645 Executor task launch worker for task 415 INFO Executor: Running task 187.0 in stage 121.0 (TID 415) 10:40:28.645 task-result-getter-3 INFO TaskSetManager: Finished task 185.0 in stage 121.0 (TID 413) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (186/200) 10:40:28.645 task-result-getter-1 INFO TaskSetManager: Finished task 186.0 in stage 121.0 (TID 414) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (187/200) 10:40:28.645 Executor task launch worker for task 416 INFO Executor: Running task 188.0 in stage 121.0 (TID 416) 10:40:28.647 Executor task launch worker for task 416 INFO Executor: Finished task 188.0 in stage 121.0 (TID 416). 1343 bytes result sent to driver 10:40:28.647 Executor task launch worker for task 415 INFO Executor: Finished task 187.0 in stage 121.0 (TID 415). 1343 bytes result sent to driver 10:40:28.647 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 189.0 in stage 121.0 (TID 417, amp-jenkins-worker-04.amp, executor driver, partition 189, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.648 Executor task launch worker for task 417 INFO Executor: Running task 189.0 in stage 121.0 (TID 417) 10:40:28.648 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 190.0 in stage 121.0 (TID 418, amp-jenkins-worker-04.amp, executor driver, partition 190, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.648 Executor task launch worker for task 418 INFO Executor: Running task 190.0 in stage 121.0 (TID 418) 10:40:28.648 task-result-getter-2 INFO TaskSetManager: Finished task 187.0 in stage 121.0 (TID 415) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (188/200) 10:40:28.648 task-result-getter-0 INFO TaskSetManager: Finished task 188.0 in stage 121.0 (TID 416) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (189/200) 10:40:28.650 Executor task launch worker for task 418 INFO Executor: Finished task 190.0 in stage 121.0 (TID 418). 1343 bytes result sent to driver 10:40:28.650 Executor task launch worker for task 417 INFO Executor: Finished task 189.0 in stage 121.0 (TID 417). 1343 bytes result sent to driver 10:40:28.650 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 191.0 in stage 121.0 (TID 419, amp-jenkins-worker-04.amp, executor driver, partition 191, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.651 Executor task launch worker for task 419 INFO Executor: Running task 191.0 in stage 121.0 (TID 419) 10:40:28.651 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 192.0 in stage 121.0 (TID 420, amp-jenkins-worker-04.amp, executor driver, partition 192, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.651 task-result-getter-3 INFO TaskSetManager: Finished task 190.0 in stage 121.0 (TID 418) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (190/200) 10:40:28.651 Executor task launch worker for task 420 INFO Executor: Running task 192.0 in stage 121.0 (TID 420) 10:40:28.651 task-result-getter-1 INFO TaskSetManager: Finished task 189.0 in stage 121.0 (TID 417) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (191/200) 10:40:28.652 Executor task launch worker for task 419 INFO Executor: Finished task 191.0 in stage 121.0 (TID 419). 1300 bytes result sent to driver 10:40:28.652 Executor task launch worker for task 420 INFO Executor: Finished task 192.0 in stage 121.0 (TID 420). 1300 bytes result sent to driver 10:40:28.652 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 193.0 in stage 121.0 (TID 421, amp-jenkins-worker-04.amp, executor driver, partition 193, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.653 Executor task launch worker for task 421 INFO Executor: Running task 193.0 in stage 121.0 (TID 421) 10:40:28.653 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 194.0 in stage 121.0 (TID 422, amp-jenkins-worker-04.amp, executor driver, partition 194, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.653 Executor task launch worker for task 422 INFO Executor: Running task 194.0 in stage 121.0 (TID 422) 10:40:28.653 task-result-getter-2 INFO TaskSetManager: Finished task 191.0 in stage 121.0 (TID 419) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (192/200) 10:40:28.653 task-result-getter-0 INFO TaskSetManager: Finished task 192.0 in stage 121.0 (TID 420) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (193/200) 10:40:28.654 Executor task launch worker for task 422 INFO Executor: Finished task 194.0 in stage 121.0 (TID 422). 1300 bytes result sent to driver 10:40:28.654 Executor task launch worker for task 421 INFO Executor: Finished task 193.0 in stage 121.0 (TID 421). 1300 bytes result sent to driver 10:40:28.654 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 195.0 in stage 121.0 (TID 423, amp-jenkins-worker-04.amp, executor driver, partition 195, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.654 Executor task launch worker for task 423 INFO Executor: Running task 195.0 in stage 121.0 (TID 423) 10:40:28.654 task-result-getter-3 INFO TaskSetManager: Finished task 194.0 in stage 121.0 (TID 422) in 1 ms on amp-jenkins-worker-04.amp (executor driver) (194/200) 10:40:28.655 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 196.0 in stage 121.0 (TID 424, amp-jenkins-worker-04.amp, executor driver, partition 196, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.655 Executor task launch worker for task 424 INFO Executor: Running task 196.0 in stage 121.0 (TID 424) 10:40:28.655 task-result-getter-1 INFO TaskSetManager: Finished task 193.0 in stage 121.0 (TID 421) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (195/200) 10:40:28.656 Executor task launch worker for task 424 INFO Executor: Finished task 196.0 in stage 121.0 (TID 424). 1300 bytes result sent to driver 10:40:28.656 Executor task launch worker for task 423 INFO Executor: Finished task 195.0 in stage 121.0 (TID 423). 1300 bytes result sent to driver 10:40:28.656 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 197.0 in stage 121.0 (TID 425, amp-jenkins-worker-04.amp, executor driver, partition 197, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.656 Executor task launch worker for task 425 INFO Executor: Running task 197.0 in stage 121.0 (TID 425) 10:40:28.657 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 198.0 in stage 121.0 (TID 426, amp-jenkins-worker-04.amp, executor driver, partition 198, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.657 task-result-getter-2 INFO TaskSetManager: Finished task 196.0 in stage 121.0 (TID 424) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (196/200) 10:40:28.657 Executor task launch worker for task 426 INFO Executor: Running task 198.0 in stage 121.0 (TID 426) 10:40:28.657 task-result-getter-0 INFO TaskSetManager: Finished task 195.0 in stage 121.0 (TID 423) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (197/200) 10:40:28.658 Executor task launch worker for task 426 INFO Executor: Finished task 198.0 in stage 121.0 (TID 426). 1300 bytes result sent to driver 10:40:28.658 Executor task launch worker for task 425 INFO Executor: Finished task 197.0 in stage 121.0 (TID 425). 1300 bytes result sent to driver 10:40:28.658 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 199.0 in stage 121.0 (TID 427, amp-jenkins-worker-04.amp, executor driver, partition 199, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.658 Executor task launch worker for task 427 INFO Executor: Running task 199.0 in stage 121.0 (TID 427) 10:40:28.659 task-result-getter-3 INFO TaskSetManager: Finished task 198.0 in stage 121.0 (TID 426) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (198/200) 10:40:28.659 task-result-getter-1 INFO TaskSetManager: Finished task 197.0 in stage 121.0 (TID 425) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (199/200) 10:40:28.660 Executor task launch worker for task 427 INFO Executor: Finished task 199.0 in stage 121.0 (TID 427). 1360 bytes result sent to driver 10:40:28.660 task-result-getter-2 INFO TaskSetManager: Finished task 199.0 in stage 121.0 (TID 427) in 2 ms on amp-jenkins-worker-04.amp (executor driver) (200/200) 10:40:28.660 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 121.0, whose tasks have all completed, from pool 10:40:28.660 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 121 (apply at OutcomeOf.scala:85) finished in 0.259 s 10:40:28.661 dag-scheduler-event-loop INFO DAGScheduler: Job 95 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:28.661 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 121: Stage finished 10:40:28.661 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 95 finished: apply at OutcomeOf.scala:85, took 0.263317 s 10:40:28.693 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.693 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.712 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 9.108579 ms 10:40:28.721 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:28.721 dag-scheduler-event-loop INFO DAGScheduler: Got job 96 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:28.721 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 122 (apply at OutcomeOf.scala:85) 10:40:28.721 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:28.721 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:28.722 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 122 (MapPartitionsRDD[350] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:28.723 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_139 stored as values in memory (estimated size 9.6 KiB, free 2.1 GiB) 10:40:28.724 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_139_piece0 stored as bytes in memory (estimated size 4.5 KiB, free 2.1 GiB) 10:40:28.724 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_139_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 4.5 KiB, free: 2.1 GiB) 10:40:28.725 dag-scheduler-event-loop INFO SparkContext: Created broadcast 139 from broadcast at DAGScheduler.scala:1293 10:40:28.725 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 122 (MapPartitionsRDD[350] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:28.725 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 122.0 with 2 tasks resource profile 0 10:40:28.726 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 122.0 (TID 428, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.726 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 122.0 (TID 429, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7393 bytes) taskResourceAssignments Map() 10:40:28.726 Executor task launch worker for task 429 INFO Executor: Running task 1.0 in stage 122.0 (TID 429) 10:40:28.726 Executor task launch worker for task 428 INFO Executor: Running task 0.0 in stage 122.0 (TID 428) 10:40:28.730 Executor task launch worker for task 428 INFO Executor: Finished task 0.0 in stage 122.0 (TID 428). 1439 bytes result sent to driver 10:40:28.730 Executor task launch worker for task 429 INFO Executor: Finished task 1.0 in stage 122.0 (TID 429). 1446 bytes result sent to driver 10:40:28.730 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 122.0 (TID 429) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:28.730 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 122.0 (TID 428) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:28.730 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 122.0, whose tasks have all completed, from pool 10:40:28.731 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 122 (apply at OutcomeOf.scala:85) finished in 0.009 s 10:40:28.731 dag-scheduler-event-loop INFO DAGScheduler: Job 96 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:28.731 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 122: Stage finished 10:40:28.731 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 96 finished: apply at OutcomeOf.scala:85, took 0.010310 s 10:40:28.733 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== FINISHED o.a.s.sql.SQLQueryTestSuite: 'table-valued-functions.sql' ===== 10:40:28.746 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== TEST OUTPUT FOR o.a.s.sql.SQLQueryTestSuite: 'inner-join.sql' ===== 10:40:28.750 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: Setting configs: set spark.sql.codegen.wholeStage=true, set spark.sql.autoBroadcastJoinThreshold=10485760 10:40:28.754 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.754 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.763 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.763 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.775 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.775 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.788 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.788 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.801 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.801 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.815 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.815 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.829 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.829 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.845 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.852 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.873 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.873 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:28.954 broadcast-exchange-10 INFO CodeGenerator: Code generated in 5.970335 ms 10:40:28.963 broadcast-exchange-10 INFO CodeGenerator: Code generated in 6.447495 ms 10:40:28.972 broadcast-exchange-10 INFO CodeGenerator: Code generated in 4.859843 ms 10:40:28.989 broadcast-exchange-10 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:28.991 dag-scheduler-event-loop INFO DAGScheduler: Got job 97 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 2 output partitions 10:40:28.991 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 123 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:28.991 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:28.992 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:28.992 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 123 (MapPartitionsRDD[356] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:28.994 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_140 stored as values in memory (estimated size 8.8 KiB, free 2.1 GiB) 10:40:28.996 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_140_piece0 stored as bytes in memory (estimated size 3.7 KiB, free 2.1 GiB) 10:40:28.996 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_140_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.7 KiB, free: 2.1 GiB) 10:40:28.996 dag-scheduler-event-loop INFO SparkContext: Created broadcast 140 from broadcast at DAGScheduler.scala:1293 10:40:28.997 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 123 (MapPartitionsRDD[356] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0, 1)) 10:40:28.997 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 123.0 with 2 tasks resource profile 0 10:40:28.999 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 123.0 (TID 430, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7634 bytes) taskResourceAssignments Map() 10:40:28.999 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 123.0 (TID 431, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7634 bytes) taskResourceAssignments Map() 10:40:28.999 Executor task launch worker for task 430 INFO Executor: Running task 0.0 in stage 123.0 (TID 430) 10:40:28.999 Executor task launch worker for task 431 INFO Executor: Running task 1.0 in stage 123.0 (TID 431) 10:40:29.003 Executor task launch worker for task 431 INFO Executor: Finished task 1.0 in stage 123.0 (TID 431). 1536 bytes result sent to driver 10:40:29.003 Executor task launch worker for task 430 INFO Executor: Finished task 0.0 in stage 123.0 (TID 430). 1536 bytes result sent to driver 10:40:29.003 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 123.0 (TID 431) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:29.003 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 123.0 (TID 430) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:29.003 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 123.0, whose tasks have all completed, from pool 10:40:29.004 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 123 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.012 s 10:40:29.004 dag-scheduler-event-loop INFO DAGScheduler: Job 97 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:29.004 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 123: Stage finished 10:40:29.004 broadcast-exchange-10 INFO DAGScheduler: Job 97 finished: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266, took 0.014756 s 10:40:29.010 broadcast-exchange-10 INFO CodeGenerator: Code generated in 4.417858 ms 10:40:29.023 broadcast-exchange-10 INFO MemoryStore: Block broadcast_141 stored as values in memory (estimated size 64.0 MiB, free 2.1 GiB) 10:40:29.025 broadcast-exchange-10 INFO MemoryStore: Block broadcast_141_piece0 stored as bytes in memory (estimated size 187.0 B, free 2.1 GiB) 10:40:29.025 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_141_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 187.0 B, free: 2.1 GiB) 10:40:29.025 broadcast-exchange-10 INFO SparkContext: Created broadcast 141 from $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:29.039 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 9.453089 ms 10:40:29.077 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 8.796587 ms 10:40:29.091 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 8.026073 ms 10:40:29.110 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:29.111 dag-scheduler-event-loop INFO DAGScheduler: Got job 98 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:29.111 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 124 (apply at OutcomeOf.scala:85) 10:40:29.111 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:29.111 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:29.111 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 124 (MapPartitionsRDD[363] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:29.113 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_142 stored as values in memory (estimated size 12.5 KiB, free 2.1 GiB) 10:40:29.115 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_142_piece0 stored as bytes in memory (estimated size 4.9 KiB, free 2.1 GiB) 10:40:29.116 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_142_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 4.9 KiB, free: 2.1 GiB) 10:40:29.116 dag-scheduler-event-loop INFO SparkContext: Created broadcast 142 from broadcast at DAGScheduler.scala:1293 10:40:29.117 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 124 (MapPartitionsRDD[363] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:29.117 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 124.0 with 4 tasks resource profile 0 10:40:29.118 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 124.0 (TID 432, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7634 bytes) taskResourceAssignments Map() 10:40:29.118 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 124.0 (TID 433, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7634 bytes) taskResourceAssignments Map() 10:40:29.118 Executor task launch worker for task 433 INFO Executor: Running task 1.0 in stage 124.0 (TID 433) 10:40:29.118 Executor task launch worker for task 432 INFO Executor: Running task 0.0 in stage 124.0 (TID 432) 10:40:29.125 Executor task launch worker for task 432 INFO Executor: Finished task 0.0 in stage 124.0 (TID 432). 1703 bytes result sent to driver 10:40:29.125 Executor task launch worker for task 433 INFO Executor: Finished task 1.0 in stage 124.0 (TID 433). 1703 bytes result sent to driver 10:40:29.126 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 2.0 in stage 124.0 (TID 434, amp-jenkins-worker-04.amp, executor driver, partition 2, PROCESS_LOCAL, 7634 bytes) taskResourceAssignments Map() 10:40:29.126 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 124.0 (TID 435, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7634 bytes) taskResourceAssignments Map() 10:40:29.126 Executor task launch worker for task 434 INFO Executor: Running task 2.0 in stage 124.0 (TID 434) 10:40:29.126 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 124.0 (TID 432) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:29.126 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 124.0 (TID 433) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:29.133 Executor task launch worker for task 435 INFO Executor: Running task 3.0 in stage 124.0 (TID 435) 10:40:29.133 Executor task launch worker for task 434 INFO Executor: Finished task 2.0 in stage 124.0 (TID 434). 1703 bytes result sent to driver 10:40:29.133 task-result-getter-1 INFO TaskSetManager: Finished task 2.0 in stage 124.0 (TID 434) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:29.135 Executor task launch worker for task 435 INFO Executor: Finished task 3.0 in stage 124.0 (TID 435). 1660 bytes result sent to driver 10:40:29.136 task-result-getter-2 INFO TaskSetManager: Finished task 3.0 in stage 124.0 (TID 435) in 10 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:29.136 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 124.0, whose tasks have all completed, from pool 10:40:29.136 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 124 (apply at OutcomeOf.scala:85) finished in 0.024 s 10:40:29.137 dag-scheduler-event-loop INFO DAGScheduler: Job 98 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:29.137 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 124: Stage finished 10:40:29.137 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 98 finished: apply at OutcomeOf.scala:85, took 0.027309 s 10:40:29.140 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: Setting configs: set spark.sql.codegen.wholeStage=false, set spark.sql.codegen.factoryMode=CODEGEN_ONLY, set spark.sql.autoBroadcastJoinThreshold=10485760 10:40:29.146 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.146 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.157 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.157 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.167 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.167 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.178 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.178 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.195 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.195 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.209 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.209 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.224 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.224 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.241 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.241 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.255 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.255 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.274 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.274 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.357 broadcast-exchange-11 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:29.358 dag-scheduler-event-loop INFO DAGScheduler: Got job 99 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 2 output partitions 10:40:29.358 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 125 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:29.358 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:29.358 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:29.358 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 125 (MapPartitionsRDD[371] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:29.360 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_143 stored as values in memory (estimated size 7.5 KiB, free 2.1 GiB) 10:40:29.361 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_143_piece0 stored as bytes in memory (estimated size 3.9 KiB, free 2.1 GiB) 10:40:29.361 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_143_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.9 KiB, free: 2.1 GiB) 10:40:29.362 dag-scheduler-event-loop INFO SparkContext: Created broadcast 143 from broadcast at DAGScheduler.scala:1293 10:40:29.362 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 125 (MapPartitionsRDD[371] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0, 1)) 10:40:29.362 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 125.0 with 2 tasks resource profile 0 10:40:29.363 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 125.0 (TID 436, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7634 bytes) taskResourceAssignments Map() 10:40:29.363 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 125.0 (TID 437, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7634 bytes) taskResourceAssignments Map() 10:40:29.363 Executor task launch worker for task 437 INFO Executor: Running task 1.0 in stage 125.0 (TID 437) 10:40:29.363 Executor task launch worker for task 436 INFO Executor: Running task 0.0 in stage 125.0 (TID 436) 10:40:29.377 Executor task launch worker for task 436 INFO CodeGenerator: Code generated in 6.427012 ms 10:40:29.379 Executor task launch worker for task 436 INFO Executor: Finished task 0.0 in stage 125.0 (TID 436). 1402 bytes result sent to driver 10:40:29.379 Executor task launch worker for task 437 INFO Executor: Finished task 1.0 in stage 125.0 (TID 437). 1402 bytes result sent to driver 10:40:29.380 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 125.0 (TID 436) in 18 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:29.380 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 125.0 (TID 437) in 17 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:29.380 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 125.0, whose tasks have all completed, from pool 10:40:29.381 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 125 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.021 s 10:40:29.381 dag-scheduler-event-loop INFO DAGScheduler: Job 99 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:29.381 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 125: Stage finished 10:40:29.381 broadcast-exchange-11 INFO DAGScheduler: Job 99 finished: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266, took 0.023911 s 10:40:29.395 broadcast-exchange-11 INFO MemoryStore: Block broadcast_144 stored as values in memory (estimated size 64.0 MiB, free 2.0 GiB) 10:40:29.396 broadcast-exchange-11 INFO MemoryStore: Block broadcast_144_piece0 stored as bytes in memory (estimated size 187.0 B, free 2.0 GiB) 10:40:29.396 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_144_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 187.0 B, free: 2.1 GiB) 10:40:29.396 broadcast-exchange-11 INFO SparkContext: Created broadcast 144 from $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:29.432 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:29.433 dag-scheduler-event-loop INFO DAGScheduler: Got job 100 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:29.433 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 126 (apply at OutcomeOf.scala:85) 10:40:29.433 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:29.433 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:29.433 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 126 (MapPartitionsRDD[381] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:29.435 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_145 stored as values in memory (estimated size 12.3 KiB, free 2.0 GiB) 10:40:29.437 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_145_piece0 stored as bytes in memory (estimated size 5.9 KiB, free 2.0 GiB) 10:40:29.437 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_145_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.9 KiB, free: 2.1 GiB) 10:40:29.437 dag-scheduler-event-loop INFO SparkContext: Created broadcast 145 from broadcast at DAGScheduler.scala:1293 10:40:29.438 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 126 (MapPartitionsRDD[381] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:29.438 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 126.0 with 4 tasks resource profile 0 10:40:29.439 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 126.0 (TID 438, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7634 bytes) taskResourceAssignments Map() 10:40:29.439 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 126.0 (TID 439, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7634 bytes) taskResourceAssignments Map() 10:40:29.439 Executor task launch worker for task 439 INFO Executor: Running task 1.0 in stage 126.0 (TID 439) 10:40:29.439 Executor task launch worker for task 438 INFO Executor: Running task 0.0 in stage 126.0 (TID 438) 10:40:29.458 Executor task launch worker for task 438 INFO CodeGenerator: Code generated in 7.545742 ms 10:40:29.467 Executor task launch worker for task 438 INFO CodeGenerator: Code generated in 6.124337 ms 10:40:29.471 Executor task launch worker for task 438 INFO Executor: Finished task 0.0 in stage 126.0 (TID 438). 1931 bytes result sent to driver 10:40:29.471 Executor task launch worker for task 439 INFO Executor: Finished task 1.0 in stage 126.0 (TID 439). 1931 bytes result sent to driver 10:40:29.471 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 2.0 in stage 126.0 (TID 440, amp-jenkins-worker-04.amp, executor driver, partition 2, PROCESS_LOCAL, 7634 bytes) taskResourceAssignments Map() 10:40:29.471 Executor task launch worker for task 440 INFO Executor: Running task 2.0 in stage 126.0 (TID 440) 10:40:29.472 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 3.0 in stage 126.0 (TID 441, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7634 bytes) taskResourceAssignments Map() 10:40:29.472 Executor task launch worker for task 441 INFO Executor: Running task 3.0 in stage 126.0 (TID 441) 10:40:29.472 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 126.0 (TID 438) in 33 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:29.472 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 126.0 (TID 439) in 33 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:29.477 Executor task launch worker for task 441 INFO Executor: Finished task 3.0 in stage 126.0 (TID 441). 1931 bytes result sent to driver 10:40:29.477 Executor task launch worker for task 440 INFO Executor: Finished task 2.0 in stage 126.0 (TID 440). 1931 bytes result sent to driver 10:40:29.483 task-result-getter-3 INFO TaskSetManager: Finished task 3.0 in stage 126.0 (TID 441) in 12 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:29.483 task-result-getter-0 INFO TaskSetManager: Finished task 2.0 in stage 126.0 (TID 440) in 12 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:29.483 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 126.0, whose tasks have all completed, from pool 10:40:29.484 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 126 (apply at OutcomeOf.scala:85) finished in 0.049 s 10:40:29.484 dag-scheduler-event-loop INFO DAGScheduler: Job 100 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:29.484 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 126: Stage finished 10:40:29.484 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 100 finished: apply at OutcomeOf.scala:85, took 0.051404 s 10:40:29.487 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: Setting configs: set spark.sql.codegen.wholeStage=false, set spark.sql.codegen.factoryMode=NO_CODEGEN, set spark.sql.autoBroadcastJoinThreshold=10485760 10:40:29.493 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.493 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.501 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.501 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.510 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.510 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.520 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.520 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.542 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.542 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.561 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.561 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.575 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.575 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.590 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.590 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.606 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.606 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.627 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.627 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:29.713 broadcast-exchange-12 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:29.714 dag-scheduler-event-loop INFO DAGScheduler: Got job 101 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 2 output partitions 10:40:29.714 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 127 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:29.714 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:29.714 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:29.714 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 127 (MapPartitionsRDD[389] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:29.716 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_146 stored as values in memory (estimated size 7.5 KiB, free 2.0 GiB) 10:40:29.718 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_146_piece0 stored as bytes in memory (estimated size 3.8 KiB, free 2.0 GiB) 10:40:29.718 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_146_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.8 KiB, free: 2.1 GiB) 10:40:29.719 dag-scheduler-event-loop INFO SparkContext: Created broadcast 146 from broadcast at DAGScheduler.scala:1293 10:40:29.719 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 127 (MapPartitionsRDD[389] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0, 1)) 10:40:29.719 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 127.0 with 2 tasks resource profile 0 10:40:29.721 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 127.0 (TID 442, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7634 bytes) taskResourceAssignments Map() 10:40:29.721 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 127.0 (TID 443, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7634 bytes) taskResourceAssignments Map() 10:40:29.721 Executor task launch worker for task 442 INFO Executor: Running task 0.0 in stage 127.0 (TID 442) 10:40:29.721 Executor task launch worker for task 443 INFO Executor: Running task 1.0 in stage 127.0 (TID 443) 10:40:29.726 Executor task launch worker for task 442 INFO Executor: Finished task 0.0 in stage 127.0 (TID 442). 1402 bytes result sent to driver 10:40:29.726 Executor task launch worker for task 443 INFO Executor: Finished task 1.0 in stage 127.0 (TID 443). 1402 bytes result sent to driver 10:40:29.727 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 127.0 (TID 442) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:29.727 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 127.0 (TID 443) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:29.727 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 127.0, whose tasks have all completed, from pool 10:40:29.727 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 127 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.012 s 10:40:29.728 dag-scheduler-event-loop INFO DAGScheduler: Job 101 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:29.728 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 127: Stage finished 10:40:29.728 broadcast-exchange-12 INFO DAGScheduler: Job 101 finished: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266, took 0.014399 s 10:40:29.761 broadcast-exchange-12 INFO MemoryStore: Block broadcast_147 stored as values in memory (estimated size 64.0 MiB, free 1990.0 MiB) 10:40:29.762 broadcast-exchange-12 INFO MemoryStore: Block broadcast_147_piece0 stored as bytes in memory (estimated size 187.0 B, free 1990.0 MiB) 10:40:29.762 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_147_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 187.0 B, free: 2.1 GiB) 10:40:29.763 broadcast-exchange-12 INFO SparkContext: Created broadcast 147 from $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:29.786 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:29.787 dag-scheduler-event-loop INFO DAGScheduler: Got job 102 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:29.787 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 128 (apply at OutcomeOf.scala:85) 10:40:29.787 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:29.787 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:29.787 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 128 (MapPartitionsRDD[399] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:29.789 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_148 stored as values in memory (estimated size 12.3 KiB, free 1990.0 MiB) 10:40:30.970 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_146_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.8 KiB, free: 2.1 GiB) 10:40:30.970 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_148_piece0 stored as bytes in memory (estimated size 5.9 KiB, free 1990.0 MiB) 10:40:30.971 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_148_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.9 KiB, free: 2.1 GiB) 10:40:30.971 dag-scheduler-event-loop INFO SparkContext: Created broadcast 148 from broadcast at DAGScheduler.scala:1293 10:40:30.971 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_119_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 264.0 B, free: 2.1 GiB) 10:40:30.971 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 128 (MapPartitionsRDD[399] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:30.971 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 128.0 with 4 tasks resource profile 0 10:40:30.972 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_126_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.4 KiB, free: 2.1 GiB) 10:40:30.972 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 128.0 (TID 444, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7634 bytes) taskResourceAssignments Map() 10:40:30.973 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_145_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.9 KiB, free: 2.1 GiB) 10:40:30.973 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 128.0 (TID 445, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7634 bytes) taskResourceAssignments Map() 10:40:30.973 Executor task launch worker for task 444 INFO Executor: Running task 0.0 in stage 128.0 (TID 444) 10:40:30.973 Executor task launch worker for task 445 INFO Executor: Running task 1.0 in stage 128.0 (TID 445) 10:40:30.973 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_137_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 4.5 KiB, free: 2.1 GiB) 10:40:30.975 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_120_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 4.3 KiB, free: 2.1 GiB) 10:40:30.976 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_132_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.4 KiB, free: 2.1 GiB) 10:40:30.977 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_128_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.4 KiB, free: 2.1 GiB) 10:40:30.978 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_131_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.5 KiB, free: 2.1 GiB) 10:40:30.978 Executor task launch worker for task 445 INFO Executor: Finished task 1.0 in stage 128.0 (TID 445). 1931 bytes result sent to driver 10:40:30.978 Executor task launch worker for task 444 INFO Executor: Finished task 0.0 in stage 128.0 (TID 444). 1931 bytes result sent to driver 10:40:30.978 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_143_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.9 KiB, free: 2.1 GiB) 10:40:30.979 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 2.0 in stage 128.0 (TID 446, amp-jenkins-worker-04.amp, executor driver, partition 2, PROCESS_LOCAL, 7634 bytes) taskResourceAssignments Map() 10:40:30.979 Executor task launch worker for task 446 INFO Executor: Running task 2.0 in stage 128.0 (TID 446) 10:40:30.979 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 128.0 (TID 447, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7634 bytes) taskResourceAssignments Map() 10:40:30.979 Executor task launch worker for task 447 INFO Executor: Running task 3.0 in stage 128.0 (TID 447) 10:40:30.979 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 128.0 (TID 445) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:30.979 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_123_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 4.3 KiB, free: 2.1 GiB) 10:40:30.979 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 128.0 (TID 444) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:30.980 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_124_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.2 KiB, free: 2.1 GiB) 10:40:30.981 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_141_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 187.0 B, free: 2.1 GiB) 10:40:30.982 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_135_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 4.5 KiB, free: 2.1 GiB) 10:40:30.982 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_142_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 4.9 KiB, free: 2.1 GiB) 10:40:30.983 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_121_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.4 KiB, free: 2.1 GiB) 10:40:30.984 Executor task launch worker for task 447 INFO Executor: Finished task 3.0 in stage 128.0 (TID 447). 1931 bytes result sent to driver 10:40:30.984 Executor task launch worker for task 446 INFO Executor: Finished task 2.0 in stage 128.0 (TID 446). 1931 bytes result sent to driver 10:40:30.984 task-result-getter-1 INFO TaskSetManager: Finished task 3.0 in stage 128.0 (TID 447) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:30.984 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_129_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.5 KiB, free: 2.1 GiB) 10:40:30.984 task-result-getter-2 INFO TaskSetManager: Finished task 2.0 in stage 128.0 (TID 446) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:30.984 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 128.0, whose tasks have all completed, from pool 10:40:30.984 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 128 (apply at OutcomeOf.scala:85) finished in 1.196 s 10:40:30.985 dag-scheduler-event-loop INFO DAGScheduler: Job 102 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:30.985 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 128: Stage finished 10:40:30.985 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_140_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.7 KiB, free: 2.1 GiB) 10:40:30.985 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 102 finished: apply at OutcomeOf.scala:85, took 1.198571 s 10:40:30.985 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_133_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 10.5 KiB, free: 2.1 GiB) 10:40:30.986 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_127_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.5 KiB, free: 2.1 GiB) 10:40:30.987 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_144_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 187.0 B, free: 2.1 GiB) 10:40:30.987 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_139_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 4.5 KiB, free: 2.1 GiB) 10:40:30.988 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_130_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.4 KiB, free: 2.1 GiB) 10:40:30.988 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: Setting configs: set spark.sql.codegen.wholeStage=true, set spark.sql.autoBroadcastJoinThreshold=-1, set spark.sql.join.preferSortMergeJoin=true 10:40:30.989 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_122_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 264.0 B, free: 2.1 GiB) 10:40:30.989 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_134_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 10.0 KiB, free: 2.1 GiB) 10:40:30.990 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_138_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 4.5 KiB, free: 2.1 GiB) 10:40:30.991 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_136_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 4.5 KiB, free: 2.1 GiB) 10:40:30.991 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_125_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.4 KiB, free: 2.1 GiB) 10:40:30.993 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:30.994 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.028 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.029 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.044 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.044 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.059 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.059 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.083 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.083 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.107 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.107 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.130 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.130 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.149 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.149 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.171 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.171 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.198 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.198 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.332 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 12.434466 ms 10:40:31.342 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 7.823499 ms 10:40:31.363 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 8.98338 ms 10:40:31.373 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 4.526938 ms 10:40:31.400 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:31.401 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 405 (apply at OutcomeOf.scala:85) as input to shuffle 26 10:40:31.401 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 413 (apply at OutcomeOf.scala:85) as input to shuffle 27 10:40:31.401 dag-scheduler-event-loop INFO DAGScheduler: Got job 103 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:31.401 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 131 (apply at OutcomeOf.scala:85) 10:40:31.401 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 129, ShuffleMapStage 130) 10:40:31.402 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 129, ShuffleMapStage 130) 10:40:31.402 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 129 (MapPartitionsRDD[405] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:31.403 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_149 stored as values in memory (estimated size 11.7 KiB, free 2.1 GiB) 10:40:31.405 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_149_piece0 stored as bytes in memory (estimated size 5.4 KiB, free 2.1 GiB) 10:40:31.405 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_149_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.4 KiB, free: 2.1 GiB) 10:40:31.405 dag-scheduler-event-loop INFO SparkContext: Created broadcast 149 from broadcast at DAGScheduler.scala:1293 10:40:31.406 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 129 (MapPartitionsRDD[405] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:31.406 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 129.0 with 2 tasks resource profile 0 10:40:31.406 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 130 (MapPartitionsRDD[413] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:31.406 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 129.0 (TID 448, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:31.407 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 129.0 (TID 449, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:31.407 Executor task launch worker for task 448 INFO Executor: Running task 0.0 in stage 129.0 (TID 448) 10:40:31.407 Executor task launch worker for task 449 INFO Executor: Running task 1.0 in stage 129.0 (TID 449) 10:40:31.407 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_150 stored as values in memory (estimated size 11.7 KiB, free 2.1 GiB) 10:40:31.409 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_150_piece0 stored as bytes in memory (estimated size 5.4 KiB, free 2.1 GiB) 10:40:31.410 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_150_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.4 KiB, free: 2.1 GiB) 10:40:31.410 dag-scheduler-event-loop INFO SparkContext: Created broadcast 150 from broadcast at DAGScheduler.scala:1293 10:40:31.411 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ShuffleMapStage 130 (MapPartitionsRDD[413] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:31.411 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 130.0 with 4 tasks resource profile 0 10:40:31.420 Executor task launch worker for task 448 INFO CodeGenerator: Code generated in 8.79344 ms 10:40:31.423 Executor task launch worker for task 448 INFO Executor: Finished task 0.0 in stage 129.0 (TID 448). 1829 bytes result sent to driver 10:40:31.423 Executor task launch worker for task 449 INFO Executor: Finished task 1.0 in stage 129.0 (TID 449). 1829 bytes result sent to driver 10:40:31.424 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 130.0 (TID 450, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:31.424 Executor task launch worker for task 450 INFO Executor: Running task 0.0 in stage 130.0 (TID 450) 10:40:31.424 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 130.0 (TID 451, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:31.424 Executor task launch worker for task 451 INFO Executor: Running task 1.0 in stage 130.0 (TID 451) 10:40:31.424 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 129.0 (TID 448) in 18 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:31.424 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 129.0 (TID 449) in 18 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:31.424 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 129.0, whose tasks have all completed, from pool 10:40:31.426 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 129 (apply at OutcomeOf.scala:85) finished in 0.023 s 10:40:31.426 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:31.426 dag-scheduler-event-loop INFO DAGScheduler: running: Set(ShuffleMapStage 130) 10:40:31.426 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 131) 10:40:31.427 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:31.430 Executor task launch worker for task 450 INFO Executor: Finished task 0.0 in stage 130.0 (TID 450). 1829 bytes result sent to driver 10:40:31.430 Executor task launch worker for task 451 INFO Executor: Finished task 1.0 in stage 130.0 (TID 451). 1829 bytes result sent to driver 10:40:31.430 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 2.0 in stage 130.0 (TID 452, amp-jenkins-worker-04.amp, executor driver, partition 2, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:31.431 Executor task launch worker for task 452 INFO Executor: Running task 2.0 in stage 130.0 (TID 452) 10:40:31.431 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 3.0 in stage 130.0 (TID 453, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:31.431 Executor task launch worker for task 453 INFO Executor: Running task 3.0 in stage 130.0 (TID 453) 10:40:31.431 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 130.0 (TID 450) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:31.431 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 130.0 (TID 451) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:31.437 Executor task launch worker for task 453 INFO Executor: Finished task 3.0 in stage 130.0 (TID 453). 1829 bytes result sent to driver 10:40:31.437 Executor task launch worker for task 452 INFO Executor: Finished task 2.0 in stage 130.0 (TID 452). 1829 bytes result sent to driver 10:40:31.438 task-result-getter-3 INFO TaskSetManager: Finished task 3.0 in stage 130.0 (TID 453) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:31.438 task-result-getter-0 INFO TaskSetManager: Finished task 2.0 in stage 130.0 (TID 452) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:31.438 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 130.0, whose tasks have all completed, from pool 10:40:31.438 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 130 (apply at OutcomeOf.scala:85) finished in 0.031 s 10:40:31.438 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:31.438 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:31.438 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 131) 10:40:31.438 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:31.438 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 131 (MapPartitionsRDD[418] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:31.440 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_151 stored as values in memory (estimated size 24.3 KiB, free 2.1 GiB) 10:40:31.442 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_151_piece0 stored as bytes in memory (estimated size 10.0 KiB, free 2.1 GiB) 10:40:31.442 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_151_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 10.0 KiB, free: 2.1 GiB) 10:40:31.442 dag-scheduler-event-loop INFO SparkContext: Created broadcast 151 from broadcast at DAGScheduler.scala:1293 10:40:31.443 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 131 (MapPartitionsRDD[418] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:31.443 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 131.0 with 4 tasks resource profile 0 10:40:31.446 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 131.0 (TID 454, amp-jenkins-worker-04.amp, executor driver, partition 1, NODE_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:31.446 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 2.0 in stage 131.0 (TID 455, amp-jenkins-worker-04.amp, executor driver, partition 2, NODE_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:31.446 Executor task launch worker for task 454 INFO Executor: Running task 1.0 in stage 131.0 (TID 454) 10:40:31.446 Executor task launch worker for task 455 INFO Executor: Running task 2.0 in stage 131.0 (TID 455) 10:40:31.450 Executor task launch worker for task 454 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:31.450 Executor task launch worker for task 455 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:31.450 Executor task launch worker for task 454 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:31.450 Executor task launch worker for task 455 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:31.458 Executor task launch worker for task 454 INFO CodeGenerator: Code generated in 5.749298 ms 10:40:31.465 Executor task launch worker for task 454 INFO CodeGenerator: Code generated in 5.11603 ms 10:40:31.467 Executor task launch worker for task 455 INFO ShuffleBlockFetcherIterator: Getting 2 (144.0 B) non-empty blocks including 2 (144.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:31.467 Executor task launch worker for task 455 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:31.467 Executor task launch worker for task 454 INFO ShuffleBlockFetcherIterator: Getting 2 (144.0 B) non-empty blocks including 2 (144.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:31.467 Executor task launch worker for task 454 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:31.570 Executor task launch worker for task 455 INFO Executor: Finished task 2.0 in stage 131.0 (TID 455). 4313 bytes result sent to driver 10:40:31.570 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 131.0 (TID 456, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:31.571 Executor task launch worker for task 456 INFO Executor: Running task 0.0 in stage 131.0 (TID 456) 10:40:31.571 task-result-getter-1 INFO TaskSetManager: Finished task 2.0 in stage 131.0 (TID 455) in 125 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:31.573 Executor task launch worker for task 456 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:31.573 Executor task launch worker for task 456 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:31.576 Executor task launch worker for task 456 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:31.576 Executor task launch worker for task 456 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:31.577 Executor task launch worker for task 454 INFO Executor: Finished task 1.0 in stage 131.0 (TID 454). 4313 bytes result sent to driver 10:40:31.577 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 3.0 in stage 131.0 (TID 457, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:31.578 Executor task launch worker for task 457 INFO Executor: Running task 3.0 in stage 131.0 (TID 457) 10:40:31.578 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 131.0 (TID 454) in 135 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:31.578 Executor task launch worker for task 456 INFO Executor: Finished task 0.0 in stage 131.0 (TID 456). 4287 bytes result sent to driver 10:40:31.578 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 131.0 (TID 456) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:31.581 Executor task launch worker for task 457 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:31.581 Executor task launch worker for task 457 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:31.583 Executor task launch worker for task 457 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:31.583 Executor task launch worker for task 457 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:31.586 Executor task launch worker for task 457 INFO Executor: Finished task 3.0 in stage 131.0 (TID 457). 4287 bytes result sent to driver 10:40:31.587 task-result-getter-0 INFO TaskSetManager: Finished task 3.0 in stage 131.0 (TID 457) in 10 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:31.587 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 131.0, whose tasks have all completed, from pool 10:40:31.587 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 131 (apply at OutcomeOf.scala:85) finished in 0.148 s 10:40:31.587 dag-scheduler-event-loop INFO DAGScheduler: Job 103 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:31.587 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 131: Stage finished 10:40:31.588 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 103 finished: apply at OutcomeOf.scala:85, took 0.187624 s 10:40:31.591 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: Setting configs: set spark.sql.codegen.wholeStage=false, set spark.sql.codegen.factoryMode=CODEGEN_ONLY, set spark.sql.autoBroadcastJoinThreshold=-1, set spark.sql.join.preferSortMergeJoin=true 10:40:31.597 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.597 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.608 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.609 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.617 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.617 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.625 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.625 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.634 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.634 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.647 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.647 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.661 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.661 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.673 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.673 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.687 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.687 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.704 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.704 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.722 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.722 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:31.816 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:31.817 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 426 (apply at OutcomeOf.scala:85) as input to shuffle 28 10:40:31.817 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 436 (apply at OutcomeOf.scala:85) as input to shuffle 29 10:40:31.817 dag-scheduler-event-loop INFO DAGScheduler: Got job 104 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:31.817 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 134 (apply at OutcomeOf.scala:85) 10:40:31.817 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 132, ShuffleMapStage 133) 10:40:31.817 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 132, ShuffleMapStage 133) 10:40:31.818 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 132 (MapPartitionsRDD[426] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:31.819 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_152 stored as values in memory (estimated size 9.9 KiB, free 2.1 GiB) 10:40:31.821 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_152_piece0 stored as bytes in memory (estimated size 5.1 KiB, free 2.1 GiB) 10:40:31.821 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_152_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.1 KiB, free: 2.1 GiB) 10:40:31.822 dag-scheduler-event-loop INFO SparkContext: Created broadcast 152 from broadcast at DAGScheduler.scala:1293 10:40:31.822 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 132 (MapPartitionsRDD[426] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:31.822 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 132.0 with 2 tasks resource profile 0 10:40:31.823 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 133 (MapPartitionsRDD[436] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:31.823 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 132.0 (TID 458, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:31.823 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 132.0 (TID 459, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:31.823 Executor task launch worker for task 459 INFO Executor: Running task 1.0 in stage 132.0 (TID 459) 10:40:31.823 Executor task launch worker for task 458 INFO Executor: Running task 0.0 in stage 132.0 (TID 458) 10:40:31.824 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_153 stored as values in memory (estimated size 9.9 KiB, free 2.1 GiB) 10:40:31.829 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_153_piece0 stored as bytes in memory (estimated size 5.1 KiB, free 2.1 GiB) 10:40:31.829 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_153_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.1 KiB, free: 2.1 GiB) 10:40:31.829 dag-scheduler-event-loop INFO SparkContext: Created broadcast 153 from broadcast at DAGScheduler.scala:1293 10:40:31.830 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ShuffleMapStage 133 (MapPartitionsRDD[436] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:31.830 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 133.0 with 4 tasks resource profile 0 10:40:31.832 Executor task launch worker for task 459 INFO Executor: Finished task 1.0 in stage 132.0 (TID 459). 1695 bytes result sent to driver 10:40:31.832 Executor task launch worker for task 458 INFO Executor: Finished task 0.0 in stage 132.0 (TID 458). 1695 bytes result sent to driver 10:40:31.832 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 133.0 (TID 460, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:31.833 Executor task launch worker for task 460 INFO Executor: Running task 0.0 in stage 133.0 (TID 460) 10:40:31.833 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 133.0 (TID 461, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:31.833 Executor task launch worker for task 461 INFO Executor: Running task 1.0 in stage 133.0 (TID 461) 10:40:31.833 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 132.0 (TID 459) in 10 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:31.833 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 132.0 (TID 458) in 10 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:31.833 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 132.0, whose tasks have all completed, from pool 10:40:31.833 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 132 (apply at OutcomeOf.scala:85) finished in 0.015 s 10:40:31.833 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:31.833 dag-scheduler-event-loop INFO DAGScheduler: running: Set(ShuffleMapStage 133) 10:40:31.833 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 134) 10:40:31.834 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:31.838 Executor task launch worker for task 461 INFO Executor: Finished task 1.0 in stage 133.0 (TID 461). 1695 bytes result sent to driver 10:40:31.839 Executor task launch worker for task 460 INFO Executor: Finished task 0.0 in stage 133.0 (TID 460). 1695 bytes result sent to driver 10:40:31.839 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 2.0 in stage 133.0 (TID 462, amp-jenkins-worker-04.amp, executor driver, partition 2, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:31.839 Executor task launch worker for task 462 INFO Executor: Running task 2.0 in stage 133.0 (TID 462) 10:40:31.839 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 3.0 in stage 133.0 (TID 463, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:31.839 Executor task launch worker for task 463 INFO Executor: Running task 3.0 in stage 133.0 (TID 463) 10:40:31.839 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 133.0 (TID 461) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:31.839 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 133.0 (TID 460) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:31.844 Executor task launch worker for task 463 INFO Executor: Finished task 3.0 in stage 133.0 (TID 463). 1695 bytes result sent to driver 10:40:31.845 Executor task launch worker for task 462 INFO Executor: Finished task 2.0 in stage 133.0 (TID 462). 1695 bytes result sent to driver 10:40:31.845 task-result-getter-1 INFO TaskSetManager: Finished task 3.0 in stage 133.0 (TID 463) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:31.845 task-result-getter-2 INFO TaskSetManager: Finished task 2.0 in stage 133.0 (TID 462) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:31.845 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 133.0, whose tasks have all completed, from pool 10:40:31.845 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 133 (apply at OutcomeOf.scala:85) finished in 0.022 s 10:40:31.846 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:31.846 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:31.846 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 134) 10:40:31.846 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:31.846 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 134 (MapPartitionsRDD[441] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:31.848 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_154 stored as values in memory (estimated size 14.9 KiB, free 2.1 GiB) 10:40:31.849 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_154_piece0 stored as bytes in memory (estimated size 7.2 KiB, free 2.1 GiB) 10:40:31.849 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_154_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 7.2 KiB, free: 2.1 GiB) 10:40:31.850 dag-scheduler-event-loop INFO SparkContext: Created broadcast 154 from broadcast at DAGScheduler.scala:1293 10:40:31.850 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 134 (MapPartitionsRDD[441] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:31.850 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 134.0 with 4 tasks resource profile 0 10:40:31.850 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 134.0 (TID 464, amp-jenkins-worker-04.amp, executor driver, partition 1, NODE_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:31.851 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 2.0 in stage 134.0 (TID 465, amp-jenkins-worker-04.amp, executor driver, partition 2, NODE_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:31.851 Executor task launch worker for task 465 INFO Executor: Running task 2.0 in stage 134.0 (TID 465) 10:40:31.851 Executor task launch worker for task 464 INFO Executor: Running task 1.0 in stage 134.0 (TID 464) 10:40:31.869 Executor task launch worker for task 464 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:31.869 Executor task launch worker for task 465 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:31.871 Executor task launch worker for task 464 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms 10:40:31.871 Executor task launch worker for task 465 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms 10:40:31.886 Executor task launch worker for task 464 INFO ShuffleBlockFetcherIterator: Getting 2 (144.0 B) non-empty blocks including 2 (144.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:31.886 Executor task launch worker for task 464 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:31.898 Executor task launch worker for task 465 INFO ShuffleBlockFetcherIterator: Getting 2 (144.0 B) non-empty blocks including 2 (144.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:31.898 Executor task launch worker for task 465 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:31.944 Executor task launch worker for task 464 INFO CodeGenerator: Code generated in 8.388475 ms 10:40:31.952 Executor task launch worker for task 465 INFO CodeGenerator: Code generated in 5.466373 ms 10:40:31.999 Executor task launch worker for task 464 INFO Executor: Finished task 1.0 in stage 134.0 (TID 464). 3873 bytes result sent to driver 10:40:31.999 Executor task launch worker for task 465 INFO Executor: Finished task 2.0 in stage 134.0 (TID 465). 3873 bytes result sent to driver 10:40:32.000 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 134.0 (TID 466, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:32.000 Executor task launch worker for task 466 INFO Executor: Running task 0.0 in stage 134.0 (TID 466) 10:40:32.000 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 134.0 (TID 467, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:32.000 Executor task launch worker for task 467 INFO Executor: Running task 3.0 in stage 134.0 (TID 467) 10:40:32.000 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 134.0 (TID 464) in 150 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:32.000 task-result-getter-0 INFO TaskSetManager: Finished task 2.0 in stage 134.0 (TID 465) in 149 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:32.002 Executor task launch worker for task 466 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.002 Executor task launch worker for task 467 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.002 Executor task launch worker for task 466 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.002 Executor task launch worker for task 467 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.004 Executor task launch worker for task 467 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.004 Executor task launch worker for task 466 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.004 Executor task launch worker for task 467 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.004 Executor task launch worker for task 466 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.009 Executor task launch worker for task 467 INFO Executor: Finished task 3.0 in stage 134.0 (TID 467). 3847 bytes result sent to driver 10:40:32.009 Executor task launch worker for task 466 INFO Executor: Finished task 0.0 in stage 134.0 (TID 466). 3847 bytes result sent to driver 10:40:32.010 task-result-getter-1 INFO TaskSetManager: Finished task 3.0 in stage 134.0 (TID 467) in 10 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:32.010 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 134.0 (TID 466) in 11 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:32.010 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 134.0, whose tasks have all completed, from pool 10:40:32.011 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 134 (apply at OutcomeOf.scala:85) finished in 0.164 s 10:40:32.011 dag-scheduler-event-loop INFO DAGScheduler: Job 104 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:32.011 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 134: Stage finished 10:40:32.011 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 104 finished: apply at OutcomeOf.scala:85, took 0.194932 s 10:40:32.014 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: Setting configs: set spark.sql.codegen.wholeStage=false, set spark.sql.codegen.factoryMode=NO_CODEGEN, set spark.sql.autoBroadcastJoinThreshold=-1, set spark.sql.join.preferSortMergeJoin=true 10:40:32.019 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.019 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.028 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.028 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.037 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.037 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.046 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.046 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.055 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.055 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.068 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.068 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.084 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.084 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.105 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.105 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.123 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.123 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.138 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.138 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.161 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.161 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.257 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:32.258 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 449 (apply at OutcomeOf.scala:85) as input to shuffle 30 10:40:32.258 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 459 (apply at OutcomeOf.scala:85) as input to shuffle 31 10:40:32.258 dag-scheduler-event-loop INFO DAGScheduler: Got job 105 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:32.258 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 137 (apply at OutcomeOf.scala:85) 10:40:32.258 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 135, ShuffleMapStage 136) 10:40:32.258 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 135, ShuffleMapStage 136) 10:40:32.259 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 135 (MapPartitionsRDD[449] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:32.261 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_155 stored as values in memory (estimated size 9.9 KiB, free 2.1 GiB) 10:40:32.262 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_155_piece0 stored as bytes in memory (estimated size 5.1 KiB, free 2.1 GiB) 10:40:32.263 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_155_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.1 KiB, free: 2.1 GiB) 10:40:32.263 dag-scheduler-event-loop INFO SparkContext: Created broadcast 155 from broadcast at DAGScheduler.scala:1293 10:40:32.264 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 135 (MapPartitionsRDD[449] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:32.264 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 135.0 with 2 tasks resource profile 0 10:40:32.264 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 136 (MapPartitionsRDD[459] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:32.264 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 135.0 (TID 468, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:32.264 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 135.0 (TID 469, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:32.265 Executor task launch worker for task 468 INFO Executor: Running task 0.0 in stage 135.0 (TID 468) 10:40:32.265 Executor task launch worker for task 469 INFO Executor: Running task 1.0 in stage 135.0 (TID 469) 10:40:32.266 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_156 stored as values in memory (estimated size 9.9 KiB, free 2.1 GiB) 10:40:32.268 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_156_piece0 stored as bytes in memory (estimated size 5.1 KiB, free 2.1 GiB) 10:40:32.269 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_156_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.1 KiB, free: 2.1 GiB) 10:40:32.269 dag-scheduler-event-loop INFO SparkContext: Created broadcast 156 from broadcast at DAGScheduler.scala:1293 10:40:32.270 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ShuffleMapStage 136 (MapPartitionsRDD[459] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:32.270 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 136.0 with 4 tasks resource profile 0 10:40:32.272 Executor task launch worker for task 468 INFO Executor: Finished task 0.0 in stage 135.0 (TID 468). 1695 bytes result sent to driver 10:40:32.272 Executor task launch worker for task 469 INFO Executor: Finished task 1.0 in stage 135.0 (TID 469). 1695 bytes result sent to driver 10:40:32.273 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 136.0 (TID 470, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:32.273 Executor task launch worker for task 470 INFO Executor: Running task 0.0 in stage 136.0 (TID 470) 10:40:32.273 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 136.0 (TID 471, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:32.273 Executor task launch worker for task 471 INFO Executor: Running task 1.0 in stage 136.0 (TID 471) 10:40:32.273 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 135.0 (TID 468) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:32.273 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 135.0 (TID 469) in 9 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:32.274 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 135.0, whose tasks have all completed, from pool 10:40:32.274 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 135 (apply at OutcomeOf.scala:85) finished in 0.015 s 10:40:32.274 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:32.274 dag-scheduler-event-loop INFO DAGScheduler: running: Set(ShuffleMapStage 136) 10:40:32.274 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 137) 10:40:32.274 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:32.278 Executor task launch worker for task 470 INFO Executor: Finished task 0.0 in stage 136.0 (TID 470). 1695 bytes result sent to driver 10:40:32.278 Executor task launch worker for task 471 INFO Executor: Finished task 1.0 in stage 136.0 (TID 471). 1695 bytes result sent to driver 10:40:32.279 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 2.0 in stage 136.0 (TID 472, amp-jenkins-worker-04.amp, executor driver, partition 2, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:32.279 Executor task launch worker for task 472 INFO Executor: Running task 2.0 in stage 136.0 (TID 472) 10:40:32.279 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 3.0 in stage 136.0 (TID 473, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:32.279 Executor task launch worker for task 473 INFO Executor: Running task 3.0 in stage 136.0 (TID 473) 10:40:32.279 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 136.0 (TID 470) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:32.279 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 136.0 (TID 471) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:32.284 Executor task launch worker for task 472 INFO Executor: Finished task 2.0 in stage 136.0 (TID 472). 1695 bytes result sent to driver 10:40:32.284 Executor task launch worker for task 473 INFO Executor: Finished task 3.0 in stage 136.0 (TID 473). 1695 bytes result sent to driver 10:40:32.285 task-result-getter-3 INFO TaskSetManager: Finished task 2.0 in stage 136.0 (TID 472) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:32.285 task-result-getter-0 INFO TaskSetManager: Finished task 3.0 in stage 136.0 (TID 473) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:32.285 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 136.0, whose tasks have all completed, from pool 10:40:32.285 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 136 (apply at OutcomeOf.scala:85) finished in 0.020 s 10:40:32.285 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:32.285 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:32.285 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 137) 10:40:32.285 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:32.286 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 137 (MapPartitionsRDD[464] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:32.288 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_157 stored as values in memory (estimated size 14.9 KiB, free 2.1 GiB) 10:40:32.293 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_157_piece0 stored as bytes in memory (estimated size 7.2 KiB, free 2.1 GiB) 10:40:32.293 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_157_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 7.2 KiB, free: 2.1 GiB) 10:40:32.293 dag-scheduler-event-loop INFO SparkContext: Created broadcast 157 from broadcast at DAGScheduler.scala:1293 10:40:32.294 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 137 (MapPartitionsRDD[464] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:32.294 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 137.0 with 4 tasks resource profile 0 10:40:32.295 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 137.0 (TID 474, amp-jenkins-worker-04.amp, executor driver, partition 1, NODE_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:32.295 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 2.0 in stage 137.0 (TID 475, amp-jenkins-worker-04.amp, executor driver, partition 2, NODE_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:32.295 Executor task launch worker for task 474 INFO Executor: Running task 1.0 in stage 137.0 (TID 474) 10:40:32.295 Executor task launch worker for task 475 INFO Executor: Running task 2.0 in stage 137.0 (TID 475) 10:40:32.298 Executor task launch worker for task 475 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.298 Executor task launch worker for task 474 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.299 Executor task launch worker for task 475 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.299 Executor task launch worker for task 474 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.315 Executor task launch worker for task 474 INFO ShuffleBlockFetcherIterator: Getting 2 (144.0 B) non-empty blocks including 2 (144.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.315 Executor task launch worker for task 474 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.327 Executor task launch worker for task 475 INFO ShuffleBlockFetcherIterator: Getting 2 (144.0 B) non-empty blocks including 2 (144.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.327 Executor task launch worker for task 475 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.375 Executor task launch worker for task 474 INFO Executor: Finished task 1.0 in stage 137.0 (TID 474). 3873 bytes result sent to driver 10:40:32.375 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 137.0 (TID 476, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:32.376 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 137.0 (TID 474) in 82 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:32.376 Executor task launch worker for task 476 INFO Executor: Running task 0.0 in stage 137.0 (TID 476) 10:40:32.379 Executor task launch worker for task 476 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.379 Executor task launch worker for task 476 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.381 Executor task launch worker for task 476 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.381 Executor task launch worker for task 476 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.384 Executor task launch worker for task 476 INFO Executor: Finished task 0.0 in stage 137.0 (TID 476). 3847 bytes result sent to driver 10:40:32.385 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 3.0 in stage 137.0 (TID 477, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:32.385 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 137.0 (TID 476) in 10 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:32.387 Executor task launch worker for task 475 INFO Executor: Finished task 2.0 in stage 137.0 (TID 475). 3873 bytes result sent to driver 10:40:32.388 Executor task launch worker for task 477 INFO Executor: Running task 3.0 in stage 137.0 (TID 477) 10:40:32.388 task-result-getter-3 INFO TaskSetManager: Finished task 2.0 in stage 137.0 (TID 475) in 93 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:32.390 Executor task launch worker for task 477 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.390 Executor task launch worker for task 477 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.391 Executor task launch worker for task 477 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.392 Executor task launch worker for task 477 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.394 Executor task launch worker for task 477 INFO Executor: Finished task 3.0 in stage 137.0 (TID 477). 3847 bytes result sent to driver 10:40:32.394 task-result-getter-0 INFO TaskSetManager: Finished task 3.0 in stage 137.0 (TID 477) in 10 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:32.394 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 137.0, whose tasks have all completed, from pool 10:40:32.395 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 137 (apply at OutcomeOf.scala:85) finished in 0.108 s 10:40:32.395 dag-scheduler-event-loop INFO DAGScheduler: Job 105 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:32.395 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 137: Stage finished 10:40:32.395 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 105 finished: apply at OutcomeOf.scala:85, took 0.138106 s 10:40:32.399 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: Setting configs: set spark.sql.codegen.wholeStage=true, set spark.sql.autoBroadcastJoinThreshold=-1, set spark.sql.join.preferSortMergeJoin=false 10:40:32.410 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.410 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.435 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.435 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.462 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.462 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.502 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.502 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.541 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.541 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.570 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.570 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.587 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.587 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.601 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.601 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.615 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.615 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.635 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.635 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.751 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:32.752 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 470 (apply at OutcomeOf.scala:85) as input to shuffle 32 10:40:32.752 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 478 (apply at OutcomeOf.scala:85) as input to shuffle 33 10:40:32.752 dag-scheduler-event-loop INFO DAGScheduler: Got job 106 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:32.752 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 140 (apply at OutcomeOf.scala:85) 10:40:32.752 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 139, ShuffleMapStage 138) 10:40:32.752 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 139, ShuffleMapStage 138) 10:40:32.752 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 138 (MapPartitionsRDD[470] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:32.754 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_158 stored as values in memory (estimated size 11.7 KiB, free 2.1 GiB) 10:40:32.755 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_158_piece0 stored as bytes in memory (estimated size 5.4 KiB, free 2.1 GiB) 10:40:32.756 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_158_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.4 KiB, free: 2.1 GiB) 10:40:32.756 dag-scheduler-event-loop INFO SparkContext: Created broadcast 158 from broadcast at DAGScheduler.scala:1293 10:40:32.756 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 138 (MapPartitionsRDD[470] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:32.756 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 138.0 with 2 tasks resource profile 0 10:40:32.757 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 139 (MapPartitionsRDD[478] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:32.757 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 138.0 (TID 478, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:32.757 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 138.0 (TID 479, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:32.757 Executor task launch worker for task 478 INFO Executor: Running task 0.0 in stage 138.0 (TID 478) 10:40:32.757 Executor task launch worker for task 479 INFO Executor: Running task 1.0 in stage 138.0 (TID 479) 10:40:32.760 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_159 stored as values in memory (estimated size 11.7 KiB, free 2.1 GiB) 10:40:32.761 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_159_piece0 stored as bytes in memory (estimated size 5.4 KiB, free 2.1 GiB) 10:40:32.761 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_159_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.4 KiB, free: 2.1 GiB) 10:40:32.762 dag-scheduler-event-loop INFO SparkContext: Created broadcast 159 from broadcast at DAGScheduler.scala:1293 10:40:32.762 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ShuffleMapStage 139 (MapPartitionsRDD[478] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:32.762 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 139.0 with 4 tasks resource profile 0 10:40:32.763 Executor task launch worker for task 478 INFO Executor: Finished task 0.0 in stage 138.0 (TID 478). 1829 bytes result sent to driver 10:40:32.763 Executor task launch worker for task 479 INFO Executor: Finished task 1.0 in stage 138.0 (TID 479). 1829 bytes result sent to driver 10:40:32.763 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 139.0 (TID 480, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:32.763 Executor task launch worker for task 480 INFO Executor: Running task 0.0 in stage 139.0 (TID 480) 10:40:32.763 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 139.0 (TID 481, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:32.763 Executor task launch worker for task 481 INFO Executor: Running task 1.0 in stage 139.0 (TID 481) 10:40:32.763 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 138.0 (TID 478) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:32.763 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 138.0 (TID 479) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:32.764 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 138.0, whose tasks have all completed, from pool 10:40:32.764 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 138 (apply at OutcomeOf.scala:85) finished in 0.011 s 10:40:32.764 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:32.764 dag-scheduler-event-loop INFO DAGScheduler: running: Set(ShuffleMapStage 139) 10:40:32.764 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 140) 10:40:32.764 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:32.769 Executor task launch worker for task 481 INFO Executor: Finished task 1.0 in stage 139.0 (TID 481). 1829 bytes result sent to driver 10:40:32.769 Executor task launch worker for task 480 INFO Executor: Finished task 0.0 in stage 139.0 (TID 480). 1829 bytes result sent to driver 10:40:32.770 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 2.0 in stage 139.0 (TID 482, amp-jenkins-worker-04.amp, executor driver, partition 2, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:32.770 Executor task launch worker for task 482 INFO Executor: Running task 2.0 in stage 139.0 (TID 482) 10:40:32.770 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 139.0 (TID 481) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:32.770 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 139.0 (TID 483, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:32.770 Executor task launch worker for task 483 INFO Executor: Running task 3.0 in stage 139.0 (TID 483) 10:40:32.770 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 139.0 (TID 480) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:32.775 Executor task launch worker for task 483 INFO Executor: Finished task 3.0 in stage 139.0 (TID 483). 1829 bytes result sent to driver 10:40:32.775 Executor task launch worker for task 482 INFO Executor: Finished task 2.0 in stage 139.0 (TID 482). 1829 bytes result sent to driver 10:40:32.775 task-result-getter-1 INFO TaskSetManager: Finished task 3.0 in stage 139.0 (TID 483) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:32.776 task-result-getter-2 INFO TaskSetManager: Finished task 2.0 in stage 139.0 (TID 482) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:32.776 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 139.0, whose tasks have all completed, from pool 10:40:32.776 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 139 (apply at OutcomeOf.scala:85) finished in 0.018 s 10:40:32.776 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:32.776 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:32.776 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 140) 10:40:32.776 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:32.777 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 140 (MapPartitionsRDD[483] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:32.779 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_160 stored as values in memory (estimated size 24.3 KiB, free 2.1 GiB) 10:40:32.781 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_160_piece0 stored as bytes in memory (estimated size 10.0 KiB, free 2.1 GiB) 10:40:32.783 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_160_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 10.0 KiB, free: 2.1 GiB) 10:40:32.784 dag-scheduler-event-loop INFO SparkContext: Created broadcast 160 from broadcast at DAGScheduler.scala:1293 10:40:32.784 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 140 (MapPartitionsRDD[483] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:32.784 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 140.0 with 4 tasks resource profile 0 10:40:32.785 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 140.0 (TID 484, amp-jenkins-worker-04.amp, executor driver, partition 1, NODE_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:32.785 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 2.0 in stage 140.0 (TID 485, amp-jenkins-worker-04.amp, executor driver, partition 2, NODE_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:32.785 Executor task launch worker for task 484 INFO Executor: Running task 1.0 in stage 140.0 (TID 484) 10:40:32.785 Executor task launch worker for task 485 INFO Executor: Running task 2.0 in stage 140.0 (TID 485) 10:40:32.789 Executor task launch worker for task 485 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.789 Executor task launch worker for task 484 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.789 Executor task launch worker for task 485 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.789 Executor task launch worker for task 484 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.791 Executor task launch worker for task 484 INFO ShuffleBlockFetcherIterator: Getting 2 (144.0 B) non-empty blocks including 2 (144.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.791 Executor task launch worker for task 485 INFO ShuffleBlockFetcherIterator: Getting 2 (144.0 B) non-empty blocks including 2 (144.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.791 Executor task launch worker for task 484 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.791 Executor task launch worker for task 485 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.856 Executor task launch worker for task 484 INFO Executor: Finished task 1.0 in stage 140.0 (TID 484). 4313 bytes result sent to driver 10:40:32.857 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 140.0 (TID 486, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:32.857 Executor task launch worker for task 486 INFO Executor: Running task 0.0 in stage 140.0 (TID 486) 10:40:32.857 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 140.0 (TID 484) in 72 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:32.860 Executor task launch worker for task 486 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.860 Executor task launch worker for task 486 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.862 Executor task launch worker for task 486 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.862 Executor task launch worker for task 486 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.866 Executor task launch worker for task 486 INFO Executor: Finished task 0.0 in stage 140.0 (TID 486). 4287 bytes result sent to driver 10:40:32.867 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 140.0 (TID 487, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:32.867 Executor task launch worker for task 487 INFO Executor: Running task 3.0 in stage 140.0 (TID 487) 10:40:32.867 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 140.0 (TID 486) in 10 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:32.869 Executor task launch worker for task 485 INFO Executor: Finished task 2.0 in stage 140.0 (TID 485). 4313 bytes result sent to driver 10:40:32.869 task-result-getter-1 INFO TaskSetManager: Finished task 2.0 in stage 140.0 (TID 485) in 84 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:32.869 Executor task launch worker for task 487 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.869 Executor task launch worker for task 487 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.871 Executor task launch worker for task 487 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:32.871 Executor task launch worker for task 487 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:32.874 Executor task launch worker for task 487 INFO Executor: Finished task 3.0 in stage 140.0 (TID 487). 4287 bytes result sent to driver 10:40:32.874 task-result-getter-2 INFO TaskSetManager: Finished task 3.0 in stage 140.0 (TID 487) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:32.875 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 140.0, whose tasks have all completed, from pool 10:40:32.875 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 140 (apply at OutcomeOf.scala:85) finished in 0.098 s 10:40:32.875 dag-scheduler-event-loop INFO DAGScheduler: Job 106 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:32.875 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 140: Stage finished 10:40:32.875 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 106 finished: apply at OutcomeOf.scala:85, took 0.124167 s 10:40:32.878 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: Setting configs: set spark.sql.codegen.wholeStage=false, set spark.sql.codegen.factoryMode=CODEGEN_ONLY, set spark.sql.autoBroadcastJoinThreshold=-1, set spark.sql.join.preferSortMergeJoin=false 10:40:32.885 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.885 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.897 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.897 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.907 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.908 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.916 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.916 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.926 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.926 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.940 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.960 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.974 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.974 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.988 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:32.988 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.004 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.004 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.020 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.020 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.042 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.042 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.135 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:33.136 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 491 (apply at OutcomeOf.scala:85) as input to shuffle 34 10:40:33.136 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 501 (apply at OutcomeOf.scala:85) as input to shuffle 35 10:40:33.136 dag-scheduler-event-loop INFO DAGScheduler: Got job 107 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:33.136 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 143 (apply at OutcomeOf.scala:85) 10:40:33.136 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 141, ShuffleMapStage 142) 10:40:33.136 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 141, ShuffleMapStage 142) 10:40:33.136 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 141 (MapPartitionsRDD[491] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:33.138 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_161 stored as values in memory (estimated size 9.9 KiB, free 2.1 GiB) 10:40:33.139 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_161_piece0 stored as bytes in memory (estimated size 5.1 KiB, free 2.1 GiB) 10:40:33.139 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_161_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.1 KiB, free: 2.1 GiB) 10:40:33.140 dag-scheduler-event-loop INFO SparkContext: Created broadcast 161 from broadcast at DAGScheduler.scala:1293 10:40:33.140 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 141 (MapPartitionsRDD[491] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:33.140 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 141.0 with 2 tasks resource profile 0 10:40:33.140 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 142 (MapPartitionsRDD[501] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:33.140 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 141.0 (TID 488, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:33.141 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 141.0 (TID 489, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:33.141 Executor task launch worker for task 488 INFO Executor: Running task 0.0 in stage 141.0 (TID 488) 10:40:33.141 Executor task launch worker for task 489 INFO Executor: Running task 1.0 in stage 141.0 (TID 489) 10:40:33.142 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_162 stored as values in memory (estimated size 9.9 KiB, free 2.1 GiB) 10:40:33.143 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_162_piece0 stored as bytes in memory (estimated size 5.1 KiB, free 2.1 GiB) 10:40:33.144 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_162_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.1 KiB, free: 2.1 GiB) 10:40:33.144 dag-scheduler-event-loop INFO SparkContext: Created broadcast 162 from broadcast at DAGScheduler.scala:1293 10:40:33.145 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ShuffleMapStage 142 (MapPartitionsRDD[501] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:33.145 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 142.0 with 4 tasks resource profile 0 10:40:33.147 Executor task launch worker for task 488 INFO Executor: Finished task 0.0 in stage 141.0 (TID 488). 1695 bytes result sent to driver 10:40:33.147 Executor task launch worker for task 489 INFO Executor: Finished task 1.0 in stage 141.0 (TID 489). 1695 bytes result sent to driver 10:40:33.148 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 142.0 (TID 490, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:33.148 Executor task launch worker for task 490 INFO Executor: Running task 0.0 in stage 142.0 (TID 490) 10:40:33.148 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 142.0 (TID 491, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:33.148 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 141.0 (TID 488) in 8 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:33.148 Executor task launch worker for task 491 INFO Executor: Running task 1.0 in stage 142.0 (TID 491) 10:40:33.148 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 141.0 (TID 489) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:33.148 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 141.0, whose tasks have all completed, from pool 10:40:33.149 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 141 (apply at OutcomeOf.scala:85) finished in 0.011 s 10:40:33.149 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:33.149 dag-scheduler-event-loop INFO DAGScheduler: running: Set(ShuffleMapStage 142) 10:40:33.149 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 143) 10:40:33.149 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:33.154 Executor task launch worker for task 491 INFO Executor: Finished task 1.0 in stage 142.0 (TID 491). 1695 bytes result sent to driver 10:40:33.154 Executor task launch worker for task 490 INFO Executor: Finished task 0.0 in stage 142.0 (TID 490). 1695 bytes result sent to driver 10:40:33.154 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 2.0 in stage 142.0 (TID 492, amp-jenkins-worker-04.amp, executor driver, partition 2, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:33.154 Executor task launch worker for task 492 INFO Executor: Running task 2.0 in stage 142.0 (TID 492) 10:40:33.154 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 3.0 in stage 142.0 (TID 493, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:33.154 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 142.0 (TID 491) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:33.154 Executor task launch worker for task 493 INFO Executor: Running task 3.0 in stage 142.0 (TID 493) 10:40:33.154 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 142.0 (TID 490) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:33.159 Executor task launch worker for task 493 INFO Executor: Finished task 3.0 in stage 142.0 (TID 493). 1695 bytes result sent to driver 10:40:33.159 Executor task launch worker for task 492 INFO Executor: Finished task 2.0 in stage 142.0 (TID 492). 1695 bytes result sent to driver 10:40:33.160 task-result-getter-3 INFO TaskSetManager: Finished task 3.0 in stage 142.0 (TID 493) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:33.160 task-result-getter-0 INFO TaskSetManager: Finished task 2.0 in stage 142.0 (TID 492) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:33.160 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 142.0, whose tasks have all completed, from pool 10:40:33.161 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 142 (apply at OutcomeOf.scala:85) finished in 0.019 s 10:40:33.161 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:33.161 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:33.161 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 143) 10:40:33.161 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:33.161 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 143 (MapPartitionsRDD[506] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:33.163 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_163 stored as values in memory (estimated size 14.9 KiB, free 2.1 GiB) 10:40:33.165 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_163_piece0 stored as bytes in memory (estimated size 7.2 KiB, free 2.1 GiB) 10:40:33.165 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_163_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 7.2 KiB, free: 2.1 GiB) 10:40:33.165 dag-scheduler-event-loop INFO SparkContext: Created broadcast 163 from broadcast at DAGScheduler.scala:1293 10:40:33.165 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 143 (MapPartitionsRDD[506] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:33.165 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 143.0 with 4 tasks resource profile 0 10:40:33.166 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 143.0 (TID 494, amp-jenkins-worker-04.amp, executor driver, partition 1, NODE_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:33.166 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 2.0 in stage 143.0 (TID 495, amp-jenkins-worker-04.amp, executor driver, partition 2, NODE_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:33.167 Executor task launch worker for task 495 INFO Executor: Running task 2.0 in stage 143.0 (TID 495) 10:40:33.167 Executor task launch worker for task 494 INFO Executor: Running task 1.0 in stage 143.0 (TID 494) 10:40:33.170 Executor task launch worker for task 495 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:33.170 Executor task launch worker for task 494 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:33.170 Executor task launch worker for task 495 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:33.170 Executor task launch worker for task 494 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:33.184 Executor task launch worker for task 495 INFO ShuffleBlockFetcherIterator: Getting 2 (144.0 B) non-empty blocks including 2 (144.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:33.185 Executor task launch worker for task 495 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:33.195 Executor task launch worker for task 494 INFO ShuffleBlockFetcherIterator: Getting 2 (144.0 B) non-empty blocks including 2 (144.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:33.195 Executor task launch worker for task 494 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:33.255 Executor task launch worker for task 495 INFO Executor: Finished task 2.0 in stage 143.0 (TID 495). 3873 bytes result sent to driver 10:40:33.256 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 143.0 (TID 496, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:33.256 Executor task launch worker for task 496 INFO Executor: Running task 0.0 in stage 143.0 (TID 496) 10:40:33.256 task-result-getter-1 INFO TaskSetManager: Finished task 2.0 in stage 143.0 (TID 495) in 90 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:33.262 Executor task launch worker for task 496 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:33.262 Executor task launch worker for task 496 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:33.267 Executor task launch worker for task 496 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:33.267 Executor task launch worker for task 496 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:33.268 Executor task launch worker for task 494 INFO Executor: Finished task 1.0 in stage 143.0 (TID 494). 3873 bytes result sent to driver 10:40:33.268 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 3.0 in stage 143.0 (TID 497, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:33.268 Executor task launch worker for task 497 INFO Executor: Running task 3.0 in stage 143.0 (TID 497) 10:40:33.268 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 143.0 (TID 494) in 102 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:33.271 Executor task launch worker for task 497 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:33.271 Executor task launch worker for task 497 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:33.272 Executor task launch worker for task 496 INFO Executor: Finished task 0.0 in stage 143.0 (TID 496). 3847 bytes result sent to driver 10:40:33.273 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 143.0 (TID 496) in 17 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:33.274 Executor task launch worker for task 497 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:33.274 Executor task launch worker for task 497 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:33.282 Executor task launch worker for task 497 INFO Executor: Finished task 3.0 in stage 143.0 (TID 497). 3847 bytes result sent to driver 10:40:33.282 task-result-getter-0 INFO TaskSetManager: Finished task 3.0 in stage 143.0 (TID 497) in 14 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:33.282 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 143.0, whose tasks have all completed, from pool 10:40:33.283 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 143 (apply at OutcomeOf.scala:85) finished in 0.121 s 10:40:33.283 dag-scheduler-event-loop INFO DAGScheduler: Job 107 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:33.283 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 143: Stage finished 10:40:33.283 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 107 finished: apply at OutcomeOf.scala:85, took 0.148180 s 10:40:33.287 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: Setting configs: set spark.sql.codegen.wholeStage=false, set spark.sql.codegen.factoryMode=NO_CODEGEN, set spark.sql.autoBroadcastJoinThreshold=-1, set spark.sql.join.preferSortMergeJoin=false 10:40:33.293 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.293 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.306 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.306 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.319 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.319 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.333 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.333 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.345 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.345 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.364 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.365 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.379 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.379 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.392 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.393 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.407 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.407 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.423 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.423 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.448 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.448 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.565 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:33.565 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 524 (apply at OutcomeOf.scala:85) as input to shuffle 37 10:40:33.565 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 514 (apply at OutcomeOf.scala:85) as input to shuffle 36 10:40:33.566 dag-scheduler-event-loop INFO DAGScheduler: Got job 108 (apply at OutcomeOf.scala:85) with 4 output partitions 10:40:33.566 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 146 (apply at OutcomeOf.scala:85) 10:40:33.566 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 144, ShuffleMapStage 145) 10:40:33.566 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 144, ShuffleMapStage 145) 10:40:33.566 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 144 (MapPartitionsRDD[524] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:33.567 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_164 stored as values in memory (estimated size 9.9 KiB, free 2.1 GiB) 10:40:33.569 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_164_piece0 stored as bytes in memory (estimated size 5.1 KiB, free 2.1 GiB) 10:40:33.569 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_164_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.1 KiB, free: 2.1 GiB) 10:40:33.569 dag-scheduler-event-loop INFO SparkContext: Created broadcast 164 from broadcast at DAGScheduler.scala:1293 10:40:33.570 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ShuffleMapStage 144 (MapPartitionsRDD[524] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:33.570 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 144.0 with 4 tasks resource profile 0 10:40:33.570 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 145 (MapPartitionsRDD[514] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:33.570 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 144.0 (TID 498, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:33.571 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 144.0 (TID 499, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:33.571 Executor task launch worker for task 499 INFO Executor: Running task 1.0 in stage 144.0 (TID 499) 10:40:33.571 Executor task launch worker for task 498 INFO Executor: Running task 0.0 in stage 144.0 (TID 498) 10:40:33.572 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_165 stored as values in memory (estimated size 9.9 KiB, free 2.1 GiB) 10:40:33.573 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_165_piece0 stored as bytes in memory (estimated size 5.1 KiB, free 2.1 GiB) 10:40:33.574 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_165_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.1 KiB, free: 2.1 GiB) 10:40:33.574 dag-scheduler-event-loop INFO SparkContext: Created broadcast 165 from broadcast at DAGScheduler.scala:1293 10:40:33.575 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 145 (MapPartitionsRDD[514] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:33.575 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 145.0 with 2 tasks resource profile 0 10:40:33.576 Executor task launch worker for task 498 INFO Executor: Finished task 0.0 in stage 144.0 (TID 498). 1695 bytes result sent to driver 10:40:33.576 Executor task launch worker for task 499 INFO Executor: Finished task 1.0 in stage 144.0 (TID 499). 1695 bytes result sent to driver 10:40:33.576 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 2.0 in stage 144.0 (TID 500, amp-jenkins-worker-04.amp, executor driver, partition 2, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:33.577 Executor task launch worker for task 500 INFO Executor: Running task 2.0 in stage 144.0 (TID 500) 10:40:33.577 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 3.0 in stage 144.0 (TID 501, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:33.577 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 144.0 (TID 498) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:33.577 Executor task launch worker for task 501 INFO Executor: Running task 3.0 in stage 144.0 (TID 501) 10:40:33.577 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 144.0 (TID 499) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:33.580 Executor task launch worker for task 501 INFO Executor: Finished task 3.0 in stage 144.0 (TID 501). 1695 bytes result sent to driver 10:40:33.580 Executor task launch worker for task 500 INFO Executor: Finished task 2.0 in stage 144.0 (TID 500). 1695 bytes result sent to driver 10:40:33.580 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 145.0 (TID 502, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:33.581 Executor task launch worker for task 502 INFO Executor: Running task 0.0 in stage 145.0 (TID 502) 10:40:33.581 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 145.0 (TID 503, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7623 bytes) taskResourceAssignments Map() 10:40:33.581 Executor task launch worker for task 503 INFO Executor: Running task 1.0 in stage 145.0 (TID 503) 10:40:33.581 task-result-getter-3 INFO TaskSetManager: Finished task 3.0 in stage 144.0 (TID 501) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:33.581 task-result-getter-0 INFO TaskSetManager: Finished task 2.0 in stage 144.0 (TID 500) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:33.581 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 144.0, whose tasks have all completed, from pool 10:40:33.581 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 144 (apply at OutcomeOf.scala:85) finished in 0.014 s 10:40:33.581 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:33.582 dag-scheduler-event-loop INFO DAGScheduler: running: Set(ShuffleMapStage 145) 10:40:33.582 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 146) 10:40:33.582 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:33.585 Executor task launch worker for task 503 INFO Executor: Finished task 1.0 in stage 145.0 (TID 503). 1695 bytes result sent to driver 10:40:33.585 Executor task launch worker for task 502 INFO Executor: Finished task 0.0 in stage 145.0 (TID 502). 1695 bytes result sent to driver 10:40:33.585 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 145.0 (TID 503) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:33.586 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 145.0 (TID 502) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:33.586 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 145.0, whose tasks have all completed, from pool 10:40:33.586 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 145 (apply at OutcomeOf.scala:85) finished in 0.015 s 10:40:33.586 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:33.586 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:33.586 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 146) 10:40:33.586 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:33.586 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 146 (MapPartitionsRDD[529] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:33.588 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_166 stored as values in memory (estimated size 14.9 KiB, free 2.1 GiB) 10:40:33.589 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_166_piece0 stored as bytes in memory (estimated size 7.2 KiB, free 2.1 GiB) 10:40:33.590 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_166_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 7.2 KiB, free: 2.1 GiB) 10:40:33.590 dag-scheduler-event-loop INFO SparkContext: Created broadcast 166 from broadcast at DAGScheduler.scala:1293 10:40:33.590 dag-scheduler-event-loop INFO DAGScheduler: Submitting 4 missing tasks from ResultStage 146 (MapPartitionsRDD[529] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) 10:40:33.590 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 146.0 with 4 tasks resource profile 0 10:40:33.591 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 146.0 (TID 504, amp-jenkins-worker-04.amp, executor driver, partition 1, NODE_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:33.591 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 2.0 in stage 146.0 (TID 505, amp-jenkins-worker-04.amp, executor driver, partition 2, NODE_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:33.591 Executor task launch worker for task 504 INFO Executor: Running task 1.0 in stage 146.0 (TID 504) 10:40:33.591 Executor task launch worker for task 505 INFO Executor: Running task 2.0 in stage 146.0 (TID 505) 10:40:33.594 Executor task launch worker for task 505 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:33.594 Executor task launch worker for task 504 INFO ShuffleBlockFetcherIterator: Getting 1 (72.0 B) non-empty blocks including 1 (72.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:33.594 Executor task launch worker for task 505 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:33.594 Executor task launch worker for task 504 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:33.607 Executor task launch worker for task 504 INFO ShuffleBlockFetcherIterator: Getting 2 (144.0 B) non-empty blocks including 2 (144.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:33.607 Executor task launch worker for task 504 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:33.620 Executor task launch worker for task 505 INFO ShuffleBlockFetcherIterator: Getting 2 (144.0 B) non-empty blocks including 2 (144.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:33.620 Executor task launch worker for task 505 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:33.680 Executor task launch worker for task 504 INFO Executor: Finished task 1.0 in stage 146.0 (TID 504). 3873 bytes result sent to driver 10:40:33.681 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 146.0 (TID 506, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:33.681 Executor task launch worker for task 506 INFO Executor: Running task 0.0 in stage 146.0 (TID 506) 10:40:33.681 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 146.0 (TID 504) in 90 ms on amp-jenkins-worker-04.amp (executor driver) (1/4) 10:40:33.683 Executor task launch worker for task 506 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:33.684 Executor task launch worker for task 506 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:33.685 Executor task launch worker for task 506 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:33.685 Executor task launch worker for task 506 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:33.687 Executor task launch worker for task 506 INFO Executor: Finished task 0.0 in stage 146.0 (TID 506). 3847 bytes result sent to driver 10:40:33.687 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 146.0 (TID 507, amp-jenkins-worker-04.amp, executor driver, partition 3, PROCESS_LOCAL, 7607 bytes) taskResourceAssignments Map() 10:40:33.688 Executor task launch worker for task 507 INFO Executor: Running task 3.0 in stage 146.0 (TID 507) 10:40:33.688 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 146.0 (TID 506) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (2/4) 10:40:33.690 Executor task launch worker for task 505 INFO Executor: Finished task 2.0 in stage 146.0 (TID 505). 3873 bytes result sent to driver 10:40:33.690 Executor task launch worker for task 507 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:33.690 Executor task launch worker for task 507 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:33.690 task-result-getter-1 INFO TaskSetManager: Finished task 2.0 in stage 146.0 (TID 505) in 99 ms on amp-jenkins-worker-04.amp (executor driver) (3/4) 10:40:33.691 Executor task launch worker for task 507 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:33.691 Executor task launch worker for task 507 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:33.693 Executor task launch worker for task 507 INFO Executor: Finished task 3.0 in stage 146.0 (TID 507). 3847 bytes result sent to driver 10:40:33.693 task-result-getter-2 INFO TaskSetManager: Finished task 3.0 in stage 146.0 (TID 507) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (4/4) 10:40:33.694 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 146.0, whose tasks have all completed, from pool 10:40:33.694 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 146 (apply at OutcomeOf.scala:85) finished in 0.107 s 10:40:33.694 dag-scheduler-event-loop INFO DAGScheduler: Job 108 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:33.694 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 146: Stage finished 10:40:33.694 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 108 finished: apply at OutcomeOf.scala:85, took 0.129543 s 10:40:33.697 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== FINISHED o.a.s.sql.SQLQueryTestSuite: 'inner-join.sql' ===== 10:40:33.717 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== TEST OUTPUT FOR o.a.s.sql.SQLQueryTestSuite: 'pred-pushdown.sql' ===== 10:40:33.725 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.726 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.747 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.747 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.775 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.775 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:33.825 broadcast-exchange-13 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:33.825 dag-scheduler-event-loop INFO DAGScheduler: Got job 109 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 1 output partitions 10:40:33.825 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 147 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:33.825 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:33.825 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:33.825 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 147 (MapPartitionsRDD[532] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:33.827 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_167 stored as values in memory (estimated size 5.9 KiB, free 2.1 GiB) 10:40:33.829 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_167_piece0 stored as bytes in memory (estimated size 3.1 KiB, free 2.1 GiB) 10:40:33.829 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_167_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.1 KiB, free: 2.1 GiB) 10:40:33.829 dag-scheduler-event-loop INFO SparkContext: Created broadcast 167 from broadcast at DAGScheduler.scala:1293 10:40:33.830 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 147 (MapPartitionsRDD[532] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0)) 10:40:33.830 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 147.0 with 1 tasks resource profile 0 10:40:33.830 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 147.0 (TID 508, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7525 bytes) taskResourceAssignments Map() 10:40:33.831 Executor task launch worker for task 508 INFO Executor: Running task 0.0 in stage 147.0 (TID 508) 10:40:33.833 Executor task launch worker for task 508 INFO Executor: Finished task 0.0 in stage 147.0 (TID 508). 1347 bytes result sent to driver 10:40:33.833 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 147.0 (TID 508) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:33.833 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 147.0, whose tasks have all completed, from pool 10:40:33.834 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 147 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.007 s 10:40:33.834 dag-scheduler-event-loop INFO DAGScheduler: Job 109 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:33.834 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 147: Stage finished 10:40:33.834 broadcast-exchange-13 INFO DAGScheduler: Job 109 finished: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266, took 0.009230 s 10:40:33.836 broadcast-exchange-13 INFO MemoryStore: Block broadcast_168 stored as values in memory (estimated size 104.0 B, free 2.1 GiB) 10:40:33.838 broadcast-exchange-13 INFO MemoryStore: Block broadcast_168_piece0 stored as bytes in memory (estimated size 183.0 B, free 2.1 GiB) 10:40:33.838 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_168_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 183.0 B, free: 2.1 GiB) 10:40:33.838 broadcast-exchange-13 INFO SparkContext: Created broadcast 168 from $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:33.855 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:33.855 dag-scheduler-event-loop INFO DAGScheduler: Got job 110 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:33.855 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 148 (apply at OutcomeOf.scala:85) 10:40:33.855 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:33.855 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:33.855 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 148 (MapPartitionsRDD[537] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:33.857 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_169 stored as values in memory (estimated size 9.1 KiB, free 2.1 GiB) 10:40:33.958 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_169_piece0 stored as bytes in memory (estimated size 4.6 KiB, free 2.1 GiB) 10:40:33.958 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_169_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 4.6 KiB, free: 2.1 GiB) 10:40:33.958 dag-scheduler-event-loop INFO SparkContext: Created broadcast 169 from broadcast at DAGScheduler.scala:1293 10:40:33.959 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 148 (MapPartitionsRDD[537] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:33.959 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 148.0 with 2 tasks resource profile 0 10:40:33.959 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 148.0 (TID 509, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7533 bytes) taskResourceAssignments Map() 10:40:33.960 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 1.0 in stage 148.0 (TID 510, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7574 bytes) taskResourceAssignments Map() 10:40:33.960 Executor task launch worker for task 509 INFO Executor: Running task 0.0 in stage 148.0 (TID 509) 10:40:33.960 Executor task launch worker for task 510 INFO Executor: Running task 1.0 in stage 148.0 (TID 510) 10:40:34.066 Executor task launch worker for task 509 INFO CodeGenerator: Code generated in 4.365287 ms 10:40:34.068 Executor task launch worker for task 509 INFO Executor: Finished task 0.0 in stage 148.0 (TID 509). 1806 bytes result sent to driver 10:40:34.068 Executor task launch worker for task 510 INFO Executor: Finished task 1.0 in stage 148.0 (TID 510). 1840 bytes result sent to driver 10:40:34.069 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 148.0 (TID 509) in 110 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:34.069 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 148.0 (TID 510) in 110 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:34.069 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 148.0, whose tasks have all completed, from pool 10:40:34.069 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 148 (apply at OutcomeOf.scala:85) finished in 0.213 s 10:40:34.070 dag-scheduler-event-loop INFO DAGScheduler: Job 110 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:34.070 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 148: Stage finished 10:40:34.070 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 110 finished: apply at OutcomeOf.scala:85, took 0.214916 s 10:40:34.085 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:34.085 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:34.089 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:34.089 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:34.214 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 4.576283 ms 10:40:34.310 broadcast-exchange-14 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:34.310 dag-scheduler-event-loop INFO DAGScheduler: Got job 111 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 1 output partitions 10:40:34.311 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 149 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:34.311 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:34.311 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:34.311 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 149 (MapPartitionsRDD[540] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:34.312 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_170 stored as values in memory (estimated size 5.9 KiB, free 2.1 GiB) 10:40:34.399 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_170_piece0 stored as bytes in memory (estimated size 3.1 KiB, free 2.1 GiB) 10:40:34.425 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_170_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.1 KiB, free: 2.1 GiB) 10:40:34.426 dag-scheduler-event-loop INFO SparkContext: Created broadcast 170 from broadcast at DAGScheduler.scala:1293 10:40:34.426 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 149 (MapPartitionsRDD[540] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0)) 10:40:34.426 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 149.0 with 1 tasks resource profile 0 10:40:34.427 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 149.0 (TID 511, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7525 bytes) taskResourceAssignments Map() 10:40:34.427 Executor task launch worker for task 511 INFO Executor: Running task 0.0 in stage 149.0 (TID 511) 10:40:34.429 Executor task launch worker for task 511 INFO Executor: Finished task 0.0 in stage 149.0 (TID 511). 1347 bytes result sent to driver 10:40:34.433 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 149.0 (TID 511) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:34.433 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 149.0, whose tasks have all completed, from pool 10:40:34.433 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 149 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.122 s 10:40:34.433 dag-scheduler-event-loop INFO DAGScheduler: Job 111 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:34.433 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 149: Stage finished 10:40:34.433 broadcast-exchange-14 INFO DAGScheduler: Job 111 finished: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266, took 0.123179 s 10:40:34.434 broadcast-exchange-14 INFO MemoryStore: Block broadcast_171 stored as values in memory (estimated size 104.0 B, free 2.1 GiB) 10:40:34.437 broadcast-exchange-14 INFO MemoryStore: Block broadcast_171_piece0 stored as bytes in memory (estimated size 183.0 B, free 2.1 GiB) 10:40:34.437 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_171_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 183.0 B, free: 2.1 GiB) 10:40:34.437 broadcast-exchange-14 INFO SparkContext: Created broadcast 171 from $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:34.538 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:34.539 dag-scheduler-event-loop INFO DAGScheduler: Got job 112 (apply at OutcomeOf.scala:85) with 2 output partitions 10:40:34.539 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 150 (apply at OutcomeOf.scala:85) 10:40:34.539 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:34.539 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:34.539 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 150 (MapPartitionsRDD[546] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:34.540 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_172 stored as values in memory (estimated size 12.0 KiB, free 2.1 GiB) 10:40:34.645 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_172_piece0 stored as bytes in memory (estimated size 5.7 KiB, free 2.1 GiB) 10:40:34.645 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_172_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.7 KiB, free: 2.1 GiB) 10:40:34.646 dag-scheduler-event-loop INFO SparkContext: Created broadcast 172 from broadcast at DAGScheduler.scala:1293 10:40:34.646 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 150 (MapPartitionsRDD[546] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0, 1)) 10:40:34.646 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 150.0 with 2 tasks resource profile 0 10:40:34.647 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 150.0 (TID 512, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7533 bytes) taskResourceAssignments Map() 10:40:34.647 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 150.0 (TID 513, amp-jenkins-worker-04.amp, executor driver, partition 1, PROCESS_LOCAL, 7574 bytes) taskResourceAssignments Map() 10:40:34.647 Executor task launch worker for task 512 INFO Executor: Running task 0.0 in stage 150.0 (TID 512) 10:40:34.647 Executor task launch worker for task 513 INFO Executor: Running task 1.0 in stage 150.0 (TID 513) 10:40:34.662 Executor task launch worker for task 513 INFO CodeGenerator: Code generated in 11.159177 ms 10:40:34.667 Executor task launch worker for task 512 INFO Executor: Finished task 0.0 in stage 150.0 (TID 512). 1944 bytes result sent to driver 10:40:34.668 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 150.0 (TID 512) in 21 ms on amp-jenkins-worker-04.amp (executor driver) (1/2) 10:40:34.669 Executor task launch worker for task 513 INFO Executor: Finished task 1.0 in stage 150.0 (TID 513). 1951 bytes result sent to driver 10:40:34.670 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 150.0 (TID 513) in 23 ms on amp-jenkins-worker-04.amp (executor driver) (2/2) 10:40:34.670 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 150.0, whose tasks have all completed, from pool 10:40:34.670 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 150 (apply at OutcomeOf.scala:85) finished in 0.131 s 10:40:34.670 dag-scheduler-event-loop INFO DAGScheduler: Job 112 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:34.670 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 150: Stage finished 10:40:34.670 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 112 finished: apply at OutcomeOf.scala:85, took 0.131927 s 10:40:34.672 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== FINISHED o.a.s.sql.SQLQueryTestSuite: 'pred-pushdown.sql' ===== 10:40:34.690 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== TEST OUTPUT FOR o.a.s.sql.SQLQueryTestSuite: 'show-tblproperties.sql' ===== 10:40:34.702 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:34.702 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:34.711 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO InMemoryFileIndex: It took 0 ms to list leaf files for 0 paths. 10:40:34.727 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:34.727 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:34.739 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:34.739 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:34.848 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:34.848 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:34.901 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:34.901 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:34.920 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO InMemoryFileIndex: It took 0 ms to list leaf files for 1 paths. 10:40:34.954 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:34.954 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.092 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_147_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 187.0 B, free: 2.1 GiB) 10:40:35.093 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_158_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.4 KiB, free: 2.1 GiB) 10:40:35.094 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_159_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.4 KiB, free: 2.1 GiB) 10:40:35.095 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_163_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 7.2 KiB, free: 2.1 GiB) 10:40:35.096 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_161_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.1 KiB, free: 2.1 GiB) 10:40:35.097 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.097 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.097 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_160_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 10.0 KiB, free: 2.1 GiB) 10:40:35.097 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_168_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 183.0 B, free: 2.1 GiB) 10:40:35.099 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_150_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.4 KiB, free: 2.1 GiB) 10:40:35.100 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_167_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.1 KiB, free: 2.1 GiB) 10:40:35.100 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_153_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.1 KiB, free: 2.1 GiB) 10:40:35.101 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_171_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 183.0 B, free: 2.1 GiB) 10:40:35.102 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_154_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 7.2 KiB, free: 2.1 GiB) 10:40:35.102 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_172_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.7 KiB, free: 2.1 GiB) 10:40:35.103 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_157_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 7.2 KiB, free: 2.1 GiB) 10:40:35.104 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_169_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 4.6 KiB, free: 2.1 GiB) 10:40:35.104 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_164_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.1 KiB, free: 2.1 GiB) 10:40:35.106 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_151_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 10.0 KiB, free: 2.1 GiB) 10:40:35.106 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_155_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.1 KiB, free: 2.1 GiB) 10:40:35.107 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_166_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 7.2 KiB, free: 2.1 GiB) 10:40:35.111 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.112 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.114 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_162_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.1 KiB, free: 2.1 GiB) 10:40:35.115 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_170_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 3.1 KiB, free: 2.1 GiB) 10:40:35.116 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_152_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.1 KiB, free: 2.1 GiB) 10:40:35.117 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_156_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.1 KiB, free: 2.1 GiB) 10:40:35.118 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_148_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.9 KiB, free: 2.1 GiB) 10:40:35.118 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_165_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.1 KiB, free: 2.1 GiB) 10:40:35.119 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_149_piece0 on amp-jenkins-worker-04.amp:34728 in memory (size: 5.4 KiB, free: 2.1 GiB) 10:40:35.126 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.126 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.141 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.141 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.166 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.166 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.179 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.179 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.189 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.189 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.201 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== FINISHED o.a.s.sql.SQLQueryTestSuite: 'show-tblproperties.sql' ===== 10:40:35.217 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: ===== TEST OUTPUT FOR o.a.s.sql.SQLQueryTestSuite: 'cte-nonlegacy.sql' ===== 10:40:35.219 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SQLQueryTestSuite: Setting configs: set spark.sql.legacy.ctePrecedencePolicy=corrected 10:40:35.224 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.224 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.242 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.242 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.263 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 4.74765 ms 10:40:35.270 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:35.271 dag-scheduler-event-loop INFO DAGScheduler: Got job 113 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:35.271 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 151 (apply at OutcomeOf.scala:85) 10:40:35.271 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:35.271 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:35.271 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 151 (MapPartitionsRDD[549] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:35.272 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_173 stored as values in memory (estimated size 6.3 KiB, free 2.1 GiB) 10:40:35.273 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_173_piece0 stored as bytes in memory (estimated size 3.2 KiB, free 2.1 GiB) 10:40:35.274 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_173_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.2 KiB, free: 2.1 GiB) 10:40:35.274 dag-scheduler-event-loop INFO SparkContext: Created broadcast 173 from broadcast at DAGScheduler.scala:1293 10:40:35.275 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 151 (MapPartitionsRDD[549] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:35.275 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 151.0 with 1 tasks resource profile 0 10:40:35.275 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 151.0 (TID 514, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:35.276 Executor task launch worker for task 514 INFO Executor: Running task 0.0 in stage 151.0 (TID 514) 10:40:35.280 Executor task launch worker for task 514 INFO Executor: Finished task 0.0 in stage 151.0 (TID 514). 1403 bytes result sent to driver 10:40:35.281 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 151.0 (TID 514) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:35.281 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 151.0, whose tasks have all completed, from pool 10:40:35.281 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 151 (apply at OutcomeOf.scala:85) finished in 0.009 s 10:40:35.281 dag-scheduler-event-loop INFO DAGScheduler: Job 113 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:35.281 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 151: Stage finished 10:40:35.281 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 113 finished: apply at OutcomeOf.scala:85, took 0.010676 s 10:40:35.296 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.296 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.328 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 6.890438 ms 10:40:35.339 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 8.520406 ms 10:40:35.349 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:35.349 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 551 (apply at OutcomeOf.scala:85) as input to shuffle 38 10:40:35.350 dag-scheduler-event-loop INFO DAGScheduler: Got job 114 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:35.350 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 153 (apply at OutcomeOf.scala:85) 10:40:35.350 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 152) 10:40:35.350 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 152) 10:40:35.350 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 152 (MapPartitionsRDD[551] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:35.352 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_174 stored as values in memory (estimated size 10.4 KiB, free 2.1 GiB) 10:40:35.353 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_174_piece0 stored as bytes in memory (estimated size 5.4 KiB, free 2.1 GiB) 10:40:35.354 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_174_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.4 KiB, free: 2.1 GiB) 10:40:35.354 dag-scheduler-event-loop INFO SparkContext: Created broadcast 174 from broadcast at DAGScheduler.scala:1293 10:40:35.354 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 152 (MapPartitionsRDD[551] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:35.354 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 152.0 with 1 tasks resource profile 0 10:40:35.355 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 152.0 (TID 515, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7550 bytes) taskResourceAssignments Map() 10:40:35.355 Executor task launch worker for task 515 INFO Executor: Running task 0.0 in stage 152.0 (TID 515) 10:40:35.361 Executor task launch worker for task 515 INFO Executor: Finished task 0.0 in stage 152.0 (TID 515). 1849 bytes result sent to driver 10:40:35.361 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 152.0 (TID 515) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:35.361 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 152.0, whose tasks have all completed, from pool 10:40:35.361 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 152 (apply at OutcomeOf.scala:85) finished in 0.010 s 10:40:35.361 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:35.362 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:35.362 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 153) 10:40:35.362 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:35.362 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 153 (MapPartitionsRDD[554] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:35.363 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_175 stored as values in memory (estimated size 10.6 KiB, free 2.1 GiB) 10:40:35.365 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_175_piece0 stored as bytes in memory (estimated size 5.2 KiB, free 2.1 GiB) 10:40:35.365 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_175_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.2 KiB, free: 2.1 GiB) 10:40:35.366 dag-scheduler-event-loop INFO SparkContext: Created broadcast 175 from broadcast at DAGScheduler.scala:1293 10:40:35.366 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 153 (MapPartitionsRDD[554] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:35.366 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 153.0 with 1 tasks resource profile 0 10:40:35.367 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 153.0 (TID 516, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:35.367 Executor task launch worker for task 516 INFO Executor: Running task 0.0 in stage 153.0 (TID 516) 10:40:35.370 Executor task launch worker for task 516 INFO ShuffleBlockFetcherIterator: Getting 1 (60.0 B) non-empty blocks including 1 (60.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:35.370 Executor task launch worker for task 516 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:35.372 Executor task launch worker for task 516 INFO Executor: Finished task 0.0 in stage 153.0 (TID 516). 2648 bytes result sent to driver 10:40:35.373 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 153.0 (TID 516) in 6 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:35.373 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 153.0, whose tasks have all completed, from pool 10:40:35.373 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 153 (apply at OutcomeOf.scala:85) finished in 0.011 s 10:40:35.373 dag-scheduler-event-loop INFO DAGScheduler: Job 114 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:35.373 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 153: Stage finished 10:40:35.374 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 114 finished: apply at OutcomeOf.scala:85, took 0.024617 s 10:40:35.383 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.383 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.384 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.384 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.405 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.405 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.434 subquery-1 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:35.435 dag-scheduler-event-loop INFO DAGScheduler: Got job 115 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 1 output partitions 10:40:35.435 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 154 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:35.435 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:35.435 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:35.435 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 154 (MapPartitionsRDD[556] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:35.437 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_176 stored as values in memory (estimated size 7.0 KiB, free 2.1 GiB) 10:40:35.438 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_176_piece0 stored as bytes in memory (estimated size 3.6 KiB, free 2.1 GiB) 10:40:35.438 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_176_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.6 KiB, free: 2.1 GiB) 10:40:35.439 dag-scheduler-event-loop INFO SparkContext: Created broadcast 176 from broadcast at DAGScheduler.scala:1293 10:40:35.439 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 154 (MapPartitionsRDD[556] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0)) 10:40:35.439 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 154.0 with 1 tasks resource profile 0 10:40:35.439 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 154.0 (TID 517, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:35.440 Executor task launch worker for task 517 INFO Executor: Running task 0.0 in stage 154.0 (TID 517) 10:40:35.442 Executor task launch worker for task 517 INFO Executor: Finished task 0.0 in stage 154.0 (TID 517). 1360 bytes result sent to driver 10:40:35.443 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 154.0 (TID 517) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:35.443 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 154.0, whose tasks have all completed, from pool 10:40:35.443 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 154 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.007 s 10:40:35.443 dag-scheduler-event-loop INFO DAGScheduler: Job 115 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:35.443 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 154: Stage finished 10:40:35.443 subquery-1 INFO DAGScheduler: Job 115 finished: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266, took 0.008687 s 10:40:35.450 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 4.753152 ms 10:40:35.457 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:35.458 dag-scheduler-event-loop INFO DAGScheduler: Got job 116 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:35.458 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 155 (apply at OutcomeOf.scala:85) 10:40:35.458 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:35.458 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:35.459 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 155 (MapPartitionsRDD[558] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:35.460 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_177 stored as values in memory (estimated size 7.1 KiB, free 2.1 GiB) 10:40:35.461 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_177_piece0 stored as bytes in memory (estimated size 3.7 KiB, free 2.1 GiB) 10:40:35.461 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_177_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.7 KiB, free: 2.1 GiB) 10:40:35.461 dag-scheduler-event-loop INFO SparkContext: Created broadcast 177 from broadcast at DAGScheduler.scala:1293 10:40:35.462 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 155 (MapPartitionsRDD[558] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:35.462 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 155.0 with 1 tasks resource profile 0 10:40:35.462 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 155.0 (TID 518, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:35.463 Executor task launch worker for task 518 INFO Executor: Running task 0.0 in stage 155.0 (TID 518) 10:40:35.467 Executor task launch worker for task 518 INFO Executor: Finished task 0.0 in stage 155.0 (TID 518). 1403 bytes result sent to driver 10:40:35.467 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 155.0 (TID 518) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:35.467 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 155.0, whose tasks have all completed, from pool 10:40:35.467 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 155 (apply at OutcomeOf.scala:85) finished in 0.008 s 10:40:35.468 dag-scheduler-event-loop INFO DAGScheduler: Job 116 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:35.468 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 155: Stage finished 10:40:35.468 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 116 finished: apply at OutcomeOf.scala:85, took 0.010167 s 10:40:35.476 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.476 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.500 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 6.542228 ms 10:40:35.508 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:35.508 dag-scheduler-event-loop INFO DAGScheduler: Got job 117 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:35.508 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 156 (apply at OutcomeOf.scala:85) 10:40:35.508 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:35.508 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:35.508 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 156 (MapPartitionsRDD[560] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:35.509 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_178 stored as values in memory (estimated size 7.0 KiB, free 2.1 GiB) 10:40:35.511 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_178_piece0 stored as bytes in memory (estimated size 3.6 KiB, free 2.1 GiB) 10:40:35.511 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_178_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.6 KiB, free: 2.1 GiB) 10:40:35.511 dag-scheduler-event-loop INFO SparkContext: Created broadcast 178 from broadcast at DAGScheduler.scala:1293 10:40:35.512 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 156 (MapPartitionsRDD[560] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:35.512 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 156.0 with 1 tasks resource profile 0 10:40:35.512 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 156.0 (TID 519, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:35.513 Executor task launch worker for task 519 INFO Executor: Running task 0.0 in stage 156.0 (TID 519) 10:40:35.516 Executor task launch worker for task 519 INFO Executor: Finished task 0.0 in stage 156.0 (TID 519). 1403 bytes result sent to driver 10:40:35.516 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 156.0 (TID 519) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:35.516 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 156.0, whose tasks have all completed, from pool 10:40:35.516 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 156 (apply at OutcomeOf.scala:85) finished in 0.007 s 10:40:35.516 dag-scheduler-event-loop INFO DAGScheduler: Job 117 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:35.517 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 156: Stage finished 10:40:35.517 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 117 finished: apply at OutcomeOf.scala:85, took 0.008905 s 10:40:35.534 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.534 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.536 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.537 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.566 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.566 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.594 subquery-2 INFO CodeGenerator: Code generated in 6.219963 ms 10:40:35.601 subquery-2 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:35.602 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 562 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) as input to shuffle 39 10:40:35.602 dag-scheduler-event-loop INFO DAGScheduler: Got job 118 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 1 output partitions 10:40:35.602 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 158 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:35.602 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 157) 10:40:35.602 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 157) 10:40:35.602 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 157 (MapPartitionsRDD[562] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:35.604 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_179 stored as values in memory (estimated size 10.4 KiB, free 2.1 GiB) 10:40:35.605 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_179_piece0 stored as bytes in memory (estimated size 5.4 KiB, free 2.1 GiB) 10:40:35.605 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_179_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.4 KiB, free: 2.1 GiB) 10:40:35.605 dag-scheduler-event-loop INFO SparkContext: Created broadcast 179 from broadcast at DAGScheduler.scala:1293 10:40:35.606 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 157 (MapPartitionsRDD[562] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0)) 10:40:35.606 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 157.0 with 1 tasks resource profile 0 10:40:35.606 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 157.0 (TID 520, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7550 bytes) taskResourceAssignments Map() 10:40:35.606 Executor task launch worker for task 520 INFO Executor: Running task 0.0 in stage 157.0 (TID 520) 10:40:35.611 Executor task launch worker for task 520 INFO Executor: Finished task 0.0 in stage 157.0 (TID 520). 1849 bytes result sent to driver 10:40:35.611 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 157.0 (TID 520) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:35.611 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 157.0, whose tasks have all completed, from pool 10:40:35.611 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 157 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.008 s 10:40:35.611 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:35.611 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:35.611 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 158) 10:40:35.611 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:35.612 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 158 (MapPartitionsRDD[565] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:35.613 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_180 stored as values in memory (estimated size 10.6 KiB, free 2.1 GiB) 10:40:35.614 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_180_piece0 stored as bytes in memory (estimated size 5.2 KiB, free 2.1 GiB) 10:40:35.614 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_180_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.2 KiB, free: 2.1 GiB) 10:40:35.614 dag-scheduler-event-loop INFO SparkContext: Created broadcast 180 from broadcast at DAGScheduler.scala:1293 10:40:35.615 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 158 (MapPartitionsRDD[565] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0)) 10:40:35.615 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 158.0 with 1 tasks resource profile 0 10:40:35.615 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 158.0 (TID 521, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:35.615 Executor task launch worker for task 521 INFO Executor: Running task 0.0 in stage 158.0 (TID 521) 10:40:35.617 Executor task launch worker for task 521 INFO ShuffleBlockFetcherIterator: Getting 1 (60.0 B) non-empty blocks including 1 (60.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:35.617 Executor task launch worker for task 521 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:35.618 Executor task launch worker for task 521 INFO Executor: Finished task 0.0 in stage 158.0 (TID 521). 2648 bytes result sent to driver 10:40:35.618 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 158.0 (TID 521) in 3 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:35.618 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 158.0, whose tasks have all completed, from pool 10:40:35.619 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 158 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) finished in 0.007 s 10:40:35.619 dag-scheduler-event-loop INFO DAGScheduler: Job 118 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:35.619 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 158: Stage finished 10:40:35.619 subquery-2 INFO DAGScheduler: Job 118 finished: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266, took 0.017414 s 10:40:35.625 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 4.332447 ms 10:40:35.632 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:35.632 dag-scheduler-event-loop INFO DAGScheduler: Got job 119 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:35.632 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 159 (apply at OutcomeOf.scala:85) 10:40:35.632 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:35.632 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:35.632 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 159 (MapPartitionsRDD[567] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:35.633 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_181 stored as values in memory (estimated size 7.1 KiB, free 2.1 GiB) 10:40:35.635 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_181_piece0 stored as bytes in memory (estimated size 3.7 KiB, free 2.1 GiB) 10:40:35.635 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_181_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.7 KiB, free: 2.1 GiB) 10:40:35.635 dag-scheduler-event-loop INFO SparkContext: Created broadcast 181 from broadcast at DAGScheduler.scala:1293 10:40:35.635 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 159 (MapPartitionsRDD[567] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:35.635 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 159.0 with 1 tasks resource profile 0 10:40:35.636 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 159.0 (TID 522, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:35.636 Executor task launch worker for task 522 INFO Executor: Running task 0.0 in stage 159.0 (TID 522) 10:40:35.640 Executor task launch worker for task 522 INFO Executor: Finished task 0.0 in stage 159.0 (TID 522). 1403 bytes result sent to driver 10:40:35.640 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 159.0 (TID 522) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:35.640 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 159.0, whose tasks have all completed, from pool 10:40:35.641 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 159 (apply at OutcomeOf.scala:85) finished in 0.007 s 10:40:35.641 dag-scheduler-event-loop INFO DAGScheduler: Job 119 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:35.641 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 159: Stage finished 10:40:35.641 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 119 finished: apply at OutcomeOf.scala:85, took 0.009119 s 10:40:35.650 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.650 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.672 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 5.238264 ms 10:40:35.682 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:35.683 dag-scheduler-event-loop INFO DAGScheduler: Got job 120 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:35.683 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 160 (apply at OutcomeOf.scala:85) 10:40:35.683 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:35.683 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:35.683 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 160 (MapPartitionsRDD[569] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:35.684 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_182 stored as values in memory (estimated size 7.0 KiB, free 2.1 GiB) 10:40:35.686 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_182_piece0 stored as bytes in memory (estimated size 3.6 KiB, free 2.1 GiB) 10:40:35.686 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_182_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.6 KiB, free: 2.1 GiB) 10:40:35.686 dag-scheduler-event-loop INFO SparkContext: Created broadcast 182 from broadcast at DAGScheduler.scala:1293 10:40:35.687 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 160 (MapPartitionsRDD[569] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:35.687 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 160.0 with 1 tasks resource profile 0 10:40:35.688 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 160.0 (TID 523, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:35.688 Executor task launch worker for task 523 INFO Executor: Running task 0.0 in stage 160.0 (TID 523) 10:40:35.693 Executor task launch worker for task 523 INFO Executor: Finished task 0.0 in stage 160.0 (TID 523). 1403 bytes result sent to driver 10:40:35.694 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 160.0 (TID 523) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:35.694 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 160.0, whose tasks have all completed, from pool 10:40:35.695 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 160 (apply at OutcomeOf.scala:85) finished in 0.012 s 10:40:35.695 dag-scheduler-event-loop INFO DAGScheduler: Job 120 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:35.695 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 160: Stage finished 10:40:35.695 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 120 finished: apply at OutcomeOf.scala:85, took 0.013006 s 10:40:35.712 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.713 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.763 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:35.764 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 571 (apply at OutcomeOf.scala:85) as input to shuffle 40 10:40:35.764 dag-scheduler-event-loop INFO DAGScheduler: Got job 121 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:35.764 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 162 (apply at OutcomeOf.scala:85) 10:40:35.764 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 161) 10:40:35.764 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 161) 10:40:35.765 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 161 (MapPartitionsRDD[571] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:35.766 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_183 stored as values in memory (estimated size 10.4 KiB, free 2.1 GiB) 10:40:35.768 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_183_piece0 stored as bytes in memory (estimated size 5.4 KiB, free 2.1 GiB) 10:40:35.768 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_183_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.4 KiB, free: 2.1 GiB) 10:40:35.769 dag-scheduler-event-loop INFO SparkContext: Created broadcast 183 from broadcast at DAGScheduler.scala:1293 10:40:35.769 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 161 (MapPartitionsRDD[571] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:35.769 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 161.0 with 1 tasks resource profile 0 10:40:35.770 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 161.0 (TID 524, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7550 bytes) taskResourceAssignments Map() 10:40:35.771 Executor task launch worker for task 524 INFO Executor: Running task 0.0 in stage 161.0 (TID 524) 10:40:35.775 Executor task launch worker for task 524 INFO Executor: Finished task 0.0 in stage 161.0 (TID 524). 1849 bytes result sent to driver 10:40:35.775 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 161.0 (TID 524) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:35.775 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 161.0, whose tasks have all completed, from pool 10:40:35.776 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 161 (apply at OutcomeOf.scala:85) finished in 0.011 s 10:40:35.776 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:35.776 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:35.776 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 162) 10:40:35.776 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:35.777 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 162 (MapPartitionsRDD[574] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:35.778 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_184 stored as values in memory (estimated size 10.6 KiB, free 2.1 GiB) 10:40:35.780 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_184_piece0 stored as bytes in memory (estimated size 5.2 KiB, free 2.1 GiB) 10:40:35.780 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_184_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.2 KiB, free: 2.1 GiB) 10:40:35.780 dag-scheduler-event-loop INFO SparkContext: Created broadcast 184 from broadcast at DAGScheduler.scala:1293 10:40:35.781 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 162 (MapPartitionsRDD[574] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:35.781 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 162.0 with 1 tasks resource profile 0 10:40:35.781 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 162.0 (TID 525, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:35.782 Executor task launch worker for task 525 INFO Executor: Running task 0.0 in stage 162.0 (TID 525) 10:40:35.786 Executor task launch worker for task 525 INFO ShuffleBlockFetcherIterator: Getting 1 (60.0 B) non-empty blocks including 1 (60.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:35.786 Executor task launch worker for task 525 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:35.788 Executor task launch worker for task 525 INFO Executor: Finished task 0.0 in stage 162.0 (TID 525). 2648 bytes result sent to driver 10:40:35.788 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 162.0 (TID 525) in 7 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:35.788 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 162.0, whose tasks have all completed, from pool 10:40:35.788 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 162 (apply at OutcomeOf.scala:85) finished in 0.011 s 10:40:35.789 dag-scheduler-event-loop INFO DAGScheduler: Job 121 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:35.789 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 162: Stage finished 10:40:35.789 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 121 finished: apply at OutcomeOf.scala:85, took 0.025232 s 10:40:35.810 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.810 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.852 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 10.919588 ms 10:40:35.863 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:35.864 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 576 (apply at OutcomeOf.scala:85) as input to shuffle 41 10:40:35.864 dag-scheduler-event-loop INFO DAGScheduler: Got job 122 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:35.864 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 164 (apply at OutcomeOf.scala:85) 10:40:35.864 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 163) 10:40:35.864 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 163) 10:40:35.864 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 163 (MapPartitionsRDD[576] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:35.865 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_185 stored as values in memory (estimated size 10.4 KiB, free 2.1 GiB) 10:40:35.867 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_185_piece0 stored as bytes in memory (estimated size 5.4 KiB, free 2.1 GiB) 10:40:35.867 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_185_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.4 KiB, free: 2.1 GiB) 10:40:35.867 dag-scheduler-event-loop INFO SparkContext: Created broadcast 185 from broadcast at DAGScheduler.scala:1293 10:40:35.867 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 163 (MapPartitionsRDD[576] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:35.867 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 163.0 with 1 tasks resource profile 0 10:40:35.868 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 163.0 (TID 526, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7550 bytes) taskResourceAssignments Map() 10:40:35.868 Executor task launch worker for task 526 INFO Executor: Running task 0.0 in stage 163.0 (TID 526) 10:40:35.871 Executor task launch worker for task 526 INFO Executor: Finished task 0.0 in stage 163.0 (TID 526). 1849 bytes result sent to driver 10:40:35.872 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 163.0 (TID 526) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:35.872 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 163.0, whose tasks have all completed, from pool 10:40:35.872 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 163 (apply at OutcomeOf.scala:85) finished in 0.007 s 10:40:35.872 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:35.872 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:35.872 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 164) 10:40:35.872 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:35.873 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 164 (MapPartitionsRDD[579] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:35.874 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_186 stored as values in memory (estimated size 14.9 KiB, free 2.1 GiB) 10:40:35.875 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_186_piece0 stored as bytes in memory (estimated size 6.2 KiB, free 2.1 GiB) 10:40:35.876 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_186_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 6.2 KiB, free: 2.1 GiB) 10:40:35.876 dag-scheduler-event-loop INFO SparkContext: Created broadcast 186 from broadcast at DAGScheduler.scala:1293 10:40:35.876 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 164 (MapPartitionsRDD[579] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:35.876 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 164.0 with 1 tasks resource profile 0 10:40:35.877 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 164.0 (TID 527, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:35.877 Executor task launch worker for task 527 INFO Executor: Running task 0.0 in stage 164.0 (TID 527) 10:40:35.879 Executor task launch worker for task 527 INFO ShuffleBlockFetcherIterator: Getting 1 (60.0 B) non-empty blocks including 1 (60.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:35.879 Executor task launch worker for task 527 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:35.882 Executor task launch worker for task 527 INFO Executor: Finished task 0.0 in stage 164.0 (TID 527). 2896 bytes result sent to driver 10:40:35.882 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 164.0 (TID 527) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:35.882 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 164.0, whose tasks have all completed, from pool 10:40:35.883 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 164 (apply at OutcomeOf.scala:85) finished in 0.010 s 10:40:35.883 dag-scheduler-event-loop INFO DAGScheduler: Job 122 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:35.883 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 164: Stage finished 10:40:35.883 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 122 finished: apply at OutcomeOf.scala:85, took 0.019450 s 10:40:35.900 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.900 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.941 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO CodeGenerator: Code generated in 7.360305 ms 10:40:35.949 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO SparkContext: Starting job: apply at OutcomeOf.scala:85 10:40:35.950 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 581 (apply at OutcomeOf.scala:85) as input to shuffle 42 10:40:35.950 dag-scheduler-event-loop INFO DAGScheduler: Got job 123 (apply at OutcomeOf.scala:85) with 1 output partitions 10:40:35.950 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 166 (apply at OutcomeOf.scala:85) 10:40:35.950 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 165) 10:40:35.950 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 165) 10:40:35.950 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 165 (MapPartitionsRDD[581] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:35.952 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_187 stored as values in memory (estimated size 10.4 KiB, free 2.1 GiB) 10:40:35.953 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_187_piece0 stored as bytes in memory (estimated size 5.4 KiB, free 2.1 GiB) 10:40:35.953 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_187_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 5.4 KiB, free: 2.1 GiB) 10:40:35.953 dag-scheduler-event-loop INFO SparkContext: Created broadcast 187 from broadcast at DAGScheduler.scala:1293 10:40:35.954 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 165 (MapPartitionsRDD[581] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:35.954 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 165.0 with 1 tasks resource profile 0 10:40:35.954 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 165.0 (TID 528, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7550 bytes) taskResourceAssignments Map() 10:40:35.955 Executor task launch worker for task 528 INFO Executor: Running task 0.0 in stage 165.0 (TID 528) 10:40:35.959 Executor task launch worker for task 528 INFO Executor: Finished task 0.0 in stage 165.0 (TID 528). 1849 bytes result sent to driver 10:40:35.959 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 165.0 (TID 528) in 5 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:35.959 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 165.0, whose tasks have all completed, from pool 10:40:35.960 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 165 (apply at OutcomeOf.scala:85) finished in 0.009 s 10:40:35.960 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 10:40:35.960 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 10:40:35.960 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 166) 10:40:35.960 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 10:40:35.960 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 166 (MapPartitionsRDD[584] at apply at OutcomeOf.scala:85), which has no missing parents 10:40:35.961 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_188 stored as values in memory (estimated size 14.9 KiB, free 2.1 GiB) 10:40:35.963 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_188_piece0 stored as bytes in memory (estimated size 6.2 KiB, free 2.1 GiB) 10:40:35.963 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_188_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 6.2 KiB, free: 2.1 GiB) 10:40:35.963 dag-scheduler-event-loop INFO SparkContext: Created broadcast 188 from broadcast at DAGScheduler.scala:1293 10:40:35.963 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 166 (MapPartitionsRDD[584] at apply at OutcomeOf.scala:85) (first 15 tasks are for partitions Vector(0)) 10:40:35.963 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 166.0 with 1 tasks resource profile 0 10:40:35.964 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 166.0 (TID 529, amp-jenkins-worker-04.amp, executor driver, partition 0, NODE_LOCAL, 7325 bytes) taskResourceAssignments Map() 10:40:35.964 Executor task launch worker for task 529 INFO Executor: Running task 0.0 in stage 166.0 (TID 529) 10:40:35.966 Executor task launch worker for task 529 INFO ShuffleBlockFetcherIterator: Getting 1 (60.0 B) non-empty blocks including 1 (60.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks 10:40:35.966 Executor task launch worker for task 529 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 10:40:35.967 Executor task launch worker for task 529 INFO Executor: Finished task 0.0 in stage 166.0 (TID 529). 2896 bytes result sent to driver 10:40:35.968 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 166.0 (TID 529) in 4 ms on amp-jenkins-worker-04.amp (executor driver) (1/1) 10:40:35.968 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 166.0, whose tasks have all completed, from pool 10:40:35.968 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 166 (apply at OutcomeOf.scala:85) finished in 0.007 s 10:40:35.968 dag-scheduler-event-loop INFO DAGScheduler: Job 123 is finished. Cancelling potential speculative or zombie tasks for this job 10:40:35.968 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 166: Stage finished 10:40:35.968 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO DAGScheduler: Job 123 finished: apply at OutcomeOf.scala:85, took 0.018691 s 10:40:35.977 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.978 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.979 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:35.979 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:36.000 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:36.001 pool-1-thread-1-ScalaTest-running-SQLQueryTestSuite INFO BaseSessionStateBuilder$$anon$2: Optimization rule 'org.apache.spark.sql.catalyst.optimizer.ConvertToLocalRelation' is excluded from the optimizer. 10:40:36.026 subquery-3 INFO SparkContext: Starting job: $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266 10:40:36.027 dag-scheduler-event-loop INFO DAGScheduler: Got job 124 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) with 1 output partitions 10:40:36.027 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 167 ($anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) 10:40:36.027 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 10:40:36.027 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 10:40:36.027 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 167 (MapPartitionsRDD[586] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266), which has no missing parents 10:40:36.028 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_189 stored as values in memory (estimated size 7.0 KiB, free 2.1 GiB) 10:40:36.030 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_189_piece0 stored as bytes in memory (estimated size 3.6 KiB, free 2.1 GiB) 10:40:36.030 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_189_piece0 in memory on amp-jenkins-worker-04.amp:34728 (size: 3.6 KiB, free: 2.1 GiB) 10:40:36.030 dag-scheduler-event-loop INFO SparkContext: Created broadcast 189 from broadcast at DAGScheduler.scala:1293 10:40:36.031 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 167 (MapPartitionsRDD[586] at $anonfun$withThreadLocalCaptured$1 at FutureTask.java:266) (first 15 tasks are for partitions Vector(0)) 10:40:36.031 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 167.0 with 1 tasks resource profile 0 10:40:36.031 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 167.0 (TID 530, amp-jenkins-worker-04.amp, executor driver, partition 0, PROCESS_LOCAL, 7561 bytes) taskResourceAssignments Map() 10:40:36.032 Executor task launch worker for task 530 INFO Exe