20/08/03 12:33:50.092 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== TEST OUTPUT FOR o.a.s.repl.ExecutorClassLoaderSuite: 'child over system classloader' ===== 20/08/03 12:33:50.818 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 20/08/03 12:33:51.204 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== FINISHED o.a.s.repl.ExecutorClassLoaderSuite: 'child over system classloader' ===== 20/08/03 12:33:51.223 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== TEST OUTPUT FOR o.a.s.repl.ExecutorClassLoaderSuite: 'child first' ===== 20/08/03 12:33:51.269 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== FINISHED o.a.s.repl.ExecutorClassLoaderSuite: 'child first' ===== 20/08/03 12:33:51.271 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== TEST OUTPUT FOR o.a.s.repl.ExecutorClassLoaderSuite: 'parent first' ===== 20/08/03 12:33:51.319 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== FINISHED o.a.s.repl.ExecutorClassLoaderSuite: 'parent first' ===== 20/08/03 12:33:51.321 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== TEST OUTPUT FOR o.a.s.repl.ExecutorClassLoaderSuite: 'child first can fall back' ===== 20/08/03 12:33:51.368 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== FINISHED o.a.s.repl.ExecutorClassLoaderSuite: 'child first can fall back' ===== 20/08/03 12:33:51.370 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== TEST OUTPUT FOR o.a.s.repl.ExecutorClassLoaderSuite: 'child first can fail' ===== 20/08/03 12:33:51.407 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== FINISHED o.a.s.repl.ExecutorClassLoaderSuite: 'child first can fail' ===== 20/08/03 12:33:51.409 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== TEST OUTPUT FOR o.a.s.repl.ExecutorClassLoaderSuite: 'resource from parent' ===== 20/08/03 12:33:51.454 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== FINISHED o.a.s.repl.ExecutorClassLoaderSuite: 'resource from parent' ===== 20/08/03 12:33:51.457 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== TEST OUTPUT FOR o.a.s.repl.ExecutorClassLoaderSuite: 'resources from parent' ===== 20/08/03 12:33:51.494 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== FINISHED o.a.s.repl.ExecutorClassLoaderSuite: 'resources from parent' ===== 20/08/03 12:33:51.496 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== TEST OUTPUT FOR o.a.s.repl.ExecutorClassLoaderSuite: 'fetch classes using Spark's RpcEnv' ===== 20/08/03 12:33:52.340 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== FINISHED o.a.s.repl.ExecutorClassLoaderSuite: 'fetch classes using Spark's RpcEnv' ===== 20/08/03 12:33:52.342 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== TEST OUTPUT FOR o.a.s.repl.ExecutorClassLoaderSuite: 'nonexistent class and transient errors should cause different errors' ===== 20/08/03 12:33:52.374 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO SparkContext: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:33:52.418 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ResourceUtils: ============================================================== 20/08/03 12:33:52.419 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ResourceUtils: Resources for spark.driver: 20/08/03 12:33:52.420 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ResourceUtils: ============================================================== 20/08/03 12:33:52.420 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO SparkContext: Submitted application: executor-class-loader-test 20/08/03 12:33:52.489 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:33:52.489 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:33:52.490 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO SecurityManager: Changing view acls groups to: 20/08/03 12:33:52.490 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:33:52.490 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:33:52.808 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO Utils: Successfully started service 'sparkDriver' on port 42180. 20/08/03 12:33:52.835 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO SparkEnv: Registering MapOutputTracker 20/08/03 12:33:52.868 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO SparkEnv: Registering BlockManagerMaster 20/08/03 12:33:52.872 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 20/08/03 12:33:52.873 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up 20/08/03 12:33:52.877 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO SparkEnv: Registering BlockManagerMasterHeartbeat 20/08/03 12:33:52.887 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/blockmgr-2c44691b-1009-4f14-9dd2-843ce0c8a448 20/08/03 12:33:52.914 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO MemoryStore: MemoryStore started with capacity 2.1 GiB 20/08/03 12:33:52.930 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO SparkEnv: Registering OutputCommitCoordinator 20/08/03 12:33:53.335 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO Executor: Starting executor ID driver on host amp-jenkins-worker-06.amp 20/08/03 12:33:53.345 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO Executor: Using REPL class URI: spark://amp-jenkins-worker-06.amp:42180/classes 20/08/03 12:33:53.366 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 45587. 20/08/03 12:33:53.366 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO NettyBlockTransferService: Server created on amp-jenkins-worker-06.amp:45587 20/08/03 12:33:53.368 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 20/08/03 12:33:53.375 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 45587, None) 20/08/03 12:33:53.379 dispatcher-BlockManagerMaster INFO BlockManagerMasterEndpoint: Registering block manager amp-jenkins-worker-06.amp:45587 with 2.1 GiB RAM, BlockManagerId(driver, amp-jenkins-worker-06.amp, 45587, None) 20/08/03 12:33:53.382 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 45587, None) 20/08/03 12:33:53.383 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, amp-jenkins-worker-06.amp, 45587, None) 20/08/03 12:33:53.598 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO log: Logging initialized @8640ms to org.eclipse.jetty.util.log.Slf4jLog 20/08/03 12:33:53.679 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:33:53.679 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:33:53.679 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO SecurityManager: Changing view acls groups to: 20/08/03 12:33:53.679 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:33:53.680 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:33:53.770 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-06.amp/192.168.10.26:42180 after 45 ms (0 ms spent in bootstraps) 20/08/03 12:33:53.820 dispatcher-event-loop-1 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 20/08/03 12:33:53.829 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO MemoryStore: MemoryStore cleared 20/08/03 12:33:53.829 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO BlockManager: BlockManager stopped 20/08/03 12:33:53.837 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO BlockManagerMaster: BlockManagerMaster stopped 20/08/03 12:33:53.842 dispatcher-event-loop-1 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 20/08/03 12:33:53.847 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO SparkContext: Successfully stopped SparkContext 20/08/03 12:33:53.848 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO TransportClientFactory: Found inactive connection to amp-jenkins-worker-06.amp/192.168.10.26:42180, creating a new one. 20/08/03 12:33:53.851 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite ERROR Utils: Aborting task java.io.IOException: Failed to connect to amp-jenkins-worker-06.amp/192.168.10.26:42180 at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:253) at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:195) at org.apache.spark.rpc.netty.NettyRpcEnv.downloadClient(NettyRpcEnv.scala:392) at org.apache.spark.rpc.netty.NettyRpcEnv.$anonfun$openChannel$4(NettyRpcEnv.scala:360) at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) at org.apache.spark.util.Utils$.tryWithSafeFinallyAndFailureCallbacks(Utils.scala:1411) at org.apache.spark.rpc.netty.NettyRpcEnv.openChannel(NettyRpcEnv.scala:359) at org.apache.spark.repl.ExecutorClassLoader.getClassFileInputStreamFromSparkRPC(ExecutorClassLoader.scala:135) at org.apache.spark.repl.ExecutorClassLoader.$anonfun$fetchFn$1(ExecutorClassLoader.scala:66) at org.apache.spark.repl.ExecutorClassLoader.findClassLocally(ExecutorClassLoader.scala:176) at org.apache.spark.repl.ExecutorClassLoader.findClass(ExecutorClassLoader.scala:113) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at org.apache.spark.repl.ExecutorClassLoaderSuite.$anonfun$new$18(ExecutorClassLoaderSuite.scala:270) at org.scalatest.Assertions.intercept(Assertions.scala:807) at org.scalatest.Assertions.intercept$(Assertions.scala:804) at org.scalatest.FunSuite.intercept(FunSuite.scala:1560) at org.apache.spark.repl.ExecutorClassLoaderSuite.$anonfun$new$16(ExecutorClassLoaderSuite.scala:269) at org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) at org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) at org.scalatest.Transformer.apply(Transformer.scala:22) at org.scalatest.Transformer.apply(Transformer.scala:20) at org.scalatest.FunSuiteLike$$anon$1.apply(FunSuiteLike.scala:186) at org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:157) at org.scalatest.FunSuiteLike.invokeWithFixture$1(FunSuiteLike.scala:184) at org.scalatest.FunSuiteLike.$anonfun$runTest$1(FunSuiteLike.scala:196) at org.scalatest.SuperEngine.runTestImpl(Engine.scala:286) at org.scalatest.FunSuiteLike.runTest(FunSuiteLike.scala:196) at org.scalatest.FunSuiteLike.runTest$(FunSuiteLike.scala:178) at org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:59) at org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:221) at org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:214) at org.apache.spark.SparkFunSuite.runTest(SparkFunSuite.scala:59) at org.scalatest.FunSuiteLike.$anonfun$runTests$1(FunSuiteLike.scala:229) at org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:393) at scala.collection.immutable.List.foreach(List.scala:392) at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:381) at org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:376) at org.scalatest.SuperEngine.runTestsImpl(Engine.scala:458) at org.scalatest.FunSuiteLike.runTests(FunSuiteLike.scala:229) at org.scalatest.FunSuiteLike.runTests$(FunSuiteLike.scala:228) at org.scalatest.FunSuite.runTests(FunSuite.scala:1560) at org.scalatest.Suite.run(Suite.scala:1124) at org.scalatest.Suite.run$(Suite.scala:1106) at org.scalatest.FunSuite.org$scalatest$FunSuiteLike$$super$run(FunSuite.scala:1560) at org.scalatest.FunSuiteLike.$anonfun$run$1(FunSuiteLike.scala:233) at org.scalatest.SuperEngine.runImpl(Engine.scala:518) at org.scalatest.FunSuiteLike.run(FunSuiteLike.scala:233) at org.scalatest.FunSuiteLike.run$(FunSuiteLike.scala:232) at org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:59) at org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) at org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) at org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) at org.apache.spark.SparkFunSuite.run(SparkFunSuite.scala:59) at org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:317) at org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:510) at sbt.ForkMain$Run$2.call(ForkMain.java:296) at sbt.ForkMain$Run$2.call(ForkMain.java:286) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: amp-jenkins-worker-06.amp/192.168.10.26:42180 Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:330) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:702) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 20/08/03 12:33:53.857 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite ERROR ExecutorClassLoader: Failed to check existence of class ThisIsAClassName on REPL class server at spark://amp-jenkins-worker-06.amp:42180/classes java.io.IOException: Failed to connect to amp-jenkins-worker-06.amp/192.168.10.26:42180 at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:253) at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:195) at org.apache.spark.rpc.netty.NettyRpcEnv.downloadClient(NettyRpcEnv.scala:392) at org.apache.spark.rpc.netty.NettyRpcEnv.$anonfun$openChannel$4(NettyRpcEnv.scala:360) at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) at org.apache.spark.util.Utils$.tryWithSafeFinallyAndFailureCallbacks(Utils.scala:1411) at org.apache.spark.rpc.netty.NettyRpcEnv.openChannel(NettyRpcEnv.scala:359) at org.apache.spark.repl.ExecutorClassLoader.getClassFileInputStreamFromSparkRPC(ExecutorClassLoader.scala:135) at org.apache.spark.repl.ExecutorClassLoader.$anonfun$fetchFn$1(ExecutorClassLoader.scala:66) at org.apache.spark.repl.ExecutorClassLoader.findClassLocally(ExecutorClassLoader.scala:176) at org.apache.spark.repl.ExecutorClassLoader.findClass(ExecutorClassLoader.scala:113) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at org.apache.spark.repl.ExecutorClassLoaderSuite.$anonfun$new$18(ExecutorClassLoaderSuite.scala:270) at org.scalatest.Assertions.intercept(Assertions.scala:807) at org.scalatest.Assertions.intercept$(Assertions.scala:804) at org.scalatest.FunSuite.intercept(FunSuite.scala:1560) at org.apache.spark.repl.ExecutorClassLoaderSuite.$anonfun$new$16(ExecutorClassLoaderSuite.scala:269) at org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85) at org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83) at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104) at org.scalatest.Transformer.apply(Transformer.scala:22) at org.scalatest.Transformer.apply(Transformer.scala:20) at org.scalatest.FunSuiteLike$$anon$1.apply(FunSuiteLike.scala:186) at org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:157) at org.scalatest.FunSuiteLike.invokeWithFixture$1(FunSuiteLike.scala:184) at org.scalatest.FunSuiteLike.$anonfun$runTest$1(FunSuiteLike.scala:196) at org.scalatest.SuperEngine.runTestImpl(Engine.scala:286) at org.scalatest.FunSuiteLike.runTest(FunSuiteLike.scala:196) at org.scalatest.FunSuiteLike.runTest$(FunSuiteLike.scala:178) at org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:59) at org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:221) at org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:214) at org.apache.spark.SparkFunSuite.runTest(SparkFunSuite.scala:59) at org.scalatest.FunSuiteLike.$anonfun$runTests$1(FunSuiteLike.scala:229) at org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:393) at scala.collection.immutable.List.foreach(List.scala:392) at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:381) at org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:376) at org.scalatest.SuperEngine.runTestsImpl(Engine.scala:458) at org.scalatest.FunSuiteLike.runTests(FunSuiteLike.scala:229) at org.scalatest.FunSuiteLike.runTests$(FunSuiteLike.scala:228) at org.scalatest.FunSuite.runTests(FunSuite.scala:1560) at org.scalatest.Suite.run(Suite.scala:1124) at org.scalatest.Suite.run$(Suite.scala:1106) at org.scalatest.FunSuite.org$scalatest$FunSuiteLike$$super$run(FunSuite.scala:1560) at org.scalatest.FunSuiteLike.$anonfun$run$1(FunSuiteLike.scala:233) at org.scalatest.SuperEngine.runImpl(Engine.scala:518) at org.scalatest.FunSuiteLike.run(FunSuiteLike.scala:233) at org.scalatest.FunSuiteLike.run$(FunSuiteLike.scala:232) at org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:59) at org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213) at org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210) at org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208) at org.apache.spark.SparkFunSuite.run(SparkFunSuite.scala:59) at org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:317) at org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:510) at sbt.ForkMain$Run$2.call(ForkMain.java:296) at sbt.ForkMain$Run$2.call(ForkMain.java:286) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: amp-jenkins-worker-06.amp/192.168.10.26:42180 Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:330) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:702) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 20/08/03 12:33:53.861 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO SparkContext: SparkContext already stopped. 20/08/03 12:33:53.862 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== FINISHED o.a.s.repl.ExecutorClassLoaderSuite: 'nonexistent class and transient errors should cause different errors' ===== 20/08/03 12:33:53.864 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== TEST OUTPUT FOR o.a.s.repl.ExecutorClassLoaderSuite: 'SPARK-20547 ExecutorClassLoader should not throw ClassNotFoundException without acknowledgment from driver' ===== 20/08/03 12:33:53.909 pool-1-thread-1-ScalaTest-running-ExecutorClassLoaderSuite INFO ExecutorClassLoaderSuite: ===== FINISHED o.a.s.repl.ExecutorClassLoaderSuite: 'SPARK-20547 ExecutorClassLoader should not throw ClassNotFoundException without acknowledgment from driver' ===== 20/08/03 12:33:53.926 pool-1-thread-1 WARN ExecutorClassLoaderSuite: ===== POSSIBLE THREAD LEAK IN SUITE o.a.s.repl.ExecutorClassLoaderSuite, thread names: rpc-boss-3-1, files-client-9-1, shuffle-boss-6-1 ===== 20/08/03 12:33:53.943 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.ReplSuite: 'propagation of local properties' ===== 20/08/03 12:33:53.960 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SignalUtils: Registered signal handler for INT 20/08/03 12:33:54.089 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:33:54.090 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:33:54.090 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: Resources for spark.driver: 20/08/03 12:33:54.090 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:33:54.090 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Submitted application: repl-test 20/08/03 12:33:54.093 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:33:54.093 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:33:54.093 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls groups to: 20/08/03 12:33:54.093 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:33:54.094 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:33:54.132 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'sparkDriver' on port 38397. 20/08/03 12:33:54.136 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering MapOutputTracker 20/08/03 12:33:54.138 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMaster 20/08/03 12:33:54.139 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 20/08/03 12:33:54.139 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up 20/08/03 12:33:54.140 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMasterHeartbeat 20/08/03 12:33:54.141 pool-1-thread-1-ScalaTest-running-ReplSuite INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/blockmgr-466ef299-23e5-4df8-a361-34fb07264703 20/08/03 12:33:54.142 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore started with capacity 2.1 GiB 20/08/03 12:33:54.145 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering OutputCommitCoordinator 20/08/03 12:33:54.185 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Executor: Starting executor ID driver on host amp-jenkins-worker-06.amp 20/08/03 12:33:54.190 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 38079. 20/08/03 12:33:54.191 pool-1-thread-1-ScalaTest-running-ReplSuite INFO NettyBlockTransferService: Server created on amp-jenkins-worker-06.amp:38079 20/08/03 12:33:54.191 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 20/08/03 12:33:54.191 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 38079, None) 20/08/03 12:33:54.192 dispatcher-BlockManagerMaster INFO BlockManagerMasterEndpoint: Registering block manager amp-jenkins-worker-06.amp:38079 with 2.1 GiB RAM, BlockManagerId(driver, amp-jenkins-worker-06.amp, 38079, None) 20/08/03 12:33:54.193 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 38079, None) 20/08/03 12:33:54.193 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, amp-jenkins-worker-06.amp, 38079, None) 20/08/03 12:33:57.692 dispatcher-event-loop-0 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 20/08/03 12:33:57.700 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore cleared 20/08/03 12:33:57.701 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: BlockManager stopped 20/08/03 12:33:57.701 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: BlockManagerMaster stopped 20/08/03 12:33:57.701 dispatcher-event-loop-1 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 20/08/03 12:33:57.706 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Successfully stopped SparkContext 20/08/03 12:33:57.706 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== FINISHED o.a.s.repl.ReplSuite: 'propagation of local properties' ===== 20/08/03 12:33:57.708 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.ReplSuite: 'SPARK-15236: use Hive catalog' ===== 20/08/03 12:33:59.605 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:33:59.606 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:33:59.606 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: Resources for spark.driver: 20/08/03 12:33:59.606 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:33:59.606 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Submitted application: Spark shell 20/08/03 12:33:59.608 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:33:59.609 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:33:59.609 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls groups to: 20/08/03 12:33:59.609 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:33:59.609 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:33:59.660 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'sparkDriver' on port 46761. 20/08/03 12:33:59.663 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering MapOutputTracker 20/08/03 12:33:59.664 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMaster 20/08/03 12:33:59.664 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 20/08/03 12:33:59.665 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up 20/08/03 12:33:59.665 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMasterHeartbeat 20/08/03 12:33:59.667 pool-1-thread-1-ScalaTest-running-ReplSuite INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/blockmgr-0cf1e76b-4572-4191-b711-2f6971dd4467 20/08/03 12:33:59.667 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore started with capacity 2.1 GiB 20/08/03 12:33:59.669 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering OutputCommitCoordinator 20/08/03 12:33:59.731 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Executor: Starting executor ID driver on host amp-jenkins-worker-06.amp 20/08/03 12:33:59.740 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Executor: Using REPL class URI: spark://amp-jenkins-worker-06.amp:46761/classes 20/08/03 12:33:59.744 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 34489. 20/08/03 12:33:59.744 pool-1-thread-1-ScalaTest-running-ReplSuite INFO NettyBlockTransferService: Server created on amp-jenkins-worker-06.amp:34489 20/08/03 12:33:59.744 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 20/08/03 12:33:59.745 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 34489, None) 20/08/03 12:33:59.745 dispatcher-BlockManagerMaster INFO BlockManagerMasterEndpoint: Registering block manager amp-jenkins-worker-06.amp:34489 with 2.1 GiB RAM, BlockManagerId(driver, amp-jenkins-worker-06.amp, 34489, None) 20/08/03 12:33:59.746 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 34489, None) 20/08/03 12:33:59.746 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, amp-jenkins-worker-06.amp, 34489, None) 20/08/03 12:33:59.842 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Main: Created Spark session 20/08/03 12:34:03.380 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SharedState: Setting hive.metastore.warehouse.dir ('null') to the value of spark.sql.warehouse.dir ('file:/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/spark-warehouse'). 20/08/03 12:34:03.380 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SharedState: Warehouse path is 'file:/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/spark-warehouse'. 20/08/03 12:34:05.672 dispatcher-event-loop-0 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 20/08/03 12:34:05.676 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore cleared 20/08/03 12:34:05.676 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: BlockManager stopped 20/08/03 12:34:05.677 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: BlockManagerMaster stopped 20/08/03 12:34:05.677 dispatcher-event-loop-0 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 20/08/03 12:34:05.681 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Successfully stopped SparkContext 20/08/03 12:34:05.683 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== FINISHED o.a.s.repl.ReplSuite: 'SPARK-15236: use Hive catalog' ===== 20/08/03 12:34:05.685 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.ReplSuite: 'SPARK-15236: use in-memory catalog' ===== 20/08/03 12:34:06.558 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:34:06.559 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:34:06.559 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: Resources for spark.driver: 20/08/03 12:34:06.560 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:34:06.560 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Submitted application: Spark shell 20/08/03 12:34:06.561 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:06.561 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:06.561 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:06.561 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:06.562 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:06.644 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'sparkDriver' on port 38678. 20/08/03 12:34:06.648 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering MapOutputTracker 20/08/03 12:34:06.649 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMaster 20/08/03 12:34:06.650 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 20/08/03 12:34:06.650 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up 20/08/03 12:34:06.651 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMasterHeartbeat 20/08/03 12:34:06.653 pool-1-thread-1-ScalaTest-running-ReplSuite INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/blockmgr-3b27f9b4-4d57-40d0-b512-ef5184cba9ee 20/08/03 12:34:06.654 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore started with capacity 2.1 GiB 20/08/03 12:34:06.656 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering OutputCommitCoordinator 20/08/03 12:34:06.742 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Executor: Starting executor ID driver on host amp-jenkins-worker-06.amp 20/08/03 12:34:06.750 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Executor: Using REPL class URI: spark://amp-jenkins-worker-06.amp:38678/classes 20/08/03 12:34:06.755 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 43729. 20/08/03 12:34:06.756 pool-1-thread-1-ScalaTest-running-ReplSuite INFO NettyBlockTransferService: Server created on amp-jenkins-worker-06.amp:43729 20/08/03 12:34:06.756 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 20/08/03 12:34:06.756 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 43729, None) 20/08/03 12:34:06.757 dispatcher-BlockManagerMaster INFO BlockManagerMasterEndpoint: Registering block manager amp-jenkins-worker-06.amp:43729 with 2.1 GiB RAM, BlockManagerId(driver, amp-jenkins-worker-06.amp, 43729, None) 20/08/03 12:34:06.758 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 43729, None) 20/08/03 12:34:06.758 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, amp-jenkins-worker-06.amp, 43729, None) 20/08/03 12:34:06.768 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Main: Created Spark session 20/08/03 12:34:08.752 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SharedState: Setting hive.metastore.warehouse.dir ('null') to the value of spark.sql.warehouse.dir ('file:/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/spark-warehouse'). 20/08/03 12:34:08.752 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SharedState: Warehouse path is 'file:/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/spark-warehouse'. 20/08/03 12:34:08.821 dispatcher-event-loop-1 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 20/08/03 12:34:08.826 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore cleared 20/08/03 12:34:08.826 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: BlockManager stopped 20/08/03 12:34:08.827 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: BlockManagerMaster stopped 20/08/03 12:34:08.827 dispatcher-event-loop-0 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 20/08/03 12:34:08.831 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Successfully stopped SparkContext 20/08/03 12:34:08.831 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== FINISHED o.a.s.repl.ReplSuite: 'SPARK-15236: use in-memory catalog' ===== 20/08/03 12:34:08.833 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.ReplSuite: 'broadcast vars' ===== 20/08/03 12:34:09.482 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:34:09.483 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:34:09.483 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: Resources for spark.driver: 20/08/03 12:34:09.483 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:34:09.484 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Submitted application: Spark shell 20/08/03 12:34:09.485 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:09.485 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:09.485 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:09.485 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:09.485 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:09.542 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'sparkDriver' on port 33073. 20/08/03 12:34:09.544 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering MapOutputTracker 20/08/03 12:34:09.545 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMaster 20/08/03 12:34:09.545 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 20/08/03 12:34:09.545 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up 20/08/03 12:34:09.545 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMasterHeartbeat 20/08/03 12:34:09.547 pool-1-thread-1-ScalaTest-running-ReplSuite INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/blockmgr-14f3f8de-2f44-4dbc-98b1-cd0b7f05fe22 20/08/03 12:34:09.547 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore started with capacity 2.1 GiB 20/08/03 12:34:09.549 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering OutputCommitCoordinator 20/08/03 12:34:09.598 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Executor: Starting executor ID driver on host amp-jenkins-worker-06.amp 20/08/03 12:34:09.602 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Executor: Using REPL class URI: spark://amp-jenkins-worker-06.amp:33073/classes 20/08/03 12:34:09.606 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 44774. 20/08/03 12:34:09.606 pool-1-thread-1-ScalaTest-running-ReplSuite INFO NettyBlockTransferService: Server created on amp-jenkins-worker-06.amp:44774 20/08/03 12:34:09.607 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 20/08/03 12:34:09.607 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 44774, None) 20/08/03 12:34:09.607 dispatcher-BlockManagerMaster INFO BlockManagerMasterEndpoint: Registering block manager amp-jenkins-worker-06.amp:44774 with 2.1 GiB RAM, BlockManagerId(driver, amp-jenkins-worker-06.amp, 44774, None) 20/08/03 12:34:09.608 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 44774, None) 20/08/03 12:34:09.608 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, amp-jenkins-worker-06.amp, 44774, None) 20/08/03 12:34:09.614 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Main: Created Spark session 20/08/03 12:34:11.753 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 64.0 B, free 2.1 GiB) 20/08/03 12:34:11.811 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 80.0 B, free 2.1 GiB) 20/08/03 12:34:11.814 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on amp-jenkins-worker-06.amp:44774 (size: 80.0 B, free: 2.1 GiB) 20/08/03 12:34:11.818 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Created broadcast 0 from broadcast at :26 20/08/03 12:34:12.657 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Starting job: collect at :27 20/08/03 12:34:12.674 dag-scheduler-event-loop INFO DAGScheduler: Got job 0 (collect at :27) with 1 output partitions 20/08/03 12:34:12.674 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 0 (collect at :27) 20/08/03 12:34:12.674 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:12.676 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:12.681 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[1] at map at :27), which has no missing parents 20/08/03 12:34:12.700 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 6.6 KiB, free 2.1 GiB) 20/08/03 12:34:12.708 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 20/08/03 12:34:12.709 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on amp-jenkins-worker-06.amp:44774 (size: 3.3 KiB, free: 2.1 GiB) 20/08/03 12:34:12.709 dag-scheduler-event-loop INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:12.729 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 0 (MapPartitionsRDD[1] at map at :27) (first 15 tasks are for partitions Vector(0)) 20/08/03 12:34:12.730 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks 20/08/03 12:34:12.786 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, amp-jenkins-worker-06.amp, executor driver, partition 0, PROCESS_LOCAL, 7450 bytes) 20/08/03 12:34:12.797 Executor task launch worker for task 0 INFO Executor: Running task 0.0 in stage 0.0 (TID 0) 20/08/03 12:34:13.223 Executor task launch worker for task 0 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 840 bytes result sent to driver 20/08/03 12:34:13.232 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 459 ms on amp-jenkins-worker-06.amp (executor driver) (1/1) 20/08/03 12:34:13.235 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 20/08/03 12:34:13.241 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 0 (collect at :27) finished in 0.545 s 20/08/03 12:34:13.247 dag-scheduler-event-loop INFO DAGScheduler: Job 0 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:13.247 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 0: Stage finished 20/08/03 12:34:13.249 pool-1-thread-1-ScalaTest-running-ReplSuite INFO DAGScheduler: Job 0 finished: collect at :27, took 0.592181 s 20/08/03 12:34:13.671 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Starting job: collect at :27 20/08/03 12:34:13.672 dag-scheduler-event-loop INFO DAGScheduler: Got job 1 (collect at :27) with 1 output partitions 20/08/03 12:34:13.672 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 1 (collect at :27) 20/08/03 12:34:13.672 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:13.673 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:13.673 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[3] at map at :27), which has no missing parents 20/08/03 12:34:13.676 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 6.6 KiB, free 2.1 GiB) 20/08/03 12:34:13.679 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 20/08/03 12:34:13.680 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on amp-jenkins-worker-06.amp:44774 (size: 3.3 KiB, free: 2.1 GiB) 20/08/03 12:34:13.680 dag-scheduler-event-loop INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:13.681 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 1 (MapPartitionsRDD[3] at map at :27) (first 15 tasks are for partitions Vector(0)) 20/08/03 12:34:13.681 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 1.0 with 1 tasks 20/08/03 12:34:13.683 dispatcher-event-loop-0 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, amp-jenkins-worker-06.amp, executor driver, partition 0, PROCESS_LOCAL, 7450 bytes) 20/08/03 12:34:13.684 Executor task launch worker for task 1 INFO Executor: Running task 0.0 in stage 1.0 (TID 1) 20/08/03 12:34:13.695 Executor task launch worker for task 1 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 840 bytes result sent to driver 20/08/03 12:34:13.696 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 13 ms on amp-jenkins-worker-06.amp (executor driver) (1/1) 20/08/03 12:34:13.696 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 20/08/03 12:34:13.697 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 1 (collect at :27) finished in 0.023 s 20/08/03 12:34:13.697 dag-scheduler-event-loop INFO DAGScheduler: Job 1 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:13.697 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 1: Stage finished 20/08/03 12:34:13.698 pool-1-thread-1-ScalaTest-running-ReplSuite INFO DAGScheduler: Job 1 finished: collect at :27, took 0.025804 s 20/08/03 12:34:13.733 dispatcher-event-loop-1 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 20/08/03 12:34:13.738 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore cleared 20/08/03 12:34:13.739 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: BlockManager stopped 20/08/03 12:34:13.739 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: BlockManagerMaster stopped 20/08/03 12:34:13.740 dispatcher-event-loop-1 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 20/08/03 12:34:13.743 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Successfully stopped SparkContext 20/08/03 12:34:13.744 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== FINISHED o.a.s.repl.ReplSuite: 'broadcast vars' ===== 20/08/03 12:34:13.745 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.ReplSuite: 'line wrapper only initialized once when used as encoder outer scope' ===== 20/08/03 12:34:14.413 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:34:14.414 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:34:14.414 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: Resources for spark.driver: 20/08/03 12:34:14.414 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:34:14.414 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Submitted application: Spark shell 20/08/03 12:34:14.415 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:14.415 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:14.415 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:14.415 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:14.415 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:14.456 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'sparkDriver' on port 44437. 20/08/03 12:34:14.459 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering MapOutputTracker 20/08/03 12:34:14.459 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMaster 20/08/03 12:34:14.459 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 20/08/03 12:34:14.459 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up 20/08/03 12:34:14.460 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMasterHeartbeat 20/08/03 12:34:14.460 pool-1-thread-1-ScalaTest-running-ReplSuite INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/blockmgr-fe8a2d7d-1b33-42d2-96db-563934d455a1 20/08/03 12:34:14.461 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore started with capacity 2.1 GiB 20/08/03 12:34:14.463 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering OutputCommitCoordinator 20/08/03 12:34:14.511 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Executor: Starting executor ID driver on host amp-jenkins-worker-06.amp 20/08/03 12:34:14.515 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Executor: Using REPL class URI: spark://amp-jenkins-worker-06.amp:44437/classes 20/08/03 12:34:14.519 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 34676. 20/08/03 12:34:14.519 pool-1-thread-1-ScalaTest-running-ReplSuite INFO NettyBlockTransferService: Server created on amp-jenkins-worker-06.amp:34676 20/08/03 12:34:14.519 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 20/08/03 12:34:14.519 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 34676, None) 20/08/03 12:34:14.520 dispatcher-BlockManagerMaster INFO BlockManagerMasterEndpoint: Registering block manager amp-jenkins-worker-06.amp:34676 with 2.1 GiB RAM, BlockManagerId(driver, amp-jenkins-worker-06.amp, 34676, None) 20/08/03 12:34:14.521 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 34676, None) 20/08/03 12:34:14.521 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, amp-jenkins-worker-06.amp, 34676, None) 20/08/03 12:34:14.525 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Main: Created Spark session 20/08/03 12:34:17.337 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Starting job: collect at :27 20/08/03 12:34:17.338 dag-scheduler-event-loop INFO DAGScheduler: Got job 0 (collect at :27) with 1 output partitions 20/08/03 12:34:17.338 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 0 (collect at :27) 20/08/03 12:34:17.338 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:17.338 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:17.339 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[1] at map at :27), which has no missing parents 20/08/03 12:34:17.342 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 3.3 KiB, free 2.1 GiB) 20/08/03 12:34:17.345 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1890.0 B, free 2.1 GiB) 20/08/03 12:34:17.346 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on amp-jenkins-worker-06.amp:34676 (size: 1890.0 B, free: 2.1 GiB) 20/08/03 12:34:17.346 dag-scheduler-event-loop INFO SparkContext: Created broadcast 0 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:17.347 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 0 (MapPartitionsRDD[1] at map at :27) (first 15 tasks are for partitions Vector(0)) 20/08/03 12:34:17.347 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks 20/08/03 12:34:17.348 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, amp-jenkins-worker-06.amp, executor driver, partition 0, PROCESS_LOCAL, 7450 bytes) 20/08/03 12:34:17.349 Executor task launch worker for task 0 INFO Executor: Running task 0.0 in stage 0.0 (TID 0) 20/08/03 12:34:17.385 Executor task launch worker for task 0 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 5745 bytes result sent to driver 20/08/03 12:34:17.392 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 44 ms on amp-jenkins-worker-06.amp (executor driver) (1/1) 20/08/03 12:34:17.392 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 20/08/03 12:34:17.393 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 0 (collect at :27) finished in 0.053 s 20/08/03 12:34:17.393 dag-scheduler-event-loop INFO DAGScheduler: Job 0 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:17.393 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 0: Stage finished 20/08/03 12:34:17.393 pool-1-thread-1-ScalaTest-running-ReplSuite INFO DAGScheduler: Job 0 finished: collect at :27, took 0.055852 s 20/08/03 12:34:17.569 dispatcher-event-loop-0 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 20/08/03 12:34:17.573 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore cleared 20/08/03 12:34:17.574 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: BlockManager stopped 20/08/03 12:34:17.574 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: BlockManagerMaster stopped 20/08/03 12:34:17.574 dispatcher-event-loop-0 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 20/08/03 12:34:17.578 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Successfully stopped SparkContext 20/08/03 12:34:17.578 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== FINISHED o.a.s.repl.ReplSuite: 'line wrapper only initialized once when used as encoder outer scope' ===== 20/08/03 12:34:17.579 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.ReplSuite: 'define case class and create Dataset together with paste mode' ===== 20/08/03 12:34:18.113 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:34:18.114 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:34:18.114 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: Resources for spark.driver: 20/08/03 12:34:18.114 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:34:18.114 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Submitted application: Spark shell 20/08/03 12:34:18.116 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:18.116 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:18.116 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:18.116 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:18.116 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:18.163 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'sparkDriver' on port 33351. 20/08/03 12:34:18.166 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering MapOutputTracker 20/08/03 12:34:18.166 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMaster 20/08/03 12:34:18.167 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 20/08/03 12:34:18.167 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up 20/08/03 12:34:18.167 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMasterHeartbeat 20/08/03 12:34:18.168 pool-1-thread-1-ScalaTest-running-ReplSuite INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/blockmgr-3772f4fc-c716-4795-b201-8698ecdfe4dd 20/08/03 12:34:18.168 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore started with capacity 2.1 GiB 20/08/03 12:34:18.170 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering OutputCommitCoordinator 20/08/03 12:34:18.212 pool-1-thread-1-ScalaTest-running-ReplSuite INFO LocalSparkCluster: Starting a local Spark cluster with 1 workers. 20/08/03 12:34:18.213 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:18.213 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:18.213 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:18.213 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:18.213 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:18.259 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'sparkMaster' on port 40229. 20/08/03 12:34:18.290 dispatcher-event-loop-1 INFO Master: Starting Spark master at spark://amp-jenkins-worker-06.amp:40229 20/08/03 12:34:18.291 dispatcher-event-loop-1 INFO Master: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:34:18.349 dispatcher-event-loop-1 INFO Server: jetty-9.4.18.v20190429; built: 2019-04-29T20:42:08.989Z; git: e1bc35120a6617ee3df052294e433f3a25ce7097; jvm 1.8.0_191-b12 20/08/03 12:34:18.382 dispatcher-event-loop-1 INFO Server: Started @33425ms 20/08/03 12:34:18.432 dispatcher-event-loop-1 INFO AbstractConnector: Started ServerConnector@5c439220{HTTP/1.1,[http/1.1]}{0.0.0.0:44831} 20/08/03 12:34:18.432 dispatcher-event-loop-1 INFO Utils: Successfully started service 'MasterUI' on port 44831. 20/08/03 12:34:18.462 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@2c153710{/app,null,AVAILABLE,@Spark} 20/08/03 12:34:18.464 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@2cedb9d4{/app/json,null,AVAILABLE,@Spark} 20/08/03 12:34:18.464 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@57582e27{/,null,AVAILABLE,@Spark} 20/08/03 12:34:18.465 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@2551e72e{/json,null,AVAILABLE,@Spark} 20/08/03 12:34:18.474 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@8688d71{/static,null,AVAILABLE,@Spark} 20/08/03 12:34:18.475 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@61c137cc{/app/kill,null,AVAILABLE,@Spark} 20/08/03 12:34:18.476 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@56eda121{/driver/kill,null,AVAILABLE,@Spark} 20/08/03 12:34:18.478 dispatcher-event-loop-1 INFO MasterWebUI: Bound MasterWebUI to 0.0.0.0, and started at http://amp-jenkins-worker-06.amp:44831 20/08/03 12:34:18.484 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@12679dc9{/metrics/master/json,null,AVAILABLE,@Spark} 20/08/03 12:34:18.485 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@b6064bb{/metrics/applications/json,null,AVAILABLE,@Spark} 20/08/03 12:34:18.492 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:18.492 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:18.492 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:18.492 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:18.492 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:18.497 dispatcher-event-loop-1 INFO Master: I have been elected leader! New state: ALIVE 20/08/03 12:34:18.549 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'sparkWorker1' on port 40467. 20/08/03 12:34:18.566 dispatcher-event-loop-2 INFO Worker: Starting Spark worker amp-jenkins-worker-06.amp:40467 with 1 cores, 1024.0 MiB RAM 20/08/03 12:34:18.567 dispatcher-event-loop-2 INFO Worker: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:34:18.567 dispatcher-event-loop-2 INFO Worker: Spark home: /home/jenkins/workspace/NewSparkPullRequestBuilder 20/08/03 12:34:18.568 dispatcher-event-loop-2 INFO ResourceUtils: ============================================================== 20/08/03 12:34:18.569 dispatcher-event-loop-2 INFO ResourceUtils: Resources for spark.worker: 20/08/03 12:34:18.569 dispatcher-event-loop-2 INFO ResourceUtils: ============================================================== 20/08/03 12:34:18.580 dispatcher-event-loop-2 INFO Server: jetty-9.4.18.v20190429; built: 2019-04-29T20:42:08.989Z; git: e1bc35120a6617ee3df052294e433f3a25ce7097; jvm 1.8.0_191-b12 20/08/03 12:34:18.585 dispatcher-event-loop-2 INFO Server: Started @33628ms 20/08/03 12:34:18.598 dispatcher-event-loop-2 INFO AbstractConnector: Started ServerConnector@79d86fa1{HTTP/1.1,[http/1.1]}{0.0.0.0:37946} 20/08/03 12:34:18.599 dispatcher-event-loop-2 INFO Utils: Successfully started service 'WorkerUI' on port 37946. 20/08/03 12:34:18.600 dispatcher-event-loop-2 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@6029f2b2{/logPage,null,AVAILABLE,@Spark} 20/08/03 12:34:18.601 dispatcher-event-loop-2 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@654db1f4{/logPage/json,null,AVAILABLE,@Spark} 20/08/03 12:34:18.602 dispatcher-event-loop-2 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@7621b5b1{/,null,AVAILABLE,@Spark} 20/08/03 12:34:18.602 dispatcher-event-loop-2 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@6b96e10b{/json,null,AVAILABLE,@Spark} 20/08/03 12:34:18.603 dispatcher-event-loop-2 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@5a1b2147{/static,null,AVAILABLE,@Spark} 20/08/03 12:34:18.604 dispatcher-event-loop-2 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@4f328b3{/log,null,AVAILABLE,@Spark} 20/08/03 12:34:18.604 dispatcher-event-loop-2 INFO WorkerWebUI: Bound WorkerWebUI to 0.0.0.0, and started at http://amp-jenkins-worker-06.amp:37946 20/08/03 12:34:18.606 worker-register-master-threadpool-0 INFO Worker: Connecting to master amp-jenkins-worker-06.amp:40229... 20/08/03 12:34:18.608 dispatcher-event-loop-2 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@1e62e99c{/metrics/json,null,AVAILABLE,@Spark} 20/08/03 12:34:18.609 appclient-register-master-threadpool-0 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://amp-jenkins-worker-06.amp:40229... 20/08/03 12:34:18.619 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-06.amp/192.168.10.26:40229 after 4 ms (0 ms spent in bootstraps) 20/08/03 12:34:18.620 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-06.amp/192.168.10.26:40229 after 5 ms (0 ms spent in bootstraps) 20/08/03 12:34:18.662 dispatcher-event-loop-15 INFO Master: Registering worker amp-jenkins-worker-06.amp:40467 with 1 cores, 1024.0 MiB RAM 20/08/03 12:34:18.670 dispatcher-event-loop-5 INFO Worker: Successfully registered with master spark://amp-jenkins-worker-06.amp:40229 20/08/03 12:34:18.689 dispatcher-event-loop-18 INFO Master: Registering app Spark shell 20/08/03 12:34:18.694 dispatcher-event-loop-18 INFO Master: Registered app Spark shell with ID app-20200803123418-0000 20/08/03 12:34:18.700 dispatcher-event-loop-14 INFO StandaloneSchedulerBackend: Connected to Spark cluster with app ID app-20200803123418-0000 20/08/03 12:34:18.708 dispatcher-event-loop-18 INFO Master: Launching executor app-20200803123418-0000/0 on worker worker-20200803123418-amp-jenkins-worker-06.amp-40467 20/08/03 12:34:18.726 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 34469. 20/08/03 12:34:18.726 pool-1-thread-1-ScalaTest-running-ReplSuite INFO NettyBlockTransferService: Server created on amp-jenkins-worker-06.amp:34469 20/08/03 12:34:18.726 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 20/08/03 12:34:18.726 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 34469, None) 20/08/03 12:34:18.727 dispatcher-BlockManagerMaster INFO BlockManagerMasterEndpoint: Registering block manager amp-jenkins-worker-06.amp:34469 with 2.1 GiB RAM, BlockManagerId(driver, amp-jenkins-worker-06.amp, 34469, None) 20/08/03 12:34:18.728 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 34469, None) 20/08/03 12:34:18.728 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, amp-jenkins-worker-06.amp, 34469, None) 20/08/03 12:34:18.733 dispatcher-event-loop-8 INFO Worker: Asked to launch executor app-20200803123418-0000/0 for Spark shell 20/08/03 12:34:18.735 dispatcher-event-loop-21 INFO StandaloneAppClient$ClientEndpoint: Executor added: app-20200803123418-0000/0 on worker-20200803123418-amp-jenkins-worker-06.amp-40467 (amp-jenkins-worker-06.amp:40467) with 1 core(s) 20/08/03 12:34:18.738 pool-1-thread-1-ScalaTest-running-ReplSuite INFO StandaloneSchedulerBackend: SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.0 20/08/03 12:34:18.742 dispatcher-event-loop-21 INFO StandaloneSchedulerBackend: Granted executor ID app-20200803123418-0000/0 on hostPort amp-jenkins-worker-06.amp:40467 with 1 core(s), 1024.0 MiB RAM 20/08/03 12:34:18.745 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Main: Created Spark session 20/08/03 12:34:18.752 ExecutorRunner for app-20200803123418-0000/0 INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:18.752 ExecutorRunner for app-20200803123418-0000/0 INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:18.752 ExecutorRunner for app-20200803123418-0000/0 INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:18.752 ExecutorRunner for app-20200803123418-0000/0 INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:18.752 ExecutorRunner for app-20200803123418-0000/0 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:18.842 ExecutorRunner for app-20200803123418-0000/0 INFO ExecutorRunner: Launch command: "/usr/java/jdk1.8.0_191/bin/java" "-cp" "/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/target/scala-2.12/spark-repl_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/core/target/scala-2.12/spark-core_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/launcher/target/scala-2.12/spark-launcher_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/tags/target/scala-2.12/spark-tags_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/kvstore/target/scala-2.12/spark-kvstore_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-common/target/scala-2.12/spark-network-common_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-shuffle/target/scala-2.12/spark-network-shuffle_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/unsafe/target/scala-2.12/spark-unsafe_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/core/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/launcher/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/tags/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-shuffle/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-common/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib/target/scala-2.12/spark-mllib_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/streaming/target/scala-2.12/spark-streaming_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/target/scala-2.12/spark-sql_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/sketch/target/scala-2.12/spark-sketch_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/catalyst/target/scala-2.12/spark-catalyst_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/graphx/target/scala-2.12/spark-graphx_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib-local/target/scala-2.12/spark-mllib-local_2.12-3.0.1-SNAPSHOT.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.12.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.12.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang/scala-reflect/jars/scala-reflect-2.12.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.spark-project.spark/unused/jars/unused-1.0.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.fusesource.leveldbjni/leveldbjni-all/bundles/leveldbjni-all-1.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.core/jackson-core/bundles/jackson-core-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.core/jackson-databind/bundles/jackson-databind-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.core/jackson-annotations/bundles/jackson-annotations-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.netty/netty-all/jars/netty-all-4.1.47.Final.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-lang3/jars/commons-lang3-3.9.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-core/bundles/metrics-core-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.slf4j/slf4j-api/jars/slf4j-api-1.7.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.guava/guava/bundles/guava-14.0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-crypto/jars/commons-crypto-1.0.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.twitter/chill_2.12/jars/chill_2.12-0.9.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.twitter/chill-java/jars/chill-java-0.9.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.esotericsoftware/kryo-shaded/bundles/kryo-shaded-4.0.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.esotericsoftware/minlog/bundles/minlog-1.3.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.xbean/xbean-asm7-shaded/bundles/xbean-asm7-shaded-4.15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.avro/avro/jars/avro-1.8.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jackson/jackson-core-asl/jars/jackson-core-asl-1.9.13.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jackson/jackson-mapper-asl/jars/jackson-mapper-asl-1.9.13.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.thoughtworks.paranamer/paranamer/bundles/paranamer-2.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.xerial.snappy/snappy-java/bundles/snappy-java-1.1.7.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-compress/jars/commons-compress-1.8.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.tukaani/xz/jars/xz-1.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.avro/avro-mapred/jars/avro-mapred-1.8.2-hadoop2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.avro/avro-ipc/jars/avro-ipc-1.8.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-client/jars/hadoop-client-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-common/jars/hadoop-common-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-annotations/jars/hadoop-annotations-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-cli/commons-cli/jars/commons-cli-1.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-math3/jars/commons-math3-3.4.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xmlenc/xmlenc/jars/xmlenc-0.52.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-httpclient/commons-httpclient/jars/commons-httpclient-3.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-io/commons-io/jars/commons-io-2.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-net/commons-net/jars/commons-net-3.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-collections/commons-collections/jars/commons-collections-3.2.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.mortbay.jetty/jetty-sslengine/jars/jetty-sslengine-6.1.26.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/log4j/log4j/bundles/log4j-1.2.17.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-lang/commons-lang/jars/commons-lang-2.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-configuration/commons-configuration/jars/commons-configuration-1.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-digester/commons-digester/jars/commons-digester-1.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-beanutils/commons-beanutils/jars/commons-beanutils-1.7.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.protobuf/protobuf-java/bundles/protobuf-java-2.5.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-auth/jars/hadoop-auth-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.httpcomponents/httpclient/jars/httpclient-4.5.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.httpcomponents/httpcore/jars/httpcore-4.4.12.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-logging/commons-logging/jars/commons-logging-1.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-codec/commons-codec/jars/commons-codec-1.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-kerberos-codec/bundles/apacheds-kerberos-codec-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-i18n/bundles/apacheds-i18n-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-asn1-api/bundles/api-asn1-api-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-util/bundles/api-util-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.zookeeper/zookeeper/jars/zookeeper-3.4.14.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.slf4j/slf4j-log4j12/jars/slf4j-log4j12-1.7.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.github.spotbugs/spotbugs-annotations/jars/spotbugs-annotations-3.1.9.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.code.findbugs/jsr305/jars/jsr305-3.0.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.yetus/audience-annotations/jars/audience-annotations-0.5.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.netty/netty/bundles/netty-3.10.6.Final.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.curator/curator-framework/bundles/curator-framework-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.curator/curator-client/bundles/curator-client-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.curator/curator-recipes/bundles/curator-recipes-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.htrace/htrace-core/jars/htrace-core-3.1.0-incubating.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/jars/hadoop-hdfs-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.mortbay.jetty/jetty-util/jars/jetty-util-6.1.26.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xerces/xercesImpl/jars/xercesImpl-2.12.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xml-apis/xml-apis/jars/xml-apis-1.4.01.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-app/jars/hadoop-mapreduce-client-app-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-common/jars/hadoop-mapreduce-client-common-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-yarn-common/jars/hadoop-yarn-common-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-yarn-api/jars/hadoop-yarn-api-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.xml.bind/jaxb-api/jars/jaxb-api-2.2.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.xml.stream/stax-api/jars/stax-api-1.0-2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.activation/activation/jars/activation-1.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jackson/jackson-jaxrs/jars/jackson-jaxrs-1.9.13.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jackson/jackson-xc/jars/jackson-xc-1.9.13.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.inject/guice/jars/guice-3.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.inject/javax.inject/jars/javax.inject-1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/aopalliance/aopalliance/jars/aopalliance-1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.sonatype.sisu.inject/cglib/jars/cglib-2.2.1-v20090111.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jettison/jettison/bundles/jettison-1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.sun.xml.bind/jaxb-impl/jars/jaxb-impl-2.2.3-1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-yarn-client/jars/hadoop-yarn-client-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-core/jars/hadoop-mapreduce-client-core-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-yarn-server-common/jars/hadoop-yarn-server-common-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-shuffle/jars/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-jobclient/jars/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.servlet.jsp/jsp-api/jars/jsp-api-2.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-plus/jars/jetty-plus-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-webapp/jars/jetty-webapp-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-xml/jars/jetty-xml-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-util/jars/jetty-util-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-servlet/jars/jetty-servlet-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-security/jars/jetty-security-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-server/jars/jetty-server-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.servlet/javax.servlet-api/jars/javax.servlet-api-3.1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-http/jars/jetty-http-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-io/jars/jetty-io-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-jndi/jars/jetty-jndi-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-continuation/jars/jetty-continuation-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-proxy/jars/jetty-proxy-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-client/jars/jetty-client-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-servlets/jars/jetty-servlets-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-text/jars/commons-text-1.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.slf4j/jul-to-slf4j/jars/jul-to-slf4j-1.7.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.slf4j/jcl-over-slf4j/jars/jcl-over-slf4j-1.7.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.ning/compress-lzf/bundles/compress-lzf-1.0.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.lz4/lz4-java/jars/lz4-java-1.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.github.luben/zstd-jni/jars/zstd-jni-1.4.4-3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.roaringbitmap/RoaringBitmap/jars/RoaringBitmap-0.7.45.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.roaringbitmap/shims/jars/shims-0.7.45.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang.modules/scala-xml_2.12/bundles/scala-xml_2.12-1.2.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.json4s/json4s-jackson_2.12/jars/json4s-jackson_2.12-3.6.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.json4s/json4s-core_2.12/jars/json4s-core_2.12-3.6.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.json4s/json4s-ast_2.12/jars/json4s-ast_2.12-3.6.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.json4s/json4s-scalap_2.12/jars/json4s-scalap_2.12-3.6.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.core/jersey-client/jars/jersey-client-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.ws.rs/jakarta.ws.rs-api/bundles/jakarta.ws.rs-api-2.1.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.core/jersey-common/jars/jersey-common-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.annotation/jakarta.annotation-api/jars/jakarta.annotation-api-1.3.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2.external/jakarta.inject/jars/jakarta.inject-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2/osgi-resource-locator/jars/osgi-resource-locator-1.0.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.core/jersey-server/jars/jersey-server-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.media/jersey-media-jaxb/jars/jersey-media-jaxb-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.validation/jakarta.validation-api/jars/jakarta.validation-api-2.0.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.containers/jersey-container-servlet/jars/jersey-container-servlet-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.containers/jersey-container-servlet-core/jars/jersey-container-servlet-core-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.inject/jersey-hk2/jars/jersey-hk2-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2/hk2-locator/jars/hk2-locator-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2.external/aopalliance-repackaged/jars/aopalliance-repackaged-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2/hk2-api/jars/hk2-api-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2/hk2-utils/jars/hk2-utils-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.javassist/javassist/bundles/javassist-3.25.0-GA.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.clearspring.analytics/stream/jars/stream-2.9.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-jvm/bundles/metrics-jvm-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-json/bundles/metrics-json-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-graphite/bundles/metrics-graphite-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-jmx/bundles/metrics-jmx-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.module/jackson-module-scala_2.12/bundles/jackson-module-scala_2.12-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.module/jackson-module-paranamer/bundles/jackson-module-paranamer-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.ivy/ivy/jars/ivy-2.4.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/oro/oro/jars/oro-2.0.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.razorvine/pyrolite/jars/pyrolite-4.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sf.py4j/py4j/jars/py4j-0.10.9.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang.modules/scala-parser-combinators_2.12/bundles/scala-parser-combinators_2.12-1.1.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.janino/janino/jars/janino-3.0.16.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.janino/commons-compiler/jars/commons-compiler-3.0.16.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.antlr/antlr4-runtime/jars/antlr4-runtime-4.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.univocity/univocity-parsers/jars/univocity-parsers-2.8.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.arrow/arrow-vector/jars/arrow-vector-0.15.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.arrow/arrow-format/jars/arrow-format-0.15.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.flatbuffers/flatbuffers-java/bundles/flatbuffers-java-1.9.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.arrow/arrow-memory/jars/arrow-memory-0.15.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.orc/orc-core/jars/orc-core-1.5.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.orc/orc-shims/jars/orc-shims-1.5.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.airlift/aircompressor/jars/aircompressor-0.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.threeten/threeten-extra/jars/threeten-extra-1.5.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.orc/orc-mapreduce/jars/orc-mapreduce-1.5.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hive/hive-storage-api/jars/hive-storage-api-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-column/jars/parquet-column-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-common/jars/parquet-common-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-format/jars/parquet-format-2.4.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-encoding/jars/parquet-encoding-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-hadoop/jars/parquet-hadoop-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-jackson/jars/parquet-jackson-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalanlp/breeze_2.12/jars/breeze_2.12-1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalanlp/breeze-macros_2.12/jars/breeze-macros_2.12-1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.github.fommil.netlib/core/jars/core-1.1.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.f2j/arpack_combined_all/jars/arpack_combined_all-0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sf.opencsv/opencsv/jars/opencsv-2.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.github.wendykierp/JTransforms/jars/JTransforms-3.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/pl.edu.icm/JLargeArrays/jars/JLargeArrays-1.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.chuusai/shapeless_2.12/bundles/shapeless_2.12-2.3.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/macro-compat_2.12/jars/macro-compat_2.12-1.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/spire_2.12/jars/spire_2.12-0.17.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/spire-macros_2.12/jars/spire-macros_2.12-0.17.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/machinist_2.12/jars/machinist_2.12-0.6.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/algebra_2.12/jars/algebra_2.12-2.0.0-M2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/cats-kernel_2.12/jars/cats-kernel_2.12-2.0.0-M4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/spire-platform_2.12/jars/spire-platform_2.12-0.17.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/spire-util_2.12/jars/spire-util_2.12-0.17.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang.modules/scala-collection-compat_2.12/bundles/scala-collection-compat_2.12-2.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.jpmml/pmml-model/jars/pmml-model-1.4.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jaxb/jaxb-runtime/jars/jaxb-runtime-2.3.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.xml.bind/jakarta.xml.bind-api/jars/jakarta.xml.bind-api-2.3.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.sun.istack/istack-commons-runtime/jars/istack-commons-runtime-3.0.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalatest/scalatest_2.12/bundles/scalatest_2.12-3.0.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalactic/scalactic_2.12/bundles/scalactic_2.12-3.0.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/junit/junit/jars/junit-4.12.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.hamcrest/hamcrest-core/jars/hamcrest-core-1.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.novocode/junit-interface/jars/junit-interface-0.11.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-sbt/test-interface/jars/test-interface-1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.mockito/mockito-core/jars/mockito-core-3.1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.bytebuddy/byte-buddy/jars/byte-buddy-1.9.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.bytebuddy/byte-buddy-agent/jars/byte-buddy-agent-1.9.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.objenesis/objenesis/jars/objenesis-2.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.test-framework.providers/jersey-test-framework-provider-simple/jars/jersey-test-framework-provider-simple-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.test-framework/jersey-test-framework-core/jars/jersey-test-framework-core-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.servlet/jakarta.servlet-api/jars/jakarta.servlet-api-4.0.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.containers/jersey-container-simple-http/jars/jersey-container-simple-http-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.simpleframework/simple-http/jars/simple-http-6.0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.simpleframework/simple-common/jars/simple-common-6.0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.simpleframework/simple-transport/jars/simple-transport-6.0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.derby/derby/jars/derby-10.12.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-java/jars/selenium-java-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-chrome-driver/jars/selenium-chrome-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-remote-driver/jars/selenium-remote-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/cglib/cglib-nodep/jars/cglib-nodep-2.1_3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.code.gson/gson/jars/gson-2.3.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-api/jars/selenium-api-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-exec/jars/commons-exec-1.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.java.dev.jna/jna/jars/jna-4.1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.java.dev.jna/jna-platform/jars/jna-platform-4.1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-edge-driver/jars/selenium-edge-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-htmlunit-driver/jars/selenium-htmlunit-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-support/jars/selenium-support-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.htmlunit/htmlunit/jars/htmlunit-2.22.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xalan/xalan/jars/xalan-2.7.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xalan/serializer/jars/serializer-2.7.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.httpcomponents/httpmime/jars/httpmime-4.5.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.htmlunit/htmlunit-core-js/jars/htmlunit-core-js-2.22.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.htmlunit/neko-htmlunit/jars/neko-htmlunit-2.21.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.cssparser/cssparser/jars/cssparser-0.9.19.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.w3c.css/sac/jars/sac-1.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty.websocket/websocket-client/jars/websocket-client-9.2.17.v20160517.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty.websocket/websocket-common/jars/websocket-common-9.2.17.v20160517.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty.websocket/websocket-api/jars/websocket-api-9.2.17.v20160517.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-firefox-driver/jars/selenium-firefox-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-ie-driver/jars/selenium-ie-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-safari-driver/jars/selenium-safari-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.webbitserver/webbit/jars/webbit-0.4.14.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-leg-rc/jars/selenium-leg-rc-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.hamcrest/hamcrest-library/jars/hamcrest-library-1.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalacheck/scalacheck_2.12/jars/scalacheck_2.12-1.14.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.curator/curator-test/jars/curator-test-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-math/jars/commons-math-2.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-minikdc/jars/hadoop-minikdc-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core-api/jars/apacheds-core-api-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core-constants/bundles/apacheds-core-constants-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-i18n/bundles/api-i18n-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-client-api/bundles/api-ldap-client-api-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-codec-core/bundles/api-ldap-codec-core-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-asn1-ber/bundles/api-asn1-ber-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-model/bundles/api-ldap-model-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.mina/mina-core/bundles/mina-core-2.0.7.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/antlr/antlr/jars/antlr-2.7.7.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-pool/commons-pool/jars/commons-pool-1.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-aci/bundles/api-ldap-extras-aci-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-util/bundles/api-ldap-extras-util-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sf.ehcache/ehcache-core/jars/ehcache-core-2.4.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptor-kerberos/bundles/apacheds-interceptor-kerberos-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core/bundles/apacheds-core-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core-shared/bundles/apacheds-core-shared-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-codec-api/bundles/api-ldap-extras-codec-api-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-admin/bundles/apacheds-interceptors-admin-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-authn/bundles/apacheds-interceptors-authn-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-codec/bundles/api-ldap-extras-codec-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-authz/bundles/apacheds-interceptors-authz-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-changelog/bundles/apacheds-interceptors-changelog-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-collective/bundles/apacheds-interceptors-collective-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-event/bundles/apacheds-interceptors-event-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-exception/bundles/apacheds-interceptors-exception-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-journal/bundles/apacheds-interceptors-journal-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-normalization/bundles/apacheds-interceptors-normalization-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-operational/bundles/apacheds-interceptors-operational-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-referral/bundles/apacheds-interceptors-referral-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-schema/bundles/apacheds-interceptors-schema-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-subtree/bundles/apacheds-interceptors-subtree-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-trigger/bundles/apacheds-interceptors-trigger-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-trigger/bundles/api-ldap-extras-trigger-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/bouncycastle/bcprov-jdk15/jars/bcprov-jdk15-140.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-protocol-shared/bundles/apacheds-protocol-shared-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-protocol-kerberos/bundles/apacheds-protocol-kerberos-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-ldif-partition/bundles/apacheds-ldif-partition-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-xdbm-partition/jars/apacheds-xdbm-partition-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core-avl/bundles/apacheds-core-avl-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-mavibot-partition/jars/apacheds-mavibot-partition-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.mavibot/mavibot/jars/mavibot-1.0.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-all/jars/api-all-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-jdbm-partition/bundles/apacheds-jdbm-partition-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.jdbm/apacheds-jdbm1/bundles/apacheds-jdbm1-2.0.0-M2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-protocol-ldap/bundles/apacheds-protocol-ldap-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-sp/bundles/api-ldap-extras-sp-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.sbt/boot/scala-2.10.7/org.scala-sbt/sbt/0.13.18/test-agent-0.13.18.jar:/home/sparkivy/per-executor-caches/6/.sbt/boot/scala-2.10.7/org.scala-sbt/sbt/0.13.18/test-interface-1.0.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/conf/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/kvstore/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-common/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-shuffle/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-yarn/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/sketch/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/tags/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/unsafe/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/core/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/examples/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/graphx/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/launcher/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/resource-managers/mesos/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/resource-managers/yarn/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/catalyst/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/hive/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/hive-thriftserver/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/streaming/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/kvstore/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-yarn/target/scala-2.12/test-classes:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/sketch/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/unsafe/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/examples/target/scala-2.12/test-classes:/home/jenkins/workspace/NewSparkPullRequestBuilder/graphx/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/resource-managers/mesos/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/resource-managers/yarn/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/catalyst/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/hive/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/hive-thriftserver/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/streaming/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/core/target/jars/*:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib/target/jars/*:/home/jenkins/workspace/NewSparkPullRequestBuilder/assembly/target/scala-2.12/jars/*" "-Xmx1024M" "-Dspark.driver.port=33351" "-Dspark.port.maxRetries=100" "org.apache.spark.executor.CoarseGrainedExecutorBackend" "--driver-url" "spark://CoarseGrainedScheduler@amp-jenkins-worker-06.amp:33351" "--executor-id" "0" "--hostname" "amp-jenkins-worker-06.amp" "--cores" "1" "--app-id" "app-20200803123418-0000" "--worker-url" "spark://Worker@amp-jenkins-worker-06.amp:40467" 20/08/03 12:34:18.866 dispatcher-event-loop-22 INFO StandaloneAppClient$ClientEndpoint: Executor updated: app-20200803123418-0000/0 is now RUNNING 20/08/03 12:34:20.940 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SharedState: Setting hive.metastore.warehouse.dir ('null') to the value of spark.sql.warehouse.dir ('file:/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/spark-warehouse'). 20/08/03 12:34:20.941 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SharedState: Warehouse path is 'file:/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/spark-warehouse'. 20/08/03 12:34:21.095 dispatcher-CoarseGrainedScheduler INFO ResourceProfile: Default ResourceProfile created, executor resources: Map(cores -> name: cores, amount: 1, script: , vendor: , memory -> name: memory, amount: 1024, script: , vendor: ), task resources: Map(cpus -> name: cpus, amount: 1.0) 20/08/03 12:34:21.389 pool-1-thread-1-ScalaTest-running-ReplSuite INFO CodeGenerator: Code generated in 280.14411 ms 20/08/03 12:34:21.667 dispatcher-CoarseGrainedScheduler INFO CoarseGrainedSchedulerBackend$DriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (192.168.10.26:49676) with ID 0 20/08/03 12:34:21.799 dispatcher-BlockManagerMaster INFO BlockManagerMasterEndpoint: Registering block manager amp-jenkins-worker-06.amp:37454 with 546.3 MiB RAM, BlockManagerId(0, amp-jenkins-worker-06.amp, 37454, None) 20/08/03 12:34:22.041 pool-1-thread-1-ScalaTest-running-ReplSuite INFO StandaloneSchedulerBackend: Shutting down all executors 20/08/03 12:34:22.041 dispatcher-CoarseGrainedScheduler INFO CoarseGrainedSchedulerBackend$DriverEndpoint: Asking each executor to shut down 20/08/03 12:34:22.050 pool-1-thread-1-ScalaTest-running-ReplSuite INFO LocalSparkCluster: Shutting down local Spark cluster. 20/08/03 12:34:22.051 dispatcher-event-loop-20 INFO Master: Received unregister request from application app-20200803123418-0000 20/08/03 12:34:22.053 dispatcher-event-loop-20 INFO Master: Removing app app-20200803123418-0000 20/08/03 12:34:22.053 ExecutorRunner for app-20200803123418-0000/0 INFO ExecutorRunner: Runner thread for executor app-20200803123418-0000/0 interrupted 20/08/03 12:34:22.054 ExecutorRunner for app-20200803123418-0000/0 INFO ExecutorRunner: Killing process! 20/08/03 12:34:22.056 rpc-client-46-1 ERROR TransportRequestHandler: Error while invoking RpcHandler#receive() for one-way message. org.apache.spark.rpc.RpcEnvStoppedException: RpcEnv already stopped. at org.apache.spark.rpc.netty.Dispatcher.postMessage(Dispatcher.scala:167) at org.apache.spark.rpc.netty.Dispatcher.postOneWayMessage(Dispatcher.scala:150) at org.apache.spark.rpc.netty.NettyRpcHandler.receive(NettyRpcEnv.scala:684) at org.apache.spark.network.server.TransportRequestHandler.processOneWayMessage(TransportRequestHandler.java:253) at org.apache.spark.network.server.TransportRequestHandler.handle(TransportRequestHandler.java:111) at org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:140) at org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:53) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at org.apache.spark.network.util.TransportFrameDecoder.channelRead(TransportFrameDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 20/08/03 12:34:22.057 rpc-client-46-1 ERROR TransportRequestHandler: Error while invoking RpcHandler#receive() for one-way message. org.apache.spark.rpc.RpcEnvStoppedException: RpcEnv already stopped. at org.apache.spark.rpc.netty.Dispatcher.postMessage(Dispatcher.scala:167) at org.apache.spark.rpc.netty.Dispatcher.postOneWayMessage(Dispatcher.scala:150) at org.apache.spark.rpc.netty.NettyRpcHandler.receive(NettyRpcEnv.scala:684) at org.apache.spark.network.server.TransportRequestHandler.processOneWayMessage(TransportRequestHandler.java:253) at org.apache.spark.network.server.TransportRequestHandler.handle(TransportRequestHandler.java:111) at org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:140) at org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:53) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at org.apache.spark.network.util.TransportFrameDecoder.channelRead(TransportFrameDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 20/08/03 12:34:22.062 dispatcher-event-loop-13 INFO AbstractConnector: Stopped Spark@79d86fa1{HTTP/1.1,[http/1.1]}{0.0.0.0:0} 20/08/03 12:34:22.067 dispatcher-event-loop-21 INFO Master: 192.168.10.26:59626 got disassociated, removing it. 20/08/03 12:34:22.068 dispatcher-event-loop-21 INFO Master: amp-jenkins-worker-06.amp:40467 got disassociated, removing it. 20/08/03 12:34:22.069 dispatcher-event-loop-21 INFO Master: Removing worker worker-20200803123418-amp-jenkins-worker-06.amp-40467 on amp-jenkins-worker-06.amp:40467 20/08/03 12:34:22.070 dispatcher-event-loop-21 INFO Master: Telling app of lost worker: worker-20200803123418-amp-jenkins-worker-06.amp-40467 20/08/03 12:34:22.074 dispatcher-event-loop-21 INFO AbstractConnector: Stopped Spark@5c439220{HTTP/1.1,[http/1.1]}{0.0.0.0:0} 20/08/03 12:34:22.080 dispatcher-event-loop-3 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 20/08/03 12:34:22.088 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore cleared 20/08/03 12:34:22.088 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: BlockManager stopped 20/08/03 12:34:22.088 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: BlockManagerMaster stopped 20/08/03 12:34:22.088 dispatcher-event-loop-2 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 20/08/03 12:34:22.096 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Successfully stopped SparkContext 20/08/03 12:34:22.097 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== FINISHED o.a.s.repl.ReplSuite: 'define case class and create Dataset together with paste mode' ===== 20/08/03 12:34:22.098 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.ReplSuite: ':replay should work correctly' ===== 20/08/03 12:34:22.661 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:34:22.662 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:34:22.662 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: Resources for spark.driver: 20/08/03 12:34:22.662 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:34:22.662 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Submitted application: Spark shell 20/08/03 12:34:22.663 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:22.663 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:22.663 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:22.663 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:22.663 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:22.710 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'sparkDriver' on port 38451. 20/08/03 12:34:22.712 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering MapOutputTracker 20/08/03 12:34:22.713 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMaster 20/08/03 12:34:22.714 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 20/08/03 12:34:22.714 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up 20/08/03 12:34:22.714 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMasterHeartbeat 20/08/03 12:34:22.715 pool-1-thread-1-ScalaTest-running-ReplSuite INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/blockmgr-92caac13-3726-4e99-a3a6-cc49693d2635 20/08/03 12:34:22.715 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore started with capacity 2.1 GiB 20/08/03 12:34:22.717 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering OutputCommitCoordinator 20/08/03 12:34:22.775 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Executor: Starting executor ID driver on host amp-jenkins-worker-06.amp 20/08/03 12:34:22.780 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Executor: Using REPL class URI: spark://amp-jenkins-worker-06.amp:38451/classes 20/08/03 12:34:22.785 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 45585. 20/08/03 12:34:22.786 pool-1-thread-1-ScalaTest-running-ReplSuite INFO NettyBlockTransferService: Server created on amp-jenkins-worker-06.amp:45585 20/08/03 12:34:22.786 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 20/08/03 12:34:22.786 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 45585, None) 20/08/03 12:34:22.787 dispatcher-BlockManagerMaster INFO BlockManagerMasterEndpoint: Registering block manager amp-jenkins-worker-06.amp:45585 with 2.1 GiB RAM, BlockManagerId(driver, amp-jenkins-worker-06.amp, 45585, None) 20/08/03 12:34:22.788 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 45585, None) 20/08/03 12:34:22.788 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, amp-jenkins-worker-06.amp, 45585, None) 20/08/03 12:34:22.795 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Main: Created Spark session 20/08/03 12:34:26.775 dispatcher-event-loop-0 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 20/08/03 12:34:26.815 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore cleared 20/08/03 12:34:26.816 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: BlockManager stopped 20/08/03 12:34:26.816 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: BlockManagerMaster stopped 20/08/03 12:34:26.816 dispatcher-event-loop-1 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 20/08/03 12:34:26.855 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Successfully stopped SparkContext 20/08/03 12:34:26.855 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== FINISHED o.a.s.repl.ReplSuite: ':replay should work correctly' ===== 20/08/03 12:34:26.856 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.ReplSuite: 'spark-shell should find imported types in class constructors and extends clause' ===== 20/08/03 12:34:27.504 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:34:27.505 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:34:27.505 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: Resources for spark.driver: 20/08/03 12:34:27.505 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:34:27.505 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Submitted application: Spark shell 20/08/03 12:34:27.506 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:27.506 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:27.506 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:27.506 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:27.506 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:27.551 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'sparkDriver' on port 37713. 20/08/03 12:34:27.554 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering MapOutputTracker 20/08/03 12:34:27.555 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMaster 20/08/03 12:34:27.555 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 20/08/03 12:34:27.555 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up 20/08/03 12:34:27.555 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMasterHeartbeat 20/08/03 12:34:27.556 pool-1-thread-1-ScalaTest-running-ReplSuite INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/blockmgr-51b47c5b-b466-4d0c-99c1-02826ec8e02f 20/08/03 12:34:27.557 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore started with capacity 2.1 GiB 20/08/03 12:34:27.558 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering OutputCommitCoordinator 20/08/03 12:34:27.606 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Executor: Starting executor ID driver on host amp-jenkins-worker-06.amp 20/08/03 12:34:27.610 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Executor: Using REPL class URI: spark://amp-jenkins-worker-06.amp:37713/classes 20/08/03 12:34:27.613 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 46150. 20/08/03 12:34:27.613 pool-1-thread-1-ScalaTest-running-ReplSuite INFO NettyBlockTransferService: Server created on amp-jenkins-worker-06.amp:46150 20/08/03 12:34:27.613 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 20/08/03 12:34:27.614 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 46150, None) 20/08/03 12:34:27.614 dispatcher-BlockManagerMaster INFO BlockManagerMasterEndpoint: Registering block manager amp-jenkins-worker-06.amp:46150 with 2.1 GiB RAM, BlockManagerId(driver, amp-jenkins-worker-06.amp, 46150, None) 20/08/03 12:34:27.615 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 46150, None) 20/08/03 12:34:27.615 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, amp-jenkins-worker-06.amp, 46150, None) 20/08/03 12:34:27.619 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Main: Created Spark session 20/08/03 12:34:29.399 dispatcher-event-loop-0 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 20/08/03 12:34:29.405 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore cleared 20/08/03 12:34:29.405 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: BlockManager stopped 20/08/03 12:34:29.405 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: BlockManagerMaster stopped 20/08/03 12:34:29.405 dispatcher-event-loop-0 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 20/08/03 12:34:29.410 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Successfully stopped SparkContext 20/08/03 12:34:29.410 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== FINISHED o.a.s.repl.ReplSuite: 'spark-shell should find imported types in class constructors and extends clause' ===== 20/08/03 12:34:29.411 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.ReplSuite: 'spark-shell should shadow val/def definitions correctly' ===== 20/08/03 12:34:29.956 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:34:29.957 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:34:29.957 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: Resources for spark.driver: 20/08/03 12:34:29.957 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:34:29.957 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Submitted application: Spark shell 20/08/03 12:34:29.958 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:29.958 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:29.958 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:29.958 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:29.958 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:30.001 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'sparkDriver' on port 38513. 20/08/03 12:34:30.003 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering MapOutputTracker 20/08/03 12:34:30.004 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMaster 20/08/03 12:34:30.004 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 20/08/03 12:34:30.004 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up 20/08/03 12:34:30.004 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMasterHeartbeat 20/08/03 12:34:30.005 pool-1-thread-1-ScalaTest-running-ReplSuite INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/blockmgr-f43daeba-84c8-4298-9745-ba14671b982c 20/08/03 12:34:30.005 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore started with capacity 2.1 GiB 20/08/03 12:34:30.007 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering OutputCommitCoordinator 20/08/03 12:34:30.054 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Executor: Starting executor ID driver on host amp-jenkins-worker-06.amp 20/08/03 12:34:30.057 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Executor: Using REPL class URI: spark://amp-jenkins-worker-06.amp:38513/classes 20/08/03 12:34:30.060 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 46319. 20/08/03 12:34:30.060 pool-1-thread-1-ScalaTest-running-ReplSuite INFO NettyBlockTransferService: Server created on amp-jenkins-worker-06.amp:46319 20/08/03 12:34:30.061 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 20/08/03 12:34:30.061 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 46319, None) 20/08/03 12:34:30.061 dispatcher-BlockManagerMaster INFO BlockManagerMasterEndpoint: Registering block manager amp-jenkins-worker-06.amp:46319 with 2.1 GiB RAM, BlockManagerId(driver, amp-jenkins-worker-06.amp, 46319, None) 20/08/03 12:34:30.062 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 46319, None) 20/08/03 12:34:30.062 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, amp-jenkins-worker-06.amp, 46319, None) 20/08/03 12:34:30.066 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Main: Created Spark session 20/08/03 12:34:32.359 dispatcher-event-loop-1 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 20/08/03 12:34:32.422 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore cleared 20/08/03 12:34:32.422 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: BlockManager stopped 20/08/03 12:34:32.423 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: BlockManagerMaster stopped 20/08/03 12:34:32.423 dispatcher-event-loop-1 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 20/08/03 12:34:32.454 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Successfully stopped SparkContext 20/08/03 12:34:33.278 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:34:33.279 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:34:33.279 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: Resources for spark.driver: 20/08/03 12:34:33.279 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:34:33.279 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Submitted application: Spark shell 20/08/03 12:34:33.280 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:33.280 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:33.280 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:33.280 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:33.280 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:33.352 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'sparkDriver' on port 43743. 20/08/03 12:34:33.355 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering MapOutputTracker 20/08/03 12:34:33.356 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMaster 20/08/03 12:34:33.357 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 20/08/03 12:34:33.357 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up 20/08/03 12:34:33.357 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMasterHeartbeat 20/08/03 12:34:33.358 pool-1-thread-1-ScalaTest-running-ReplSuite INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/blockmgr-77c32f1d-07d5-4b83-9c59-bb268a5423d4 20/08/03 12:34:33.358 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore started with capacity 2.1 GiB 20/08/03 12:34:33.360 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering OutputCommitCoordinator 20/08/03 12:34:33.442 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Executor: Starting executor ID driver on host amp-jenkins-worker-06.amp 20/08/03 12:34:33.449 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Executor: Using REPL class URI: spark://amp-jenkins-worker-06.amp:43743/classes 20/08/03 12:34:33.453 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 43856. 20/08/03 12:34:33.454 pool-1-thread-1-ScalaTest-running-ReplSuite INFO NettyBlockTransferService: Server created on amp-jenkins-worker-06.amp:43856 20/08/03 12:34:33.454 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 20/08/03 12:34:33.454 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 43856, None) 20/08/03 12:34:33.462 dispatcher-BlockManagerMaster INFO BlockManagerMasterEndpoint: Registering block manager amp-jenkins-worker-06.amp:43856 with 2.1 GiB RAM, BlockManagerId(driver, amp-jenkins-worker-06.amp, 43856, None) 20/08/03 12:34:33.463 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 43856, None) 20/08/03 12:34:33.463 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, amp-jenkins-worker-06.amp, 43856, None) 20/08/03 12:34:33.470 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Main: Created Spark session 20/08/03 12:34:35.427 dispatcher-event-loop-1 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 20/08/03 12:34:35.432 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore cleared 20/08/03 12:34:35.432 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: BlockManager stopped 20/08/03 12:34:35.432 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: BlockManagerMaster stopped 20/08/03 12:34:35.433 dispatcher-event-loop-0 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 20/08/03 12:34:35.437 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Successfully stopped SparkContext 20/08/03 12:34:35.438 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== FINISHED o.a.s.repl.ReplSuite: 'spark-shell should shadow val/def definitions correctly' ===== 20/08/03 12:34:35.439 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.ReplSuite: 'SPARK-26633: ExecutorClassLoader.getResourceAsStream find REPL classes' ===== 20/08/03 12:34:36.066 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:34:36.066 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:34:36.067 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: Resources for spark.driver: 20/08/03 12:34:36.067 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ResourceUtils: ============================================================== 20/08/03 12:34:36.067 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Submitted application: Spark shell 20/08/03 12:34:36.067 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:36.067 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:36.067 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:36.067 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:36.067 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:36.115 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'sparkDriver' on port 39650. 20/08/03 12:34:36.117 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering MapOutputTracker 20/08/03 12:34:36.118 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMaster 20/08/03 12:34:36.118 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 20/08/03 12:34:36.118 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up 20/08/03 12:34:36.119 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering BlockManagerMasterHeartbeat 20/08/03 12:34:36.119 pool-1-thread-1-ScalaTest-running-ReplSuite INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/blockmgr-7783b234-3311-44a8-a3ca-6b83a43454c6 20/08/03 12:34:36.120 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore started with capacity 2.1 GiB 20/08/03 12:34:36.121 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkEnv: Registering OutputCommitCoordinator 20/08/03 12:34:36.162 pool-1-thread-1-ScalaTest-running-ReplSuite INFO LocalSparkCluster: Starting a local Spark cluster with 1 workers. 20/08/03 12:34:36.162 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:36.162 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:36.162 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:36.162 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:36.162 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:36.214 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'sparkMaster' on port 43592. 20/08/03 12:34:36.234 dispatcher-event-loop-1 INFO Master: Starting Spark master at spark://amp-jenkins-worker-06.amp:43592 20/08/03 12:34:36.234 dispatcher-event-loop-1 INFO Master: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:34:36.236 dispatcher-event-loop-1 INFO Server: jetty-9.4.18.v20190429; built: 2019-04-29T20:42:08.989Z; git: e1bc35120a6617ee3df052294e433f3a25ce7097; jvm 1.8.0_191-b12 20/08/03 12:34:36.238 dispatcher-event-loop-1 INFO Server: Started @51281ms 20/08/03 12:34:36.246 dispatcher-event-loop-1 INFO AbstractConnector: Started ServerConnector@56c6dbee{HTTP/1.1,[http/1.1]}{0.0.0.0:46241} 20/08/03 12:34:36.246 dispatcher-event-loop-1 INFO Utils: Successfully started service 'MasterUI' on port 46241. 20/08/03 12:34:36.247 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@1edf81d7{/app,null,AVAILABLE,@Spark} 20/08/03 12:34:36.247 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@60203694{/app/json,null,AVAILABLE,@Spark} 20/08/03 12:34:36.247 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@72d49a54{/,null,AVAILABLE,@Spark} 20/08/03 12:34:36.249 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@2c873c0d{/json,null,AVAILABLE,@Spark} 20/08/03 12:34:36.250 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@511ea7fc{/static,null,AVAILABLE,@Spark} 20/08/03 12:34:36.251 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@18ffff29{/app/kill,null,AVAILABLE,@Spark} 20/08/03 12:34:36.251 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@4f1cc146{/driver/kill,null,AVAILABLE,@Spark} 20/08/03 12:34:36.252 dispatcher-event-loop-1 INFO MasterWebUI: Bound MasterWebUI to 0.0.0.0, and started at http://amp-jenkins-worker-06.amp:46241 20/08/03 12:34:36.254 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@f8b3940{/metrics/master/json,null,AVAILABLE,@Spark} 20/08/03 12:34:36.255 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@783b8c0d{/metrics/applications/json,null,AVAILABLE,@Spark} 20/08/03 12:34:36.256 dispatcher-event-loop-1 INFO Master: I have been elected leader! New state: ALIVE 20/08/03 12:34:36.256 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:36.256 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:36.256 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:36.256 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:36.256 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:36.305 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'sparkWorker1' on port 37088. 20/08/03 12:34:36.307 dispatcher-event-loop-1 INFO Worker: Starting Spark worker amp-jenkins-worker-06.amp:37088 with 1 cores, 1024.0 MiB RAM 20/08/03 12:34:36.307 dispatcher-event-loop-1 INFO Worker: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:34:36.307 dispatcher-event-loop-1 INFO Worker: Spark home: /home/jenkins/workspace/NewSparkPullRequestBuilder 20/08/03 12:34:36.308 dispatcher-event-loop-1 INFO ResourceUtils: ============================================================== 20/08/03 12:34:36.308 dispatcher-event-loop-1 INFO ResourceUtils: Resources for spark.worker: 20/08/03 12:34:36.308 dispatcher-event-loop-1 INFO ResourceUtils: ============================================================== 20/08/03 12:34:36.311 dispatcher-event-loop-1 INFO Server: jetty-9.4.18.v20190429; built: 2019-04-29T20:42:08.989Z; git: e1bc35120a6617ee3df052294e433f3a25ce7097; jvm 1.8.0_191-b12 20/08/03 12:34:36.313 appclient-register-master-threadpool-0 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://amp-jenkins-worker-06.amp:43592... 20/08/03 12:34:36.314 dispatcher-event-loop-1 INFO Server: Started @51357ms 20/08/03 12:34:36.321 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-06.amp/192.168.10.26:43592 after 6 ms (0 ms spent in bootstraps) 20/08/03 12:34:36.324 dispatcher-event-loop-1 INFO AbstractConnector: Started ServerConnector@cff9288{HTTP/1.1,[http/1.1]}{0.0.0.0:45399} 20/08/03 12:34:36.324 dispatcher-event-loop-1 INFO Utils: Successfully started service 'WorkerUI' on port 45399. 20/08/03 12:34:36.325 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@62d30ff5{/logPage,null,AVAILABLE,@Spark} 20/08/03 12:34:36.328 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@5f3f16b7{/logPage/json,null,AVAILABLE,@Spark} 20/08/03 12:34:36.328 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@52f4cd04{/,null,AVAILABLE,@Spark} 20/08/03 12:34:36.329 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@53ce5f0e{/json,null,AVAILABLE,@Spark} 20/08/03 12:34:36.330 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@19a042a6{/static,null,AVAILABLE,@Spark} 20/08/03 12:34:36.331 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@57173445{/log,null,AVAILABLE,@Spark} 20/08/03 12:34:36.331 dispatcher-event-loop-1 INFO WorkerWebUI: Bound WorkerWebUI to 0.0.0.0, and started at http://amp-jenkins-worker-06.amp:45399 20/08/03 12:34:36.332 worker-register-master-threadpool-0 INFO Worker: Connecting to master amp-jenkins-worker-06.amp:43592... 20/08/03 12:34:36.337 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@26bae863{/metrics/json,null,AVAILABLE,@Spark} 20/08/03 12:34:36.337 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-06.amp/192.168.10.26:43592 after 4 ms (0 ms spent in bootstraps) 20/08/03 12:34:36.339 dispatcher-event-loop-10 INFO Master: Registering app Spark shell 20/08/03 12:34:36.340 dispatcher-event-loop-10 INFO Master: Registered app Spark shell with ID app-20200803123436-0000 20/08/03 12:34:36.341 dispatcher-event-loop-10 WARN Master: App app-20200803123436-0000 requires more resource than any of Workers could have. 20/08/03 12:34:36.342 dispatcher-event-loop-14 INFO StandaloneSchedulerBackend: Connected to Spark cluster with app ID app-20200803123436-0000 20/08/03 12:34:36.346 dispatcher-event-loop-16 INFO Master: Registering worker amp-jenkins-worker-06.amp:37088 with 1 cores, 1024.0 MiB RAM 20/08/03 12:34:36.346 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 34677. 20/08/03 12:34:36.346 pool-1-thread-1-ScalaTest-running-ReplSuite INFO NettyBlockTransferService: Server created on amp-jenkins-worker-06.amp:34677 20/08/03 12:34:36.347 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 20/08/03 12:34:36.347 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 34677, None) 20/08/03 12:34:36.347 dispatcher-event-loop-16 INFO Master: Launching executor app-20200803123436-0000/0 on worker worker-20200803123436-amp-jenkins-worker-06.amp-37088 20/08/03 12:34:36.348 dispatcher-BlockManagerMaster INFO BlockManagerMasterEndpoint: Registering block manager amp-jenkins-worker-06.amp:34677 with 2.1 GiB RAM, BlockManagerId(driver, amp-jenkins-worker-06.amp, 34677, None) 20/08/03 12:34:36.349 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 34677, None) 20/08/03 12:34:36.349 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, amp-jenkins-worker-06.amp, 34677, None) 20/08/03 12:34:36.349 dispatcher-event-loop-5 INFO Worker: Successfully registered with master spark://amp-jenkins-worker-06.amp:43592 20/08/03 12:34:36.350 dispatcher-event-loop-21 INFO StandaloneAppClient$ClientEndpoint: Executor added: app-20200803123436-0000/0 on worker-20200803123436-amp-jenkins-worker-06.amp-37088 (amp-jenkins-worker-06.amp:37088) with 1 core(s) 20/08/03 12:34:36.350 dispatcher-event-loop-21 INFO StandaloneSchedulerBackend: Granted executor ID app-20200803123436-0000/0 on hostPort amp-jenkins-worker-06.amp:37088 with 1 core(s), 1024.0 MiB RAM 20/08/03 12:34:36.352 pool-1-thread-1-ScalaTest-running-ReplSuite INFO StandaloneSchedulerBackend: SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.0 20/08/03 12:34:36.353 pool-1-thread-1-ScalaTest-running-ReplSuite INFO Main: Created Spark session 20/08/03 12:34:36.353 dispatcher-event-loop-8 INFO Worker: Asked to launch executor app-20200803123436-0000/0 for Spark shell 20/08/03 12:34:36.355 ExecutorRunner for app-20200803123436-0000/0 INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:36.355 ExecutorRunner for app-20200803123436-0000/0 INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:36.355 ExecutorRunner for app-20200803123436-0000/0 INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:36.355 ExecutorRunner for app-20200803123436-0000/0 INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:36.355 ExecutorRunner for app-20200803123436-0000/0 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:36.415 ExecutorRunner for app-20200803123436-0000/0 INFO ExecutorRunner: Launch command: "/usr/java/jdk1.8.0_191/bin/java" "-cp" "/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/target/scala-2.12/spark-repl_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/core/target/scala-2.12/spark-core_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/launcher/target/scala-2.12/spark-launcher_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/tags/target/scala-2.12/spark-tags_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/kvstore/target/scala-2.12/spark-kvstore_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-common/target/scala-2.12/spark-network-common_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-shuffle/target/scala-2.12/spark-network-shuffle_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/unsafe/target/scala-2.12/spark-unsafe_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/core/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/launcher/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/tags/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-shuffle/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-common/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib/target/scala-2.12/spark-mllib_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/streaming/target/scala-2.12/spark-streaming_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/target/scala-2.12/spark-sql_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/sketch/target/scala-2.12/spark-sketch_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/catalyst/target/scala-2.12/spark-catalyst_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/graphx/target/scala-2.12/spark-graphx_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib-local/target/scala-2.12/spark-mllib-local_2.12-3.0.1-SNAPSHOT.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.12.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.12.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang/scala-reflect/jars/scala-reflect-2.12.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.spark-project.spark/unused/jars/unused-1.0.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.fusesource.leveldbjni/leveldbjni-all/bundles/leveldbjni-all-1.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.core/jackson-core/bundles/jackson-core-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.core/jackson-databind/bundles/jackson-databind-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.core/jackson-annotations/bundles/jackson-annotations-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.netty/netty-all/jars/netty-all-4.1.47.Final.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-lang3/jars/commons-lang3-3.9.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-core/bundles/metrics-core-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.slf4j/slf4j-api/jars/slf4j-api-1.7.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.guava/guava/bundles/guava-14.0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-crypto/jars/commons-crypto-1.0.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.twitter/chill_2.12/jars/chill_2.12-0.9.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.twitter/chill-java/jars/chill-java-0.9.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.esotericsoftware/kryo-shaded/bundles/kryo-shaded-4.0.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.esotericsoftware/minlog/bundles/minlog-1.3.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.xbean/xbean-asm7-shaded/bundles/xbean-asm7-shaded-4.15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.avro/avro/jars/avro-1.8.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jackson/jackson-core-asl/jars/jackson-core-asl-1.9.13.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jackson/jackson-mapper-asl/jars/jackson-mapper-asl-1.9.13.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.thoughtworks.paranamer/paranamer/bundles/paranamer-2.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.xerial.snappy/snappy-java/bundles/snappy-java-1.1.7.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-compress/jars/commons-compress-1.8.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.tukaani/xz/jars/xz-1.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.avro/avro-mapred/jars/avro-mapred-1.8.2-hadoop2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.avro/avro-ipc/jars/avro-ipc-1.8.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-client/jars/hadoop-client-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-common/jars/hadoop-common-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-annotations/jars/hadoop-annotations-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-cli/commons-cli/jars/commons-cli-1.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-math3/jars/commons-math3-3.4.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xmlenc/xmlenc/jars/xmlenc-0.52.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-httpclient/commons-httpclient/jars/commons-httpclient-3.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-io/commons-io/jars/commons-io-2.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-net/commons-net/jars/commons-net-3.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-collections/commons-collections/jars/commons-collections-3.2.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.mortbay.jetty/jetty-sslengine/jars/jetty-sslengine-6.1.26.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/log4j/log4j/bundles/log4j-1.2.17.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-lang/commons-lang/jars/commons-lang-2.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-configuration/commons-configuration/jars/commons-configuration-1.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-digester/commons-digester/jars/commons-digester-1.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-beanutils/commons-beanutils/jars/commons-beanutils-1.7.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.protobuf/protobuf-java/bundles/protobuf-java-2.5.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-auth/jars/hadoop-auth-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.httpcomponents/httpclient/jars/httpclient-4.5.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.httpcomponents/httpcore/jars/httpcore-4.4.12.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-logging/commons-logging/jars/commons-logging-1.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-codec/commons-codec/jars/commons-codec-1.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-kerberos-codec/bundles/apacheds-kerberos-codec-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-i18n/bundles/apacheds-i18n-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-asn1-api/bundles/api-asn1-api-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-util/bundles/api-util-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.zookeeper/zookeeper/jars/zookeeper-3.4.14.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.slf4j/slf4j-log4j12/jars/slf4j-log4j12-1.7.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.github.spotbugs/spotbugs-annotations/jars/spotbugs-annotations-3.1.9.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.code.findbugs/jsr305/jars/jsr305-3.0.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.yetus/audience-annotations/jars/audience-annotations-0.5.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.netty/netty/bundles/netty-3.10.6.Final.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.curator/curator-framework/bundles/curator-framework-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.curator/curator-client/bundles/curator-client-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.curator/curator-recipes/bundles/curator-recipes-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.htrace/htrace-core/jars/htrace-core-3.1.0-incubating.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/jars/hadoop-hdfs-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.mortbay.jetty/jetty-util/jars/jetty-util-6.1.26.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xerces/xercesImpl/jars/xercesImpl-2.12.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xml-apis/xml-apis/jars/xml-apis-1.4.01.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-app/jars/hadoop-mapreduce-client-app-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-common/jars/hadoop-mapreduce-client-common-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-yarn-common/jars/hadoop-yarn-common-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-yarn-api/jars/hadoop-yarn-api-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.xml.bind/jaxb-api/jars/jaxb-api-2.2.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.xml.stream/stax-api/jars/stax-api-1.0-2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.activation/activation/jars/activation-1.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jackson/jackson-jaxrs/jars/jackson-jaxrs-1.9.13.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jackson/jackson-xc/jars/jackson-xc-1.9.13.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.inject/guice/jars/guice-3.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.inject/javax.inject/jars/javax.inject-1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/aopalliance/aopalliance/jars/aopalliance-1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.sonatype.sisu.inject/cglib/jars/cglib-2.2.1-v20090111.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jettison/jettison/bundles/jettison-1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.sun.xml.bind/jaxb-impl/jars/jaxb-impl-2.2.3-1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-yarn-client/jars/hadoop-yarn-client-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-core/jars/hadoop-mapreduce-client-core-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-yarn-server-common/jars/hadoop-yarn-server-common-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-shuffle/jars/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-jobclient/jars/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.servlet.jsp/jsp-api/jars/jsp-api-2.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-plus/jars/jetty-plus-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-webapp/jars/jetty-webapp-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-xml/jars/jetty-xml-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-util/jars/jetty-util-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-servlet/jars/jetty-servlet-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-security/jars/jetty-security-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-server/jars/jetty-server-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.servlet/javax.servlet-api/jars/javax.servlet-api-3.1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-http/jars/jetty-http-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-io/jars/jetty-io-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-jndi/jars/jetty-jndi-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-continuation/jars/jetty-continuation-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-proxy/jars/jetty-proxy-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-client/jars/jetty-client-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-servlets/jars/jetty-servlets-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-text/jars/commons-text-1.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.slf4j/jul-to-slf4j/jars/jul-to-slf4j-1.7.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.slf4j/jcl-over-slf4j/jars/jcl-over-slf4j-1.7.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.ning/compress-lzf/bundles/compress-lzf-1.0.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.lz4/lz4-java/jars/lz4-java-1.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.github.luben/zstd-jni/jars/zstd-jni-1.4.4-3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.roaringbitmap/RoaringBitmap/jars/RoaringBitmap-0.7.45.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.roaringbitmap/shims/jars/shims-0.7.45.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang.modules/scala-xml_2.12/bundles/scala-xml_2.12-1.2.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.json4s/json4s-jackson_2.12/jars/json4s-jackson_2.12-3.6.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.json4s/json4s-core_2.12/jars/json4s-core_2.12-3.6.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.json4s/json4s-ast_2.12/jars/json4s-ast_2.12-3.6.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.json4s/json4s-scalap_2.12/jars/json4s-scalap_2.12-3.6.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.core/jersey-client/jars/jersey-client-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.ws.rs/jakarta.ws.rs-api/bundles/jakarta.ws.rs-api-2.1.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.core/jersey-common/jars/jersey-common-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.annotation/jakarta.annotation-api/jars/jakarta.annotation-api-1.3.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2.external/jakarta.inject/jars/jakarta.inject-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2/osgi-resource-locator/jars/osgi-resource-locator-1.0.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.core/jersey-server/jars/jersey-server-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.media/jersey-media-jaxb/jars/jersey-media-jaxb-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.validation/jakarta.validation-api/jars/jakarta.validation-api-2.0.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.containers/jersey-container-servlet/jars/jersey-container-servlet-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.containers/jersey-container-servlet-core/jars/jersey-container-servlet-core-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.inject/jersey-hk2/jars/jersey-hk2-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2/hk2-locator/jars/hk2-locator-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2.external/aopalliance-repackaged/jars/aopalliance-repackaged-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2/hk2-api/jars/hk2-api-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2/hk2-utils/jars/hk2-utils-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.javassist/javassist/bundles/javassist-3.25.0-GA.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.clearspring.analytics/stream/jars/stream-2.9.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-jvm/bundles/metrics-jvm-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-json/bundles/metrics-json-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-graphite/bundles/metrics-graphite-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-jmx/bundles/metrics-jmx-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.module/jackson-module-scala_2.12/bundles/jackson-module-scala_2.12-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.module/jackson-module-paranamer/bundles/jackson-module-paranamer-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.ivy/ivy/jars/ivy-2.4.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/oro/oro/jars/oro-2.0.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.razorvine/pyrolite/jars/pyrolite-4.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sf.py4j/py4j/jars/py4j-0.10.9.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang.modules/scala-parser-combinators_2.12/bundles/scala-parser-combinators_2.12-1.1.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.janino/janino/jars/janino-3.0.16.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.janino/commons-compiler/jars/commons-compiler-3.0.16.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.antlr/antlr4-runtime/jars/antlr4-runtime-4.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.univocity/univocity-parsers/jars/univocity-parsers-2.8.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.arrow/arrow-vector/jars/arrow-vector-0.15.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.arrow/arrow-format/jars/arrow-format-0.15.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.flatbuffers/flatbuffers-java/bundles/flatbuffers-java-1.9.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.arrow/arrow-memory/jars/arrow-memory-0.15.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.orc/orc-core/jars/orc-core-1.5.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.orc/orc-shims/jars/orc-shims-1.5.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.airlift/aircompressor/jars/aircompressor-0.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.threeten/threeten-extra/jars/threeten-extra-1.5.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.orc/orc-mapreduce/jars/orc-mapreduce-1.5.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hive/hive-storage-api/jars/hive-storage-api-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-column/jars/parquet-column-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-common/jars/parquet-common-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-format/jars/parquet-format-2.4.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-encoding/jars/parquet-encoding-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-hadoop/jars/parquet-hadoop-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-jackson/jars/parquet-jackson-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalanlp/breeze_2.12/jars/breeze_2.12-1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalanlp/breeze-macros_2.12/jars/breeze-macros_2.12-1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.github.fommil.netlib/core/jars/core-1.1.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.f2j/arpack_combined_all/jars/arpack_combined_all-0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sf.opencsv/opencsv/jars/opencsv-2.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.github.wendykierp/JTransforms/jars/JTransforms-3.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/pl.edu.icm/JLargeArrays/jars/JLargeArrays-1.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.chuusai/shapeless_2.12/bundles/shapeless_2.12-2.3.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/macro-compat_2.12/jars/macro-compat_2.12-1.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/spire_2.12/jars/spire_2.12-0.17.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/spire-macros_2.12/jars/spire-macros_2.12-0.17.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/machinist_2.12/jars/machinist_2.12-0.6.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/algebra_2.12/jars/algebra_2.12-2.0.0-M2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/cats-kernel_2.12/jars/cats-kernel_2.12-2.0.0-M4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/spire-platform_2.12/jars/spire-platform_2.12-0.17.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/spire-util_2.12/jars/spire-util_2.12-0.17.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang.modules/scala-collection-compat_2.12/bundles/scala-collection-compat_2.12-2.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.jpmml/pmml-model/jars/pmml-model-1.4.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jaxb/jaxb-runtime/jars/jaxb-runtime-2.3.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.xml.bind/jakarta.xml.bind-api/jars/jakarta.xml.bind-api-2.3.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.sun.istack/istack-commons-runtime/jars/istack-commons-runtime-3.0.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalatest/scalatest_2.12/bundles/scalatest_2.12-3.0.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalactic/scalactic_2.12/bundles/scalactic_2.12-3.0.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/junit/junit/jars/junit-4.12.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.hamcrest/hamcrest-core/jars/hamcrest-core-1.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.novocode/junit-interface/jars/junit-interface-0.11.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-sbt/test-interface/jars/test-interface-1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.mockito/mockito-core/jars/mockito-core-3.1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.bytebuddy/byte-buddy/jars/byte-buddy-1.9.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.bytebuddy/byte-buddy-agent/jars/byte-buddy-agent-1.9.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.objenesis/objenesis/jars/objenesis-2.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.test-framework.providers/jersey-test-framework-provider-simple/jars/jersey-test-framework-provider-simple-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.test-framework/jersey-test-framework-core/jars/jersey-test-framework-core-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.servlet/jakarta.servlet-api/jars/jakarta.servlet-api-4.0.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.containers/jersey-container-simple-http/jars/jersey-container-simple-http-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.simpleframework/simple-http/jars/simple-http-6.0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.simpleframework/simple-common/jars/simple-common-6.0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.simpleframework/simple-transport/jars/simple-transport-6.0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.derby/derby/jars/derby-10.12.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-java/jars/selenium-java-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-chrome-driver/jars/selenium-chrome-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-remote-driver/jars/selenium-remote-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/cglib/cglib-nodep/jars/cglib-nodep-2.1_3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.code.gson/gson/jars/gson-2.3.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-api/jars/selenium-api-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-exec/jars/commons-exec-1.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.java.dev.jna/jna/jars/jna-4.1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.java.dev.jna/jna-platform/jars/jna-platform-4.1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-edge-driver/jars/selenium-edge-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-htmlunit-driver/jars/selenium-htmlunit-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-support/jars/selenium-support-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.htmlunit/htmlunit/jars/htmlunit-2.22.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xalan/xalan/jars/xalan-2.7.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xalan/serializer/jars/serializer-2.7.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.httpcomponents/httpmime/jars/httpmime-4.5.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.htmlunit/htmlunit-core-js/jars/htmlunit-core-js-2.22.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.htmlunit/neko-htmlunit/jars/neko-htmlunit-2.21.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.cssparser/cssparser/jars/cssparser-0.9.19.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.w3c.css/sac/jars/sac-1.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty.websocket/websocket-client/jars/websocket-client-9.2.17.v20160517.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty.websocket/websocket-common/jars/websocket-common-9.2.17.v20160517.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty.websocket/websocket-api/jars/websocket-api-9.2.17.v20160517.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-firefox-driver/jars/selenium-firefox-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-ie-driver/jars/selenium-ie-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-safari-driver/jars/selenium-safari-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.webbitserver/webbit/jars/webbit-0.4.14.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-leg-rc/jars/selenium-leg-rc-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.hamcrest/hamcrest-library/jars/hamcrest-library-1.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalacheck/scalacheck_2.12/jars/scalacheck_2.12-1.14.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.curator/curator-test/jars/curator-test-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-math/jars/commons-math-2.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-minikdc/jars/hadoop-minikdc-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core-api/jars/apacheds-core-api-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core-constants/bundles/apacheds-core-constants-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-i18n/bundles/api-i18n-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-client-api/bundles/api-ldap-client-api-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-codec-core/bundles/api-ldap-codec-core-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-asn1-ber/bundles/api-asn1-ber-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-model/bundles/api-ldap-model-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.mina/mina-core/bundles/mina-core-2.0.7.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/antlr/antlr/jars/antlr-2.7.7.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-pool/commons-pool/jars/commons-pool-1.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-aci/bundles/api-ldap-extras-aci-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-util/bundles/api-ldap-extras-util-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sf.ehcache/ehcache-core/jars/ehcache-core-2.4.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptor-kerberos/bundles/apacheds-interceptor-kerberos-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core/bundles/apacheds-core-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core-shared/bundles/apacheds-core-shared-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-codec-api/bundles/api-ldap-extras-codec-api-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-admin/bundles/apacheds-interceptors-admin-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-authn/bundles/apacheds-interceptors-authn-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-codec/bundles/api-ldap-extras-codec-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-authz/bundles/apacheds-interceptors-authz-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-changelog/bundles/apacheds-interceptors-changelog-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-collective/bundles/apacheds-interceptors-collective-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-event/bundles/apacheds-interceptors-event-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-exception/bundles/apacheds-interceptors-exception-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-journal/bundles/apacheds-interceptors-journal-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-normalization/bundles/apacheds-interceptors-normalization-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-operational/bundles/apacheds-interceptors-operational-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-referral/bundles/apacheds-interceptors-referral-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-schema/bundles/apacheds-interceptors-schema-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-subtree/bundles/apacheds-interceptors-subtree-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-trigger/bundles/apacheds-interceptors-trigger-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-trigger/bundles/api-ldap-extras-trigger-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/bouncycastle/bcprov-jdk15/jars/bcprov-jdk15-140.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-protocol-shared/bundles/apacheds-protocol-shared-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-protocol-kerberos/bundles/apacheds-protocol-kerberos-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-ldif-partition/bundles/apacheds-ldif-partition-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-xdbm-partition/jars/apacheds-xdbm-partition-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core-avl/bundles/apacheds-core-avl-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-mavibot-partition/jars/apacheds-mavibot-partition-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.mavibot/mavibot/jars/mavibot-1.0.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-all/jars/api-all-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-jdbm-partition/bundles/apacheds-jdbm-partition-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.jdbm/apacheds-jdbm1/bundles/apacheds-jdbm1-2.0.0-M2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-protocol-ldap/bundles/apacheds-protocol-ldap-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-sp/bundles/api-ldap-extras-sp-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.sbt/boot/scala-2.10.7/org.scala-sbt/sbt/0.13.18/test-agent-0.13.18.jar:/home/sparkivy/per-executor-caches/6/.sbt/boot/scala-2.10.7/org.scala-sbt/sbt/0.13.18/test-interface-1.0.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/conf/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/kvstore/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-common/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-shuffle/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-yarn/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/sketch/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/tags/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/unsafe/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/core/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/examples/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/graphx/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/launcher/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/resource-managers/mesos/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/resource-managers/yarn/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/catalyst/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/hive/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/hive-thriftserver/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/streaming/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/kvstore/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-yarn/target/scala-2.12/test-classes:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/sketch/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/unsafe/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/examples/target/scala-2.12/test-classes:/home/jenkins/workspace/NewSparkPullRequestBuilder/graphx/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/resource-managers/mesos/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/resource-managers/yarn/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/catalyst/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/hive/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/hive-thriftserver/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/streaming/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/core/target/jars/*:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib/target/jars/*:/home/jenkins/workspace/NewSparkPullRequestBuilder/assembly/target/scala-2.12/jars/*" "-Xmx1024M" "-Dspark.driver.port=39650" "-Dspark.port.maxRetries=100" "org.apache.spark.executor.CoarseGrainedExecutorBackend" "--driver-url" "spark://CoarseGrainedScheduler@amp-jenkins-worker-06.amp:39650" "--executor-id" "0" "--hostname" "amp-jenkins-worker-06.amp" "--cores" "1" "--app-id" "app-20200803123436-0000" "--worker-url" "spark://Worker@amp-jenkins-worker-06.amp:37088" 20/08/03 12:34:36.426 dispatcher-event-loop-22 INFO StandaloneAppClient$ClientEndpoint: Executor updated: app-20200803123436-0000/0 is now RUNNING 20/08/03 12:34:38.003 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Starting job: collect at :17 20/08/03 12:34:38.006 dag-scheduler-event-loop INFO DAGScheduler: Got job 0 (collect at :17) with 2 output partitions 20/08/03 12:34:38.006 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 0 (collect at :17) 20/08/03 12:34:38.006 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:38.006 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:38.006 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[1] at map at :17), which has no missing parents 20/08/03 12:34:38.016 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 3.2 KiB, free 2.1 GiB) 20/08/03 12:34:38.019 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1860.0 B, free 2.1 GiB) 20/08/03 12:34:38.020 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on amp-jenkins-worker-06.amp:34677 (size: 1860.0 B, free: 2.1 GiB) 20/08/03 12:34:38.020 dag-scheduler-event-loop INFO SparkContext: Created broadcast 0 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:38.021 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 0 (MapPartitionsRDD[1] at map at :17) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:34:38.022 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 0.0 with 2 tasks 20/08/03 12:34:39.323 dispatcher-CoarseGrainedScheduler INFO CoarseGrainedSchedulerBackend$DriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (192.168.10.26:46424) with ID 0 20/08/03 12:34:39.449 dispatcher-BlockManagerMaster INFO BlockManagerMasterEndpoint: Registering block manager amp-jenkins-worker-06.amp:32787 with 546.3 MiB RAM, BlockManagerId(0, amp-jenkins-worker-06.amp, 32787, None) 20/08/03 12:34:39.491 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, amp-jenkins-worker-06.amp, executor 0, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:34:39.747 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on amp-jenkins-worker-06.amp:32787 (size: 1860.0 B, free: 546.3 MiB) 20/08/03 12:34:40.354 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 864 ms on amp-jenkins-worker-06.amp (executor 0) (1/2) 20/08/03 12:34:40.355 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 0.0 (TID 1, amp-jenkins-worker-06.amp, executor 0, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:34:40.383 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 0.0 (TID 1) in 28 ms on amp-jenkins-worker-06.amp (executor 0) (2/2) 20/08/03 12:34:40.384 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 20/08/03 12:34:40.384 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 0 (collect at :17) finished in 2.373 s 20/08/03 12:34:40.384 dag-scheduler-event-loop INFO DAGScheduler: Job 0 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:40.384 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 0: Stage finished 20/08/03 12:34:40.385 pool-1-thread-1-ScalaTest-running-ReplSuite INFO DAGScheduler: Job 0 finished: collect at :17, took 2.380588 s 20/08/03 12:34:40.388 pool-1-thread-1-ScalaTest-running-ReplSuite INFO StandaloneSchedulerBackend: Shutting down all executors 20/08/03 12:34:40.389 dispatcher-CoarseGrainedScheduler INFO CoarseGrainedSchedulerBackend$DriverEndpoint: Asking each executor to shut down 20/08/03 12:34:40.390 pool-1-thread-1-ScalaTest-running-ReplSuite INFO LocalSparkCluster: Shutting down local Spark cluster. 20/08/03 12:34:40.390 ExecutorRunner for app-20200803123436-0000/0 INFO ExecutorRunner: Runner thread for executor app-20200803123436-0000/0 interrupted 20/08/03 12:34:40.390 ExecutorRunner for app-20200803123436-0000/0 INFO ExecutorRunner: Killing process! 20/08/03 12:34:40.391 dispatcher-event-loop-20 INFO Master: Received unregister request from application app-20200803123436-0000 20/08/03 12:34:40.391 dispatcher-event-loop-20 INFO Master: Removing app app-20200803123436-0000 20/08/03 12:34:40.392 rpc-client-83-1 ERROR TransportRequestHandler: Error while invoking RpcHandler#receive() for one-way message. org.apache.spark.rpc.RpcEnvStoppedException: RpcEnv already stopped. at org.apache.spark.rpc.netty.Dispatcher.postMessage(Dispatcher.scala:167) at org.apache.spark.rpc.netty.Dispatcher.postOneWayMessage(Dispatcher.scala:150) at org.apache.spark.rpc.netty.NettyRpcHandler.receive(NettyRpcEnv.scala:684) at org.apache.spark.network.server.TransportRequestHandler.processOneWayMessage(TransportRequestHandler.java:253) at org.apache.spark.network.server.TransportRequestHandler.handle(TransportRequestHandler.java:111) at org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:140) at org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:53) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at org.apache.spark.network.util.TransportFrameDecoder.channelRead(TransportFrameDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 20/08/03 12:34:40.394 dispatcher-event-loop-14 INFO AbstractConnector: Stopped Spark@cff9288{HTTP/1.1,[http/1.1]}{0.0.0.0:0} 20/08/03 12:34:40.394 rpc-client-83-1 ERROR TransportRequestHandler: Error while invoking RpcHandler#receive() for one-way message. org.apache.spark.rpc.RpcEnvStoppedException: RpcEnv already stopped. at org.apache.spark.rpc.netty.Dispatcher.postMessage(Dispatcher.scala:167) at org.apache.spark.rpc.netty.Dispatcher.postOneWayMessage(Dispatcher.scala:150) at org.apache.spark.rpc.netty.NettyRpcHandler.receive(NettyRpcEnv.scala:684) at org.apache.spark.network.server.TransportRequestHandler.processOneWayMessage(TransportRequestHandler.java:253) at org.apache.spark.network.server.TransportRequestHandler.handle(TransportRequestHandler.java:111) at org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:140) at org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:53) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at org.apache.spark.network.util.TransportFrameDecoder.channelRead(TransportFrameDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 20/08/03 12:34:40.397 dispatcher-event-loop-21 INFO Master: 192.168.10.26:43448 got disassociated, removing it. 20/08/03 12:34:40.397 dispatcher-event-loop-21 INFO Master: amp-jenkins-worker-06.amp:37088 got disassociated, removing it. 20/08/03 12:34:40.397 dispatcher-event-loop-21 INFO Master: Removing worker worker-20200803123436-amp-jenkins-worker-06.amp-37088 on amp-jenkins-worker-06.amp:37088 20/08/03 12:34:40.397 dispatcher-event-loop-21 INFO Master: Telling app of lost worker: worker-20200803123436-amp-jenkins-worker-06.amp-37088 20/08/03 12:34:40.400 dispatcher-event-loop-25 INFO AbstractConnector: Stopped Spark@56c6dbee{HTTP/1.1,[http/1.1]}{0.0.0.0:0} 20/08/03 12:34:40.404 dispatcher-event-loop-3 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 20/08/03 12:34:40.410 pool-1-thread-1-ScalaTest-running-ReplSuite INFO MemoryStore: MemoryStore cleared 20/08/03 12:34:40.410 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManager: BlockManager stopped 20/08/03 12:34:40.411 pool-1-thread-1-ScalaTest-running-ReplSuite INFO BlockManagerMaster: BlockManagerMaster stopped 20/08/03 12:34:40.411 dispatcher-event-loop-8 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 20/08/03 12:34:40.535 pool-1-thread-1-ScalaTest-running-ReplSuite INFO SparkContext: Successfully stopped SparkContext 20/08/03 12:34:40.535 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== FINISHED o.a.s.repl.ReplSuite: 'SPARK-26633: ExecutorClassLoader.getResourceAsStream find REPL classes' ===== 20/08/03 12:34:40.537 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.ReplSuite: 'SPARK-30167: Log4j configuration for REPL should override root logger properly' ===== 20/08/03 12:34:43.665 pool-1-thread-1-ScalaTest-running-ReplSuite INFO ReplSuite: ===== FINISHED o.a.s.repl.ReplSuite: 'SPARK-30167: Log4j configuration for REPL should override root logger properly' ===== 20/08/03 12:34:44.228 Thread-146 INFO SparkContext: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:34:44.230 Thread-146 INFO ResourceUtils: ============================================================== 20/08/03 12:34:44.230 Thread-146 INFO ResourceUtils: Resources for spark.driver: 20/08/03 12:34:44.230 Thread-146 INFO ResourceUtils: ============================================================== 20/08/03 12:34:44.230 Thread-146 INFO SparkContext: Submitted application: Spark shell 20/08/03 12:34:44.230 Thread-146 INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:44.230 Thread-146 INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:44.230 Thread-146 INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:44.230 Thread-146 INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:44.231 Thread-146 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:44.283 Thread-146 INFO Utils: Successfully started service 'sparkDriver' on port 36379. 20/08/03 12:34:44.286 Thread-146 INFO SparkEnv: Registering MapOutputTracker 20/08/03 12:34:44.287 Thread-146 INFO SparkEnv: Registering BlockManagerMaster 20/08/03 12:34:44.287 Thread-146 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 20/08/03 12:34:44.287 Thread-146 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up 20/08/03 12:34:44.288 Thread-146 INFO SparkEnv: Registering BlockManagerMasterHeartbeat 20/08/03 12:34:44.288 Thread-146 INFO DiskBlockManager: Created local directory at /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/blockmgr-d5cdd7b6-22db-4cc9-b74c-96928a77115a 20/08/03 12:34:44.289 Thread-146 INFO MemoryStore: MemoryStore started with capacity 2.1 GiB 20/08/03 12:34:44.290 Thread-146 INFO SparkEnv: Registering OutputCommitCoordinator 20/08/03 12:34:44.412 Thread-146 INFO LocalSparkCluster: Starting a local Spark cluster with 2 workers. 20/08/03 12:34:44.413 Thread-146 INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:44.413 Thread-146 INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:44.413 Thread-146 INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:44.413 Thread-146 INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:44.413 Thread-146 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:44.472 Thread-146 INFO Utils: Successfully started service 'sparkMaster' on port 38073. 20/08/03 12:34:44.495 dispatcher-event-loop-1 INFO Master: Starting Spark master at spark://amp-jenkins-worker-06.amp:38073 20/08/03 12:34:44.495 dispatcher-event-loop-1 INFO Master: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:34:44.497 dispatcher-event-loop-1 INFO Server: jetty-9.4.18.v20190429; built: 2019-04-29T20:42:08.989Z; git: e1bc35120a6617ee3df052294e433f3a25ce7097; jvm 1.8.0_191-b12 20/08/03 12:34:44.498 dispatcher-event-loop-1 INFO Server: Started @59541ms 20/08/03 12:34:44.503 dispatcher-event-loop-1 INFO AbstractConnector: Started ServerConnector@20c5f991{HTTP/1.1,[http/1.1]}{0.0.0.0:36918} 20/08/03 12:34:44.503 dispatcher-event-loop-1 INFO Utils: Successfully started service 'MasterUI' on port 36918. 20/08/03 12:34:44.504 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@51b3840d{/app,null,AVAILABLE,@Spark} 20/08/03 12:34:44.504 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@55fa4053{/app/json,null,AVAILABLE,@Spark} 20/08/03 12:34:44.505 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@360fa61{/,null,AVAILABLE,@Spark} 20/08/03 12:34:44.505 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@5ae3c354{/json,null,AVAILABLE,@Spark} 20/08/03 12:34:44.507 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@64327de8{/static,null,AVAILABLE,@Spark} 20/08/03 12:34:44.508 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@1a6aa7f7{/app/kill,null,AVAILABLE,@Spark} 20/08/03 12:34:44.508 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@248fa018{/driver/kill,null,AVAILABLE,@Spark} 20/08/03 12:34:44.509 dispatcher-event-loop-1 INFO MasterWebUI: Bound MasterWebUI to 0.0.0.0, and started at http://amp-jenkins-worker-06.amp:36918 20/08/03 12:34:44.513 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@2c4a651e{/metrics/master/json,null,AVAILABLE,@Spark} 20/08/03 12:34:44.514 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@2072768c{/metrics/applications/json,null,AVAILABLE,@Spark} 20/08/03 12:34:44.514 dispatcher-event-loop-1 INFO Master: I have been elected leader! New state: ALIVE 20/08/03 12:34:44.514 Thread-146 INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:44.514 Thread-146 INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:44.514 Thread-146 INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:44.514 Thread-146 INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:44.515 Thread-146 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:44.579 Thread-146 INFO Utils: Successfully started service 'sparkWorker1' on port 34141. 20/08/03 12:34:44.582 Thread-146 INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:44.582 dispatcher-event-loop-1 INFO Worker: Starting Spark worker amp-jenkins-worker-06.amp:34141 with 1 cores, 1024.0 MiB RAM 20/08/03 12:34:44.582 Thread-146 INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:44.582 dispatcher-event-loop-1 INFO Worker: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:34:44.582 Thread-146 INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:44.582 dispatcher-event-loop-1 INFO Worker: Spark home: /home/jenkins/workspace/NewSparkPullRequestBuilder 20/08/03 12:34:44.582 Thread-146 INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:44.582 Thread-146 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:44.583 dispatcher-event-loop-1 INFO ResourceUtils: ============================================================== 20/08/03 12:34:44.583 dispatcher-event-loop-1 INFO ResourceUtils: Resources for spark.worker: 20/08/03 12:34:44.583 dispatcher-event-loop-1 INFO ResourceUtils: ============================================================== 20/08/03 12:34:44.585 dispatcher-event-loop-1 INFO Server: jetty-9.4.18.v20190429; built: 2019-04-29T20:42:08.989Z; git: e1bc35120a6617ee3df052294e433f3a25ce7097; jvm 1.8.0_191-b12 20/08/03 12:34:44.587 dispatcher-event-loop-1 INFO Server: Started @59630ms 20/08/03 12:34:44.591 dispatcher-event-loop-1 INFO AbstractConnector: Started ServerConnector@6eee5f64{HTTP/1.1,[http/1.1]}{0.0.0.0:34253} 20/08/03 12:34:44.592 dispatcher-event-loop-1 INFO Utils: Successfully started service 'WorkerUI' on port 34253. 20/08/03 12:34:44.593 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@6f5135e8{/logPage,null,AVAILABLE,@Spark} 20/08/03 12:34:44.593 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@5fd72d12{/logPage/json,null,AVAILABLE,@Spark} 20/08/03 12:34:44.593 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@31345287{/,null,AVAILABLE,@Spark} 20/08/03 12:34:44.594 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@713f228f{/json,null,AVAILABLE,@Spark} 20/08/03 12:34:44.595 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@538ef696{/static,null,AVAILABLE,@Spark} 20/08/03 12:34:44.596 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@7dfbb107{/log,null,AVAILABLE,@Spark} 20/08/03 12:34:44.596 dispatcher-event-loop-1 INFO WorkerWebUI: Bound WorkerWebUI to 0.0.0.0, and started at http://amp-jenkins-worker-06.amp:34253 20/08/03 12:34:44.597 worker-register-master-threadpool-0 INFO Worker: Connecting to master amp-jenkins-worker-06.amp:38073... 20/08/03 12:34:44.598 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@50c243dc{/metrics/json,null,AVAILABLE,@Spark} 20/08/03 12:34:44.599 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-06.amp/192.168.10.26:38073 after 1 ms (0 ms spent in bootstraps) 20/08/03 12:34:44.607 dispatcher-event-loop-10 INFO Master: Registering worker amp-jenkins-worker-06.amp:34141 with 1 cores, 1024.0 MiB RAM 20/08/03 12:34:44.609 dispatcher-event-loop-5 INFO Worker: Successfully registered with master spark://amp-jenkins-worker-06.amp:38073 20/08/03 12:34:44.658 Thread-146 INFO Utils: Successfully started service 'sparkWorker2' on port 45396. 20/08/03 12:34:44.661 dispatcher-event-loop-1 INFO Worker: Starting Spark worker amp-jenkins-worker-06.amp:45396 with 1 cores, 1024.0 MiB RAM 20/08/03 12:34:44.662 dispatcher-event-loop-1 INFO Worker: Running Spark version 3.0.1-SNAPSHOT 20/08/03 12:34:44.662 dispatcher-event-loop-1 INFO Worker: Spark home: /home/jenkins/workspace/NewSparkPullRequestBuilder 20/08/03 12:34:44.662 dispatcher-event-loop-1 INFO ResourceUtils: ============================================================== 20/08/03 12:34:44.662 dispatcher-event-loop-1 INFO ResourceUtils: Resources for spark.worker: 20/08/03 12:34:44.662 dispatcher-event-loop-1 INFO ResourceUtils: ============================================================== 20/08/03 12:34:44.664 dispatcher-event-loop-1 INFO Server: jetty-9.4.18.v20190429; built: 2019-04-29T20:42:08.989Z; git: e1bc35120a6617ee3df052294e433f3a25ce7097; jvm 1.8.0_191-b12 20/08/03 12:34:44.665 dispatcher-event-loop-1 INFO Server: Started @59708ms 20/08/03 12:34:44.667 appclient-register-master-threadpool-0 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://amp-jenkins-worker-06.amp:38073... 20/08/03 12:34:44.670 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-06.amp/192.168.10.26:38073 after 1 ms (0 ms spent in bootstraps) 20/08/03 12:34:44.671 dispatcher-event-loop-1 INFO AbstractConnector: Started ServerConnector@63f815fb{HTTP/1.1,[http/1.1]}{0.0.0.0:39440} 20/08/03 12:34:44.672 dispatcher-event-loop-1 INFO Utils: Successfully started service 'WorkerUI' on port 39440. 20/08/03 12:34:44.673 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@7963b0ee{/logPage,null,AVAILABLE,@Spark} 20/08/03 12:34:44.673 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@3aa22560{/logPage/json,null,AVAILABLE,@Spark} 20/08/03 12:34:44.674 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@19b45ea{/,null,AVAILABLE,@Spark} 20/08/03 12:34:44.674 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@83d452e{/json,null,AVAILABLE,@Spark} 20/08/03 12:34:44.675 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@6d1c56aa{/static,null,AVAILABLE,@Spark} 20/08/03 12:34:44.676 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@53c1b681{/log,null,AVAILABLE,@Spark} 20/08/03 12:34:44.676 dispatcher-event-loop-1 INFO WorkerWebUI: Bound WorkerWebUI to 0.0.0.0, and started at http://amp-jenkins-worker-06.amp:39440 20/08/03 12:34:44.677 worker-register-master-threadpool-0 INFO Worker: Connecting to master amp-jenkins-worker-06.amp:38073... 20/08/03 12:34:44.677 dispatcher-event-loop-18 INFO Master: Registering app Spark shell 20/08/03 12:34:44.678 dispatcher-event-loop-18 INFO Master: Registered app Spark shell with ID app-20200803123444-0000 20/08/03 12:34:44.679 dispatcher-event-loop-18 INFO Master: Launching executor app-20200803123444-0000/0 on worker worker-20200803123444-amp-jenkins-worker-06.amp-34141 20/08/03 12:34:44.679 dispatcher-event-loop-1 INFO ContextHandler: Started o.e.j.s.ServletContextHandler@632d28dd{/metrics/json,null,AVAILABLE,@Spark} 20/08/03 12:34:44.680 dispatcher-event-loop-16 INFO StandaloneSchedulerBackend: Connected to Spark cluster with app ID app-20200803123444-0000 20/08/03 12:34:44.680 netty-rpc-connection-0 INFO TransportClientFactory: Successfully created connection to amp-jenkins-worker-06.amp/192.168.10.26:38073 after 1 ms (0 ms spent in bootstraps) 20/08/03 12:34:44.682 dispatcher-event-loop-21 INFO StandaloneAppClient$ClientEndpoint: Executor added: app-20200803123444-0000/0 on worker-20200803123444-amp-jenkins-worker-06.amp-34141 (amp-jenkins-worker-06.amp:34141) with 1 core(s) 20/08/03 12:34:44.682 dispatcher-event-loop-21 INFO StandaloneSchedulerBackend: Granted executor ID app-20200803123444-0000/0 on hostPort amp-jenkins-worker-06.amp:34141 with 1 core(s), 1024.0 MiB RAM 20/08/03 12:34:44.684 Thread-146 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 33461. 20/08/03 12:34:44.684 dispatcher-event-loop-8 INFO Worker: Asked to launch executor app-20200803123444-0000/0 for Spark shell 20/08/03 12:34:44.684 Thread-146 INFO NettyBlockTransferService: Server created on amp-jenkins-worker-06.amp:33461 20/08/03 12:34:44.685 Thread-146 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 20/08/03 12:34:44.686 Thread-146 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 33461, None) 20/08/03 12:34:44.687 dispatcher-BlockManagerMaster INFO BlockManagerMasterEndpoint: Registering block manager amp-jenkins-worker-06.amp:33461 with 2.1 GiB RAM, BlockManagerId(driver, amp-jenkins-worker-06.amp, 33461, None) 20/08/03 12:34:44.688 Thread-146 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, amp-jenkins-worker-06.amp, 33461, None) 20/08/03 12:34:44.688 Thread-146 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, amp-jenkins-worker-06.amp, 33461, None) 20/08/03 12:34:44.689 ExecutorRunner for app-20200803123444-0000/0 INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:44.689 ExecutorRunner for app-20200803123444-0000/0 INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:44.689 ExecutorRunner for app-20200803123444-0000/0 INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:44.689 ExecutorRunner for app-20200803123444-0000/0 INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:44.689 ExecutorRunner for app-20200803123444-0000/0 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:44.694 dispatcher-event-loop-24 INFO Master: Registering worker amp-jenkins-worker-06.amp:45396 with 1 cores, 1024.0 MiB RAM 20/08/03 12:34:44.695 dispatcher-event-loop-24 INFO Master: Launching executor app-20200803123444-0000/1 on worker worker-20200803123444-amp-jenkins-worker-06.amp-45396 20/08/03 12:34:44.696 Thread-146 INFO StandaloneSchedulerBackend: SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.0 20/08/03 12:34:44.696 dispatcher-event-loop-22 INFO StandaloneAppClient$ClientEndpoint: Executor added: app-20200803123444-0000/1 on worker-20200803123444-amp-jenkins-worker-06.amp-45396 (amp-jenkins-worker-06.amp:45396) with 1 core(s) 20/08/03 12:34:44.697 Thread-146 INFO Main: Created Spark session 20/08/03 12:34:44.697 dispatcher-event-loop-22 INFO StandaloneSchedulerBackend: Granted executor ID app-20200803123444-0000/1 on hostPort amp-jenkins-worker-06.amp:45396 with 1 core(s), 1024.0 MiB RAM 20/08/03 12:34:44.698 dispatcher-event-loop-4 INFO Worker: Successfully registered with master spark://amp-jenkins-worker-06.amp:38073 20/08/03 12:34:44.701 dispatcher-event-loop-8 INFO Worker: Asked to launch executor app-20200803123444-0000/1 for Spark shell 20/08/03 12:34:44.702 ExecutorRunner for app-20200803123444-0000/1 INFO SecurityManager: Changing view acls to: jenkins 20/08/03 12:34:44.703 ExecutorRunner for app-20200803123444-0000/1 INFO SecurityManager: Changing modify acls to: jenkins 20/08/03 12:34:44.703 ExecutorRunner for app-20200803123444-0000/1 INFO SecurityManager: Changing view acls groups to: 20/08/03 12:34:44.703 ExecutorRunner for app-20200803123444-0000/1 INFO SecurityManager: Changing modify acls groups to: 20/08/03 12:34:44.703 ExecutorRunner for app-20200803123444-0000/1 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(jenkins); groups with view permissions: Set(); users with modify permissions: Set(jenkins); groups with modify permissions: Set() 20/08/03 12:34:44.764 ExecutorRunner for app-20200803123444-0000/1 INFO ExecutorRunner: Launch command: "/usr/java/jdk1.8.0_191/bin/java" "-cp" "/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/target/scala-2.12/spark-repl_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/core/target/scala-2.12/spark-core_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/launcher/target/scala-2.12/spark-launcher_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/tags/target/scala-2.12/spark-tags_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/kvstore/target/scala-2.12/spark-kvstore_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-common/target/scala-2.12/spark-network-common_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-shuffle/target/scala-2.12/spark-network-shuffle_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/unsafe/target/scala-2.12/spark-unsafe_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/core/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/launcher/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/tags/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-shuffle/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-common/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib/target/scala-2.12/spark-mllib_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/streaming/target/scala-2.12/spark-streaming_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/target/scala-2.12/spark-sql_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/sketch/target/scala-2.12/spark-sketch_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/catalyst/target/scala-2.12/spark-catalyst_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/graphx/target/scala-2.12/spark-graphx_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib-local/target/scala-2.12/spark-mllib-local_2.12-3.0.1-SNAPSHOT.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.12.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.12.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang/scala-reflect/jars/scala-reflect-2.12.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.spark-project.spark/unused/jars/unused-1.0.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.fusesource.leveldbjni/leveldbjni-all/bundles/leveldbjni-all-1.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.core/jackson-core/bundles/jackson-core-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.core/jackson-databind/bundles/jackson-databind-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.core/jackson-annotations/bundles/jackson-annotations-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.netty/netty-all/jars/netty-all-4.1.47.Final.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-lang3/jars/commons-lang3-3.9.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-core/bundles/metrics-core-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.slf4j/slf4j-api/jars/slf4j-api-1.7.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.guava/guava/bundles/guava-14.0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-crypto/jars/commons-crypto-1.0.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.twitter/chill_2.12/jars/chill_2.12-0.9.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.twitter/chill-java/jars/chill-java-0.9.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.esotericsoftware/kryo-shaded/bundles/kryo-shaded-4.0.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.esotericsoftware/minlog/bundles/minlog-1.3.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.xbean/xbean-asm7-shaded/bundles/xbean-asm7-shaded-4.15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.avro/avro/jars/avro-1.8.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jackson/jackson-core-asl/jars/jackson-core-asl-1.9.13.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jackson/jackson-mapper-asl/jars/jackson-mapper-asl-1.9.13.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.thoughtworks.paranamer/paranamer/bundles/paranamer-2.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.xerial.snappy/snappy-java/bundles/snappy-java-1.1.7.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-compress/jars/commons-compress-1.8.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.tukaani/xz/jars/xz-1.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.avro/avro-mapred/jars/avro-mapred-1.8.2-hadoop2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.avro/avro-ipc/jars/avro-ipc-1.8.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-client/jars/hadoop-client-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-common/jars/hadoop-common-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-annotations/jars/hadoop-annotations-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-cli/commons-cli/jars/commons-cli-1.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-math3/jars/commons-math3-3.4.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xmlenc/xmlenc/jars/xmlenc-0.52.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-httpclient/commons-httpclient/jars/commons-httpclient-3.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-io/commons-io/jars/commons-io-2.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-net/commons-net/jars/commons-net-3.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-collections/commons-collections/jars/commons-collections-3.2.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.mortbay.jetty/jetty-sslengine/jars/jetty-sslengine-6.1.26.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/log4j/log4j/bundles/log4j-1.2.17.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-lang/commons-lang/jars/commons-lang-2.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-configuration/commons-configuration/jars/commons-configuration-1.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-digester/commons-digester/jars/commons-digester-1.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-beanutils/commons-beanutils/jars/commons-beanutils-1.7.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.protobuf/protobuf-java/bundles/protobuf-java-2.5.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-auth/jars/hadoop-auth-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.httpcomponents/httpclient/jars/httpclient-4.5.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.httpcomponents/httpcore/jars/httpcore-4.4.12.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-logging/commons-logging/jars/commons-logging-1.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-codec/commons-codec/jars/commons-codec-1.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-kerberos-codec/bundles/apacheds-kerberos-codec-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-i18n/bundles/apacheds-i18n-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-asn1-api/bundles/api-asn1-api-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-util/bundles/api-util-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.zookeeper/zookeeper/jars/zookeeper-3.4.14.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.slf4j/slf4j-log4j12/jars/slf4j-log4j12-1.7.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.github.spotbugs/spotbugs-annotations/jars/spotbugs-annotations-3.1.9.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.code.findbugs/jsr305/jars/jsr305-3.0.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.yetus/audience-annotations/jars/audience-annotations-0.5.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.netty/netty/bundles/netty-3.10.6.Final.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.curator/curator-framework/bundles/curator-framework-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.curator/curator-client/bundles/curator-client-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.curator/curator-recipes/bundles/curator-recipes-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.htrace/htrace-core/jars/htrace-core-3.1.0-incubating.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/jars/hadoop-hdfs-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.mortbay.jetty/jetty-util/jars/jetty-util-6.1.26.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xerces/xercesImpl/jars/xercesImpl-2.12.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xml-apis/xml-apis/jars/xml-apis-1.4.01.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-app/jars/hadoop-mapreduce-client-app-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-common/jars/hadoop-mapreduce-client-common-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-yarn-common/jars/hadoop-yarn-common-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-yarn-api/jars/hadoop-yarn-api-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.xml.bind/jaxb-api/jars/jaxb-api-2.2.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.xml.stream/stax-api/jars/stax-api-1.0-2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.activation/activation/jars/activation-1.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jackson/jackson-jaxrs/jars/jackson-jaxrs-1.9.13.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jackson/jackson-xc/jars/jackson-xc-1.9.13.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.inject/guice/jars/guice-3.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.inject/javax.inject/jars/javax.inject-1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/aopalliance/aopalliance/jars/aopalliance-1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.sonatype.sisu.inject/cglib/jars/cglib-2.2.1-v20090111.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jettison/jettison/bundles/jettison-1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.sun.xml.bind/jaxb-impl/jars/jaxb-impl-2.2.3-1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-yarn-client/jars/hadoop-yarn-client-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-core/jars/hadoop-mapreduce-client-core-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-yarn-server-common/jars/hadoop-yarn-server-common-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-shuffle/jars/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-jobclient/jars/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.servlet.jsp/jsp-api/jars/jsp-api-2.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-plus/jars/jetty-plus-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-webapp/jars/jetty-webapp-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-xml/jars/jetty-xml-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-util/jars/jetty-util-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-servlet/jars/jetty-servlet-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-security/jars/jetty-security-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-server/jars/jetty-server-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.servlet/javax.servlet-api/jars/javax.servlet-api-3.1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-http/jars/jetty-http-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-io/jars/jetty-io-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-jndi/jars/jetty-jndi-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-continuation/jars/jetty-continuation-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-proxy/jars/jetty-proxy-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-client/jars/jetty-client-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-servlets/jars/jetty-servlets-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-text/jars/commons-text-1.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.slf4j/jul-to-slf4j/jars/jul-to-slf4j-1.7.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.slf4j/jcl-over-slf4j/jars/jcl-over-slf4j-1.7.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.ning/compress-lzf/bundles/compress-lzf-1.0.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.lz4/lz4-java/jars/lz4-java-1.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.github.luben/zstd-jni/jars/zstd-jni-1.4.4-3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.roaringbitmap/RoaringBitmap/jars/RoaringBitmap-0.7.45.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.roaringbitmap/shims/jars/shims-0.7.45.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang.modules/scala-xml_2.12/bundles/scala-xml_2.12-1.2.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.json4s/json4s-jackson_2.12/jars/json4s-jackson_2.12-3.6.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.json4s/json4s-core_2.12/jars/json4s-core_2.12-3.6.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.json4s/json4s-ast_2.12/jars/json4s-ast_2.12-3.6.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.json4s/json4s-scalap_2.12/jars/json4s-scalap_2.12-3.6.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.core/jersey-client/jars/jersey-client-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.ws.rs/jakarta.ws.rs-api/bundles/jakarta.ws.rs-api-2.1.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.core/jersey-common/jars/jersey-common-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.annotation/jakarta.annotation-api/jars/jakarta.annotation-api-1.3.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2.external/jakarta.inject/jars/jakarta.inject-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2/osgi-resource-locator/jars/osgi-resource-locator-1.0.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.core/jersey-server/jars/jersey-server-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.media/jersey-media-jaxb/jars/jersey-media-jaxb-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.validation/jakarta.validation-api/jars/jakarta.validation-api-2.0.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.containers/jersey-container-servlet/jars/jersey-container-servlet-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.containers/jersey-container-servlet-core/jars/jersey-container-servlet-core-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.inject/jersey-hk2/jars/jersey-hk2-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2/hk2-locator/jars/hk2-locator-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2.external/aopalliance-repackaged/jars/aopalliance-repackaged-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2/hk2-api/jars/hk2-api-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2/hk2-utils/jars/hk2-utils-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.javassist/javassist/bundles/javassist-3.25.0-GA.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.clearspring.analytics/stream/jars/stream-2.9.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-jvm/bundles/metrics-jvm-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-json/bundles/metrics-json-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-graphite/bundles/metrics-graphite-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-jmx/bundles/metrics-jmx-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.module/jackson-module-scala_2.12/bundles/jackson-module-scala_2.12-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.module/jackson-module-paranamer/bundles/jackson-module-paranamer-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.ivy/ivy/jars/ivy-2.4.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/oro/oro/jars/oro-2.0.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.razorvine/pyrolite/jars/pyrolite-4.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sf.py4j/py4j/jars/py4j-0.10.9.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang.modules/scala-parser-combinators_2.12/bundles/scala-parser-combinators_2.12-1.1.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.janino/janino/jars/janino-3.0.16.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.janino/commons-compiler/jars/commons-compiler-3.0.16.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.antlr/antlr4-runtime/jars/antlr4-runtime-4.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.univocity/univocity-parsers/jars/univocity-parsers-2.8.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.arrow/arrow-vector/jars/arrow-vector-0.15.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.arrow/arrow-format/jars/arrow-format-0.15.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.flatbuffers/flatbuffers-java/bundles/flatbuffers-java-1.9.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.arrow/arrow-memory/jars/arrow-memory-0.15.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.orc/orc-core/jars/orc-core-1.5.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.orc/orc-shims/jars/orc-shims-1.5.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.airlift/aircompressor/jars/aircompressor-0.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.threeten/threeten-extra/jars/threeten-extra-1.5.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.orc/orc-mapreduce/jars/orc-mapreduce-1.5.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hive/hive-storage-api/jars/hive-storage-api-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-column/jars/parquet-column-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-common/jars/parquet-common-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-format/jars/parquet-format-2.4.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-encoding/jars/parquet-encoding-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-hadoop/jars/parquet-hadoop-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-jackson/jars/parquet-jackson-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalanlp/breeze_2.12/jars/breeze_2.12-1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalanlp/breeze-macros_2.12/jars/breeze-macros_2.12-1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.github.fommil.netlib/core/jars/core-1.1.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.f2j/arpack_combined_all/jars/arpack_combined_all-0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sf.opencsv/opencsv/jars/opencsv-2.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.github.wendykierp/JTransforms/jars/JTransforms-3.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/pl.edu.icm/JLargeArrays/jars/JLargeArrays-1.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.chuusai/shapeless_2.12/bundles/shapeless_2.12-2.3.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/macro-compat_2.12/jars/macro-compat_2.12-1.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/spire_2.12/jars/spire_2.12-0.17.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/spire-macros_2.12/jars/spire-macros_2.12-0.17.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/machinist_2.12/jars/machinist_2.12-0.6.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/algebra_2.12/jars/algebra_2.12-2.0.0-M2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/cats-kernel_2.12/jars/cats-kernel_2.12-2.0.0-M4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/spire-platform_2.12/jars/spire-platform_2.12-0.17.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/spire-util_2.12/jars/spire-util_2.12-0.17.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang.modules/scala-collection-compat_2.12/bundles/scala-collection-compat_2.12-2.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.jpmml/pmml-model/jars/pmml-model-1.4.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jaxb/jaxb-runtime/jars/jaxb-runtime-2.3.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.xml.bind/jakarta.xml.bind-api/jars/jakarta.xml.bind-api-2.3.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.sun.istack/istack-commons-runtime/jars/istack-commons-runtime-3.0.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalatest/scalatest_2.12/bundles/scalatest_2.12-3.0.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalactic/scalactic_2.12/bundles/scalactic_2.12-3.0.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/junit/junit/jars/junit-4.12.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.hamcrest/hamcrest-core/jars/hamcrest-core-1.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.novocode/junit-interface/jars/junit-interface-0.11.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-sbt/test-interface/jars/test-interface-1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.mockito/mockito-core/jars/mockito-core-3.1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.bytebuddy/byte-buddy/jars/byte-buddy-1.9.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.bytebuddy/byte-buddy-agent/jars/byte-buddy-agent-1.9.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.objenesis/objenesis/jars/objenesis-2.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.test-framework.providers/jersey-test-framework-provider-simple/jars/jersey-test-framework-provider-simple-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.test-framework/jersey-test-framework-core/jars/jersey-test-framework-core-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.servlet/jakarta.servlet-api/jars/jakarta.servlet-api-4.0.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.containers/jersey-container-simple-http/jars/jersey-container-simple-http-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.simpleframework/simple-http/jars/simple-http-6.0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.simpleframework/simple-common/jars/simple-common-6.0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.simpleframework/simple-transport/jars/simple-transport-6.0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.derby/derby/jars/derby-10.12.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-java/jars/selenium-java-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-chrome-driver/jars/selenium-chrome-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-remote-driver/jars/selenium-remote-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/cglib/cglib-nodep/jars/cglib-nodep-2.1_3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.code.gson/gson/jars/gson-2.3.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-api/jars/selenium-api-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-exec/jars/commons-exec-1.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.java.dev.jna/jna/jars/jna-4.1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.java.dev.jna/jna-platform/jars/jna-platform-4.1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-edge-driver/jars/selenium-edge-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-htmlunit-driver/jars/selenium-htmlunit-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-support/jars/selenium-support-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.htmlunit/htmlunit/jars/htmlunit-2.22.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xalan/xalan/jars/xalan-2.7.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xalan/serializer/jars/serializer-2.7.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.httpcomponents/httpmime/jars/httpmime-4.5.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.htmlunit/htmlunit-core-js/jars/htmlunit-core-js-2.22.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.htmlunit/neko-htmlunit/jars/neko-htmlunit-2.21.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.cssparser/cssparser/jars/cssparser-0.9.19.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.w3c.css/sac/jars/sac-1.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty.websocket/websocket-client/jars/websocket-client-9.2.17.v20160517.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty.websocket/websocket-common/jars/websocket-common-9.2.17.v20160517.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty.websocket/websocket-api/jars/websocket-api-9.2.17.v20160517.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-firefox-driver/jars/selenium-firefox-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-ie-driver/jars/selenium-ie-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-safari-driver/jars/selenium-safari-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.webbitserver/webbit/jars/webbit-0.4.14.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-leg-rc/jars/selenium-leg-rc-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.hamcrest/hamcrest-library/jars/hamcrest-library-1.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalacheck/scalacheck_2.12/jars/scalacheck_2.12-1.14.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.curator/curator-test/jars/curator-test-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-math/jars/commons-math-2.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-minikdc/jars/hadoop-minikdc-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core-api/jars/apacheds-core-api-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core-constants/bundles/apacheds-core-constants-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-i18n/bundles/api-i18n-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-client-api/bundles/api-ldap-client-api-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-codec-core/bundles/api-ldap-codec-core-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-asn1-ber/bundles/api-asn1-ber-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-model/bundles/api-ldap-model-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.mina/mina-core/bundles/mina-core-2.0.7.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/antlr/antlr/jars/antlr-2.7.7.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-pool/commons-pool/jars/commons-pool-1.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-aci/bundles/api-ldap-extras-aci-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-util/bundles/api-ldap-extras-util-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sf.ehcache/ehcache-core/jars/ehcache-core-2.4.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptor-kerberos/bundles/apacheds-interceptor-kerberos-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core/bundles/apacheds-core-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core-shared/bundles/apacheds-core-shared-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-codec-api/bundles/api-ldap-extras-codec-api-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-admin/bundles/apacheds-interceptors-admin-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-authn/bundles/apacheds-interceptors-authn-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-codec/bundles/api-ldap-extras-codec-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-authz/bundles/apacheds-interceptors-authz-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-changelog/bundles/apacheds-interceptors-changelog-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-collective/bundles/apacheds-interceptors-collective-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-event/bundles/apacheds-interceptors-event-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-exception/bundles/apacheds-interceptors-exception-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-journal/bundles/apacheds-interceptors-journal-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-normalization/bundles/apacheds-interceptors-normalization-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-operational/bundles/apacheds-interceptors-operational-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-referral/bundles/apacheds-interceptors-referral-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-schema/bundles/apacheds-interceptors-schema-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-subtree/bundles/apacheds-interceptors-subtree-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-trigger/bundles/apacheds-interceptors-trigger-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-trigger/bundles/api-ldap-extras-trigger-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/bouncycastle/bcprov-jdk15/jars/bcprov-jdk15-140.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-protocol-shared/bundles/apacheds-protocol-shared-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-protocol-kerberos/bundles/apacheds-protocol-kerberos-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-ldif-partition/bundles/apacheds-ldif-partition-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-xdbm-partition/jars/apacheds-xdbm-partition-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core-avl/bundles/apacheds-core-avl-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-mavibot-partition/jars/apacheds-mavibot-partition-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.mavibot/mavibot/jars/mavibot-1.0.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-all/jars/api-all-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-jdbm-partition/bundles/apacheds-jdbm-partition-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.jdbm/apacheds-jdbm1/bundles/apacheds-jdbm1-2.0.0-M2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-protocol-ldap/bundles/apacheds-protocol-ldap-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-sp/bundles/api-ldap-extras-sp-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.sbt/boot/scala-2.10.7/org.scala-sbt/sbt/0.13.18/test-agent-0.13.18.jar:/home/sparkivy/per-executor-caches/6/.sbt/boot/scala-2.10.7/org.scala-sbt/sbt/0.13.18/test-interface-1.0.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/conf/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/kvstore/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-common/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-shuffle/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-yarn/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/sketch/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/tags/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/unsafe/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/core/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/examples/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/graphx/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/launcher/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/resource-managers/mesos/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/resource-managers/yarn/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/catalyst/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/hive/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/hive-thriftserver/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/streaming/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/kvstore/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-yarn/target/scala-2.12/test-classes:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/sketch/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/unsafe/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/examples/target/scala-2.12/test-classes:/home/jenkins/workspace/NewSparkPullRequestBuilder/graphx/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/resource-managers/mesos/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/resource-managers/yarn/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/catalyst/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/hive/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/hive-thriftserver/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/streaming/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/core/target/jars/*:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib/target/jars/*:/home/jenkins/workspace/NewSparkPullRequestBuilder/assembly/target/scala-2.12/jars/*" "-Xmx1024M" "-Dspark.driver.port=36379" "-Dspark.port.maxRetries=100" "org.apache.spark.executor.CoarseGrainedExecutorBackend" "--driver-url" "spark://CoarseGrainedScheduler@amp-jenkins-worker-06.amp:36379" "--executor-id" "1" "--hostname" "amp-jenkins-worker-06.amp" "--cores" "1" "--app-id" "app-20200803123444-0000" "--worker-url" "spark://Worker@amp-jenkins-worker-06.amp:45396" 20/08/03 12:34:44.770 ExecutorRunner for app-20200803123444-0000/0 INFO ExecutorRunner: Launch command: "/usr/java/jdk1.8.0_191/bin/java" "-cp" "/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/target/scala-2.12/spark-repl_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/core/target/scala-2.12/spark-core_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/launcher/target/scala-2.12/spark-launcher_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/tags/target/scala-2.12/spark-tags_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/kvstore/target/scala-2.12/spark-kvstore_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-common/target/scala-2.12/spark-network-common_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-shuffle/target/scala-2.12/spark-network-shuffle_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/unsafe/target/scala-2.12/spark-unsafe_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/core/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/launcher/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/tags/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-shuffle/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-common/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib/target/scala-2.12/spark-mllib_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/streaming/target/scala-2.12/spark-streaming_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/target/scala-2.12/spark-sql_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/sketch/target/scala-2.12/spark-sketch_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/catalyst/target/scala-2.12/spark-catalyst_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/graphx/target/scala-2.12/spark-graphx_2.12-3.0.1-SNAPSHOT.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib-local/target/scala-2.12/spark-mllib-local_2.12-3.0.1-SNAPSHOT.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.12.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.12.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang/scala-reflect/jars/scala-reflect-2.12.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.spark-project.spark/unused/jars/unused-1.0.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.fusesource.leveldbjni/leveldbjni-all/bundles/leveldbjni-all-1.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.core/jackson-core/bundles/jackson-core-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.core/jackson-databind/bundles/jackson-databind-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.core/jackson-annotations/bundles/jackson-annotations-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.netty/netty-all/jars/netty-all-4.1.47.Final.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-lang3/jars/commons-lang3-3.9.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-core/bundles/metrics-core-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.slf4j/slf4j-api/jars/slf4j-api-1.7.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.guava/guava/bundles/guava-14.0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-crypto/jars/commons-crypto-1.0.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.twitter/chill_2.12/jars/chill_2.12-0.9.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.twitter/chill-java/jars/chill-java-0.9.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.esotericsoftware/kryo-shaded/bundles/kryo-shaded-4.0.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.esotericsoftware/minlog/bundles/minlog-1.3.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.xbean/xbean-asm7-shaded/bundles/xbean-asm7-shaded-4.15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.avro/avro/jars/avro-1.8.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jackson/jackson-core-asl/jars/jackson-core-asl-1.9.13.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jackson/jackson-mapper-asl/jars/jackson-mapper-asl-1.9.13.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.thoughtworks.paranamer/paranamer/bundles/paranamer-2.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.xerial.snappy/snappy-java/bundles/snappy-java-1.1.7.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-compress/jars/commons-compress-1.8.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.tukaani/xz/jars/xz-1.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.avro/avro-mapred/jars/avro-mapred-1.8.2-hadoop2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.avro/avro-ipc/jars/avro-ipc-1.8.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-client/jars/hadoop-client-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-common/jars/hadoop-common-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-annotations/jars/hadoop-annotations-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-cli/commons-cli/jars/commons-cli-1.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-math3/jars/commons-math3-3.4.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xmlenc/xmlenc/jars/xmlenc-0.52.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-httpclient/commons-httpclient/jars/commons-httpclient-3.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-io/commons-io/jars/commons-io-2.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-net/commons-net/jars/commons-net-3.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-collections/commons-collections/jars/commons-collections-3.2.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.mortbay.jetty/jetty-sslengine/jars/jetty-sslengine-6.1.26.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/log4j/log4j/bundles/log4j-1.2.17.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-lang/commons-lang/jars/commons-lang-2.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-configuration/commons-configuration/jars/commons-configuration-1.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-digester/commons-digester/jars/commons-digester-1.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-beanutils/commons-beanutils/jars/commons-beanutils-1.7.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.protobuf/protobuf-java/bundles/protobuf-java-2.5.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-auth/jars/hadoop-auth-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.httpcomponents/httpclient/jars/httpclient-4.5.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.httpcomponents/httpcore/jars/httpcore-4.4.12.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-logging/commons-logging/jars/commons-logging-1.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-codec/commons-codec/jars/commons-codec-1.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-kerberos-codec/bundles/apacheds-kerberos-codec-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-i18n/bundles/apacheds-i18n-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-asn1-api/bundles/api-asn1-api-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-util/bundles/api-util-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.zookeeper/zookeeper/jars/zookeeper-3.4.14.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.slf4j/slf4j-log4j12/jars/slf4j-log4j12-1.7.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.github.spotbugs/spotbugs-annotations/jars/spotbugs-annotations-3.1.9.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.code.findbugs/jsr305/jars/jsr305-3.0.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.yetus/audience-annotations/jars/audience-annotations-0.5.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.netty/netty/bundles/netty-3.10.6.Final.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.curator/curator-framework/bundles/curator-framework-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.curator/curator-client/bundles/curator-client-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.curator/curator-recipes/bundles/curator-recipes-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.htrace/htrace-core/jars/htrace-core-3.1.0-incubating.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/jars/hadoop-hdfs-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.mortbay.jetty/jetty-util/jars/jetty-util-6.1.26.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xerces/xercesImpl/jars/xercesImpl-2.12.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xml-apis/xml-apis/jars/xml-apis-1.4.01.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-app/jars/hadoop-mapreduce-client-app-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-common/jars/hadoop-mapreduce-client-common-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-yarn-common/jars/hadoop-yarn-common-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-yarn-api/jars/hadoop-yarn-api-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.xml.bind/jaxb-api/jars/jaxb-api-2.2.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.xml.stream/stax-api/jars/stax-api-1.0-2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.activation/activation/jars/activation-1.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jackson/jackson-jaxrs/jars/jackson-jaxrs-1.9.13.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jackson/jackson-xc/jars/jackson-xc-1.9.13.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.inject/guice/jars/guice-3.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.inject/javax.inject/jars/javax.inject-1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/aopalliance/aopalliance/jars/aopalliance-1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.sonatype.sisu.inject/cglib/jars/cglib-2.2.1-v20090111.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.jettison/jettison/bundles/jettison-1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.sun.xml.bind/jaxb-impl/jars/jaxb-impl-2.2.3-1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-yarn-client/jars/hadoop-yarn-client-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-core/jars/hadoop-mapreduce-client-core-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-yarn-server-common/jars/hadoop-yarn-server-common-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-shuffle/jars/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-mapreduce-client-jobclient/jars/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.servlet.jsp/jsp-api/jars/jsp-api-2.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-plus/jars/jetty-plus-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-webapp/jars/jetty-webapp-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-xml/jars/jetty-xml-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-util/jars/jetty-util-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-servlet/jars/jetty-servlet-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-security/jars/jetty-security-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-server/jars/jetty-server-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/javax.servlet/javax.servlet-api/jars/javax.servlet-api-3.1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-http/jars/jetty-http-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-io/jars/jetty-io-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-jndi/jars/jetty-jndi-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-continuation/jars/jetty-continuation-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-proxy/jars/jetty-proxy-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-client/jars/jetty-client-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty/jetty-servlets/jars/jetty-servlets-9.4.18.v20190429.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-text/jars/commons-text-1.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.slf4j/jul-to-slf4j/jars/jul-to-slf4j-1.7.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.slf4j/jcl-over-slf4j/jars/jcl-over-slf4j-1.7.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.ning/compress-lzf/bundles/compress-lzf-1.0.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.lz4/lz4-java/jars/lz4-java-1.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.github.luben/zstd-jni/jars/zstd-jni-1.4.4-3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.roaringbitmap/RoaringBitmap/jars/RoaringBitmap-0.7.45.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.roaringbitmap/shims/jars/shims-0.7.45.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang.modules/scala-xml_2.12/bundles/scala-xml_2.12-1.2.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.json4s/json4s-jackson_2.12/jars/json4s-jackson_2.12-3.6.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.json4s/json4s-core_2.12/jars/json4s-core_2.12-3.6.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.json4s/json4s-ast_2.12/jars/json4s-ast_2.12-3.6.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.json4s/json4s-scalap_2.12/jars/json4s-scalap_2.12-3.6.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.core/jersey-client/jars/jersey-client-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.ws.rs/jakarta.ws.rs-api/bundles/jakarta.ws.rs-api-2.1.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.core/jersey-common/jars/jersey-common-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.annotation/jakarta.annotation-api/jars/jakarta.annotation-api-1.3.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2.external/jakarta.inject/jars/jakarta.inject-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2/osgi-resource-locator/jars/osgi-resource-locator-1.0.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.core/jersey-server/jars/jersey-server-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.media/jersey-media-jaxb/jars/jersey-media-jaxb-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.validation/jakarta.validation-api/jars/jakarta.validation-api-2.0.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.containers/jersey-container-servlet/jars/jersey-container-servlet-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.containers/jersey-container-servlet-core/jars/jersey-container-servlet-core-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.inject/jersey-hk2/jars/jersey-hk2-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2/hk2-locator/jars/hk2-locator-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2.external/aopalliance-repackaged/jars/aopalliance-repackaged-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2/hk2-api/jars/hk2-api-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.hk2/hk2-utils/jars/hk2-utils-2.6.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.javassist/javassist/bundles/javassist-3.25.0-GA.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.clearspring.analytics/stream/jars/stream-2.9.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-jvm/bundles/metrics-jvm-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-json/bundles/metrics-json-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-graphite/bundles/metrics-graphite-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.dropwizard.metrics/metrics-jmx/bundles/metrics-jmx-4.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.module/jackson-module-scala_2.12/bundles/jackson-module-scala_2.12-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.fasterxml.jackson.module/jackson-module-paranamer/bundles/jackson-module-paranamer-2.10.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.ivy/ivy/jars/ivy-2.4.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/oro/oro/jars/oro-2.0.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.razorvine/pyrolite/jars/pyrolite-4.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sf.py4j/py4j/jars/py4j-0.10.9.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang.modules/scala-parser-combinators_2.12/bundles/scala-parser-combinators_2.12-1.1.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.janino/janino/jars/janino-3.0.16.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.codehaus.janino/commons-compiler/jars/commons-compiler-3.0.16.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.antlr/antlr4-runtime/jars/antlr4-runtime-4.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.univocity/univocity-parsers/jars/univocity-parsers-2.8.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.arrow/arrow-vector/jars/arrow-vector-0.15.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.arrow/arrow-format/jars/arrow-format-0.15.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.flatbuffers/flatbuffers-java/bundles/flatbuffers-java-1.9.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.arrow/arrow-memory/jars/arrow-memory-0.15.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.orc/orc-core/jars/orc-core-1.5.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.orc/orc-shims/jars/orc-shims-1.5.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/io.airlift/aircompressor/jars/aircompressor-0.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.threeten/threeten-extra/jars/threeten-extra-1.5.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.orc/orc-mapreduce/jars/orc-mapreduce-1.5.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hive/hive-storage-api/jars/hive-storage-api-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-column/jars/parquet-column-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-common/jars/parquet-common-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-format/jars/parquet-format-2.4.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-encoding/jars/parquet-encoding-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-hadoop/jars/parquet-hadoop-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.parquet/parquet-jackson/jars/parquet-jackson-1.10.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalanlp/breeze_2.12/jars/breeze_2.12-1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalanlp/breeze-macros_2.12/jars/breeze-macros_2.12-1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.github.fommil.netlib/core/jars/core-1.1.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.f2j/arpack_combined_all/jars/arpack_combined_all-0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sf.opencsv/opencsv/jars/opencsv-2.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.github.wendykierp/JTransforms/jars/JTransforms-3.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/pl.edu.icm/JLargeArrays/jars/JLargeArrays-1.5.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.chuusai/shapeless_2.12/bundles/shapeless_2.12-2.3.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/macro-compat_2.12/jars/macro-compat_2.12-1.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/spire_2.12/jars/spire_2.12-0.17.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/spire-macros_2.12/jars/spire-macros_2.12-0.17.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/machinist_2.12/jars/machinist_2.12-0.6.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/algebra_2.12/jars/algebra_2.12-2.0.0-M2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/cats-kernel_2.12/jars/cats-kernel_2.12-2.0.0-M4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/spire-platform_2.12/jars/spire-platform_2.12-0.17.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.typelevel/spire-util_2.12/jars/spire-util_2.12-0.17.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-lang.modules/scala-collection-compat_2.12/bundles/scala-collection-compat_2.12-2.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.jpmml/pmml-model/jars/pmml-model-1.4.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jaxb/jaxb-runtime/jars/jaxb-runtime-2.3.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.xml.bind/jakarta.xml.bind-api/jars/jakarta.xml.bind-api-2.3.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.sun.istack/istack-commons-runtime/jars/istack-commons-runtime-3.0.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalatest/scalatest_2.12/bundles/scalatest_2.12-3.0.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalactic/scalactic_2.12/bundles/scalactic_2.12-3.0.8.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/junit/junit/jars/junit-4.12.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.hamcrest/hamcrest-core/jars/hamcrest-core-1.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.novocode/junit-interface/jars/junit-interface-0.11.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scala-sbt/test-interface/jars/test-interface-1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.mockito/mockito-core/jars/mockito-core-3.1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.bytebuddy/byte-buddy/jars/byte-buddy-1.9.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.bytebuddy/byte-buddy-agent/jars/byte-buddy-agent-1.9.10.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.objenesis/objenesis/jars/objenesis-2.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.test-framework.providers/jersey-test-framework-provider-simple/jars/jersey-test-framework-provider-simple-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.test-framework/jersey-test-framework-core/jars/jersey-test-framework-core-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/jakarta.servlet/jakarta.servlet-api/jars/jakarta.servlet-api-4.0.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.glassfish.jersey.containers/jersey-container-simple-http/jars/jersey-container-simple-http-2.30.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.simpleframework/simple-http/jars/simple-http-6.0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.simpleframework/simple-common/jars/simple-common-6.0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.simpleframework/simple-transport/jars/simple-transport-6.0.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.derby/derby/jars/derby-10.12.1.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-java/jars/selenium-java-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-chrome-driver/jars/selenium-chrome-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-remote-driver/jars/selenium-remote-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/cglib/cglib-nodep/jars/cglib-nodep-2.1_3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/com.google.code.gson/gson/jars/gson-2.3.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-api/jars/selenium-api-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-exec/jars/commons-exec-1.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.java.dev.jna/jna/jars/jna-4.1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.java.dev.jna/jna-platform/jars/jna-platform-4.1.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-edge-driver/jars/selenium-edge-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-htmlunit-driver/jars/selenium-htmlunit-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-support/jars/selenium-support-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.htmlunit/htmlunit/jars/htmlunit-2.22.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xalan/xalan/jars/xalan-2.7.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/xalan/serializer/jars/serializer-2.7.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.httpcomponents/httpmime/jars/httpmime-4.5.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.htmlunit/htmlunit-core-js/jars/htmlunit-core-js-2.22.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.htmlunit/neko-htmlunit/jars/neko-htmlunit-2.21.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sourceforge.cssparser/cssparser/jars/cssparser-0.9.19.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.w3c.css/sac/jars/sac-1.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty.websocket/websocket-client/jars/websocket-client-9.2.17.v20160517.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty.websocket/websocket-common/jars/websocket-common-9.2.17.v20160517.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.eclipse.jetty.websocket/websocket-api/jars/websocket-api-9.2.17.v20160517.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-firefox-driver/jars/selenium-firefox-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-ie-driver/jars/selenium-ie-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-safari-driver/jars/selenium-safari-driver-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.webbitserver/webbit/jars/webbit-0.4.14.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.seleniumhq.selenium/selenium-leg-rc/jars/selenium-leg-rc-2.52.0.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.hamcrest/hamcrest-library/jars/hamcrest-library-1.3.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.scalacheck/scalacheck_2.12/jars/scalacheck_2.12-1.14.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.curator/curator-test/jars/curator-test-2.7.1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.commons/commons-math/jars/commons-math-2.2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.hadoop/hadoop-minikdc/jars/hadoop-minikdc-2.7.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core-api/jars/apacheds-core-api-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core-constants/bundles/apacheds-core-constants-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-i18n/bundles/api-i18n-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-client-api/bundles/api-ldap-client-api-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-codec-core/bundles/api-ldap-codec-core-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-asn1-ber/bundles/api-asn1-ber-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-model/bundles/api-ldap-model-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.mina/mina-core/bundles/mina-core-2.0.7.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/antlr/antlr/jars/antlr-2.7.7.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/commons-pool/commons-pool/jars/commons-pool-1.6.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-aci/bundles/api-ldap-extras-aci-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-util/bundles/api-ldap-extras-util-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/net.sf.ehcache/ehcache-core/jars/ehcache-core-2.4.4.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptor-kerberos/bundles/apacheds-interceptor-kerberos-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core/bundles/apacheds-core-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core-shared/bundles/apacheds-core-shared-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-codec-api/bundles/api-ldap-extras-codec-api-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-admin/bundles/apacheds-interceptors-admin-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-authn/bundles/apacheds-interceptors-authn-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-codec/bundles/api-ldap-extras-codec-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-authz/bundles/apacheds-interceptors-authz-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-changelog/bundles/apacheds-interceptors-changelog-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-collective/bundles/apacheds-interceptors-collective-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-event/bundles/apacheds-interceptors-event-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-exception/bundles/apacheds-interceptors-exception-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-journal/bundles/apacheds-interceptors-journal-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-normalization/bundles/apacheds-interceptors-normalization-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-operational/bundles/apacheds-interceptors-operational-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-referral/bundles/apacheds-interceptors-referral-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-schema/bundles/apacheds-interceptors-schema-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-subtree/bundles/apacheds-interceptors-subtree-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-interceptors-trigger/bundles/apacheds-interceptors-trigger-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-trigger/bundles/api-ldap-extras-trigger-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/bouncycastle/bcprov-jdk15/jars/bcprov-jdk15-140.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-protocol-shared/bundles/apacheds-protocol-shared-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-protocol-kerberos/bundles/apacheds-protocol-kerberos-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-ldif-partition/bundles/apacheds-ldif-partition-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-xdbm-partition/jars/apacheds-xdbm-partition-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-core-avl/bundles/apacheds-core-avl-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-mavibot-partition/jars/apacheds-mavibot-partition-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.mavibot/mavibot/jars/mavibot-1.0.0-M1.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-all/jars/api-all-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-jdbm-partition/bundles/apacheds-jdbm-partition-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.jdbm/apacheds-jdbm1/bundles/apacheds-jdbm1-2.0.0-M2.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.server/apacheds-protocol-ldap/bundles/apacheds-protocol-ldap-2.0.0-M15.jar:/home/sparkivy/per-executor-caches/6/.ivy2/cache/org.apache.directory.api/api-ldap-extras-sp/bundles/api-ldap-extras-sp-1.0.0-M20.jar:/home/sparkivy/per-executor-caches/6/.sbt/boot/scala-2.10.7/org.scala-sbt/sbt/0.13.18/test-agent-0.13.18.jar:/home/sparkivy/per-executor-caches/6/.sbt/boot/scala-2.10.7/org.scala-sbt/sbt/0.13.18/test-interface-1.0.jar:/home/jenkins/workspace/NewSparkPullRequestBuilder/conf/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/kvstore/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-common/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-shuffle/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-yarn/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/sketch/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/tags/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/unsafe/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/core/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/examples/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/graphx/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/launcher/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/resource-managers/mesos/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/resource-managers/yarn/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/catalyst/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/hive/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/hive-thriftserver/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/streaming/target/scala-2.12/classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/kvstore/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/network-yarn/target/scala-2.12/test-classes:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/sketch/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/common/unsafe/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/examples/target/scala-2.12/test-classes:/home/jenkins/workspace/NewSparkPullRequestBuilder/graphx/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/resource-managers/mesos/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/resource-managers/yarn/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/catalyst/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/core/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/hive/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/sql/hive-thriftserver/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/streaming/target/scala-2.12/test-classes/:/home/jenkins/workspace/NewSparkPullRequestBuilder/core/target/jars/*:/home/jenkins/workspace/NewSparkPullRequestBuilder/mllib/target/jars/*:/home/jenkins/workspace/NewSparkPullRequestBuilder/assembly/target/scala-2.12/jars/*" "-Xmx1024M" "-Dspark.driver.port=36379" "-Dspark.port.maxRetries=100" "org.apache.spark.executor.CoarseGrainedExecutorBackend" "--driver-url" "spark://CoarseGrainedScheduler@amp-jenkins-worker-06.amp:36379" "--executor-id" "0" "--hostname" "amp-jenkins-worker-06.amp" "--cores" "1" "--app-id" "app-20200803123444-0000" "--worker-url" "spark://Worker@amp-jenkins-worker-06.amp:34141" 20/08/03 12:34:44.775 dispatcher-event-loop-23 INFO StandaloneAppClient$ClientEndpoint: Executor updated: app-20200803123444-0000/1 is now RUNNING 20/08/03 12:34:44.784 dispatcher-event-loop-24 INFO StandaloneAppClient$ClientEndpoint: Executor updated: app-20200803123444-0000/0 is now RUNNING 20/08/03 12:34:46.215 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'simple foreach with accumulator' ===== 20/08/03 12:34:46.611 Thread-146 INFO SparkContext: Starting job: foreach at :27 20/08/03 12:34:46.613 dag-scheduler-event-loop INFO DAGScheduler: Got job 0 (foreach at :27) with 2 output partitions 20/08/03 12:34:46.613 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 0 (foreach at :27) 20/08/03 12:34:46.613 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:46.613 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:46.613 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 0 (ParallelCollectionRDD[0] at parallelize at :27), which has no missing parents 20/08/03 12:34:46.617 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 4.7 KiB, free 2.1 GiB) 20/08/03 12:34:46.621 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 2.1 GiB) 20/08/03 12:34:46.621 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 2.4 KiB, free: 2.1 GiB) 20/08/03 12:34:46.622 dag-scheduler-event-loop INFO SparkContext: Created broadcast 0 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:46.623 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 0 (ParallelCollectionRDD[0] at parallelize at :27) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:34:46.623 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 0.0 with 2 tasks 20/08/03 12:34:47.913 dispatcher-CoarseGrainedScheduler INFO CoarseGrainedSchedulerBackend$DriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (192.168.10.26:43682) with ID 1 20/08/03 12:34:48.025 dispatcher-CoarseGrainedScheduler INFO CoarseGrainedSchedulerBackend$DriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (192.168.10.26:43684) with ID 0 20/08/03 12:34:48.039 dispatcher-BlockManagerMaster INFO BlockManagerMasterEndpoint: Registering block manager amp-jenkins-worker-06.amp:34884 with 546.3 MiB RAM, BlockManagerId(1, amp-jenkins-worker-06.amp, 34884, None) 20/08/03 12:34:48.079 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, amp-jenkins-worker-06.amp, executor 1, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:34:48.163 dispatcher-BlockManagerMaster INFO BlockManagerMasterEndpoint: Registering block manager amp-jenkins-worker-06.amp:39306 with 546.3 MiB RAM, BlockManagerId(0, amp-jenkins-worker-06.amp, 39306, None) 20/08/03 12:34:48.201 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 0.0 (TID 1, amp-jenkins-worker-06.amp, executor 0, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:34:48.304 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 2.4 KiB, free: 546.3 MiB) 20/08/03 12:34:48.496 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 2.4 KiB, free: 546.3 MiB) 20/08/03 12:34:49.080 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 1002 ms on amp-jenkins-worker-06.amp (executor 1) (1/2) 20/08/03 12:34:49.243 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 0.0 (TID 1) in 1042 ms on amp-jenkins-worker-06.amp (executor 0) (2/2) 20/08/03 12:34:49.243 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 20/08/03 12:34:49.244 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 0 (foreach at :27) finished in 2.630 s 20/08/03 12:34:49.244 dag-scheduler-event-loop INFO DAGScheduler: Job 0 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:49.244 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 0: Stage finished 20/08/03 12:34:49.244 Thread-146 INFO DAGScheduler: Job 0 finished: foreach at :27, took 2.633141 s 20/08/03 12:34:49.726 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'simple foreach with accumulator' ===== 20/08/03 12:34:49.727 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'external vars' ===== 20/08/03 12:34:50.028 Thread-146 INFO SparkContext: Starting job: collect at :26 20/08/03 12:34:50.029 dag-scheduler-event-loop INFO DAGScheduler: Got job 1 (collect at :26) with 2 output partitions 20/08/03 12:34:50.029 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 1 (collect at :26) 20/08/03 12:34:50.029 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:50.029 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:50.029 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[2] at map at :26), which has no missing parents 20/08/03 12:34:50.033 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 5.1 KiB, free 2.1 GiB) 20/08/03 12:34:50.035 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.6 KiB, free 2.1 GiB) 20/08/03 12:34:50.036 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 2.6 KiB, free: 2.1 GiB) 20/08/03 12:34:50.036 dag-scheduler-event-loop INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:50.037 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 1 (MapPartitionsRDD[2] at map at :26) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:34:50.037 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 1.0 with 2 tasks 20/08/03 12:34:50.039 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 2, amp-jenkins-worker-06.amp, executor 1, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:34:50.039 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 1.0 (TID 3, amp-jenkins-worker-06.amp, executor 0, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:34:50.068 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 2.6 KiB, free: 546.3 MiB) 20/08/03 12:34:50.071 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 2.6 KiB, free: 546.3 MiB) 20/08/03 12:34:50.181 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 1.0 (TID 3) in 141 ms on amp-jenkins-worker-06.amp (executor 0) (1/2) 20/08/03 12:34:50.185 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 2) in 147 ms on amp-jenkins-worker-06.amp (executor 1) (2/2) 20/08/03 12:34:50.185 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool 20/08/03 12:34:50.185 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 1 (collect at :26) finished in 0.154 s 20/08/03 12:34:50.186 dag-scheduler-event-loop INFO DAGScheduler: Job 1 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:50.186 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 1: Stage finished 20/08/03 12:34:50.186 Thread-146 INFO DAGScheduler: Job 1 finished: collect at :26, took 0.157826 s 20/08/03 12:34:50.606 Thread-146 INFO SparkContext: Starting job: collect at :26 20/08/03 12:34:50.607 dag-scheduler-event-loop INFO DAGScheduler: Got job 2 (collect at :26) with 2 output partitions 20/08/03 12:34:50.608 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 2 (collect at :26) 20/08/03 12:34:50.608 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:50.608 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:50.609 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 2 (MapPartitionsRDD[4] at map at :26), which has no missing parents 20/08/03 12:34:50.611 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 5.1 KiB, free 2.1 GiB) 20/08/03 12:34:50.614 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.6 KiB, free 2.1 GiB) 20/08/03 12:34:50.615 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 2.6 KiB, free: 2.1 GiB) 20/08/03 12:34:50.616 dag-scheduler-event-loop INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:50.616 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 2 (MapPartitionsRDD[4] at map at :26) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:34:50.616 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 2.0 with 2 tasks 20/08/03 12:34:50.617 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 2.0 (TID 4, amp-jenkins-worker-06.amp, executor 0, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:34:50.618 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 2.0 (TID 5, amp-jenkins-worker-06.amp, executor 1, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:34:50.644 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 2.6 KiB, free: 546.3 MiB) 20/08/03 12:34:50.645 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 2.6 KiB, free: 546.3 MiB) 20/08/03 12:34:50.703 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 2.0 (TID 4) in 86 ms on amp-jenkins-worker-06.amp (executor 0) (1/2) 20/08/03 12:34:50.706 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 2.0 (TID 5) in 88 ms on amp-jenkins-worker-06.amp (executor 1) (2/2) 20/08/03 12:34:50.706 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 2.0, whose tasks have all completed, from pool 20/08/03 12:34:50.707 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 2 (collect at :26) finished in 0.096 s 20/08/03 12:34:50.707 dag-scheduler-event-loop INFO DAGScheduler: Job 2 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:50.707 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 2: Stage finished 20/08/03 12:34:50.707 Thread-146 INFO DAGScheduler: Job 2 finished: collect at :26, took 0.100425 s 20/08/03 12:34:51.235 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'external vars' ===== 20/08/03 12:34:51.236 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'external classes' ===== 20/08/03 12:34:51.514 Thread-146 INFO SparkContext: Starting job: collect at :25 20/08/03 12:34:51.515 dag-scheduler-event-loop INFO DAGScheduler: Got job 3 (collect at :25) with 2 output partitions 20/08/03 12:34:51.515 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 3 (collect at :25) 20/08/03 12:34:51.515 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:51.515 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:51.518 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 3 (MapPartitionsRDD[6] at map at :25), which has no missing parents 20/08/03 12:34:51.520 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 3.1 KiB, free 2.1 GiB) 20/08/03 12:34:51.522 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 1807.0 B, free 2.1 GiB) 20/08/03 12:34:51.523 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 1807.0 B, free: 2.1 GiB) 20/08/03 12:34:51.523 dag-scheduler-event-loop INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:51.524 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 3 (MapPartitionsRDD[6] at map at :25) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:34:51.524 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 3.0 with 2 tasks 20/08/03 12:34:51.525 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 6, amp-jenkins-worker-06.amp, executor 1, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:34:51.525 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 3.0 (TID 7, amp-jenkins-worker-06.amp, executor 0, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:34:51.540 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 1807.0 B, free: 546.3 MiB) 20/08/03 12:34:51.541 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 1807.0 B, free: 546.3 MiB) 20/08/03 12:34:51.576 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 3.0 (TID 7) in 51 ms on amp-jenkins-worker-06.amp (executor 0) (1/2) 20/08/03 12:34:51.576 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 6) in 51 ms on amp-jenkins-worker-06.amp (executor 1) (2/2) 20/08/03 12:34:51.576 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool 20/08/03 12:34:51.577 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 3 (collect at :25) finished in 0.058 s 20/08/03 12:34:51.577 dag-scheduler-event-loop INFO DAGScheduler: Job 3 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:51.577 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 3: Stage finished 20/08/03 12:34:51.577 Thread-146 INFO DAGScheduler: Job 3 finished: collect at :25, took 0.063189 s 20/08/03 12:34:51.741 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'external classes' ===== 20/08/03 12:34:51.742 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'external functions' ===== 20/08/03 12:34:52.047 Thread-146 INFO SparkContext: Starting job: collect at :26 20/08/03 12:34:52.048 dag-scheduler-event-loop INFO DAGScheduler: Got job 4 (collect at :26) with 2 output partitions 20/08/03 12:34:52.048 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 4 (collect at :26) 20/08/03 12:34:52.048 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:52.049 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:52.049 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 4 (MapPartitionsRDD[8] at map at :26), which has no missing parents 20/08/03 12:34:52.053 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 5.1 KiB, free 2.1 GiB) 20/08/03 12:34:52.056 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 2.6 KiB, free 2.1 GiB) 20/08/03 12:34:52.057 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 2.6 KiB, free: 2.1 GiB) 20/08/03 12:34:52.058 dag-scheduler-event-loop INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:52.059 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 4 (MapPartitionsRDD[8] at map at :26) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:34:52.059 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 4.0 with 2 tasks 20/08/03 12:34:52.061 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 4.0 (TID 8, amp-jenkins-worker-06.amp, executor 1, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:34:52.061 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 4.0 (TID 9, amp-jenkins-worker-06.amp, executor 0, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:34:52.079 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 2.6 KiB, free: 546.3 MiB) 20/08/03 12:34:52.080 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 2.6 KiB, free: 546.3 MiB) 20/08/03 12:34:52.167 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 4.0 (TID 9) in 106 ms on amp-jenkins-worker-06.amp (executor 0) (1/2) 20/08/03 12:34:52.179 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 4.0 (TID 8) in 119 ms on amp-jenkins-worker-06.amp (executor 1) (2/2) 20/08/03 12:34:52.179 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 4.0, whose tasks have all completed, from pool 20/08/03 12:34:52.180 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 4 (collect at :26) finished in 0.129 s 20/08/03 12:34:52.180 dag-scheduler-event-loop INFO DAGScheduler: Job 4 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:52.180 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 4: Stage finished 20/08/03 12:34:52.181 Thread-146 INFO DAGScheduler: Job 4 finished: collect at :26, took 0.133150 s 20/08/03 12:34:52.755 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'external functions' ===== 20/08/03 12:34:52.756 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'external functions that access vars' ===== 20/08/03 12:34:53.240 Thread-146 INFO SparkContext: Starting job: collect at :26 20/08/03 12:34:53.241 dag-scheduler-event-loop INFO DAGScheduler: Got job 5 (collect at :26) with 2 output partitions 20/08/03 12:34:53.241 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 5 (collect at :26) 20/08/03 12:34:53.241 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:53.241 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:53.242 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 5 (MapPartitionsRDD[10] at map at :26), which has no missing parents 20/08/03 12:34:53.245 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 6.0 KiB, free 2.1 GiB) 20/08/03 12:34:53.249 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 2.9 KiB, free 2.1 GiB) 20/08/03 12:34:53.249 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 2.9 KiB, free: 2.1 GiB) 20/08/03 12:34:53.250 dag-scheduler-event-loop INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:53.251 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 5 (MapPartitionsRDD[10] at map at :26) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:34:53.251 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 5.0 with 2 tasks 20/08/03 12:34:53.253 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 10, amp-jenkins-worker-06.amp, executor 1, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:34:53.253 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 5.0 (TID 11, amp-jenkins-worker-06.amp, executor 0, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:34:53.267 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 2.9 KiB, free: 546.3 MiB) 20/08/03 12:34:53.272 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 2.9 KiB, free: 546.3 MiB) 20/08/03 12:34:53.389 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 5.0 (TID 11) in 136 ms on amp-jenkins-worker-06.amp (executor 0) (1/2) 20/08/03 12:34:53.400 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 10) in 147 ms on amp-jenkins-worker-06.amp (executor 1) (2/2) 20/08/03 12:34:53.400 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 20/08/03 12:34:53.400 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 5 (collect at :26) finished in 0.157 s 20/08/03 12:34:53.401 dag-scheduler-event-loop INFO DAGScheduler: Job 5 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:53.401 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 5: Stage finished 20/08/03 12:34:53.401 Thread-146 INFO DAGScheduler: Job 5 finished: collect at :26, took 0.160287 s 20/08/03 12:34:53.776 Thread-146 INFO SparkContext: Starting job: collect at :26 20/08/03 12:34:53.777 dag-scheduler-event-loop INFO DAGScheduler: Got job 6 (collect at :26) with 2 output partitions 20/08/03 12:34:53.777 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 6 (collect at :26) 20/08/03 12:34:53.778 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:53.778 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:53.779 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 6 (MapPartitionsRDD[12] at map at :26), which has no missing parents 20/08/03 12:34:53.782 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 6.0 KiB, free 2.1 GiB) 20/08/03 12:34:53.785 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 2.9 KiB, free 2.1 GiB) 20/08/03 12:34:53.786 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 2.9 KiB, free: 2.1 GiB) 20/08/03 12:34:53.787 dag-scheduler-event-loop INFO SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:53.788 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 6 (MapPartitionsRDD[12] at map at :26) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:34:53.788 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 6.0 with 2 tasks 20/08/03 12:34:53.789 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 6.0 (TID 12, amp-jenkins-worker-06.amp, executor 0, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:34:53.789 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 6.0 (TID 13, amp-jenkins-worker-06.amp, executor 1, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:34:53.802 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 2.9 KiB, free: 546.3 MiB) 20/08/03 12:34:53.804 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 2.9 KiB, free: 546.3 MiB) 20/08/03 12:34:53.837 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 6.0 (TID 13) in 48 ms on amp-jenkins-worker-06.amp (executor 1) (1/2) 20/08/03 12:34:53.844 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 6.0 (TID 12) in 55 ms on amp-jenkins-worker-06.amp (executor 0) (2/2) 20/08/03 12:34:53.844 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 6.0, whose tasks have all completed, from pool 20/08/03 12:34:53.845 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 6 (collect at :26) finished in 0.065 s 20/08/03 12:34:53.845 dag-scheduler-event-loop INFO DAGScheduler: Job 6 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:53.845 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 6: Stage finished 20/08/03 12:34:53.846 Thread-146 INFO DAGScheduler: Job 6 finished: collect at :26, took 0.068799 s 20/08/03 12:34:54.270 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'external functions that access vars' ===== 20/08/03 12:34:54.272 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'broadcast vars' ===== 20/08/03 12:34:54.512 Thread-146 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 64.0 B, free 2.1 GiB) 20/08/03 12:34:54.514 Thread-146 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 80.0 B, free 2.1 GiB) 20/08/03 12:34:54.515 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_7_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 80.0 B, free: 2.1 GiB) 20/08/03 12:34:54.515 Thread-146 INFO SparkContext: Created broadcast 7 from broadcast at :26 20/08/03 12:34:54.659 Thread-146 INFO SparkContext: Starting job: collect at :26 20/08/03 12:34:54.660 dag-scheduler-event-loop INFO DAGScheduler: Got job 7 (collect at :26) with 2 output partitions 20/08/03 12:34:54.660 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 7 (collect at :26) 20/08/03 12:34:54.660 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:54.660 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:54.662 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 7 (MapPartitionsRDD[14] at map at :26), which has no missing parents 20/08/03 12:34:54.664 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 6.6 KiB, free 2.1 GiB) 20/08/03 12:34:54.666 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 20/08/03 12:34:54.667 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_8_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 3.3 KiB, free: 2.1 GiB) 20/08/03 12:34:54.668 dag-scheduler-event-loop INFO SparkContext: Created broadcast 8 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:54.668 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 7 (MapPartitionsRDD[14] at map at :26) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:34:54.668 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 7.0 with 2 tasks 20/08/03 12:34:54.669 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 14, amp-jenkins-worker-06.amp, executor 0, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:34:54.670 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 7.0 (TID 15, amp-jenkins-worker-06.amp, executor 1, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:34:54.682 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_8_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 3.3 KiB, free: 546.3 MiB) 20/08/03 12:34:54.683 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_8_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 3.3 KiB, free: 546.3 MiB) 20/08/03 12:34:54.761 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_7_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 80.0 B, free: 546.3 MiB) 20/08/03 12:34:54.768 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 14) in 99 ms on amp-jenkins-worker-06.amp (executor 0) (1/2) 20/08/03 12:34:54.791 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_7_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 80.0 B, free: 546.3 MiB) 20/08/03 12:34:54.802 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 7.0 (TID 15) in 132 ms on amp-jenkins-worker-06.amp (executor 1) (2/2) 20/08/03 12:34:54.802 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 7.0, whose tasks have all completed, from pool 20/08/03 12:34:54.803 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 7 (collect at :26) finished in 0.141 s 20/08/03 12:34:54.803 dag-scheduler-event-loop INFO DAGScheduler: Job 7 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:54.803 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 7: Stage finished 20/08/03 12:34:54.804 Thread-146 INFO DAGScheduler: Job 7 finished: collect at :26, took 0.144253 s 20/08/03 12:34:55.017 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_2_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 2.6 KiB, free: 2.1 GiB) 20/08/03 12:34:55.025 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_2_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 2.6 KiB, free: 546.3 MiB) 20/08/03 12:34:55.027 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_2_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 2.6 KiB, free: 546.3 MiB) 20/08/03 12:34:55.038 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_1_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 2.6 KiB, free: 2.1 GiB) 20/08/03 12:34:55.041 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_1_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 2.6 KiB, free: 546.3 MiB) 20/08/03 12:34:55.041 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_1_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 2.6 KiB, free: 546.3 MiB) 20/08/03 12:34:55.050 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_0_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 2.4 KiB, free: 2.1 GiB) 20/08/03 12:34:55.051 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_0_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 2.4 KiB, free: 546.3 MiB) 20/08/03 12:34:55.052 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_0_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 2.4 KiB, free: 546.3 MiB) 20/08/03 12:34:55.061 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_8_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 3.3 KiB, free: 2.1 GiB) 20/08/03 12:34:55.063 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_8_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 3.3 KiB, free: 546.3 MiB) 20/08/03 12:34:55.063 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_8_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 3.3 KiB, free: 546.3 MiB) 20/08/03 12:34:55.069 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_3_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 1807.0 B, free: 2.1 GiB) 20/08/03 12:34:55.071 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_3_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 1807.0 B, free: 546.3 MiB) 20/08/03 12:34:55.071 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_3_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 1807.0 B, free: 546.3 MiB) 20/08/03 12:34:55.078 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_6_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 2.9 KiB, free: 2.1 GiB) 20/08/03 12:34:55.079 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_6_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 2.9 KiB, free: 546.3 MiB) 20/08/03 12:34:55.080 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_6_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 2.9 KiB, free: 546.3 MiB) 20/08/03 12:34:55.087 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_5_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 2.9 KiB, free: 2.1 GiB) 20/08/03 12:34:55.090 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_5_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 2.9 KiB, free: 546.3 MiB) 20/08/03 12:34:55.090 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_5_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 2.9 KiB, free: 546.3 MiB) 20/08/03 12:34:55.098 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_4_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 2.6 KiB, free: 2.1 GiB) 20/08/03 12:34:55.099 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_4_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 2.6 KiB, free: 546.3 MiB) 20/08/03 12:34:55.099 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_4_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 2.6 KiB, free: 546.3 MiB) 20/08/03 12:34:55.141 Thread-146 INFO SparkContext: Starting job: collect at :26 20/08/03 12:34:55.142 dag-scheduler-event-loop INFO DAGScheduler: Got job 8 (collect at :26) with 2 output partitions 20/08/03 12:34:55.142 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 8 (collect at :26) 20/08/03 12:34:55.142 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:55.142 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:55.142 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 8 (MapPartitionsRDD[16] at map at :26), which has no missing parents 20/08/03 12:34:55.146 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 6.6 KiB, free 2.1 GiB) 20/08/03 12:34:55.149 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 20/08/03 12:34:55.150 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_9_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 3.3 KiB, free: 2.1 GiB) 20/08/03 12:34:55.150 dag-scheduler-event-loop INFO SparkContext: Created broadcast 9 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:55.151 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 8 (MapPartitionsRDD[16] at map at :26) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:34:55.151 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 8.0 with 2 tasks 20/08/03 12:34:55.152 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 8.0 (TID 16, amp-jenkins-worker-06.amp, executor 0, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:34:55.152 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 8.0 (TID 17, amp-jenkins-worker-06.amp, executor 1, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:34:55.167 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_9_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 3.3 KiB, free: 546.3 MiB) 20/08/03 12:34:55.167 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_9_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 3.3 KiB, free: 546.3 MiB) 20/08/03 12:34:55.208 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 8.0 (TID 17) in 56 ms on amp-jenkins-worker-06.amp (executor 1) (1/2) 20/08/03 12:34:55.213 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 8.0 (TID 16) in 61 ms on amp-jenkins-worker-06.amp (executor 0) (2/2) 20/08/03 12:34:55.213 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 8.0, whose tasks have all completed, from pool 20/08/03 12:34:55.214 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 8 (collect at :26) finished in 0.069 s 20/08/03 12:34:55.214 dag-scheduler-event-loop INFO DAGScheduler: Job 8 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:55.214 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 8: Stage finished 20/08/03 12:34:55.214 Thread-146 INFO DAGScheduler: Job 8 finished: collect at :26, took 0.072657 s 20/08/03 12:34:55.778 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'broadcast vars' ===== 20/08/03 12:34:55.779 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'interacting with files' ===== 20/08/03 12:34:55.969 Thread-146 INFO MemoryStore: Block broadcast_10 stored as values in memory (estimated size 241.5 KiB, free 2.1 GiB) 20/08/03 12:34:56.007 Thread-146 INFO MemoryStore: Block broadcast_10_piece0 stored as bytes in memory (estimated size 23.4 KiB, free 2.1 GiB) 20/08/03 12:34:56.007 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_10_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 23.4 KiB, free: 2.1 GiB) 20/08/03 12:34:56.008 Thread-146 INFO SparkContext: Created broadcast 10 from textFile at :24 20/08/03 12:34:56.205 Thread-146 INFO FileInputFormat: Total input paths to process : 1 20/08/03 12:34:56.221 Thread-146 INFO SparkContext: Starting job: count at :25 20/08/03 12:34:56.223 dag-scheduler-event-loop INFO DAGScheduler: Got job 9 (count at :25) with 2 output partitions 20/08/03 12:34:56.223 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 9 (count at :25) 20/08/03 12:34:56.223 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:56.226 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:56.226 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 9 (/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-6ec00715-4e34-45de-ae8b-fe0c4b3c2794/input MapPartitionsRDD[18] at textFile at :24), which has no missing parents 20/08/03 12:34:56.237 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_11 stored as values in memory (estimated size 4.1 KiB, free 2.1 GiB) 20/08/03 12:34:56.240 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_11_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 2.1 GiB) 20/08/03 12:34:56.241 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_11_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 2.4 KiB, free: 2.1 GiB) 20/08/03 12:34:56.241 dag-scheduler-event-loop INFO SparkContext: Created broadcast 11 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:56.242 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 9 (/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-6ec00715-4e34-45de-ae8b-fe0c4b3c2794/input MapPartitionsRDD[18] at textFile at :24) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:34:56.242 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 9.0 with 2 tasks 20/08/03 12:34:56.252 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 9.0 (TID 18, amp-jenkins-worker-06.amp, executor 0, partition 0, PROCESS_LOCAL, 7460 bytes) 20/08/03 12:34:56.253 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 9.0 (TID 19, amp-jenkins-worker-06.amp, executor 1, partition 1, PROCESS_LOCAL, 7460 bytes) 20/08/03 12:34:56.284 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_11_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 2.4 KiB, free: 546.3 MiB) 20/08/03 12:34:56.287 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_11_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 2.4 KiB, free: 546.3 MiB) 20/08/03 12:34:56.320 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_10_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 23.4 KiB, free: 546.3 MiB) 20/08/03 12:34:56.325 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_10_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 23.4 KiB, free: 546.3 MiB) 20/08/03 12:34:56.633 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_18_1 in memory on amp-jenkins-worker-06.amp:34884 (size: 80.0 B, free: 546.3 MiB) 20/08/03 12:34:56.647 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 9.0 (TID 19) in 395 ms on amp-jenkins-worker-06.amp (executor 1) (1/2) 20/08/03 12:34:56.726 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_18_0 in memory on amp-jenkins-worker-06.amp:39306 (size: 152.0 B, free: 546.3 MiB) 20/08/03 12:34:56.743 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 9.0 (TID 18) in 500 ms on amp-jenkins-worker-06.amp (executor 0) (2/2) 20/08/03 12:34:56.743 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 9.0, whose tasks have all completed, from pool 20/08/03 12:34:56.744 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 9 (count at :25) finished in 0.516 s 20/08/03 12:34:56.745 dag-scheduler-event-loop INFO DAGScheduler: Job 9 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:56.745 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 9: Stage finished 20/08/03 12:34:56.745 Thread-146 INFO DAGScheduler: Job 9 finished: count at :25, took 0.524187 s 20/08/03 12:34:56.870 Thread-146 INFO SparkContext: Starting job: count at :25 20/08/03 12:34:56.871 dag-scheduler-event-loop INFO DAGScheduler: Got job 10 (count at :25) with 2 output partitions 20/08/03 12:34:56.871 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 10 (count at :25) 20/08/03 12:34:56.871 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:56.873 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:56.874 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 10 (/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-6ec00715-4e34-45de-ae8b-fe0c4b3c2794/input MapPartitionsRDD[18] at textFile at :24), which has no missing parents 20/08/03 12:34:56.878 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_12 stored as values in memory (estimated size 4.1 KiB, free 2.1 GiB) 20/08/03 12:34:56.881 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_12_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 2.1 GiB) 20/08/03 12:34:56.882 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_12_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 2.4 KiB, free: 2.1 GiB) 20/08/03 12:34:56.882 dag-scheduler-event-loop INFO SparkContext: Created broadcast 12 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:56.883 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 10 (/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-6ec00715-4e34-45de-ae8b-fe0c4b3c2794/input MapPartitionsRDD[18] at textFile at :24) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:34:56.883 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 10.0 with 2 tasks 20/08/03 12:34:56.888 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 10.0 (TID 20, amp-jenkins-worker-06.amp, executor 1, partition 1, PROCESS_LOCAL, 7460 bytes) 20/08/03 12:34:56.888 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 10.0 (TID 21, amp-jenkins-worker-06.amp, executor 0, partition 0, PROCESS_LOCAL, 7460 bytes) 20/08/03 12:34:56.953 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_12_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 2.4 KiB, free: 546.3 MiB) 20/08/03 12:34:56.961 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_12_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 2.4 KiB, free: 546.3 MiB) 20/08/03 12:34:56.964 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 10.0 (TID 20) in 78 ms on amp-jenkins-worker-06.amp (executor 1) (1/2) 20/08/03 12:34:56.975 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 10.0 (TID 21) in 87 ms on amp-jenkins-worker-06.amp (executor 0) (2/2) 20/08/03 12:34:56.975 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 10.0, whose tasks have all completed, from pool 20/08/03 12:34:56.975 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 10 (count at :25) finished in 0.101 s 20/08/03 12:34:56.976 dag-scheduler-event-loop INFO DAGScheduler: Job 10 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:56.976 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 10: Stage finished 20/08/03 12:34:56.976 Thread-146 INFO DAGScheduler: Job 10 finished: count at :25, took 0.105128 s 20/08/03 12:34:57.124 Thread-146 INFO SparkContext: Starting job: count at :25 20/08/03 12:34:57.125 dag-scheduler-event-loop INFO DAGScheduler: Got job 11 (count at :25) with 2 output partitions 20/08/03 12:34:57.125 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 11 (count at :25) 20/08/03 12:34:57.125 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:57.125 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:57.126 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 11 (/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-6ec00715-4e34-45de-ae8b-fe0c4b3c2794/input MapPartitionsRDD[18] at textFile at :24), which has no missing parents 20/08/03 12:34:57.128 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_13 stored as values in memory (estimated size 4.1 KiB, free 2.1 GiB) 20/08/03 12:34:57.131 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_13_piece0 stored as bytes in memory (estimated size 2.4 KiB, free 2.1 GiB) 20/08/03 12:34:57.132 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_13_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 2.4 KiB, free: 2.1 GiB) 20/08/03 12:34:57.133 dag-scheduler-event-loop INFO SparkContext: Created broadcast 13 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:57.134 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 11 (/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-6ec00715-4e34-45de-ae8b-fe0c4b3c2794/input MapPartitionsRDD[18] at textFile at :24) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:34:57.134 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 11.0 with 2 tasks 20/08/03 12:34:57.136 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 11.0 (TID 22, amp-jenkins-worker-06.amp, executor 1, partition 1, PROCESS_LOCAL, 7460 bytes) 20/08/03 12:34:57.136 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 11.0 (TID 23, amp-jenkins-worker-06.amp, executor 0, partition 0, PROCESS_LOCAL, 7460 bytes) 20/08/03 12:34:57.153 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_13_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 2.4 KiB, free: 546.3 MiB) 20/08/03 12:34:57.158 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_13_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 2.4 KiB, free: 546.3 MiB) 20/08/03 12:34:57.164 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 11.0 (TID 22) in 28 ms on amp-jenkins-worker-06.amp (executor 1) (1/2) 20/08/03 12:34:57.170 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 11.0 (TID 23) in 34 ms on amp-jenkins-worker-06.amp (executor 0) (2/2) 20/08/03 12:34:57.170 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 11.0, whose tasks have all completed, from pool 20/08/03 12:34:57.171 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 11 (count at :25) finished in 0.045 s 20/08/03 12:34:57.171 dag-scheduler-event-loop INFO DAGScheduler: Job 11 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:57.171 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 11: Stage finished 20/08/03 12:34:57.171 Thread-146 INFO DAGScheduler: Job 11 finished: count at :25, took 0.046753 s 20/08/03 12:34:57.819 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'interacting with files' ===== 20/08/03 12:34:57.821 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'local-cluster mode' ===== 20/08/03 12:34:58.277 Thread-146 INFO SparkContext: Starting job: collect at :26 20/08/03 12:34:58.278 dag-scheduler-event-loop INFO DAGScheduler: Got job 12 (collect at :26) with 2 output partitions 20/08/03 12:34:58.278 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 12 (collect at :26) 20/08/03 12:34:58.278 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:58.279 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:58.280 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 12 (MapPartitionsRDD[20] at map at :26), which has no missing parents 20/08/03 12:34:58.281 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_14 stored as values in memory (estimated size 6.0 KiB, free 2.1 GiB) 20/08/03 12:34:58.284 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_14_piece0 stored as bytes in memory (estimated size 2.9 KiB, free 2.1 GiB) 20/08/03 12:34:58.284 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_14_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 2.9 KiB, free: 2.1 GiB) 20/08/03 12:34:58.284 dag-scheduler-event-loop INFO SparkContext: Created broadcast 14 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:58.285 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 12 (MapPartitionsRDD[20] at map at :26) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:34:58.285 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 12.0 with 2 tasks 20/08/03 12:34:58.286 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 12.0 (TID 24, amp-jenkins-worker-06.amp, executor 1, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:34:58.286 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 12.0 (TID 25, amp-jenkins-worker-06.amp, executor 0, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:34:58.299 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_14_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 2.9 KiB, free: 546.3 MiB) 20/08/03 12:34:58.300 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_14_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 2.9 KiB, free: 546.3 MiB) 20/08/03 12:34:58.434 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 12.0 (TID 24) in 148 ms on amp-jenkins-worker-06.amp (executor 1) (1/2) 20/08/03 12:34:58.454 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 12.0 (TID 25) in 168 ms on amp-jenkins-worker-06.amp (executor 0) (2/2) 20/08/03 12:34:58.454 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 12.0, whose tasks have all completed, from pool 20/08/03 12:34:58.455 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 12 (collect at :26) finished in 0.174 s 20/08/03 12:34:58.455 dag-scheduler-event-loop INFO DAGScheduler: Job 12 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:58.455 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 12: Stage finished 20/08/03 12:34:58.455 Thread-146 INFO DAGScheduler: Job 12 finished: collect at :26, took 0.177515 s 20/08/03 12:34:58.739 Thread-146 INFO SparkContext: Starting job: collect at :26 20/08/03 12:34:58.764 dag-scheduler-event-loop INFO DAGScheduler: Got job 13 (collect at :26) with 2 output partitions 20/08/03 12:34:58.764 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 13 (collect at :26) 20/08/03 12:34:58.764 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:58.764 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:58.765 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 13 (MapPartitionsRDD[22] at map at :26), which has no missing parents 20/08/03 12:34:58.768 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_15 stored as values in memory (estimated size 6.0 KiB, free 2.1 GiB) 20/08/03 12:34:58.771 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_15_piece0 stored as bytes in memory (estimated size 2.9 KiB, free 2.1 GiB) 20/08/03 12:34:58.771 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_15_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 2.9 KiB, free: 2.1 GiB) 20/08/03 12:34:58.771 dag-scheduler-event-loop INFO SparkContext: Created broadcast 15 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:58.772 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 13 (MapPartitionsRDD[22] at map at :26) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:34:58.772 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 13.0 with 2 tasks 20/08/03 12:34:58.773 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 13.0 (TID 26, amp-jenkins-worker-06.amp, executor 0, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:34:58.773 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 13.0 (TID 27, amp-jenkins-worker-06.amp, executor 1, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:34:58.787 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_15_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 2.9 KiB, free: 546.3 MiB) 20/08/03 12:34:58.787 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_15_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 2.9 KiB, free: 546.3 MiB) 20/08/03 12:34:58.828 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 13.0 (TID 27) in 55 ms on amp-jenkins-worker-06.amp (executor 1) (1/2) 20/08/03 12:34:58.832 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 13.0 (TID 26) in 59 ms on amp-jenkins-worker-06.amp (executor 0) (2/2) 20/08/03 12:34:58.832 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 13.0, whose tasks have all completed, from pool 20/08/03 12:34:58.832 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 13 (collect at :26) finished in 0.066 s 20/08/03 12:34:58.833 dag-scheduler-event-loop INFO DAGScheduler: Job 13 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:58.833 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 13: Stage finished 20/08/03 12:34:58.833 Thread-146 INFO DAGScheduler: Job 13 finished: collect at :26, took 0.069325 s 20/08/03 12:34:59.103 Thread-146 INFO MemoryStore: Block broadcast_16 stored as values in memory (estimated size 64.0 B, free 2.1 GiB) 20/08/03 12:34:59.105 Thread-146 INFO MemoryStore: Block broadcast_16_piece0 stored as bytes in memory (estimated size 80.0 B, free 2.1 GiB) 20/08/03 12:34:59.105 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_16_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 80.0 B, free: 2.1 GiB) 20/08/03 12:34:59.106 Thread-146 INFO SparkContext: Created broadcast 16 from broadcast at :26 20/08/03 12:34:59.277 Thread-146 INFO SparkContext: Starting job: collect at :26 20/08/03 12:34:59.278 dag-scheduler-event-loop INFO DAGScheduler: Got job 14 (collect at :26) with 2 output partitions 20/08/03 12:34:59.278 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 14 (collect at :26) 20/08/03 12:34:59.278 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:59.278 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:59.278 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 14 (MapPartitionsRDD[24] at map at :26), which has no missing parents 20/08/03 12:34:59.281 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_17 stored as values in memory (estimated size 6.6 KiB, free 2.1 GiB) 20/08/03 12:34:59.284 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_17_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 20/08/03 12:34:59.285 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_17_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 3.3 KiB, free: 2.1 GiB) 20/08/03 12:34:59.285 dag-scheduler-event-loop INFO SparkContext: Created broadcast 17 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:59.285 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 14 (MapPartitionsRDD[24] at map at :26) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:34:59.285 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 14.0 with 2 tasks 20/08/03 12:34:59.287 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 14.0 (TID 28, amp-jenkins-worker-06.amp, executor 0, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:34:59.287 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 14.0 (TID 29, amp-jenkins-worker-06.amp, executor 1, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:34:59.299 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_17_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 3.3 KiB, free: 546.3 MiB) 20/08/03 12:34:59.302 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_17_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 3.3 KiB, free: 546.3 MiB) 20/08/03 12:34:59.404 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_16_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 80.0 B, free: 546.3 MiB) 20/08/03 12:34:59.411 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 14.0 (TID 28) in 125 ms on amp-jenkins-worker-06.amp (executor 0) (1/2) 20/08/03 12:34:59.446 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_16_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 80.0 B, free: 546.3 MiB) 20/08/03 12:34:59.454 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 14.0 (TID 29) in 167 ms on amp-jenkins-worker-06.amp (executor 1) (2/2) 20/08/03 12:34:59.454 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 14.0, whose tasks have all completed, from pool 20/08/03 12:34:59.455 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 14 (collect at :26) finished in 0.175 s 20/08/03 12:34:59.455 dag-scheduler-event-loop INFO DAGScheduler: Job 14 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:59.455 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 14: Stage finished 20/08/03 12:34:59.455 Thread-146 INFO DAGScheduler: Job 14 finished: collect at :26, took 0.178177 s 20/08/03 12:34:59.755 Thread-146 INFO SparkContext: Starting job: collect at :26 20/08/03 12:34:59.756 dag-scheduler-event-loop INFO DAGScheduler: Got job 15 (collect at :26) with 2 output partitions 20/08/03 12:34:59.756 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 15 (collect at :26) 20/08/03 12:34:59.756 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:34:59.756 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:34:59.756 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 15 (MapPartitionsRDD[26] at map at :26), which has no missing parents 20/08/03 12:34:59.758 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_18 stored as values in memory (estimated size 6.6 KiB, free 2.1 GiB) 20/08/03 12:34:59.763 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_18_piece0 stored as bytes in memory (estimated size 3.3 KiB, free 2.1 GiB) 20/08/03 12:34:59.763 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_18_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 3.3 KiB, free: 2.1 GiB) 20/08/03 12:34:59.764 dag-scheduler-event-loop INFO SparkContext: Created broadcast 18 from broadcast at DAGScheduler.scala:1221 20/08/03 12:34:59.770 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 15 (MapPartitionsRDD[26] at map at :26) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:34:59.770 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 15.0 with 2 tasks 20/08/03 12:34:59.772 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 15.0 (TID 30, amp-jenkins-worker-06.amp, executor 1, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:34:59.772 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 15.0 (TID 31, amp-jenkins-worker-06.amp, executor 0, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:34:59.785 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_18_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 3.3 KiB, free: 546.3 MiB) 20/08/03 12:34:59.788 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_18_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 3.3 KiB, free: 546.3 MiB) 20/08/03 12:34:59.824 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 15.0 (TID 30) in 52 ms on amp-jenkins-worker-06.amp (executor 1) (1/2) 20/08/03 12:34:59.827 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 15.0 (TID 31) in 55 ms on amp-jenkins-worker-06.amp (executor 0) (2/2) 20/08/03 12:34:59.827 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 15.0, whose tasks have all completed, from pool 20/08/03 12:34:59.828 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 15 (collect at :26) finished in 0.071 s 20/08/03 12:34:59.828 dag-scheduler-event-loop INFO DAGScheduler: Job 15 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:34:59.828 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 15: Stage finished 20/08/03 12:34:59.828 Thread-146 INFO DAGScheduler: Job 15 finished: collect at :26, took 0.073246 s 20/08/03 12:35:00.327 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'local-cluster mode' ===== 20/08/03 12:35:00.329 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'SPARK-1199 two instances of same class don't type check.' ===== 20/08/03 12:35:01.334 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'SPARK-1199 two instances of same class don't type check.' ===== 20/08/03 12:35:01.336 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'SPARK-2452 compound statements.' ===== 20/08/03 12:35:01.841 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'SPARK-2452 compound statements.' ===== 20/08/03 12:35:01.843 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'SPARK-2576 importing implicits' ===== 20/08/03 12:35:03.054 Thread-146 INFO SharedState: Setting hive.metastore.warehouse.dir ('null') to the value of spark.sql.warehouse.dir ('file:/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/spark-warehouse'). 20/08/03 12:35:03.056 Thread-146 INFO SharedState: Warehouse path is 'file:/home/jenkins/workspace/NewSparkPullRequestBuilder/repl/spark-warehouse'. 20/08/03 12:35:03.296 Thread-146 INFO CodeGenerator: Code generated in 65.572389 ms 20/08/03 12:35:03.329 Thread-146 INFO SparkContext: Starting job: collect at :32 20/08/03 12:35:03.330 dag-scheduler-event-loop INFO DAGScheduler: Got job 16 (collect at :32) with 2 output partitions 20/08/03 12:35:03.331 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 16 (collect at :32) 20/08/03 12:35:03.331 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:35:03.331 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:35:03.332 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 16 (MapPartitionsRDD[31] at collect at :32), which has no missing parents 20/08/03 12:35:03.335 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_19 stored as values in memory (estimated size 9.5 KiB, free 2.1 GiB) 20/08/03 12:35:03.339 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_19_piece0 stored as bytes in memory (estimated size 4.6 KiB, free 2.1 GiB) 20/08/03 12:35:03.340 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_19_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 4.6 KiB, free: 2.1 GiB) 20/08/03 12:35:03.340 dag-scheduler-event-loop INFO SparkContext: Created broadcast 19 from broadcast at DAGScheduler.scala:1221 20/08/03 12:35:03.341 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 16 (MapPartitionsRDD[31] at collect at :32) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:35:03.341 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 16.0 with 2 tasks 20/08/03 12:35:03.342 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 16.0 (TID 32, amp-jenkins-worker-06.amp, executor 1, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:35:03.342 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 16.0 (TID 33, amp-jenkins-worker-06.amp, executor 0, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:35:03.355 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_19_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 4.6 KiB, free: 546.3 MiB) 20/08/03 12:35:03.356 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_19_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 4.6 KiB, free: 546.3 MiB) 20/08/03 12:35:04.127 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 16.0 (TID 33) in 785 ms on amp-jenkins-worker-06.amp (executor 0) (1/2) 20/08/03 12:35:04.127 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 16.0 (TID 32) in 785 ms on amp-jenkins-worker-06.amp (executor 1) (2/2) 20/08/03 12:35:04.128 task-result-getter-1 INFO TaskSchedulerImpl: Removed TaskSet 16.0, whose tasks have all completed, from pool 20/08/03 12:35:04.128 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 16 (collect at :32) finished in 0.795 s 20/08/03 12:35:04.129 dag-scheduler-event-loop INFO DAGScheduler: Job 16 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:35:04.129 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 16: Stage finished 20/08/03 12:35:04.129 Thread-146 INFO DAGScheduler: Job 16 finished: collect at :32, took 0.799621 s 20/08/03 12:35:04.163 Thread-146 INFO CodeGenerator: Code generated in 17.735891 ms 20/08/03 12:35:04.548 Thread-146 INFO CodeGenerator: Code generated in 15.219727 ms 20/08/03 12:35:04.597 Thread-146 INFO CodeGenerator: Code generated in 14.500513 ms 20/08/03 12:35:04.622 Thread-146 INFO CodeGenerator: Code generated in 15.530493 ms 20/08/03 12:35:04.850 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'SPARK-2576 importing implicits' ===== 20/08/03 12:35:04.852 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'Datasets and encoders' ===== 20/08/03 12:35:05.601 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_19_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 4.6 KiB, free: 2.1 GiB) 20/08/03 12:35:05.603 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_19_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 4.6 KiB, free: 546.3 MiB) 20/08/03 12:35:05.603 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_19_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 4.6 KiB, free: 546.3 MiB) 20/08/03 12:35:05.612 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_17_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 3.3 KiB, free: 2.1 GiB) 20/08/03 12:35:05.613 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_17_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 3.3 KiB, free: 546.3 MiB) 20/08/03 12:35:05.613 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_17_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 3.3 KiB, free: 546.3 MiB) 20/08/03 12:35:05.620 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_13_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 2.4 KiB, free: 2.1 GiB) 20/08/03 12:35:05.621 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_13_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 2.4 KiB, free: 546.3 MiB) 20/08/03 12:35:05.622 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_13_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 2.4 KiB, free: 546.3 MiB) 20/08/03 12:35:05.630 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_12_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 2.4 KiB, free: 2.1 GiB) 20/08/03 12:35:05.631 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_12_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 2.4 KiB, free: 546.3 MiB) 20/08/03 12:35:05.632 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_12_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 2.4 KiB, free: 546.3 MiB) 20/08/03 12:35:05.648 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_9_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 3.3 KiB, free: 2.1 GiB) 20/08/03 12:35:05.650 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_9_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 3.3 KiB, free: 546.3 MiB) 20/08/03 12:35:05.650 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_9_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 3.3 KiB, free: 546.3 MiB) 20/08/03 12:35:05.657 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_11_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 2.4 KiB, free: 2.1 GiB) 20/08/03 12:35:05.658 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_11_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 2.4 KiB, free: 546.3 MiB) 20/08/03 12:35:05.658 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_11_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 2.4 KiB, free: 546.3 MiB) 20/08/03 12:35:05.665 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_14_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 2.9 KiB, free: 2.1 GiB) 20/08/03 12:35:05.665 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_14_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 2.9 KiB, free: 546.3 MiB) 20/08/03 12:35:05.666 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_14_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 2.9 KiB, free: 546.3 MiB) 20/08/03 12:35:05.673 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_15_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 2.9 KiB, free: 2.1 GiB) 20/08/03 12:35:05.674 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_15_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 2.9 KiB, free: 546.3 MiB) 20/08/03 12:35:05.674 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_15_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 2.9 KiB, free: 546.3 MiB) 20/08/03 12:35:05.681 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_18_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 3.3 KiB, free: 2.1 GiB) 20/08/03 12:35:05.682 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_18_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 3.3 KiB, free: 546.3 MiB) 20/08/03 12:35:05.683 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_18_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 3.3 KiB, free: 546.3 MiB) 20/08/03 12:35:06.481 Thread-146 INFO CodeGenerator: Code generated in 27.133733 ms 20/08/03 12:35:06.513 Thread-146 INFO CodeGenerator: Code generated in 27.481179 ms 20/08/03 12:35:06.579 Thread-146 INFO SparkContext: Starting job: collect at :37 20/08/03 12:35:06.582 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 34 (collect at :37) as input to shuffle 0 20/08/03 12:35:06.584 dag-scheduler-event-loop INFO DAGScheduler: Got job 17 (collect at :37) with 1 output partitions 20/08/03 12:35:06.584 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 18 (collect at :37) 20/08/03 12:35:06.585 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 17) 20/08/03 12:35:06.586 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 17) 20/08/03 12:35:06.589 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 17 (MapPartitionsRDD[34] at collect at :37), which has no missing parents 20/08/03 12:35:06.605 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_20 stored as values in memory (estimated size 10.8 KiB, free 2.1 GiB) 20/08/03 12:35:06.609 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_20_piece0 stored as bytes in memory (estimated size 5.6 KiB, free 2.1 GiB) 20/08/03 12:35:06.610 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_20_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 5.6 KiB, free: 2.1 GiB) 20/08/03 12:35:06.610 dag-scheduler-event-loop INFO SparkContext: Created broadcast 20 from broadcast at DAGScheduler.scala:1221 20/08/03 12:35:06.614 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 17 (MapPartitionsRDD[34] at collect at :37) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:35:06.614 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 17.0 with 2 tasks 20/08/03 12:35:06.620 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 17.0 (TID 34, amp-jenkins-worker-06.amp, executor 0, partition 0, PROCESS_LOCAL, 7551 bytes) 20/08/03 12:35:06.620 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 17.0 (TID 35, amp-jenkins-worker-06.amp, executor 1, partition 1, PROCESS_LOCAL, 7551 bytes) 20/08/03 12:35:06.644 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_20_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 5.6 KiB, free: 546.3 MiB) 20/08/03 12:35:06.645 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_20_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 5.6 KiB, free: 546.3 MiB) 20/08/03 12:35:06.805 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 17.0 (TID 34) in 190 ms on amp-jenkins-worker-06.amp (executor 0) (1/2) 20/08/03 12:35:06.819 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 17.0 (TID 35) in 199 ms on amp-jenkins-worker-06.amp (executor 1) (2/2) 20/08/03 12:35:06.819 task-result-getter-3 INFO TaskSchedulerImpl: Removed TaskSet 17.0, whose tasks have all completed, from pool 20/08/03 12:35:06.820 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 17 (collect at :37) finished in 0.226 s 20/08/03 12:35:06.821 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 20/08/03 12:35:06.821 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 20/08/03 12:35:06.822 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 18) 20/08/03 12:35:06.822 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 20/08/03 12:35:06.827 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 18 (MapPartitionsRDD[37] at collect at :37), which has no missing parents 20/08/03 12:35:06.840 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_21 stored as values in memory (estimated size 11.1 KiB, free 2.1 GiB) 20/08/03 12:35:06.844 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_21_piece0 stored as bytes in memory (estimated size 5.4 KiB, free 2.1 GiB) 20/08/03 12:35:06.845 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_21_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 5.4 KiB, free: 2.1 GiB) 20/08/03 12:35:06.846 dag-scheduler-event-loop INFO SparkContext: Created broadcast 21 from broadcast at DAGScheduler.scala:1221 20/08/03 12:35:06.847 dag-scheduler-event-loop INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 18 (MapPartitionsRDD[37] at collect at :37) (first 15 tasks are for partitions Vector(0)) 20/08/03 12:35:06.847 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 18.0 with 1 tasks 20/08/03 12:35:06.851 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 18.0 (TID 36, amp-jenkins-worker-06.amp, executor 0, partition 0, NODE_LOCAL, 7329 bytes) 20/08/03 12:35:06.870 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_21_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 5.4 KiB, free: 546.3 MiB) 20/08/03 12:35:06.891 dispatcher-event-loop-26 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 192.168.10.26:43684 20/08/03 12:35:07.062 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 18.0 (TID 36) in 213 ms on amp-jenkins-worker-06.amp (executor 0) (1/1) 20/08/03 12:35:07.062 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 18.0, whose tasks have all completed, from pool 20/08/03 12:35:07.063 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 18 (collect at :37) finished in 0.225 s 20/08/03 12:35:07.063 dag-scheduler-event-loop INFO DAGScheduler: Job 17 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:35:07.063 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 18: Stage finished 20/08/03 12:35:07.064 Thread-146 INFO DAGScheduler: Job 17 finished: collect at :37, took 0.484971 s 20/08/03 12:35:07.079 Thread-146 INFO CodeGenerator: Code generated in 12.67905 ms 20/08/03 12:35:07.358 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'Datasets and encoders' ===== 20/08/03 12:35:07.360 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'SPARK-2632 importing a method from non serializable class and not using it.' ===== 20/08/03 12:35:08.461 Thread-146 INFO SparkContext: Starting job: collect at :41 20/08/03 12:35:08.462 dag-scheduler-event-loop INFO DAGScheduler: Got job 18 (collect at :41) with 2 output partitions 20/08/03 12:35:08.462 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 19 (collect at :41) 20/08/03 12:35:08.462 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:35:08.462 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:35:08.464 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 19 (MapPartitionsRDD[39] at map at :41), which has no missing parents 20/08/03 12:35:08.465 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_22 stored as values in memory (estimated size 3.4 KiB, free 2.1 GiB) 20/08/03 12:35:08.468 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_22_piece0 stored as bytes in memory (estimated size 1898.0 B, free 2.1 GiB) 20/08/03 12:35:08.468 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_22_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 1898.0 B, free: 2.1 GiB) 20/08/03 12:35:08.469 dag-scheduler-event-loop INFO SparkContext: Created broadcast 22 from broadcast at DAGScheduler.scala:1221 20/08/03 12:35:08.469 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 19 (MapPartitionsRDD[39] at map at :41) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:35:08.469 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 19.0 with 2 tasks 20/08/03 12:35:08.471 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 19.0 (TID 37, amp-jenkins-worker-06.amp, executor 0, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:35:08.471 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 19.0 (TID 38, amp-jenkins-worker-06.amp, executor 1, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:35:08.483 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_22_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 1898.0 B, free: 546.3 MiB) 20/08/03 12:35:08.485 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_22_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 1898.0 B, free: 546.3 MiB) 20/08/03 12:35:08.527 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 19.0 (TID 37) in 57 ms on amp-jenkins-worker-06.amp (executor 0) (1/2) 20/08/03 12:35:08.527 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 19.0 (TID 38) in 56 ms on amp-jenkins-worker-06.amp (executor 1) (2/2) 20/08/03 12:35:08.527 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 19.0, whose tasks have all completed, from pool 20/08/03 12:35:08.529 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 19 (collect at :41) finished in 0.064 s 20/08/03 12:35:08.529 dag-scheduler-event-loop INFO DAGScheduler: Job 18 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:35:08.529 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 19: Stage finished 20/08/03 12:35:08.529 Thread-146 INFO DAGScheduler: Job 18 finished: collect at :41, took 0.067985 s 20/08/03 12:35:08.866 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'SPARK-2632 importing a method from non serializable class and not using it.' ===== 20/08/03 12:35:08.867 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'collecting objects of class defined in repl' ===== 20/08/03 12:35:09.302 Thread-146 INFO SparkContext: Starting job: collect at :38 20/08/03 12:35:09.303 dag-scheduler-event-loop INFO DAGScheduler: Got job 19 (collect at :38) with 10 output partitions 20/08/03 12:35:09.303 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 20 (collect at :38) 20/08/03 12:35:09.303 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:35:09.303 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:35:09.303 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 20 (ParallelCollectionRDD[40] at parallelize at :38), which has no missing parents 20/08/03 12:35:09.308 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_23 stored as values in memory (estimated size 2.1 KiB, free 2.1 GiB) 20/08/03 12:35:09.310 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_23_piece0 stored as bytes in memory (estimated size 1322.0 B, free 2.1 GiB) 20/08/03 12:35:09.311 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_23_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 1322.0 B, free: 2.1 GiB) 20/08/03 12:35:09.312 dag-scheduler-event-loop INFO SparkContext: Created broadcast 23 from broadcast at DAGScheduler.scala:1221 20/08/03 12:35:09.313 dag-scheduler-event-loop INFO DAGScheduler: Submitting 10 missing tasks from ResultStage 20 (ParallelCollectionRDD[40] at parallelize at :38) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9)) 20/08/03 12:35:09.313 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 20.0 with 10 tasks 20/08/03 12:35:09.320 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 20.0 (TID 39, amp-jenkins-worker-06.amp, executor 1, partition 0, PROCESS_LOCAL, 7880 bytes) 20/08/03 12:35:09.320 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 20.0 (TID 40, amp-jenkins-worker-06.amp, executor 0, partition 1, PROCESS_LOCAL, 7880 bytes) 20/08/03 12:35:09.351 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_23_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 1322.0 B, free: 546.3 MiB) 20/08/03 12:35:09.351 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_23_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 1322.0 B, free: 546.3 MiB) 20/08/03 12:35:09.360 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 2.0 in stage 20.0 (TID 41, amp-jenkins-worker-06.amp, executor 0, partition 2, PROCESS_LOCAL, 7880 bytes) 20/08/03 12:35:09.361 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 3.0 in stage 20.0 (TID 42, amp-jenkins-worker-06.amp, executor 1, partition 3, PROCESS_LOCAL, 7880 bytes) 20/08/03 12:35:09.361 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 20.0 (TID 40) in 41 ms on amp-jenkins-worker-06.amp (executor 0) (1/10) 20/08/03 12:35:09.361 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 20.0 (TID 39) in 47 ms on amp-jenkins-worker-06.amp (executor 1) (2/10) 20/08/03 12:35:09.369 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 4.0 in stage 20.0 (TID 43, amp-jenkins-worker-06.amp, executor 0, partition 4, PROCESS_LOCAL, 7880 bytes) 20/08/03 12:35:09.369 task-result-getter-1 INFO TaskSetManager: Finished task 2.0 in stage 20.0 (TID 41) in 10 ms on amp-jenkins-worker-06.amp (executor 0) (3/10) 20/08/03 12:35:09.370 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 5.0 in stage 20.0 (TID 44, amp-jenkins-worker-06.amp, executor 1, partition 5, PROCESS_LOCAL, 7880 bytes) 20/08/03 12:35:09.370 task-result-getter-2 INFO TaskSetManager: Finished task 3.0 in stage 20.0 (TID 42) in 9 ms on amp-jenkins-worker-06.amp (executor 1) (4/10) 20/08/03 12:35:09.378 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 6.0 in stage 20.0 (TID 45, amp-jenkins-worker-06.amp, executor 1, partition 6, PROCESS_LOCAL, 7880 bytes) 20/08/03 12:35:09.378 task-result-getter-3 INFO TaskSetManager: Finished task 5.0 in stage 20.0 (TID 44) in 8 ms on amp-jenkins-worker-06.amp (executor 1) (5/10) 20/08/03 12:35:09.379 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 7.0 in stage 20.0 (TID 46, amp-jenkins-worker-06.amp, executor 0, partition 7, PROCESS_LOCAL, 7880 bytes) 20/08/03 12:35:09.379 task-result-getter-0 INFO TaskSetManager: Finished task 4.0 in stage 20.0 (TID 43) in 10 ms on amp-jenkins-worker-06.amp (executor 0) (6/10) 20/08/03 12:35:09.387 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 8.0 in stage 20.0 (TID 47, amp-jenkins-worker-06.amp, executor 1, partition 8, PROCESS_LOCAL, 7880 bytes) 20/08/03 12:35:09.388 task-result-getter-1 INFO TaskSetManager: Finished task 6.0 in stage 20.0 (TID 45) in 9 ms on amp-jenkins-worker-06.amp (executor 1) (7/10) 20/08/03 12:35:09.390 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 9.0 in stage 20.0 (TID 48, amp-jenkins-worker-06.amp, executor 0, partition 9, PROCESS_LOCAL, 7880 bytes) 20/08/03 12:35:09.390 task-result-getter-2 INFO TaskSetManager: Finished task 7.0 in stage 20.0 (TID 46) in 11 ms on amp-jenkins-worker-06.amp (executor 0) (8/10) 20/08/03 12:35:09.399 task-result-getter-3 INFO TaskSetManager: Finished task 8.0 in stage 20.0 (TID 47) in 12 ms on amp-jenkins-worker-06.amp (executor 1) (9/10) 20/08/03 12:35:09.400 task-result-getter-0 INFO TaskSetManager: Finished task 9.0 in stage 20.0 (TID 48) in 11 ms on amp-jenkins-worker-06.amp (executor 0) (10/10) 20/08/03 12:35:09.400 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 20.0, whose tasks have all completed, from pool 20/08/03 12:35:09.400 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 20 (collect at :38) finished in 0.095 s 20/08/03 12:35:09.400 dag-scheduler-event-loop INFO DAGScheduler: Job 19 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:35:09.400 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 20: Stage finished 20/08/03 12:35:09.401 Thread-146 INFO DAGScheduler: Job 19 finished: collect at :38, took 0.098414 s 20/08/03 12:35:09.873 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'collecting objects of class defined in repl' ===== 20/08/03 12:35:09.874 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'collecting objects of class defined in repl - shuffling' ===== 20/08/03 12:35:10.536 Thread-146 INFO SparkContext: Starting job: collect at :38 20/08/03 12:35:10.537 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 41 (parallelize at :38) as input to shuffle 1 20/08/03 12:35:10.538 dag-scheduler-event-loop INFO DAGScheduler: Got job 20 (collect at :38) with 2 output partitions 20/08/03 12:35:10.538 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 22 (collect at :38) 20/08/03 12:35:10.538 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 21) 20/08/03 12:35:10.538 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 21) 20/08/03 12:35:10.538 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 21 (ParallelCollectionRDD[41] at parallelize at :38), which has no missing parents 20/08/03 12:35:10.548 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_24 stored as values in memory (estimated size 4.6 KiB, free 2.1 GiB) 20/08/03 12:35:10.551 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_24_piece0 stored as bytes in memory (estimated size 2.6 KiB, free 2.1 GiB) 20/08/03 12:35:10.551 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_24_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 2.6 KiB, free: 2.1 GiB) 20/08/03 12:35:10.552 dag-scheduler-event-loop INFO SparkContext: Created broadcast 24 from broadcast at DAGScheduler.scala:1221 20/08/03 12:35:10.553 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 21 (ParallelCollectionRDD[41] at parallelize at :38) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:35:10.553 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 21.0 with 2 tasks 20/08/03 12:35:10.558 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 21.0 (TID 49, amp-jenkins-worker-06.amp, executor 1, partition 0, PROCESS_LOCAL, 7719 bytes) 20/08/03 12:35:10.559 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 21.0 (TID 50, amp-jenkins-worker-06.amp, executor 0, partition 1, PROCESS_LOCAL, 7719 bytes) 20/08/03 12:35:10.591 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_24_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 2.6 KiB, free: 546.3 MiB) 20/08/03 12:35:10.610 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_24_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 2.6 KiB, free: 546.3 MiB) 20/08/03 12:35:10.706 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 21.0 (TID 49) in 152 ms on amp-jenkins-worker-06.amp (executor 1) (1/2) 20/08/03 12:35:10.715 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 21.0 (TID 50) in 155 ms on amp-jenkins-worker-06.amp (executor 0) (2/2) 20/08/03 12:35:10.715 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 21.0, whose tasks have all completed, from pool 20/08/03 12:35:10.715 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 21 (parallelize at :38) finished in 0.170 s 20/08/03 12:35:10.715 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 20/08/03 12:35:10.716 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 20/08/03 12:35:10.716 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 22) 20/08/03 12:35:10.716 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 20/08/03 12:35:10.716 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 22 (ShuffledRDD[42] at groupByKey at :38), which has no missing parents 20/08/03 12:35:10.718 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_25 stored as values in memory (estimated size 5.6 KiB, free 2.1 GiB) 20/08/03 12:35:10.722 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_25_piece0 stored as bytes in memory (estimated size 3.0 KiB, free 2.1 GiB) 20/08/03 12:35:10.722 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_25_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 3.0 KiB, free: 2.1 GiB) 20/08/03 12:35:10.723 dag-scheduler-event-loop INFO SparkContext: Created broadcast 25 from broadcast at DAGScheduler.scala:1221 20/08/03 12:35:10.724 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 22 (ShuffledRDD[42] at groupByKey at :38) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:35:10.724 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 22.0 with 2 tasks 20/08/03 12:35:10.726 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 22.0 (TID 51, amp-jenkins-worker-06.amp, executor 0, partition 1, NODE_LOCAL, 7147 bytes) 20/08/03 12:35:10.727 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 22.0 (TID 52, amp-jenkins-worker-06.amp, executor 1, partition 0, PROCESS_LOCAL, 7147 bytes) 20/08/03 12:35:10.742 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_25_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 3.0 KiB, free: 546.3 MiB) 20/08/03 12:35:10.748 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_25_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 3.0 KiB, free: 546.3 MiB) 20/08/03 12:35:10.758 dispatcher-event-loop-30 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 1 to 192.168.10.26:43684 20/08/03 12:35:10.770 dispatcher-event-loop-31 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 1 to 192.168.10.26:43682 20/08/03 12:35:10.794 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 22.0 (TID 51) in 69 ms on amp-jenkins-worker-06.amp (executor 0) (1/2) 20/08/03 12:35:10.852 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 22.0 (TID 52) in 124 ms on amp-jenkins-worker-06.amp (executor 1) (2/2) 20/08/03 12:35:10.852 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 22.0, whose tasks have all completed, from pool 20/08/03 12:35:10.852 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 22 (collect at :38) finished in 0.135 s 20/08/03 12:35:10.852 dag-scheduler-event-loop INFO DAGScheduler: Job 20 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:35:10.852 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 22: Stage finished 20/08/03 12:35:10.853 Thread-146 INFO DAGScheduler: Job 20 finished: collect at :38, took 0.316407 s 20/08/03 12:35:11.380 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'collecting objects of class defined in repl - shuffling' ===== 20/08/03 12:35:11.382 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'replicating blocks of object with class defined in repl' ===== 20/08/03 12:35:12.753 Thread-146 INFO SparkContext: Starting job: count at :41 20/08/03 12:35:12.754 dag-scheduler-event-loop INFO DAGScheduler: Got job 21 (count at :41) with 10 output partitions 20/08/03 12:35:12.754 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 23 (count at :41) 20/08/03 12:35:12.754 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:35:12.755 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:35:12.755 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 23 (ParallelCollectionRDD[43] at parallelize at :41), which has no missing parents 20/08/03 12:35:12.757 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_26 stored as values in memory (estimated size 2.0 KiB, free 2.1 GiB) 20/08/03 12:35:12.759 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_26_piece0 stored as bytes in memory (estimated size 1319.0 B, free 2.1 GiB) 20/08/03 12:35:12.760 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_26_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 1319.0 B, free: 2.1 GiB) 20/08/03 12:35:12.760 dag-scheduler-event-loop INFO SparkContext: Created broadcast 26 from broadcast at DAGScheduler.scala:1221 20/08/03 12:35:12.761 dag-scheduler-event-loop INFO DAGScheduler: Submitting 10 missing tasks from ResultStage 23 (ParallelCollectionRDD[43] at parallelize at :41) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9)) 20/08/03 12:35:12.761 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 23.0 with 10 tasks 20/08/03 12:35:12.769 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 23.0 (TID 53, amp-jenkins-worker-06.amp, executor 1, partition 0, PROCESS_LOCAL, 7890 bytes) 20/08/03 12:35:12.770 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 23.0 (TID 54, amp-jenkins-worker-06.amp, executor 0, partition 1, PROCESS_LOCAL, 7890 bytes) 20/08/03 12:35:12.804 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_26_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 1319.0 B, free: 546.3 MiB) 20/08/03 12:35:12.804 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_26_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 1319.0 B, free: 546.3 MiB) 20/08/03 12:35:12.814 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_1 in memory on amp-jenkins-worker-06.amp:39306 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.815 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_0 in memory on amp-jenkins-worker-06.amp:34884 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.848 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_0 in memory on amp-jenkins-worker-06.amp:39306 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.852 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_1 in memory on amp-jenkins-worker-06.amp:34884 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.858 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 2.0 in stage 23.0 (TID 55, amp-jenkins-worker-06.amp, executor 1, partition 2, PROCESS_LOCAL, 7890 bytes) 20/08/03 12:35:12.859 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 23.0 (TID 53) in 97 ms on amp-jenkins-worker-06.amp (executor 1) (1/10) 20/08/03 12:35:12.861 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 3.0 in stage 23.0 (TID 56, amp-jenkins-worker-06.amp, executor 0, partition 3, PROCESS_LOCAL, 7890 bytes) 20/08/03 12:35:12.861 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 23.0 (TID 54) in 92 ms on amp-jenkins-worker-06.amp (executor 0) (2/10) 20/08/03 12:35:12.869 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_2 in memory on amp-jenkins-worker-06.amp:34884 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.872 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_3 in memory on amp-jenkins-worker-06.amp:39306 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.878 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_2 in memory on amp-jenkins-worker-06.amp:39306 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.880 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_3 in memory on amp-jenkins-worker-06.amp:34884 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.883 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 4.0 in stage 23.0 (TID 57, amp-jenkins-worker-06.amp, executor 1, partition 4, PROCESS_LOCAL, 7890 bytes) 20/08/03 12:35:12.884 task-result-getter-3 INFO TaskSetManager: Finished task 2.0 in stage 23.0 (TID 55) in 26 ms on amp-jenkins-worker-06.amp (executor 1) (3/10) 20/08/03 12:35:12.885 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 5.0 in stage 23.0 (TID 58, amp-jenkins-worker-06.amp, executor 0, partition 5, PROCESS_LOCAL, 7890 bytes) 20/08/03 12:35:12.886 task-result-getter-0 INFO TaskSetManager: Finished task 3.0 in stage 23.0 (TID 56) in 26 ms on amp-jenkins-worker-06.amp (executor 0) (4/10) 20/08/03 12:35:12.895 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_4 in memory on amp-jenkins-worker-06.amp:34884 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.899 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_5 in memory on amp-jenkins-worker-06.amp:39306 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.903 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_4 in memory on amp-jenkins-worker-06.amp:39306 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.908 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_5 in memory on amp-jenkins-worker-06.amp:34884 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.908 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 6.0 in stage 23.0 (TID 59, amp-jenkins-worker-06.amp, executor 1, partition 6, PROCESS_LOCAL, 7890 bytes) 20/08/03 12:35:12.909 task-result-getter-1 INFO TaskSetManager: Finished task 4.0 in stage 23.0 (TID 57) in 26 ms on amp-jenkins-worker-06.amp (executor 1) (5/10) 20/08/03 12:35:12.914 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 7.0 in stage 23.0 (TID 60, amp-jenkins-worker-06.amp, executor 0, partition 7, PROCESS_LOCAL, 7890 bytes) 20/08/03 12:35:12.914 task-result-getter-2 INFO TaskSetManager: Finished task 5.0 in stage 23.0 (TID 58) in 29 ms on amp-jenkins-worker-06.amp (executor 0) (6/10) 20/08/03 12:35:12.918 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_6 in memory on amp-jenkins-worker-06.amp:34884 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.922 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_7 in memory on amp-jenkins-worker-06.amp:39306 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.924 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_6 in memory on amp-jenkins-worker-06.amp:39306 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.929 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 8.0 in stage 23.0 (TID 61, amp-jenkins-worker-06.amp, executor 1, partition 8, PROCESS_LOCAL, 7890 bytes) 20/08/03 12:35:12.929 task-result-getter-3 INFO TaskSetManager: Finished task 6.0 in stage 23.0 (TID 59) in 21 ms on amp-jenkins-worker-06.amp (executor 1) (7/10) 20/08/03 12:35:12.930 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_7 in memory on amp-jenkins-worker-06.amp:34884 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.934 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 9.0 in stage 23.0 (TID 62, amp-jenkins-worker-06.amp, executor 0, partition 9, PROCESS_LOCAL, 7890 bytes) 20/08/03 12:35:12.935 task-result-getter-0 INFO TaskSetManager: Finished task 7.0 in stage 23.0 (TID 60) in 22 ms on amp-jenkins-worker-06.amp (executor 0) (8/10) 20/08/03 12:35:12.937 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_8 in memory on amp-jenkins-worker-06.amp:34884 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.945 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_8 in memory on amp-jenkins-worker-06.amp:39306 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.945 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_9 in memory on amp-jenkins-worker-06.amp:39306 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.958 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_43_9 in memory on amp-jenkins-worker-06.amp:34884 (size: 376.0 B, free: 546.3 MiB) 20/08/03 12:35:12.958 task-result-getter-1 INFO TaskSetManager: Finished task 8.0 in stage 23.0 (TID 61) in 29 ms on amp-jenkins-worker-06.amp (executor 1) (9/10) 20/08/03 12:35:12.962 task-result-getter-2 INFO TaskSetManager: Finished task 9.0 in stage 23.0 (TID 62) in 28 ms on amp-jenkins-worker-06.amp (executor 0) (10/10) 20/08/03 12:35:12.963 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 23.0, whose tasks have all completed, from pool 20/08/03 12:35:12.963 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 23 (count at :41) finished in 0.208 s 20/08/03 12:35:12.963 dag-scheduler-event-loop INFO DAGScheduler: Job 21 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:35:12.963 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 23: Stage finished 20/08/03 12:35:12.963 Thread-146 INFO DAGScheduler: Job 21 finished: count at :41, took 0.209892 s 20/08/03 12:35:13.388 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'replicating blocks of object with class defined in repl' ===== 20/08/03 12:35:13.389 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'should clone and clean line object in ClosureCleaner' ===== 20/08/03 12:35:13.801 Thread-146 INFO MemoryStore: Block broadcast_27 stored as values in memory (estimated size 243.7 KiB, free 2.1 GiB) 20/08/03 12:35:13.853 Thread-146 INFO MemoryStore: Block broadcast_27_piece0 stored as bytes in memory (estimated size 23.5 KiB, free 2.1 GiB) 20/08/03 12:35:13.854 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_27_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 23.5 KiB, free: 2.1 GiB) 20/08/03 12:35:13.854 Thread-146 INFO SparkContext: Created broadcast 27 from textFile at :40 20/08/03 12:35:14.355 Thread-146 INFO FileInputFormat: Total input paths to process : 1 20/08/03 12:35:14.413 Thread-146 INFO SparkContext: Starting job: count at :42 20/08/03 12:35:14.414 dag-scheduler-event-loop INFO DAGScheduler: Got job 22 (count at :42) with 2 output partitions 20/08/03 12:35:14.414 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 24 (count at :42) 20/08/03 12:35:14.414 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:35:14.415 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:35:14.415 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 24 (MapPartitionsRDD[46] at map at :43), which has no missing parents 20/08/03 12:35:14.418 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_28 stored as values in memory (estimated size 4.5 KiB, free 2.1 GiB) 20/08/03 12:35:14.420 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_28_piece0 stored as bytes in memory (estimated size 2.6 KiB, free 2.1 GiB) 20/08/03 12:35:14.420 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_28_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 2.6 KiB, free: 2.1 GiB) 20/08/03 12:35:14.420 dag-scheduler-event-loop INFO SparkContext: Created broadcast 28 from broadcast at DAGScheduler.scala:1221 20/08/03 12:35:14.422 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 24 (MapPartitionsRDD[46] at map at :43) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:35:14.422 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_20_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 5.6 KiB, free: 2.1 GiB) 20/08/03 12:35:14.422 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 24.0 with 2 tasks 20/08/03 12:35:14.423 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_20_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 5.6 KiB, free: 546.3 MiB) 20/08/03 12:35:14.423 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 24.0 (TID 63, amp-jenkins-worker-06.amp, executor 0, partition 0, PROCESS_LOCAL, 7413 bytes) 20/08/03 12:35:14.424 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 24.0 (TID 64, amp-jenkins-worker-06.amp, executor 1, partition 1, PROCESS_LOCAL, 7413 bytes) 20/08/03 12:35:14.425 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_20_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 5.6 KiB, free: 546.3 MiB) 20/08/03 12:35:14.431 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_23_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 1322.0 B, free: 2.1 GiB) 20/08/03 12:35:14.431 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_23_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 1322.0 B, free: 546.3 MiB) 20/08/03 12:35:14.432 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_23_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 1322.0 B, free: 546.3 MiB) 20/08/03 12:35:14.434 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_28_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 2.6 KiB, free: 546.3 MiB) 20/08/03 12:35:14.441 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_25_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 3.0 KiB, free: 546.3 MiB) 20/08/03 12:35:14.441 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_28_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 2.6 KiB, free: 546.3 MiB) 20/08/03 12:35:14.442 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_25_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 3.0 KiB, free: 2.1 GiB) 20/08/03 12:35:14.442 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_25_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 3.0 KiB, free: 546.3 MiB) 20/08/03 12:35:14.446 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_26_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 1319.0 B, free: 2.1 GiB) 20/08/03 12:35:14.448 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_26_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 1319.0 B, free: 546.3 MiB) 20/08/03 12:35:14.448 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_26_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 1319.0 B, free: 546.3 MiB) 20/08/03 12:35:14.452 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_21_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 5.4 KiB, free: 2.1 GiB) 20/08/03 12:35:14.455 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_21_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 5.4 KiB, free: 546.3 MiB) 20/08/03 12:35:14.459 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_24_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 2.6 KiB, free: 2.1 GiB) 20/08/03 12:35:14.461 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_24_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 2.6 KiB, free: 546.3 MiB) 20/08/03 12:35:14.461 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_24_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 2.6 KiB, free: 546.3 MiB) 20/08/03 12:35:14.462 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_27_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 23.5 KiB, free: 546.2 MiB) 20/08/03 12:35:14.465 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_22_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 1898.0 B, free: 2.1 GiB) 20/08/03 12:35:14.467 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_22_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 1898.0 B, free: 546.3 MiB) 20/08/03 12:35:14.467 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_22_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 1898.0 B, free: 546.2 MiB) 20/08/03 12:35:14.472 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_27_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 23.5 KiB, free: 546.2 MiB) 20/08/03 12:35:14.505 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_46_0 in memory on amp-jenkins-worker-06.amp:39306 (size: 5.6 KiB, free: 546.2 MiB) 20/08/03 12:35:14.510 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 24.0 (TID 63) in 87 ms on amp-jenkins-worker-06.amp (executor 0) (1/2) 20/08/03 12:35:14.540 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_46_1 in memory on amp-jenkins-worker-06.amp:34884 (size: 6.6 KiB, free: 546.2 MiB) 20/08/03 12:35:14.544 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 24.0 (TID 64) in 120 ms on amp-jenkins-worker-06.amp (executor 1) (2/2) 20/08/03 12:35:14.544 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 24.0, whose tasks have all completed, from pool 20/08/03 12:35:14.545 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 24 (count at :42) finished in 0.129 s 20/08/03 12:35:14.545 dag-scheduler-event-loop INFO DAGScheduler: Job 22 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:35:14.545 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 24: Stage finished 20/08/03 12:35:14.545 Thread-146 INFO DAGScheduler: Job 22 finished: count at :42, took 0.131394 s 20/08/03 12:35:14.998 Thread-146 INFO SparkContext: Starting job: count at :42 20/08/03 12:35:15.000 dag-scheduler-event-loop INFO DAGScheduler: Registering RDD 47 (repartition at :41) as input to shuffle 2 20/08/03 12:35:15.000 dag-scheduler-event-loop INFO DAGScheduler: Got job 23 (count at :42) with 2 output partitions 20/08/03 12:35:15.000 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 26 (count at :42) 20/08/03 12:35:15.000 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 25) 20/08/03 12:35:15.001 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List(ShuffleMapStage 25) 20/08/03 12:35:15.001 dag-scheduler-event-loop INFO DAGScheduler: Submitting ShuffleMapStage 25 (MapPartitionsRDD[47] at repartition at :41), which has no missing parents 20/08/03 12:35:15.005 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_29 stored as values in memory (estimated size 6.5 KiB, free 2.1 GiB) 20/08/03 12:35:15.007 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_29_piece0 stored as bytes in memory (estimated size 3.5 KiB, free 2.1 GiB) 20/08/03 12:35:15.007 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_29_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 3.5 KiB, free: 2.1 GiB) 20/08/03 12:35:15.008 dag-scheduler-event-loop INFO SparkContext: Created broadcast 29 from broadcast at DAGScheduler.scala:1221 20/08/03 12:35:15.008 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ShuffleMapStage 25 (MapPartitionsRDD[47] at repartition at :41) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:35:15.009 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 25.0 with 2 tasks 20/08/03 12:35:15.010 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 25.0 (TID 65, amp-jenkins-worker-06.amp, executor 0, partition 0, PROCESS_LOCAL, 7402 bytes) 20/08/03 12:35:15.010 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 25.0 (TID 66, amp-jenkins-worker-06.amp, executor 1, partition 1, PROCESS_LOCAL, 7402 bytes) 20/08/03 12:35:15.021 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_29_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 3.5 KiB, free: 546.2 MiB) 20/08/03 12:35:15.022 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_29_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 3.5 KiB, free: 546.2 MiB) 20/08/03 12:35:15.045 task-result-getter-1 INFO TaskSetManager: Finished task 1.0 in stage 25.0 (TID 66) in 35 ms on amp-jenkins-worker-06.amp (executor 1) (1/2) 20/08/03 12:35:15.051 task-result-getter-2 INFO TaskSetManager: Finished task 0.0 in stage 25.0 (TID 65) in 41 ms on amp-jenkins-worker-06.amp (executor 0) (2/2) 20/08/03 12:35:15.051 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 25.0, whose tasks have all completed, from pool 20/08/03 12:35:15.051 dag-scheduler-event-loop INFO DAGScheduler: ShuffleMapStage 25 (repartition at :41) finished in 0.048 s 20/08/03 12:35:15.051 dag-scheduler-event-loop INFO DAGScheduler: looking for newly runnable stages 20/08/03 12:35:15.052 dag-scheduler-event-loop INFO DAGScheduler: running: Set() 20/08/03 12:35:15.052 dag-scheduler-event-loop INFO DAGScheduler: waiting: Set(ResultStage 26) 20/08/03 12:35:15.052 dag-scheduler-event-loop INFO DAGScheduler: failed: Set() 20/08/03 12:35:15.052 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 26 (MapPartitionsRDD[50] at repartition at :41), which has no missing parents 20/08/03 12:35:15.056 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_30 stored as values in memory (estimated size 4.5 KiB, free 2.1 GiB) 20/08/03 12:35:15.058 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_30_piece0 stored as bytes in memory (estimated size 2.5 KiB, free 2.1 GiB) 20/08/03 12:35:15.058 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_30_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 2.5 KiB, free: 2.1 GiB) 20/08/03 12:35:15.059 dag-scheduler-event-loop INFO SparkContext: Created broadcast 30 from broadcast at DAGScheduler.scala:1221 20/08/03 12:35:15.059 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 26 (MapPartitionsRDD[50] at repartition at :41) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:35:15.059 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 26.0 with 2 tasks 20/08/03 12:35:15.064 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 26.0 (TID 67, amp-jenkins-worker-06.amp, executor 1, partition 0, NODE_LOCAL, 7423 bytes) 20/08/03 12:35:15.065 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 26.0 (TID 68, amp-jenkins-worker-06.amp, executor 0, partition 1, NODE_LOCAL, 7423 bytes) 20/08/03 12:35:15.087 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_30_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 2.5 KiB, free: 546.2 MiB) 20/08/03 12:35:15.094 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_30_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 2.5 KiB, free: 546.2 MiB) 20/08/03 12:35:15.100 dispatcher-event-loop-3 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 2 to 192.168.10.26:43684 20/08/03 12:35:15.112 dispatcher-event-loop-2 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 2 to 192.168.10.26:43682 20/08/03 12:35:15.119 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_50_1 in memory on amp-jenkins-worker-06.amp:39306 (size: 6.2 KiB, free: 546.2 MiB) 20/08/03 12:35:15.123 task-result-getter-3 INFO TaskSetManager: Finished task 1.0 in stage 26.0 (TID 68) in 59 ms on amp-jenkins-worker-06.amp (executor 0) (1/2) 20/08/03 12:35:15.162 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added rdd_50_0 in memory on amp-jenkins-worker-06.amp:34884 (size: 6.3 KiB, free: 546.2 MiB) 20/08/03 12:35:15.168 task-result-getter-0 INFO TaskSetManager: Finished task 0.0 in stage 26.0 (TID 67) in 108 ms on amp-jenkins-worker-06.amp (executor 1) (2/2) 20/08/03 12:35:15.168 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 26.0, whose tasks have all completed, from pool 20/08/03 12:35:15.168 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 26 (count at :42) finished in 0.115 s 20/08/03 12:35:15.169 dag-scheduler-event-loop INFO DAGScheduler: Job 23 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:35:15.169 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 26: Stage finished 20/08/03 12:35:15.169 Thread-146 INFO DAGScheduler: Job 23 finished: count at :42, took 0.170638 s 20/08/03 12:35:16.914 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'should clone and clean line object in ClosureCleaner' ===== 20/08/03 12:35:16.916 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'SPARK-31399: should clone+clean line object w/ non-serializable state in ClosureCleaner' ===== 20/08/03 12:35:18.199 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_30_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 2.5 KiB, free: 2.1 GiB) 20/08/03 12:35:18.201 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_30_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 2.5 KiB, free: 546.2 MiB) 20/08/03 12:35:18.206 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_30_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 2.5 KiB, free: 546.2 MiB) 20/08/03 12:35:18.215 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_28_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 2.6 KiB, free: 2.1 GiB) 20/08/03 12:35:18.220 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_28_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 2.6 KiB, free: 546.2 MiB) 20/08/03 12:35:18.221 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_28_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 2.6 KiB, free: 546.2 MiB) 20/08/03 12:35:18.228 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_29_piece0 on amp-jenkins-worker-06.amp:33461 in memory (size: 3.5 KiB, free: 2.1 GiB) 20/08/03 12:35:18.228 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_29_piece0 on amp-jenkins-worker-06.amp:34884 in memory (size: 3.5 KiB, free: 546.2 MiB) 20/08/03 12:35:18.230 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Removed broadcast_29_piece0 on amp-jenkins-worker-06.amp:39306 in memory (size: 3.5 KiB, free: 546.2 MiB) 20/08/03 12:35:18.866 Thread-146 INFO SparkContext: Starting job: collect at :42 20/08/03 12:35:18.867 dag-scheduler-event-loop INFO DAGScheduler: Got job 24 (collect at :42) with 2 output partitions 20/08/03 12:35:18.867 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 27 (collect at :42) 20/08/03 12:35:18.867 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:35:18.867 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:35:18.867 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 27 (MapPartitionsRDD[52] at map at :42), which has no missing parents 20/08/03 12:35:18.869 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_31 stored as values in memory (estimated size 3.5 KiB, free 2.1 GiB) 20/08/03 12:35:18.872 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_31_piece0 stored as bytes in memory (estimated size 1945.0 B, free 2.1 GiB) 20/08/03 12:35:18.903 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_31_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 1945.0 B, free: 2.1 GiB) 20/08/03 12:35:18.904 dag-scheduler-event-loop INFO SparkContext: Created broadcast 31 from broadcast at DAGScheduler.scala:1221 20/08/03 12:35:18.904 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 27 (MapPartitionsRDD[52] at map at :42) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:35:18.904 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 27.0 with 2 tasks 20/08/03 12:35:18.906 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 27.0 (TID 69, amp-jenkins-worker-06.amp, executor 1, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:35:18.906 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 27.0 (TID 70, amp-jenkins-worker-06.amp, executor 0, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:35:18.919 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_31_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 1945.0 B, free: 546.2 MiB) 20/08/03 12:35:18.919 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_31_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 1945.0 B, free: 546.2 MiB) 20/08/03 12:35:18.938 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 27.0 (TID 69) in 32 ms on amp-jenkins-worker-06.amp (executor 1) (1/2) 20/08/03 12:35:19.243 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 27.0 (TID 70) in 337 ms on amp-jenkins-worker-06.amp (executor 0) (2/2) 20/08/03 12:35:19.243 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 27.0, whose tasks have all completed, from pool 20/08/03 12:35:19.244 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 27 (collect at :42) finished in 0.376 s 20/08/03 12:35:19.244 dag-scheduler-event-loop INFO DAGScheduler: Job 24 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:35:19.244 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 27: Stage finished 20/08/03 12:35:19.244 Thread-146 INFO DAGScheduler: Job 24 finished: collect at :42, took 0.378142 s 20/08/03 12:35:19.694 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'SPARK-31399: should clone+clean line object w/ non-serializable state in ClosureCleaner' ===== 20/08/03 12:35:19.695 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'SPARK-31399: ClosureCleaner should discover indirectly nested closure in inner class' ===== 20/08/03 12:35:20.315 Thread-146 INFO SparkContext: Starting job: collect at :42 20/08/03 12:35:20.316 dag-scheduler-event-loop INFO DAGScheduler: Got job 25 (collect at :42) with 2 output partitions 20/08/03 12:35:20.316 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 28 (collect at :42) 20/08/03 12:35:20.316 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:35:20.316 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:35:20.317 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 28 (MapPartitionsRDD[54] at map at :42), which has no missing parents 20/08/03 12:35:20.319 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_32 stored as values in memory (estimated size 3.5 KiB, free 2.1 GiB) 20/08/03 12:35:20.321 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_32_piece0 stored as bytes in memory (estimated size 1946.0 B, free 2.1 GiB) 20/08/03 12:35:20.322 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_32_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 1946.0 B, free: 2.1 GiB) 20/08/03 12:35:20.322 dag-scheduler-event-loop INFO SparkContext: Created broadcast 32 from broadcast at DAGScheduler.scala:1221 20/08/03 12:35:20.323 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 28 (MapPartitionsRDD[54] at map at :42) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:35:20.323 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 28.0 with 2 tasks 20/08/03 12:35:20.324 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 28.0 (TID 71, amp-jenkins-worker-06.amp, executor 0, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:35:20.324 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 28.0 (TID 72, amp-jenkins-worker-06.amp, executor 1, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:35:20.337 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_32_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 1946.0 B, free: 546.2 MiB) 20/08/03 12:35:20.337 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_32_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 1946.0 B, free: 546.2 MiB) 20/08/03 12:35:20.365 task-result-getter-3 INFO TaskSetManager: Finished task 0.0 in stage 28.0 (TID 71) in 41 ms on amp-jenkins-worker-06.amp (executor 0) (1/2) 20/08/03 12:35:20.366 task-result-getter-0 INFO TaskSetManager: Finished task 1.0 in stage 28.0 (TID 72) in 42 ms on amp-jenkins-worker-06.amp (executor 1) (2/2) 20/08/03 12:35:20.366 task-result-getter-0 INFO TaskSchedulerImpl: Removed TaskSet 28.0, whose tasks have all completed, from pool 20/08/03 12:35:20.367 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 28 (collect at :42) finished in 0.049 s 20/08/03 12:35:20.367 dag-scheduler-event-loop INFO DAGScheduler: Job 25 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:35:20.367 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 28: Stage finished 20/08/03 12:35:20.367 Thread-146 INFO DAGScheduler: Job 25 finished: collect at :42, took 0.051601 s 20/08/03 12:35:20.701 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'SPARK-31399: ClosureCleaner should discover indirectly nested closure in inner class' ===== 20/08/03 12:35:20.702 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'newProductSeqEncoder with REPL defined class' ===== 20/08/03 12:35:21.716 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'newProductSeqEncoder with REPL defined class' ===== 20/08/03 12:35:21.718 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== TEST OUTPUT FOR o.a.s.repl.SingletonReplSuite: 'create encoder in executors' ===== 20/08/03 12:35:22.426 Thread-146 INFO SparkContext: Starting job: collect at :44 20/08/03 12:35:22.426 dag-scheduler-event-loop INFO DAGScheduler: Got job 26 (collect at :44) with 2 output partitions 20/08/03 12:35:22.426 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 29 (collect at :44) 20/08/03 12:35:22.427 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 20/08/03 12:35:22.427 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 20/08/03 12:35:22.427 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 29 (MapPartitionsRDD[56] at map at :44), which has no missing parents 20/08/03 12:35:22.428 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_33 stored as values in memory (estimated size 3.4 KiB, free 2.1 GiB) 20/08/03 12:35:22.430 dag-scheduler-event-loop INFO MemoryStore: Block broadcast_33_piece0 stored as bytes in memory (estimated size 1878.0 B, free 2.1 GiB) 20/08/03 12:35:22.431 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_33_piece0 in memory on amp-jenkins-worker-06.amp:33461 (size: 1878.0 B, free: 2.1 GiB) 20/08/03 12:35:22.431 dag-scheduler-event-loop INFO SparkContext: Created broadcast 33 from broadcast at DAGScheduler.scala:1221 20/08/03 12:35:22.432 dag-scheduler-event-loop INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 29 (MapPartitionsRDD[56] at map at :44) (first 15 tasks are for partitions Vector(0, 1)) 20/08/03 12:35:22.432 dag-scheduler-event-loop INFO TaskSchedulerImpl: Adding task set 29.0 with 2 tasks 20/08/03 12:35:22.433 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 0.0 in stage 29.0 (TID 73, amp-jenkins-worker-06.amp, executor 1, partition 0, PROCESS_LOCAL, 7397 bytes) 20/08/03 12:35:22.433 dispatcher-CoarseGrainedScheduler INFO TaskSetManager: Starting task 1.0 in stage 29.0 (TID 74, amp-jenkins-worker-06.amp, executor 0, partition 1, PROCESS_LOCAL, 7454 bytes) 20/08/03 12:35:22.446 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_33_piece0 in memory on amp-jenkins-worker-06.amp:34884 (size: 1878.0 B, free: 546.2 MiB) 20/08/03 12:35:22.473 dispatcher-BlockManagerMaster INFO BlockManagerInfo: Added broadcast_33_piece0 in memory on amp-jenkins-worker-06.amp:39306 (size: 1878.0 B, free: 546.2 MiB) 20/08/03 12:35:22.477 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 29.0 (TID 73) in 44 ms on amp-jenkins-worker-06.amp (executor 1) (1/2) 20/08/03 12:35:25.033 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 29.0 (TID 74) in 2600 ms on amp-jenkins-worker-06.amp (executor 0) (2/2) 20/08/03 12:35:25.033 task-result-getter-2 INFO TaskSchedulerImpl: Removed TaskSet 29.0, whose tasks have all completed, from pool 20/08/03 12:35:25.034 dag-scheduler-event-loop INFO DAGScheduler: ResultStage 29 (collect at :44) finished in 2.607 s 20/08/03 12:35:25.034 dag-scheduler-event-loop INFO DAGScheduler: Job 26 is finished. Cancelling potential speculative or zombie tasks for this job 20/08/03 12:35:25.034 dag-scheduler-event-loop INFO TaskSchedulerImpl: Killing all running tasks in stage 29: Stage finished 20/08/03 12:35:25.034 Thread-146 INFO DAGScheduler: Job 26 finished: collect at :44, took 2.608401 s 20/08/03 12:35:25.233 pool-1-thread-1-ScalaTest-running-SingletonReplSuite INFO SingletonReplSuite: ===== FINISHED o.a.s.repl.SingletonReplSuite: 'create encoder in executors' ===== 20/08/03 12:35:25.245 Thread-146 INFO StandaloneSchedulerBackend: Shutting down all executors 20/08/03 12:35:25.246 dispatcher-CoarseGrainedScheduler INFO CoarseGrainedSchedulerBackend$DriverEndpoint: Asking each executor to shut down 20/08/03 12:35:25.247 Thread-146 INFO LocalSparkCluster: Shutting down local Spark cluster. 20/08/03 12:35:25.248 ExecutorRunner for app-20200803123444-0000/0 INFO ExecutorRunner: Runner thread for executor app-20200803123444-0000/0 interrupted 20/08/03 12:35:25.248 ExecutorRunner for app-20200803123444-0000/0 INFO ExecutorRunner: Killing process! 20/08/03 12:35:25.252 dispatcher-event-loop-2 INFO Master: Received unregister request from application app-20200803123444-0000 20/08/03 12:35:25.252 dispatcher-event-loop-2 INFO Master: Removing app app-20200803123444-0000 20/08/03 12:35:25.253 rpc-client-102-1 ERROR TransportRequestHandler: Error while invoking RpcHandler#receive() for one-way message. org.apache.spark.rpc.RpcEnvStoppedException: RpcEnv already stopped. at org.apache.spark.rpc.netty.Dispatcher.postMessage(Dispatcher.scala:167) at org.apache.spark.rpc.netty.Dispatcher.postOneWayMessage(Dispatcher.scala:150) at org.apache.spark.rpc.netty.NettyRpcHandler.receive(NettyRpcEnv.scala:684) at org.apache.spark.network.server.TransportRequestHandler.processOneWayMessage(TransportRequestHandler.java:253) at org.apache.spark.network.server.TransportRequestHandler.handle(TransportRequestHandler.java:111) at org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:140) at org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:53) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at org.apache.spark.network.util.TransportFrameDecoder.channelRead(TransportFrameDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 20/08/03 12:35:25.254 dispatcher-event-loop-15 INFO Worker: Asked to kill executor app-20200803123444-0000/1 20/08/03 12:35:25.254 ExecutorRunner for app-20200803123444-0000/1 INFO ExecutorRunner: Runner thread for executor app-20200803123444-0000/1 interrupted 20/08/03 12:35:25.254 ExecutorRunner for app-20200803123444-0000/1 INFO ExecutorRunner: Killing process! 20/08/03 12:35:25.255 rpc-client-102-1 ERROR TransportRequestHandler: Error while invoking RpcHandler#receive() for one-way message. org.apache.spark.rpc.RpcEnvStoppedException: RpcEnv already stopped. at org.apache.spark.rpc.netty.Dispatcher.postMessage(Dispatcher.scala:167) at org.apache.spark.rpc.netty.Dispatcher.postOneWayMessage(Dispatcher.scala:150) at org.apache.spark.rpc.netty.NettyRpcHandler.receive(NettyRpcEnv.scala:684) at org.apache.spark.network.server.TransportRequestHandler.processOneWayMessage(TransportRequestHandler.java:253) at org.apache.spark.network.server.TransportRequestHandler.handle(TransportRequestHandler.java:111) at org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:140) at org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:53) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at org.apache.spark.network.util.TransportFrameDecoder.channelRead(TransportFrameDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 20/08/03 12:35:25.257 dispatcher-event-loop-16 INFO AbstractConnector: Stopped Spark@6eee5f64{HTTP/1.1,[http/1.1]}{0.0.0.0:0} 20/08/03 12:35:25.262 dispatcher-event-loop-3 INFO Master: 192.168.10.26:48654 got disassociated, removing it. 20/08/03 12:35:25.262 dispatcher-event-loop-3 INFO Master: amp-jenkins-worker-06.amp:34141 got disassociated, removing it. 20/08/03 12:35:25.263 dispatcher-event-loop-3 INFO Master: Removing worker worker-20200803123444-amp-jenkins-worker-06.amp-34141 on amp-jenkins-worker-06.amp:34141 20/08/03 12:35:25.263 dispatcher-event-loop-3 INFO Master: Telling app of lost worker: worker-20200803123444-amp-jenkins-worker-06.amp-34141 20/08/03 12:35:25.376 dispatcher-event-loop-18 INFO AbstractConnector: Stopped Spark@63f815fb{HTTP/1.1,[http/1.1]}{0.0.0.0:0} 20/08/03 12:35:25.378 dispatcher-event-loop-6 INFO Master: 192.168.10.26:48658 got disassociated, removing it. 20/08/03 12:35:25.378 dispatcher-event-loop-6 INFO Master: amp-jenkins-worker-06.amp:45396 got disassociated, removing it. 20/08/03 12:35:25.378 dispatcher-event-loop-6 INFO Master: Removing worker worker-20200803123444-amp-jenkins-worker-06.amp-45396 on amp-jenkins-worker-06.amp:45396 20/08/03 12:35:25.378 dispatcher-event-loop-6 INFO Master: Telling app of lost worker: worker-20200803123444-amp-jenkins-worker-06.amp-45396 20/08/03 12:35:25.520 dispatcher-event-loop-10 INFO AbstractConnector: Stopped Spark@20c5f991{HTTP/1.1,[http/1.1]}{0.0.0.0:0} 20/08/03 12:35:25.566 dispatcher-event-loop-20 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 20/08/03 12:35:25.592 Thread-146 INFO MemoryStore: MemoryStore cleared 20/08/03 12:35:25.592 Thread-146 INFO BlockManager: BlockManager stopped 20/08/03 12:35:25.592 Thread-146 INFO BlockManagerMaster: BlockManagerMaster stopped 20/08/03 12:35:25.594 dispatcher-event-loop-25 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 20/08/03 12:35:25.626 Thread-146 INFO SparkContext: Successfully stopped SparkContext 20/08/03 12:35:25.633 pool-1-thread-1 WARN SingletonReplSuite: ===== POSSIBLE THREAD LEAK IN SUITE o.a.s.repl.SingletonReplSuite, thread names: ExecutorRunner for app-20200803123444-0000/0, File appending thread for /home/jenkins/workspace/NewSparkPullRequestBuilder/work/app-20200803123444-0000/0/stderr, rpc-boss-97-1, File appending thread for /home/jenkins/workspace/NewSparkPullRequestBuilder/work/app-20200803123444-0000/1/stdout, rpc-boss-107-1, rpc-boss-103-1, rpc-boss-100-1, shuffle-boss-111-1, File appending thread for /home/jenkins/workspace/NewSparkPullRequestBuilder/work/app-20200803123444-0000/1/stderr, File appending thread for /home/jenkins/workspace/NewSparkPullRequestBuilder/work/app-20200803123444-0000/0/stdout, ExecutorRunner for app-20200803123444-0000/1 ===== 20/08/03 12:35:25.671 Thread-2 INFO ShutdownHookManager: Shutdown hook called 20/08/03 12:35:25.672 Thread-2 INFO ShutdownHookManager: Deleting directory /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-b784d7bd-410c-4e90-b640-2cfb8629b75f 20/08/03 12:35:25.759 Thread-2 INFO ShutdownHookManager: Deleting directory /home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-b784d7bd-410c-4e90-b640-2cfb8629b75f/repl-83df328c-6efe-4b22-8f82-88c0f6e1762b