Failed

org.apache.spark.sql.hive.HiveExternalCatalogVersionsSuite.(It is not a test it is a sbt.testing.SuiteSelector)

Failing for the past 1 build (Since Failed#105501 )
Took 7.8 sec.

Error Message

org.scalatest.exceptions.TestFailedException: spark-submit returned with exit code 1. Command line: './bin/spark-submit' '--name' 'prepare testing tables' '--master' 'local[2]' '--conf' 'spark.ui.enabled=false' '--conf' 'spark.master.rest.enabled=false' '--conf' 'spark.sql.warehouse.dir=/home/jenkins/workspace/SparkPullRequestBuilder/target/tmp/warehouse-dc2ac3cb-0417-45de-ac17-f15f5c1d8a96' '--conf' 'spark.sql.test.version.index=0' '--driver-java-options' '-Dderby.system.home=/home/jenkins/workspace/SparkPullRequestBuilder/target/tmp/warehouse-dc2ac3cb-0417-45de-ac17-f15f5c1d8a96' '/home/jenkins/workspace/SparkPullRequestBuilder/target/tmp/test1466366628647132878.py'  2019-05-17 14:53:42.069 - stdout> Traceback (most recent call last): 2019-05-17 14:53:42.069 - stdout>   File "/home/jenkins/workspace/SparkPullRequestBuilder/target/tmp/test1466366628647132878.py", line 2, in <module> 2019-05-17 14:53:42.069 - stdout>     from pyspark.sql import SparkSession 2019-05-17 14:53:42.069 - stdout>   File "<frozen importlib._bootstrap>", line 971, in _find_and_load 2019-05-17 14:53:42.069 - stdout>   File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked 2019-05-17 14:53:42.069 - stdout>   File "<frozen importlib._bootstrap>", line 656, in _load_unlocked 2019-05-17 14:53:42.07 - stdout>   File "<frozen importlib._bootstrap>", line 626, in _load_backward_compatible 2019-05-17 14:53:42.07 - stdout>   File "/home/jenkins/workspace/SparkPullRequestBuilder/target/tmp/test-spark-bf3263e1-c8ba-4f84-ba12-abfcf748cb04/spark-2.0.2/python/lib/pyspark.zip/pyspark/__init__.py", line 44, in <module> 2019-05-17 14:53:42.07 - stdout>   File "<frozen importlib._bootstrap>", line 971, in _find_and_load 2019-05-17 14:53:42.071 - stdout>   File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked 2019-05-17 14:53:42.071 - stdout>   File "<frozen importlib._bootstrap>", line 656, in _load_unlocked 2019-05-17 14:53:42.071 - stdout>   File "<frozen importlib._bootstrap>", line 626, in _load_backward_compatible 2019-05-17 14:53:42.071 - stdout>   File "/home/jenkins/workspace/SparkPullRequestBuilder/target/tmp/test-spark-bf3263e1-c8ba-4f84-ba12-abfcf748cb04/spark-2.0.2/python/lib/pyspark.zip/pyspark/context.py", line 33, in <module> 2019-05-17 14:53:42.071 - stdout>   File "<frozen importlib._bootstrap>", line 971, in _find_and_load 2019-05-17 14:53:42.071 - stdout>   File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked 2019-05-17 14:53:42.071 - stdout>   File "<frozen importlib._bootstrap>", line 656, in _load_unlocked 2019-05-17 14:53:42.071 - stdout>   File "<frozen importlib._bootstrap>", line 626, in _load_backward_compatible 2019-05-17 14:53:42.071 - stdout>   File "/home/jenkins/workspace/SparkPullRequestBuilder/target/tmp/test-spark-bf3263e1-c8ba-4f84-ba12-abfcf748cb04/spark-2.0.2/python/lib/pyspark.zip/pyspark/java_gateway.py", line 25, in <module> 2019-05-17 14:53:42.071 - stdout>   File "/home/anaconda/envs/py3k/lib/python3.6/platform.py", line 919, in <module> 2019-05-17 14:53:42.087 - stdout>     "system node release version machine processor") 2019-05-17 14:53:42.087 - stdout>   File "/home/jenkins/workspace/SparkPullRequestBuilder/target/tmp/test-spark-bf3263e1-c8ba-4f84-ba12-abfcf748cb04/spark-2.0.2/python/lib/pyspark.zip/pyspark/serializers.py", line 381, in namedtuple 2019-05-17 14:53:42.088 - stdout> TypeError: namedtuple() missing 3 required keyword-only arguments: 'verbose', 'rename', and 'module'            

Stacktrace

sbt.ForkMain$ForkError: org.scalatest.exceptions.TestFailedException: spark-submit returned with exit code 1.
Command line: './bin/spark-submit' '--name' 'prepare testing tables' '--master' 'local[2]' '--conf' 'spark.ui.enabled=false' '--conf' 'spark.master.rest.enabled=false' '--conf' 'spark.sql.warehouse.dir=/home/jenkins/workspace/SparkPullRequestBuilder/target/tmp/warehouse-dc2ac3cb-0417-45de-ac17-f15f5c1d8a96' '--conf' 'spark.sql.test.version.index=0' '--driver-java-options' '-Dderby.system.home=/home/jenkins/workspace/SparkPullRequestBuilder/target/tmp/warehouse-dc2ac3cb-0417-45de-ac17-f15f5c1d8a96' '/home/jenkins/workspace/SparkPullRequestBuilder/target/tmp/test1466366628647132878.py'

2019-05-17 14:53:42.069 - stdout> Traceback (most recent call last):
2019-05-17 14:53:42.069 - stdout>   File "/home/jenkins/workspace/SparkPullRequestBuilder/target/tmp/test1466366628647132878.py", line 2, in <module>
2019-05-17 14:53:42.069 - stdout>     from pyspark.sql import SparkSession
2019-05-17 14:53:42.069 - stdout>   File "<frozen importlib._bootstrap>", line 971, in _find_and_load
2019-05-17 14:53:42.069 - stdout>   File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
2019-05-17 14:53:42.069 - stdout>   File "<frozen importlib._bootstrap>", line 656, in _load_unlocked
2019-05-17 14:53:42.07 - stdout>   File "<frozen importlib._bootstrap>", line 626, in _load_backward_compatible
2019-05-17 14:53:42.07 - stdout>   File "/home/jenkins/workspace/SparkPullRequestBuilder/target/tmp/test-spark-bf3263e1-c8ba-4f84-ba12-abfcf748cb04/spark-2.0.2/python/lib/pyspark.zip/pyspark/__init__.py", line 44, in <module>
2019-05-17 14:53:42.07 - stdout>   File "<frozen importlib._bootstrap>", line 971, in _find_and_load
2019-05-17 14:53:42.071 - stdout>   File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
2019-05-17 14:53:42.071 - stdout>   File "<frozen importlib._bootstrap>", line 656, in _load_unlocked
2019-05-17 14:53:42.071 - stdout>   File "<frozen importlib._bootstrap>", line 626, in _load_backward_compatible
2019-05-17 14:53:42.071 - stdout>   File "/home/jenkins/workspace/SparkPullRequestBuilder/target/tmp/test-spark-bf3263e1-c8ba-4f84-ba12-abfcf748cb04/spark-2.0.2/python/lib/pyspark.zip/pyspark/context.py", line 33, in <module>
2019-05-17 14:53:42.071 - stdout>   File "<frozen importlib._bootstrap>", line 971, in _find_and_load
2019-05-17 14:53:42.071 - stdout>   File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
2019-05-17 14:53:42.071 - stdout>   File "<frozen importlib._bootstrap>", line 656, in _load_unlocked
2019-05-17 14:53:42.071 - stdout>   File "<frozen importlib._bootstrap>", line 626, in _load_backward_compatible
2019-05-17 14:53:42.071 - stdout>   File "/home/jenkins/workspace/SparkPullRequestBuilder/target/tmp/test-spark-bf3263e1-c8ba-4f84-ba12-abfcf748cb04/spark-2.0.2/python/lib/pyspark.zip/pyspark/java_gateway.py", line 25, in <module>
2019-05-17 14:53:42.071 - stdout>   File "/home/anaconda/envs/py3k/lib/python3.6/platform.py", line 919, in <module>
2019-05-17 14:53:42.087 - stdout>     "system node release version machine processor")
2019-05-17 14:53:42.087 - stdout>   File "/home/jenkins/workspace/SparkPullRequestBuilder/target/tmp/test-spark-bf3263e1-c8ba-4f84-ba12-abfcf748cb04/spark-2.0.2/python/lib/pyspark.zip/pyspark/serializers.py", line 381, in namedtuple
2019-05-17 14:53:42.088 - stdout> TypeError: namedtuple() missing 3 required keyword-only arguments: 'verbose', 'rename', and 'module'
           
	at org.scalatest.Assertions$class.newAssertionFailedException(Assertions.scala:528)
	at org.scalatest.FunSuite.newAssertionFailedException(FunSuite.scala:1560)
	at org.scalatest.Assertions$class.fail(Assertions.scala:1089)
	at org.scalatest.FunSuite.fail(FunSuite.scala:1560)
	at org.apache.spark.sql.hive.SparkSubmitTestUtils$class.runSparkSubmit(SparkSubmitTestUtils.scala:81)
	at org.apache.spark.sql.hive.HiveExternalCatalogVersionsSuite.runSparkSubmit(HiveExternalCatalogVersionsSuite.scala:38)
	at org.apache.spark.sql.hive.HiveExternalCatalogVersionsSuite$$anonfun$beforeAll$1.apply(HiveExternalCatalogVersionsSuite.scala:123)
	at org.apache.spark.sql.hive.HiveExternalCatalogVersionsSuite$$anonfun$beforeAll$1.apply(HiveExternalCatalogVersionsSuite.scala:108)
	at scala.collection.immutable.List.foreach(List.scala:381)
	at org.apache.spark.sql.hive.HiveExternalCatalogVersionsSuite.beforeAll(HiveExternalCatalogVersionsSuite.scala:108)
	at org.scalatest.BeforeAndAfterAll$class.liftedTree1$1(BeforeAndAfterAll.scala:212)
	at org.scalatest.BeforeAndAfterAll$class.run(BeforeAndAfterAll.scala:210)
	at org.apache.spark.SparkFunSuite.run(SparkFunSuite.scala:31)
	at org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:314)
	at org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:480)
	at sbt.ForkMain$Run$2.call(ForkMain.java:296)
	at sbt.ForkMain$Run$2.call(ForkMain.java:286)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)