FailedConsole Output

Skipping 30,222 KB.. Full Log
ZBWZG+mAAAAkR+LCAAAAAAAAP9b85aBtbiIQT2jNKU4P0+vIKc0PTOvWC8xrzgzOT8nv0gvODO3ICfVoyQ3xy+/JNU2Yj/Tagmf50wMjD4M7CWJ6SCJEgYhn6zEskT9nMS8dP3gkqLMvHTriiIGKaihyfl5xfk5qXrOEBpkDgMEMDIxMFQUlDCw2+gXFyTm2QEAI9P8iI4AAAA= started
[info] Test test.org.apache.spark.sql.JavaDataFrameSuite.testSampleBy started
[info] Test test.org.apache.spark.sql.JavaDataFrameSuite.testCrosstab started
[info] Test test.org.apache.spark.sql.JavaDataFrameSuite.testUDF started
[info] Test test.org.apache.spark.sql.JavaDataFrameSuite.testCreateDataFromFromList started
[info] Test test.org.apache.spark.sql.JavaDataFrameSuite.testCircularReferenceBean started
[info] Test test.org.apache.spark.sql.JavaDataFrameSuite.testFrequentItems started
[info] Test test.org.apache.spark.sql.JavaDataFrameSuite.testSampleByColumn started
[info] Test test.org.apache.spark.sql.JavaDataFrameSuite.testExecution started
[info] Test test.org.apache.spark.sql.JavaDataFrameSuite.testTextLoad started
[info] Test test.org.apache.spark.sql.JavaDataFrameSuite.pivot started
[info] Test test.org.apache.spark.sql.JavaDataFrameSuite.testGenericLoad started
[info] Test test.org.apache.spark.sql.JavaDataFrameSuite.testCountMinSketch started
[info] Test test.org.apache.spark.sql.JavaDataFrameSuite.pivotColumnValues started
[info] Test test.org.apache.spark.sql.JavaDataFrameSuite.testCreateDataFrameFromJavaBeans started
[info] Test test.org.apache.spark.sql.JavaDataFrameSuite.testCorrelation started
[info] Test test.org.apache.spark.sql.JavaDataFrameSuite.testBloomFilter started
[info] Test test.org.apache.spark.sql.JavaDataFrameSuite.testCovariance started
[info] Test test.org.apache.spark.sql.JavaDataFrameSuite.testCreateDataFrameFromLocalJavaBeans started
[info] Test run finished: 0 failed, 0 ignored, 23 total, 9.868s
[info] Test run started
[info] Test test.org.apache.spark.sql.JavaDataFrameWriterV2Suite.testOverwritePartitionsAPI started
10:20:35.616 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
10:20:35.652 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
[info] Test test.org.apache.spark.sql.JavaDataFrameWriterV2Suite.testReplaceAPI started
10:20:35.770 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
10:20:35.806 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
10:20:35.843 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
10:20:35.883 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
10:20:35.921 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
[info] Test test.org.apache.spark.sql.JavaDataFrameWriterV2Suite.testAppendAPI started
10:20:36.043 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
10:20:36.079 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
[info] Test test.org.apache.spark.sql.JavaDataFrameWriterV2Suite.testCreateOrReplaceAPI started
10:20:36.239 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
10:20:36.274 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
10:20:36.309 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
10:20:36.342 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
10:20:36.375 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
[info] Test test.org.apache.spark.sql.JavaDataFrameWriterV2Suite.testOverwriteAPI started
10:20:36.487 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
10:20:36.523 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
[info] Test test.org.apache.spark.sql.JavaDataFrameWriterV2Suite.testCreateAPI started
10:20:36.642 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
10:20:36.686 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
10:20:36.727 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
10:20:36.768 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
10:20:36.809 WARN org.apache.spark.sql.execution.datasources.DataSource: All paths were ignored:
  
[info] Test run finished: 0 failed, 0 ignored, 6 total, 1.315s
[info] Test run started
[info] Test test.org.apache.spark.sql.JavaRowSuite.constructSimpleRow started
[info] Test test.org.apache.spark.sql.JavaRowSuite.constructComplexRow started
[info] Test run finished: 0 failed, 0 ignored, 2 total, 0.002s
[info] ScalaTest
[info] Run completed in 1 hour, 34 minutes, 55 seconds.
[info] Total number of tests run: 8820
[info] Suites: completed 378, aborted 0
[info] Tests: succeeded 8820, failed 0, canceled 1, ignored 52, pending 0
[info] All tests passed.
[info] Passed: Total 8945, Failed 0, Errors 0, Passed 8945, Ignored 52, Canceled 1
[success] Total time: 5720 s (01:35:20), completed Nov 27, 2020 10:20:44 AM

========================================================================
Running PySpark tests
========================================================================
Running PySpark tests. Output is in /home/jenkins/workspace/spark-master-test-sbt-hadoop-3.2-hive-2.3/python/unit-tests.log
Will test against the following Python executables: ['python3.6', 'pypy3']
Will test the following Python modules: ['pyspark-core', 'pyspark-ml', 'pyspark-mllib', 'pyspark-resource', 'pyspark-sql', 'pyspark-streaming']
python3.6 python_implementation is CPython
python3.6 version is: Python 3.6.8 :: Anaconda, Inc.
pypy3 python_implementation is PyPy
pypy3 version is: Python 3.6.9 (7.3.1+dfsg-4, Apr 22 2020, 05:15:29)
[PyPy 7.3.1 with GCC 9.3.0]
Starting test(pypy3): pyspark.sql.tests.test_arrow
Starting test(pypy3): pyspark.sql.tests.test_catalog
Starting test(pypy3): pyspark.sql.tests.test_column
Starting test(pypy3): pyspark.sql.tests.test_conf
Finished test(pypy3): pyspark.sql.tests.test_arrow (2s) ... 67 tests were skipped
Starting test(pypy3): pyspark.sql.tests.test_context
Finished test(pypy3): pyspark.sql.tests.test_conf (10s)
Starting test(pypy3): pyspark.sql.tests.test_dataframe
Finished test(pypy3): pyspark.sql.tests.test_catalog (20s)
Starting test(pypy3): pyspark.sql.tests.test_datasources
Finished test(pypy3): pyspark.sql.tests.test_context (26s)
Starting test(pypy3): pyspark.sql.tests.test_functions
Finished test(pypy3): pyspark.sql.tests.test_column (32s)
Starting test(pypy3): pyspark.sql.tests.test_group
Finished test(pypy3): pyspark.sql.tests.test_datasources (23s)
Starting test(pypy3): pyspark.sql.tests.test_pandas_cogrouped_map
Finished test(pypy3): pyspark.sql.tests.test_pandas_cogrouped_map (2s) ... 15 tests were skipped
Starting test(pypy3): pyspark.sql.tests.test_pandas_grouped_map
Finished test(pypy3): pyspark.sql.tests.test_pandas_grouped_map (2s) ... 21 tests were skipped
Starting test(pypy3): pyspark.sql.tests.test_pandas_map
Finished test(pypy3): pyspark.sql.tests.test_group (19s)
Starting test(pypy3): pyspark.sql.tests.test_pandas_udf
Finished test(pypy3): pyspark.sql.tests.test_pandas_map (2s) ... 6 tests were skipped
Starting test(pypy3): pyspark.sql.tests.test_pandas_udf_grouped_agg
Finished test(pypy3): pyspark.sql.tests.test_pandas_udf_grouped_agg (2s) ... 16 tests were skipped
Starting test(pypy3): pyspark.sql.tests.test_pandas_udf_scalar
Finished test(pypy3): pyspark.sql.tests.test_pandas_udf (2s) ... 6 tests were skipped
Starting test(pypy3): pyspark.sql.tests.test_pandas_udf_typehints
Finished test(pypy3): pyspark.sql.tests.test_pandas_udf_scalar (2s) ... 51 tests were skipped
Starting test(pypy3): pyspark.sql.tests.test_pandas_udf_window
Finished test(pypy3): pyspark.sql.tests.test_pandas_udf_typehints (2s) ... 10 tests were skipped
Starting test(pypy3): pyspark.sql.tests.test_readwriter
Finished test(pypy3): pyspark.sql.tests.test_pandas_udf_window (2s) ... 14 tests were skipped
Starting test(pypy3): pyspark.sql.tests.test_serde
Finished test(pypy3): pyspark.sql.tests.test_readwriter (37s)
Starting test(pypy3): pyspark.sql.tests.test_session
Finished test(pypy3): pyspark.sql.tests.test_serde (36s)
Starting test(pypy3): pyspark.sql.tests.test_streaming
Finished test(pypy3): pyspark.sql.tests.test_dataframe (89s) ... 10 tests were skipped
Starting test(pypy3): pyspark.sql.tests.test_types
Finished test(pypy3): pyspark.sql.tests.test_functions (75s)
Starting test(pypy3): pyspark.sql.tests.test_udf
Finished test(pypy3): pyspark.sql.tests.test_session (40s)
Starting test(pypy3): pyspark.sql.tests.test_utils
Finished test(pypy3): pyspark.sql.tests.test_streaming (41s)
Starting test(pypy3): pyspark.streaming.tests.test_context
Finished test(pypy3): pyspark.sql.tests.test_utils (13s)
Starting test(pypy3): pyspark.streaming.tests.test_dstream
Finished test(pypy3): pyspark.streaming.tests.test_dstream (2s) ... 21 tests were skipped
Starting test(pypy3): pyspark.streaming.tests.test_kinesis
Finished test(pypy3): pyspark.streaming.tests.test_kinesis (2s) ... 2 tests were skipped
Starting test(pypy3): pyspark.streaming.tests.test_listener
Finished test(pypy3): pyspark.streaming.tests.test_listener (14s)
Starting test(pypy3): pyspark.tests.test_appsubmit
Finished test(pypy3): pyspark.streaming.tests.test_context (42s)
Starting test(pypy3): pyspark.tests.test_broadcast
Finished test(pypy3): pyspark.tests.test_broadcast (44s)
Starting test(pypy3): pyspark.tests.test_conf
Finished test(pypy3): pyspark.sql.tests.test_types (126s)
Starting test(pypy3): pyspark.tests.test_context
Finished test(pypy3): pyspark.sql.tests.test_udf (140s)
Starting test(pypy3): pyspark.tests.test_daemon
Finished test(pypy3): pyspark.tests.test_daemon (9s)
Starting test(pypy3): pyspark.tests.test_install_spark
Finished test(pypy3): pyspark.tests.test_conf (33s)
Starting test(pypy3): pyspark.tests.test_join
Finished test(pypy3): pyspark.tests.test_appsubmit (110s)
Starting test(pypy3): pyspark.tests.test_profiler
Finished test(pypy3): pyspark.tests.test_join (20s)
Starting test(pypy3): pyspark.tests.test_rdd
Finished test(pypy3): pyspark.tests.test_install_spark (32s)
Starting test(pypy3): pyspark.tests.test_rddbarrier
Finished test(pypy3): pyspark.tests.test_context (69s)
Starting test(pypy3): pyspark.tests.test_readwrite
Finished test(pypy3): pyspark.tests.test_rddbarrier (11s)
Starting test(pypy3): pyspark.tests.test_serializers
Finished test(pypy3): pyspark.tests.test_serializers (3s) ... 2 tests were skipped
Starting test(pypy3): pyspark.tests.test_shuffle
Finished test(pypy3): pyspark.tests.test_profiler (32s)
Starting test(pypy3): pyspark.tests.test_taskcontext
Finished test(pypy3): pyspark.tests.test_shuffle (31s)
Starting test(pypy3): pyspark.tests.test_util
Finished test(pypy3): pyspark.tests.test_readwrite (42s)
Starting test(pypy3): pyspark.tests.test_worker
Finished test(pypy3): pyspark.tests.test_util (7s)
Starting test(python3.6): pyspark.ml.tests.test_algorithms
Finished test(pypy3): pyspark.tests.test_worker (36s)
Starting test(python3.6): pyspark.ml.tests.test_base
Finished test(python3.6): pyspark.ml.tests.test_base (12s)
Starting test(python3.6): pyspark.ml.tests.test_evaluation
Finished test(python3.6): pyspark.ml.tests.test_evaluation (13s)
Starting test(python3.6): pyspark.ml.tests.test_feature
Finished test(pypy3): pyspark.tests.test_taskcontext (92s)
Starting test(python3.6): pyspark.ml.tests.test_image
Finished test(python3.6): pyspark.ml.tests.test_algorithms (71s)
Starting test(python3.6): pyspark.ml.tests.test_linalg
Finished test(python3.6): pyspark.ml.tests.test_image (12s)
Starting test(python3.6): pyspark.ml.tests.test_param
Finished test(python3.6): pyspark.ml.tests.test_feature (23s)
Starting test(python3.6): pyspark.ml.tests.test_persistence
Finished test(python3.6): pyspark.ml.tests.test_param (18s)
Starting test(python3.6): pyspark.ml.tests.test_pipeline
Finished test(python3.6): pyspark.ml.tests.test_pipeline (5s)
Starting test(python3.6): pyspark.ml.tests.test_stat
Finished test(python3.6): pyspark.ml.tests.test_linalg (29s)
Starting test(python3.6): pyspark.ml.tests.test_training_summary
Finished test(python3.6): pyspark.ml.tests.test_stat (14s)
Starting test(python3.6): pyspark.ml.tests.test_tuning
Finished test(python3.6): pyspark.ml.tests.test_persistence (47s)
Starting test(python3.6): pyspark.ml.tests.test_wrapper
Finished test(python3.6): pyspark.ml.tests.test_training_summary (33s)
Starting test(python3.6): pyspark.mllib.tests.test_algorithms
Finished test(python3.6): pyspark.ml.tests.test_wrapper (15s)
Starting test(python3.6): pyspark.mllib.tests.test_feature
Finished test(pypy3): pyspark.tests.test_rdd (227s)
Starting test(python3.6): pyspark.mllib.tests.test_linalg
Finished test(python3.6): pyspark.mllib.tests.test_feature (31s)
Starting test(python3.6): pyspark.mllib.tests.test_stat
Finished test(python3.6): pyspark.mllib.tests.test_algorithms (62s)
Starting test(python3.6): pyspark.mllib.tests.test_streaming_algorithms
Finished test(python3.6): pyspark.mllib.tests.test_stat (26s)
Starting test(python3.6): pyspark.mllib.tests.test_util
Finished test(python3.6): pyspark.mllib.tests.test_util (11s)
Starting test(python3.6): pyspark.sql.tests.test_arrow
Finished test(python3.6): pyspark.sql.tests.test_arrow (0s) ... 67 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_catalog
Finished test(python3.6): pyspark.mllib.tests.test_linalg (58s)
Starting test(python3.6): pyspark.sql.tests.test_column
Finished test(python3.6): pyspark.sql.tests.test_catalog (16s)
Starting test(python3.6): pyspark.sql.tests.test_conf
Finished test(python3.6): pyspark.sql.tests.test_column (18s)
Starting test(python3.6): pyspark.sql.tests.test_context
Finished test(python3.6): pyspark.sql.tests.test_conf (8s)
Starting test(python3.6): pyspark.sql.tests.test_dataframe
Finished test(python3.6): pyspark.sql.tests.test_context (18s)
Starting test(python3.6): pyspark.sql.tests.test_datasources
Finished test(python3.6): pyspark.sql.tests.test_datasources (18s)
Starting test(python3.6): pyspark.sql.tests.test_functions
Finished test(python3.6): pyspark.sql.tests.test_dataframe (46s) ... 3 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_group
Finished test(python3.6): pyspark.sql.tests.test_group (16s)
Starting test(python3.6): pyspark.sql.tests.test_pandas_cogrouped_map
Finished test(python3.6): pyspark.sql.tests.test_pandas_cogrouped_map (0s) ... 15 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_pandas_grouped_map
Finished test(python3.6): pyspark.sql.tests.test_functions (30s)
Starting test(python3.6): pyspark.sql.tests.test_pandas_map
Finished test(python3.6): pyspark.sql.tests.test_pandas_grouped_map (0s) ... 21 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_pandas_udf
Finished test(python3.6): pyspark.sql.tests.test_pandas_map (0s) ... 6 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_pandas_udf_grouped_agg
Finished test(python3.6): pyspark.sql.tests.test_pandas_udf (0s) ... 6 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_pandas_udf_scalar
Finished test(python3.6): pyspark.sql.tests.test_pandas_udf_grouped_agg (0s) ... 16 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_pandas_udf_typehints
Finished test(python3.6): pyspark.sql.tests.test_pandas_udf_scalar (0s) ... 51 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_pandas_udf_window
Finished test(python3.6): pyspark.sql.tests.test_pandas_udf_typehints (0s) ... 10 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_readwriter
Finished test(python3.6): pyspark.sql.tests.test_pandas_udf_window (0s) ... 14 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_serde
Finished test(python3.6): pyspark.ml.tests.test_tuning (199s)
Starting test(python3.6): pyspark.sql.tests.test_session
Finished test(python3.6): pyspark.sql.tests.test_serde (20s)
Starting test(python3.6): pyspark.sql.tests.test_streaming
Finished test(python3.6): pyspark.sql.tests.test_readwriter (22s)
Starting test(python3.6): pyspark.sql.tests.test_types
Finished test(python3.6): pyspark.mllib.tests.test_streaming_algorithms (141s)
Starting test(python3.6): pyspark.sql.tests.test_udf
Finished test(python3.6): pyspark.sql.tests.test_session (31s)
Starting test(python3.6): pyspark.sql.tests.test_utils
Finished test(python3.6): pyspark.sql.tests.test_utils (11s)
Starting test(python3.6): pyspark.streaming.tests.test_context
Finished test(python3.6): pyspark.sql.tests.test_streaming (30s)
Starting test(python3.6): pyspark.streaming.tests.test_dstream
Finished test(python3.6): pyspark.sql.tests.test_types (40s)
Starting test(python3.6): pyspark.streaming.tests.test_kinesis
Finished test(python3.6): pyspark.streaming.tests.test_kinesis (0s) ... 2 tests were skipped
Starting test(python3.6): pyspark.streaming.tests.test_listener
Finished test(python3.6): pyspark.streaming.tests.test_context (20s)
Starting test(python3.6): pyspark.tests.test_appsubmit
Finished test(python3.6): pyspark.sql.tests.test_udf (42s)
Starting test(python3.6): pyspark.tests.test_broadcast
Finished test(python3.6): pyspark.streaming.tests.test_listener (8s)
Starting test(python3.6): pyspark.tests.test_conf
Finished test(python3.6): pyspark.tests.test_conf (14s)
Starting test(python3.6): pyspark.tests.test_context
Finished test(python3.6): pyspark.tests.test_broadcast (31s)
Starting test(python3.6): pyspark.tests.test_daemon
Finished test(python3.6): pyspark.tests.test_daemon (5s)
Starting test(python3.6): pyspark.tests.test_install_spark
Finished test(python3.6): pyspark.tests.test_context (48s)
Starting test(python3.6): pyspark.tests.test_join
Finished test(python3.6): pyspark.tests.test_appsubmit (72s)
Starting test(python3.6): pyspark.tests.test_profiler
Finished test(python3.6): pyspark.tests.test_install_spark (31s)
Starting test(python3.6): pyspark.tests.test_rdd
Finished test(python3.6): pyspark.tests.test_join (9s)
Starting test(python3.6): pyspark.tests.test_rddbarrier
Finished test(python3.6): pyspark.tests.test_profiler (14s)
Starting test(python3.6): pyspark.tests.test_readwrite
Finished test(python3.6): pyspark.tests.test_rddbarrier (8s)
Starting test(python3.6): pyspark.tests.test_serializers
Finished test(python3.6): pyspark.streaming.tests.test_dstream (107s)
Starting test(python3.6): pyspark.tests.test_shuffle
Finished test(python3.6): pyspark.tests.test_serializers (9s)
Starting test(python3.6): pyspark.tests.test_taskcontext
Finished test(python3.6): pyspark.tests.test_readwrite (16s)
Starting test(python3.6): pyspark.tests.test_util
Finished test(python3.6): pyspark.tests.test_shuffle (11s)
Starting test(python3.6): pyspark.tests.test_worker
Finished test(python3.6): pyspark.tests.test_util (5s)
Starting test(pypy3): pyspark.accumulators
Finished test(python3.6): pyspark.tests.test_worker (17s)
Starting test(pypy3): pyspark.broadcast
Finished test(pypy3): pyspark.accumulators (13s)
Starting test(pypy3): pyspark.conf
Finished test(pypy3): pyspark.conf (6s)
Starting test(pypy3): pyspark.context
Finished test(pypy3): pyspark.broadcast (10s)
Starting test(pypy3): pyspark.profiler
Finished test(pypy3): pyspark.profiler (13s)
Starting test(pypy3): pyspark.rdd
Finished test(python3.6): pyspark.tests.test_taskcontext (51s)
Starting test(pypy3): pyspark.resource.tests.test_resources
Finished test(pypy3): pyspark.resource.tests.test_resources (7s)
Starting test(pypy3): pyspark.serializers
Finished test(pypy3): pyspark.context (30s)
Starting test(pypy3): pyspark.shuffle
Finished test(python3.6): pyspark.tests.test_rdd (92s)
Starting test(pypy3): pyspark.sql.avro.functions
Finished test(pypy3): pyspark.shuffle (9s)
Starting test(pypy3): pyspark.sql.catalog
Finished test(pypy3): pyspark.serializers (17s)
Starting test(pypy3): pyspark.sql.column
Finished test(pypy3): pyspark.sql.avro.functions (17s)
Starting test(pypy3): pyspark.sql.conf
Finished test(pypy3): pyspark.sql.catalog (16s)
Starting test(pypy3): pyspark.sql.context
Finished test(pypy3): pyspark.sql.conf (8s)
Starting test(pypy3): pyspark.sql.dataframe
Finished test(pypy3): pyspark.sql.context (33s)
Starting test(pypy3): pyspark.sql.functions
Finished test(pypy3): pyspark.sql.column (49s)
Starting test(pypy3): pyspark.sql.group
Finished test(pypy3): pyspark.sql.group (37s)
Starting test(pypy3): pyspark.sql.pandas.conversion
Finished test(pypy3): pyspark.sql.pandas.conversion (9s)
Starting test(pypy3): pyspark.sql.pandas.group_ops
Finished test(pypy3): pyspark.sql.pandas.group_ops (12s)
Starting test(pypy3): pyspark.sql.pandas.map_ops
Finished test(pypy3): pyspark.sql.pandas.map_ops (11s)
Starting test(pypy3): pyspark.sql.pandas.serializers
Finished test(pypy3): pyspark.sql.pandas.serializers (1s)
Starting test(pypy3): pyspark.sql.pandas.typehints
Finished test(pypy3): pyspark.sql.pandas.typehints (1s)
Starting test(pypy3): pyspark.sql.pandas.types
Finished test(pypy3): pyspark.sql.pandas.types (1s)
Starting test(pypy3): pyspark.sql.pandas.utils
Finished test(pypy3): pyspark.sql.pandas.utils (2s)
Starting test(pypy3): pyspark.sql.readwriter
Finished test(pypy3): pyspark.rdd (162s)
Starting test(pypy3): pyspark.sql.session
Finished test(pypy3): pyspark.sql.dataframe (124s)
Starting test(pypy3): pyspark.sql.streaming
Finished test(pypy3): pyspark.sql.readwriter (23s)
Starting test(pypy3): pyspark.sql.types
Finished test(pypy3): pyspark.sql.streaming (14s)
Starting test(pypy3): pyspark.sql.udf
Finished test(pypy3): pyspark.sql.types (12s)
Starting test(pypy3): pyspark.sql.window
Finished test(pypy3): pyspark.sql.session (35s)
Starting test(pypy3): pyspark.streaming.util
Finished test(pypy3): pyspark.streaming.util (2s)
Starting test(pypy3): pyspark.util
Finished test(pypy3): pyspark.util (2s)
Starting test(python3.6): pyspark.accumulators
Finished test(pypy3): pyspark.sql.udf (17s)
Starting test(python3.6): pyspark.broadcast
Finished test(pypy3): pyspark.sql.functions (131s)
Starting test(python3.6): pyspark.conf
Finished test(python3.6): pyspark.accumulators (8s)
Starting test(python3.6): pyspark.context
Finished test(python3.6): pyspark.conf (5s)
Starting test(python3.6): pyspark.ml.classification
Finished test(python3.6): pyspark.broadcast (7s)
Starting test(python3.6): pyspark.ml.clustering
Finished test(pypy3): pyspark.sql.window (19s)
Starting test(python3.6): pyspark.ml.evaluation
Finished test(python3.6): pyspark.context (22s)
Starting test(python3.6): pyspark.ml.feature
Finished test(python3.6): pyspark.ml.evaluation (20s)
Starting test(python3.6): pyspark.ml.fpm
Finished test(python3.6): pyspark.ml.clustering (40s)
Starting test(python3.6): pyspark.ml.functions
Finished test(python3.6): pyspark.ml.fpm (19s)
Starting test(python3.6): pyspark.ml.image
Finished test(python3.6): pyspark.ml.image (7s)
Starting test(python3.6): pyspark.ml.linalg.__init__
Finished test(python3.6): pyspark.ml.linalg.__init__ (0s)
Starting test(python3.6): pyspark.ml.recommendation
Finished test(python3.6): pyspark.ml.functions (13s)
Starting test(python3.6): pyspark.ml.regression
Finished test(python3.6): pyspark.ml.classification (77s)
Starting test(python3.6): pyspark.ml.stat
Finished test(python3.6): pyspark.ml.regression (40s)
Starting test(python3.6): pyspark.ml.tuning
Finished test(python3.6): pyspark.ml.stat (22s)
Starting test(python3.6): pyspark.mllib.classification
Finished test(python3.6): pyspark.ml.feature (82s)
Starting test(python3.6): pyspark.mllib.clustering
Finished test(python3.6): pyspark.ml.tuning (27s)
Starting test(python3.6): pyspark.mllib.evaluation
Finished test(python3.6): pyspark.mllib.classification (33s)
Starting test(python3.6): pyspark.mllib.feature
Finished test(python3.6): pyspark.ml.recommendation (86s)
Starting test(python3.6): pyspark.mllib.fpm
Finished test(python3.6): pyspark.mllib.evaluation (17s)
Starting test(python3.6): pyspark.mllib.linalg.__init__
Finished test(python3.6): pyspark.mllib.linalg.__init__ (0s)
Starting test(python3.6): pyspark.mllib.linalg.distributed
Finished test(python3.6): pyspark.mllib.clustering (42s)
Starting test(python3.6): pyspark.mllib.random
Finished test(python3.6): pyspark.mllib.fpm (17s)
Starting test(python3.6): pyspark.mllib.recommendation
Finished test(python3.6): pyspark.mllib.feature (22s)
Starting test(python3.6): pyspark.mllib.regression
Finished test(python3.6): pyspark.mllib.random (10s)
Starting test(python3.6): pyspark.mllib.stat.KernelDensity
Finished test(python3.6): pyspark.mllib.stat.KernelDensity (0s)
Starting test(python3.6): pyspark.mllib.stat._statistics
Finished test(python3.6): pyspark.mllib.stat._statistics (16s)
Starting test(python3.6): pyspark.mllib.tree
Finished test(python3.6): pyspark.mllib.regression (25s)
Starting test(python3.6): pyspark.mllib.util
Finished test(python3.6): pyspark.mllib.recommendation (35s)
Starting test(python3.6): pyspark.profiler
Finished test(python3.6): pyspark.mllib.tree (18s)
Starting test(python3.6): pyspark.rdd
Finished test(python3.6): pyspark.mllib.linalg.distributed (56s)
Starting test(python3.6): pyspark.resource.tests.test_resources
Finished test(python3.6): pyspark.profiler (7s)
Starting test(python3.6): pyspark.serializers
Finished test(python3.6): pyspark.mllib.util (17s)
Starting test(python3.6): pyspark.shuffle
Finished test(python3.6): pyspark.shuffle (0s)
Starting test(python3.6): pyspark.sql.avro.functions
Finished test(python3.6): pyspark.resource.tests.test_resources (6s)
Starting test(python3.6): pyspark.sql.catalog
Finished test(python3.6): pyspark.serializers (9s)
Starting test(python3.6): pyspark.sql.column
Finished test(python3.6): pyspark.sql.avro.functions (14s)
Starting test(python3.6): pyspark.sql.conf
Finished test(python3.6): pyspark.sql.catalog (13s)
Starting test(python3.6): pyspark.sql.context
Finished test(python3.6): pyspark.sql.conf (6s)
Starting test(python3.6): pyspark.sql.dataframe
Finished test(python3.6): pyspark.rdd (28s)
Starting test(python3.6): pyspark.sql.functions
Finished test(python3.6): pyspark.sql.column (24s)
Starting test(python3.6): pyspark.sql.group
Finished test(python3.6): pyspark.sql.context (17s)
Starting test(python3.6): pyspark.sql.pandas.conversion
Finished test(python3.6): pyspark.sql.pandas.conversion (6s)
Starting test(python3.6): pyspark.sql.pandas.group_ops
Finished test(python3.6): pyspark.sql.pandas.group_ops (10s)
Starting test(python3.6): pyspark.sql.pandas.map_ops
Finished test(python3.6): pyspark.sql.group (23s)
Starting test(python3.6): pyspark.sql.pandas.serializers
Finished test(python3.6): pyspark.sql.pandas.serializers (0s)
Starting test(python3.6): pyspark.sql.pandas.typehints
Finished test(python3.6): pyspark.sql.pandas.typehints (0s)
Starting test(python3.6): pyspark.sql.pandas.types
Finished test(python3.6): pyspark.sql.pandas.types (0s)
Starting test(python3.6): pyspark.sql.pandas.utils
Finished test(python3.6): pyspark.sql.pandas.utils (0s)
Starting test(python3.6): pyspark.sql.readwriter
Finished test(python3.6): pyspark.sql.pandas.map_ops (9s)
Starting test(python3.6): pyspark.sql.session
Finished test(python3.6): pyspark.sql.dataframe (46s)
Starting test(python3.6): pyspark.sql.streaming
Finished test(python3.6): pyspark.sql.functions (48s)
Starting test(python3.6): pyspark.sql.types
Finished test(python3.6): pyspark.sql.readwriter (17s)
Starting test(python3.6): pyspark.sql.udf
Finished test(python3.6): pyspark.sql.types (7s)
Starting test(python3.6): pyspark.sql.window
Finished test(python3.6): pyspark.sql.session (17s)
Starting test(python3.6): pyspark.streaming.util
Finished test(python3.6): pyspark.streaming.util (0s)
Starting test(python3.6): pyspark.util
Finished test(python3.6): pyspark.util (0s)
Finished test(python3.6): pyspark.sql.streaming (13s)
Finished test(python3.6): pyspark.sql.udf (12s)
Finished test(python3.6): pyspark.sql.window (13s)
Tests passed in 1363 seconds

Skipped tests in pyspark.sql.tests.test_arrow with pypy3:
    test_createDataFrame_column_name_encoding (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_does_not_modify_input (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_empty_partition (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_fallback_disabled (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_fallback_enabled (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_respect_session_timezone (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_toggle (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_with_array_type (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_with_float_index (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_with_incorrect_schema (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_with_int_col_names (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_with_map_type (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_with_names (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_with_schema (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_with_single_data_type (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDateFrame_with_category_type (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_filtered_frame (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_no_partition_frame (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_no_partition_toPandas (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_null_conversion (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_pandas_round_trip (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_propagates_spark_exception (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_schema_conversion_roundtrip (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_timestamp_dst (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_timestamp_nat (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_toPandas_arrow_toggle (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_toPandas_batch_order (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_toPandas_fallback_disabled (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_toPandas_fallback_enabled (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_toPandas_respect_session_timezone (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_toPandas_with_array_type (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_toPandas_with_map_type (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_toPandas_with_map_type_nulls (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_column_name_encoding (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_does_not_modify_input (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_empty_partition (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_fallback_disabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_fallback_enabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_respect_session_timezone (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_toggle (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_with_array_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_with_float_index (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_with_incorrect_schema (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_with_int_col_names (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_with_map_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_with_names (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_with_schema (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDataFrame_with_single_data_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_createDateFrame_with_category_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_filtered_frame (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_no_partition_frame (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_no_partition_toPandas (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_null_conversion (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_pandas_round_trip (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_propagates_spark_exception (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_schema_conversion_roundtrip (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_timestamp_dst (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_timestamp_nat (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_toPandas_arrow_toggle (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_toPandas_batch_order (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_toPandas_fallback_disabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_toPandas_fallback_enabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_toPandas_respect_session_timezone (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_toPandas_with_array_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_toPandas_with_map_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_toPandas_with_map_type_nulls (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_exception_by_max_results (pyspark.sql.tests.test_arrow.MaxResultArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'

Skipped tests in pyspark.sql.tests.test_dataframe with pypy3:
    test_create_dataframe_from_pandas_with_dst (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_create_dataframe_from_pandas_with_timestamp (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_to_pandas (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_to_pandas_avoid_astype (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_to_pandas_from_empty_dataframe (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_to_pandas_from_mixed_dataframe (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_to_pandas_from_null_dataframe (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_to_pandas_on_cross_join (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_to_pandas_with_duplicated_column_names (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_query_execution_listener_on_collect_with_arrow (pyspark.sql.tests.test_dataframe.QueryExecutionListenerTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'

Skipped tests in pyspark.sql.tests.test_pandas_cogrouped_map with pypy3:
    test_case_insensitive_grouping_column (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_complex_group_by (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_different_schemas (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_empty_group_by (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_left_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_mixed_scalar_udfs_followed_by_cogrouby_apply (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_right_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_simple (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_with_key_complex (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_with_key_left (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_with_key_left_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_with_key_right (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_with_key_right_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_wrong_args (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_wrong_return_type (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'

Skipped tests in pyspark.sql.tests.test_pandas_grouped_map with pypy3:
    test_array_type_correct (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_case_insensitive_grouping_column (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_coerce (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_column_order (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_complex_groupby (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_datatype_string (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_decorator (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_empty_groupby (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_grouped_over_window (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_grouped_over_window_with_key (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_grouped_with_empty_partition (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_mixed_scalar_udfs_followed_by_groupby_apply (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_positional_assignment_conf (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_register_grouped_map_udf (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_self_join_with_pandas (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_supported_types (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_timestamp_dst (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_udf_with_key (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_unsupported_types (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_wrong_args (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_wrong_return_type (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'

Skipped tests in pyspark.sql.tests.test_pandas_map with pypy3:
    test_chain_map_partitions_in_pandas (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_different_output_length (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_empty_iterator (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_empty_rows (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_map_partitions_in_pandas (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_multiple_columns (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'

Skipped tests in pyspark.sql.tests.test_pandas_udf with pypy3:
    test_pandas_udf_arrow_overflow (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_pandas_udf_basic (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_pandas_udf_decorator (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_pandas_udf_detect_unsafe_type_conversion (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_stopiteration_in_udf (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_udf_wrong_arg (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'

Skipped tests in pyspark.sql.tests.test_pandas_udf_grouped_agg with pypy3:
    test_alias (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_array_type (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_basic (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_complex_expressions (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_complex_groupby (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_grouped_with_empty_partition (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_grouped_without_group_by_clause (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_invalid_args (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_manual (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_mixed_sql (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_mixed_udfs (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_multiple_udfs (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_no_predicate_pushdown_through (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_register_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_retain_group_columns (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_unsupported_types (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'

Skipped tests in pyspark.sql.tests.test_pandas_udf_scalar with pypy3:
    test_datasource_with_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_mixed_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_mixed_udf_and_sql (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_nondeterministic_vectorized_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_nondeterministic_vectorized_udf_in_aggregate (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_pandas_udf_nested_arrays (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_pandas_udf_tokenize (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_register_nondeterministic_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_register_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_scalar_iter_udf_close (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_scalar_iter_udf_close_early (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_scalar_iter_udf_init (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_timestamp_dst (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_type_annotation (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_udf_category_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_array_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_chained (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_chained_struct_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_check_config (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_complex (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_datatype_string (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_dates (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_decorator (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_empty_partition (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_exception (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_invalid_length (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_map_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_nested_struct (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_null_array (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_null_binary (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_null_boolean (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_null_byte (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_null_decimal (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_null_double (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_null_float (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_null_int (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_null_long (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_null_short (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_null_string (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_return_scalar (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_return_timestamp_tz (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_string_in_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_struct_complex (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_struct_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_struct_with_empty_partition (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_timestamps (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_timestamps_respect_session_timezone (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_unsupported_types (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_varargs (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_vectorized_udf_wrong_return_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'

Skipped tests in pyspark.sql.tests.test_pandas_udf_typehints with pypy3:
    test_group_agg_udf_type_hint (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_ignore_type_hint_in_cogroup_apply_in_pandas (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_ignore_type_hint_in_group_apply_in_pandas (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_ignore_type_hint_in_map_in_pandas (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_scalar_iter_udf_type_hint (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_scalar_udf_type_hint (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_type_annotation_group_agg (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_type_annotation_negative (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_type_annotation_scalar (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_type_annotation_scalar_iter (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'

Skipped tests in pyspark.sql.tests.test_pandas_udf_window with pypy3:
    test_array_type (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_bounded_mixed (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_bounded_simple (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_growing_window (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_invalid_args (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_mixed_sql (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_mixed_sql_and_udf (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_mixed_udf (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_multiple_udfs (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_replace_existing (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_shrinking_window (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_simple (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_sliding_window (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
    test_without_partitionBy (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'

Skipped tests in pyspark.streaming.tests.test_dstream with pypy3:
    test_cogroup (pyspark.streaming.tests.test_dstream.BasicOperationTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_failed_func (pyspark.streaming.tests.test_dstream.BasicOperationTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_failed_func2 (pyspark.streaming.tests.test_dstream.BasicOperationTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_failed_func_with_reseting_failure (pyspark.streaming.tests.test_dstream.BasicOperationTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_full_outer_join (pyspark.streaming.tests.test_dstream.BasicOperationTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_join (pyspark.streaming.tests.test_dstream.BasicOperationTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_left_outer_join (pyspark.streaming.tests.test_dstream.BasicOperationTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_repartition (pyspark.streaming.tests.test_dstream.BasicOperationTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_right_outer_join (pyspark.streaming.tests.test_dstream.BasicOperationTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_union (pyspark.streaming.tests.test_dstream.BasicOperationTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_update_state_by_key (pyspark.streaming.tests.test_dstream.BasicOperationTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_update_state_by_key_initial_rdd (pyspark.streaming.tests.test_dstream.BasicOperationTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_get_or_create_and_get_active_or_create (pyspark.streaming.tests.test_dstream.CheckpointTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_transform_function_serializer_failure (pyspark.streaming.tests.test_dstream.CheckpointTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_count_by_value_and_window (pyspark.streaming.tests.test_dstream.WindowFunctionTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_count_by_window (pyspark.streaming.tests.test_dstream.WindowFunctionTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_count_by_window_large (pyspark.streaming.tests.test_dstream.WindowFunctionTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_group_by_key_and_window (pyspark.streaming.tests.test_dstream.WindowFunctionTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_reduce_by_invalid_window (pyspark.streaming.tests.test_dstream.WindowFunctionTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_reduce_by_key_and_window_with_none_invFunc (pyspark.streaming.tests.test_dstream.WindowFunctionTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'
    test_window (pyspark.streaming.tests.test_dstream.WindowFunctionTests) ... skipped 'The tests fail in PyPy3 implementation for an unknown reason. With PyPy, it causes to hang DStream tests forever when Coverage report is used.'

Skipped tests in pyspark.streaming.tests.test_kinesis with pypy3:
    test_kinesis_stream (pyspark.streaming.tests.test_kinesis.KinesisStreamTests) ... skipped "Skipping all Kinesis Python tests as environmental variable 'ENABLE_KINESIS_TESTS' was not set."
    test_kinesis_stream_api (pyspark.streaming.tests.test_kinesis.KinesisStreamTests) ... skipped "Skipping all Kinesis Python tests as environmental variable 'ENABLE_KINESIS_TESTS' was not set."

Skipped tests in pyspark.tests.test_serializers with pypy3:
    test_statcounter_array (pyspark.tests.test_serializers.NumPyTests) ... skipped 'NumPy not installed'
    test_serialize (pyspark.tests.test_serializers.SciPyTests) ... skipped 'SciPy not installed'

Skipped tests in pyspark.sql.tests.test_arrow with python3.6:
      test_createDataFrame_column_name_encoding (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_createDataFrame_does_not_modify_input (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_createDataFrame_empty_partition (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_createDataFrame_fallback_disabled (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_createDataFrame_fallback_enabled (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_createDataFrame_respect_session_timezone (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_createDataFrame_toggle (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_createDataFrame_with_array_type (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_createDataFrame_with_float_index (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_createDataFrame_with_incorrect_schema (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_createDataFrame_with_int_col_names (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_createDataFrame_with_map_type (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_createDataFrame_with_names (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_createDataFrame_with_schema (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_createDataFrame_with_single_data_type (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_createDateFrame_with_category_type (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_filtered_frame (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_no_partition_frame (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_no_partition_toPandas (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_null_conversion (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_pandas_round_trip (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_propagates_spark_exception (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_schema_conversion_roundtrip (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_timestamp_dst (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_timestamp_nat (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_toPandas_arrow_toggle (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_toPandas_batch_order (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_toPandas_fallback_disabled (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_toPandas_fallback_enabled (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_toPandas_respect_session_timezone (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_toPandas_with_array_type (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_toPandas_with_map_type (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_toPandas_with_map_type_nulls (pyspark.sql.tests.test_arrow.ArrowTests) ... SKIP (0.000s)
      test_createDataFrame_column_name_encoding (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_createDataFrame_does_not_modify_input (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_createDataFrame_empty_partition (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_createDataFrame_fallback_disabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_createDataFrame_fallback_enabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_createDataFrame_respect_session_timezone (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_createDataFrame_toggle (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_createDataFrame_with_array_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_createDataFrame_with_float_index (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_createDataFrame_with_incorrect_schema (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_createDataFrame_with_int_col_names (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_createDataFrame_with_map_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_createDataFrame_with_names (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_createDataFrame_with_schema (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_createDataFrame_with_single_data_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_createDateFrame_with_category_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_filtered_frame (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_no_partition_frame (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_no_partition_toPandas (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_null_conversion (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_pandas_round_trip (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_propagates_spark_exception (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_schema_conversion_roundtrip (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_timestamp_dst (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_timestamp_nat (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_toPandas_arrow_toggle (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_toPandas_batch_order (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_toPandas_fallback_disabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_toPandas_fallback_enabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_toPandas_respect_session_timezone (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_toPandas_with_array_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_toPandas_with_map_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_toPandas_with_map_type_nulls (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... SKIP (0.000s)
      test_exception_by_max_results (pyspark.sql.tests.test_arrow.MaxResultArrowTests) ... SKIP (0.000s)

Skipped tests in pyspark.sql.tests.test_dataframe with python3.6:
      test_create_dataframe_required_pandas_not_found (pyspark.sql.tests.test_dataframe.DataFrameTests) ... SKIP (0.000s)
      test_to_pandas_required_pandas_not_found (pyspark.sql.tests.test_dataframe.DataFrameTests) ... SKIP (0.000s)
      test_query_execution_listener_on_collect_with_arrow (pyspark.sql.tests.test_dataframe.QueryExecutionListenerTests) ... SKIP (0.000s)

Skipped tests in pyspark.sql.tests.test_pandas_cogrouped_map with python3.6:
      test_case_insensitive_grouping_column (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... SKIP (0.000s)
      test_complex_group_by (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... SKIP (0.000s)
      test_different_schemas (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... SKIP (0.000s)
      test_empty_group_by (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... SKIP (0.000s)
      test_left_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... SKIP (0.000s)
      test_mixed_scalar_udfs_followed_by_cogrouby_apply (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... SKIP (0.000s)
      test_right_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... SKIP (0.000s)
      test_simple (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... SKIP (0.000s)
      test_with_key_complex (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... SKIP (0.000s)
      test_with_key_left (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... SKIP (0.000s)
      test_with_key_left_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... SKIP (0.000s)
      test_with_key_right (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... SKIP (0.000s)
      test_with_key_right_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... SKIP (0.000s)
      test_wrong_args (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... SKIP (0.000s)
      test_wrong_return_type (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... SKIP (0.000s)

Skipped tests in pyspark.sql.tests.test_pandas_grouped_map with python3.6:
      test_array_type_correct (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_case_insensitive_grouping_column (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_coerce (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_column_order (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_complex_groupby (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_datatype_string (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_decorator (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_empty_groupby (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_grouped_over_window (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_grouped_over_window_with_key (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_grouped_with_empty_partition (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_mixed_scalar_udfs_followed_by_groupby_apply (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_positional_assignment_conf (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_register_grouped_map_udf (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_self_join_with_pandas (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_supported_types (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_timestamp_dst (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_udf_with_key (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_unsupported_types (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_wrong_args (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)
      test_wrong_return_type (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... SKIP (0.000s)

Skipped tests in pyspark.sql.tests.test_pandas_map with python3.6:
      test_chain_map_partitions_in_pandas (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... SKIP (0.000s)
      test_different_output_length (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... SKIP (0.000s)
      test_empty_iterator (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... SKIP (0.000s)
      test_empty_rows (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... SKIP (0.000s)
      test_map_partitions_in_pandas (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... SKIP (0.000s)
      test_multiple_columns (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... SKIP (0.000s)

Skipped tests in pyspark.sql.tests.test_pandas_udf with python3.6:
      test_pandas_udf_arrow_overflow (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... SKIP (0.000s)
      test_pandas_udf_basic (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... SKIP (0.000s)
      test_pandas_udf_decorator (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... SKIP (0.000s)
      test_pandas_udf_detect_unsafe_type_conversion (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... SKIP (0.000s)
      test_stopiteration_in_udf (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... SKIP (0.000s)
      test_udf_wrong_arg (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... SKIP (0.000s)

Skipped tests in pyspark.sql.tests.test_pandas_udf_grouped_agg with python3.6:
      test_alias (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... SKIP (0.000s)
      test_array_type (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... SKIP (0.000s)
      test_basic (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... SKIP (0.000s)
      test_complex_expressions (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... SKIP (0.000s)
      test_complex_groupby (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... SKIP (0.000s)
      test_grouped_with_empty_partition (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... SKIP (0.000s)
      test_grouped_without_group_by_clause (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... SKIP (0.000s)
      test_invalid_args (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... SKIP (0.000s)
      test_manual (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... SKIP (0.000s)
      test_mixed_sql (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... SKIP (0.000s)
      test_mixed_udfs (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... SKIP (0.000s)
      test_multiple_udfs (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... SKIP (0.000s)
      test_no_predicate_pushdown_through (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... SKIP (0.000s)
      test_register_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... SKIP (0.000s)
      test_retain_group_columns (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... SKIP (0.000s)
      test_unsupported_types (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... SKIP (0.000s)

Skipped tests in pyspark.sql.tests.test_pandas_udf_scalar with python3.6:
      test_datasource_with_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_mixed_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_mixed_udf_and_sql (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_nondeterministic_vectorized_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_nondeterministic_vectorized_udf_in_aggregate (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_pandas_udf_nested_arrays (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_pandas_udf_tokenize (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_register_nondeterministic_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_register_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_scalar_iter_udf_close (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_scalar_iter_udf_close_early (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_scalar_iter_udf_init (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_timestamp_dst (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_type_annotation (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_udf_category_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_array_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_chained (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_chained_struct_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_check_config (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_complex (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_datatype_string (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_dates (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_decorator (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_empty_partition (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_exception (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_invalid_length (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_map_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_nested_struct (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_null_array (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_null_binary (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_null_boolean (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_null_byte (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_null_decimal (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_null_double (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_null_float (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_null_int (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_null_long (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_null_short (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_null_string (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_return_scalar (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_return_timestamp_tz (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_string_in_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_struct_complex (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_struct_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_struct_with_empty_partition (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_timestamps (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_timestamps_respect_session_timezone (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_unsupported_types (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_varargs (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)
      test_vectorized_udf_wrong_return_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... SKIP (0.000s)

Skipped tests in pyspark.sql.tests.test_pandas_udf_typehints with python3.6:
      test_group_agg_udf_type_hint (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... SKIP (0.000s)
      test_ignore_type_hint_in_cogroup_apply_in_pandas (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... SKIP (0.000s)
      test_ignore_type_hint_in_group_apply_in_pandas (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... SKIP (0.000s)
      test_ignore_type_hint_in_map_in_pandas (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... SKIP (0.000s)
      test_scalar_iter_udf_type_hint (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... SKIP (0.000s)
      test_scalar_udf_type_hint (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... SKIP (0.000s)
      test_type_annotation_group_agg (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... SKIP (0.000s)
      test_type_annotation_negative (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... SKIP (0.000s)
      test_type_annotation_scalar (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... SKIP (0.000s)
      test_type_annotation_scalar_iter (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... SKIP (0.000s)

Skipped tests in pyspark.sql.tests.test_pandas_udf_window with python3.6:
      test_array_type (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... SKIP (0.000s)
      test_bounded_mixed (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... SKIP (0.000s)
      test_bounded_simple (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... SKIP (0.000s)
      test_growing_window (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... SKIP (0.000s)
      test_invalid_args (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... SKIP (0.000s)
      test_mixed_sql (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... SKIP (0.000s)
      test_mixed_sql_and_udf (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... SKIP (0.000s)
      test_mixed_udf (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... SKIP (0.000s)
      test_multiple_udfs (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... SKIP (0.000s)
      test_replace_existing (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... SKIP (0.000s)
      test_shrinking_window (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... SKIP (0.000s)
      test_simple (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... SKIP (0.000s)
      test_sliding_window (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... SKIP (0.000s)
      test_without_partitionBy (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... SKIP (0.000s)

Skipped tests in pyspark.streaming.tests.test_kinesis with python3.6:
      test_kinesis_stream (pyspark.streaming.tests.test_kinesis.KinesisStreamTests) ... SKIP (0.000s)
      test_kinesis_stream_api (pyspark.streaming.tests.test_kinesis.KinesisStreamTests) ... SKIP (0.000s)
Combining collected coverage data under /home/jenkins/workspace/spark-master-test-sbt-hadoop-3.2-hive-2.3/python/test_coverage/coverage_data
Reporting the coverage data at /home/jenkins/workspace/spark-master-test-sbt-hadoop-3.2-hive-2.3/python/test_coverage/coverage_data/coverage
Name                                               Stmts   Miss Branch BrPart  Cover
------------------------------------------------------------------------------------
pyspark/__init__.py                                   43      0      8      2    96%
pyspark/_globals.py                                   16      2      4      2    80%
pyspark/accumulators.py                              112     15     22      5    84%
pyspark/broadcast.py                                  96     21     28      6    73%
pyspark/cloudpickle/__init__.py                        4      0      0      0   100%
pyspark/cloudpickle/cloudpickle.py                   328    131    146     15    56%
pyspark/cloudpickle/cloudpickle_fast.py              298    113    118     17    58%
pyspark/cloudpickle/compat.py                         10      3      2      1    67%
pyspark/conf.py                                       75      5     42      6    89%
pyspark/context.py                                   389     39    117     14    88%
pyspark/daemon.py                                    132     74     26      1    41%
pyspark/files.py                                      15      2      2      1    82%
pyspark/find_spark_home.py                            28     22     10      2    21%
pyspark/install.py                                    82      8     33      6    88%
pyspark/java_gateway.py                              110     18     26      9    80%
pyspark/join.py                                       66      0     58      4    97%
pyspark/ml/__init__.py                                 5      0      0      0   100%
pyspark/ml/base.py                                   110     17     34      4    84%
pyspark/ml/classification.py                         923    131    176     25    85%
pyspark/ml/clustering.py                             432     49     44      5    89%
pyspark/ml/common.py                                  70     12     42      5    83%
pyspark/ml/evaluation.py                             239     52     26      2    80%
pyspark/ml/feature.py                               1398    135    104      6    91%
pyspark/ml/fpm.py                                    119     18      4      1    85%
pyspark/ml/functions.py                               21      1      4      1    92%
pyspark/ml/image.py                                   85      8     31      8    84%
pyspark/ml/linalg/__init__.py                        528     56    240     25    87%
pyspark/ml/param/__init__.py                         249     14    121     17    92%
pyspark/ml/param/shared.py                           224      6      0      0    97%
pyspark/ml/pipeline.py                               204     19     80      5    89%
pyspark/ml/recommendation.py                         158     29     10      1    82%
pyspark/ml/regression.py                             650    110     38      5    83%
pyspark/ml/stat.py                                   123     13     18      2    89%
pyspark/ml/tests/__init__.py                           0      0      0      0   100%
pyspark/ml/tests/test_algorithms.py                  195      4     12      0    98%
pyspark/ml/tests/test_base.py                         39      2      8      0    96%
pyspark/ml/tests/test_evaluation.py                   31      2      4      0    94%
pyspark/ml/tests/test_feature.py                     186      2     18      0    99%
pyspark/ml/tests/test_image.py                        35      2      8      0    95%
pyspark/ml/tests/test_linalg.py                      267      5     54      3    98%
pyspark/ml/tests/test_param.py                       248      2     62      0    99%
pyspark/ml/tests/test_persistence.py                 306     25     26      3    90%
pyspark/ml/tests/test_pipeline.py                     41      2      4      0    96%
pyspark/ml/tests/test_stat.py                         22      2      6      0    93%
pyspark/ml/tests/test_training_summary.py            350      2      2      0    99%
pyspark/ml/tests/test_tuning.py                      436      4     81      4    98%
pyspark/ml/tests/test_wrapper.py                      79      4      2      0    95%
pyspark/ml/tree.py                                   106      9      6      0    90%
pyspark/ml/tuning.py                                 398     15     98     10    95%
pyspark/ml/util.py                                   239     21     70      7    91%
pyspark/ml/wrapper.py                                176      6     72      6    95%
pyspark/mllib/__init__.py                              6      1      4      1    80%
pyspark/mllib/classification.py                      197     11     50      5    92%
pyspark/mllib/clustering.py                          244     22     78     10    89%
pyspark/mllib/common.py                               82      7     42      2    90%
pyspark/mllib/evaluation.py                          182      6     22      2    96%
pyspark/mllib/feature.py                             206     22     22      5    88%
pyspark/mllib/fpm.py                                  53      3     12      1    94%
pyspark/mllib/linalg/__init__.py                     621     61    272     33    89%
pyspark/mllib/linalg/distributed.py                  264     40     60     12    80%
pyspark/mllib/random.py                               65      1      6      1    97%
pyspark/mllib/recommendation.py                       78      4     22      4    92%
pyspark/mllib/regression.py                          180      8     36      4    94%
pyspark/mllib/stat/KernelDensity.py                   17      9      2      0    42%
pyspark/mllib/stat/__init__.py                         6      0      0      0   100%
pyspark/mllib/stat/_statistics.py                     73      6     24      4    90%
pyspark/mllib/stat/distribution.py                     3      0      0      0   100%
pyspark/mllib/stat/test.py                            19      1      4      0    96%
pyspark/mllib/tests/__init__.py                        0      0      0      0   100%
pyspark/mllib/tests/test_algorithms.py               189      6     14      0    97%
pyspark/mllib/tests/test_feature.py                   97      2     12      0    98%
pyspark/mllib/tests/test_linalg.py                   463      5     62      3    98%
pyspark/mllib/tests/test_stat.py                     104      2      8      0    98%
pyspark/mllib/tests/test_streaming_algorithms.py     279     22     78      3    92%
pyspark/mllib/tests/test_util.py                      63      4      6      0    94%
pyspark/mllib/tree.py                                 99      5     16      3    93%
pyspark/mllib/util.py                                125     30     48      8    73%
pyspark/profiler.py                                   75     11     22      5    84%
pyspark/rdd.py                                       932     41    321     29    94%
pyspark/rddsampler.py                                 68     40     32      0    28%
pyspark/resource/__init__.py                           5      0      0      0   100%
pyspark/resource/information.py                        8      0      0      0   100%
pyspark/resource/profile.py                           83     21     38      1    72%
pyspark/resource/requests.py                         117      1     46      1    99%
pyspark/resource/tests/__init__.py                     0      0      0      0   100%
pyspark/resource/tests/test_resources.py              54      0      2      0   100%
pyspark/resultiterable.py                             11      3      0      0    73%
pyspark/serializers.py                               339     50     84     13    81%
pyspark/shuffle.py                                   395     97    160     12    72%
pyspark/sql/__init__.py                               12      0      0      0   100%
pyspark/sql/avro/__init__.py                           1      0      0      0   100%
pyspark/sql/avro/functions.py                         47     11     12      2    71%
pyspark/sql/catalog.py                               111      8     28      2    93%
pyspark/sql/column.py                                237     11     54      9    92%
pyspark/sql/conf.py                                   38      3     10      2    90%
pyspark/sql/context.py                               129     18     24      2    86%
pyspark/sql/dataframe.py                             600     53    264     45    88%
pyspark/sql/functions.py                             830     78    103     18    90%
pyspark/sql/group.py                                  64      1     12      1    97%
pyspark/sql/pandas/__init__.py                         1      0      0      0   100%
pyspark/sql/pandas/conversion.py                     230     84    116     11    63%
pyspark/sql/pandas/functions.py                       54     39     28      0    18%
pyspark/sql/pandas/group_ops.py                       52     27     10      1    45%
pyspark/sql/pandas/map_ops.py                         24      8      6      1    63%
pyspark/sql/pandas/serializers.py                    145    113     76      0    14%
pyspark/sql/pandas/typehints.py                       36     31     31      0     7%
pyspark/sql/pandas/types.py                          139    111    104      1    14%
pyspark/sql/pandas/utils.py                           27      3     10      2    81%
pyspark/sql/readwriter.py                            288     49    108     20    80%
pyspark/sql/session.py                               265     30    100     14    87%
pyspark/sql/streaming.py                             283     21    100     18    90%
pyspark/sql/tests/__init__.py                          0      0      0      0   100%
pyspark/sql/tests/test_arrow.py                      372    300     62      1    19%
pyspark/sql/tests/test_catalog.py                    108      0     38      1    99%
pyspark/sql/tests/test_column.py                     123      0     40      0   100%
pyspark/sql/tests/test_conf.py                        25      0      4      0   100%
pyspark/sql/tests/test_context.py                    119      7     24      6    90%
pyspark/sql/tests/test_dataframe.py                  477     11     68      6    97%
pyspark/sql/tests/test_datasources.py                 93      0      8      0   100%
pyspark/sql/tests/test_functions.py                  347      0    122      4    99%
pyspark/sql/tests/test_group.py                       21      0      2      0   100%
pyspark/sql/tests/test_pandas_cogrouped_map.py       112     73     25      1    34%
pyspark/sql/tests/test_pandas_grouped_map.py         266    221     67      1    16%
pyspark/sql/tests/test_pandas_map.py                  76     52     20      0    31%
pyspark/sql/tests/test_pandas_udf.py                 129    106     20      0    18%
pyspark/sql/tests/test_pandas_udf_grouped_agg.py     230    187     18      0    20%
pyspark/sql/tests/test_pandas_udf_scalar.py          702    617    287      1     9%
pyspark/sql/tests/test_pandas_udf_typehints.py       141    109     10      0    25%
pyspark/sql/tests/test_pandas_udf_window.py          190    142     16      0    26%
pyspark/sql/tests/test_readwriter.py                 125      0      4      0   100%
pyspark/sql/tests/test_serde.py                      104      0     10      0   100%
pyspark/sql/tests/test_session.py                    229      1     18      8    96%
pyspark/sql/tests/test_streaming.py                  401     20     46      8    94%
pyspark/sql/tests/test_types.py                      489      4    106      1    99%
pyspark/sql/tests/test_udf.py                        459      4    144     18    96%
pyspark/sql/tests/test_utils.py                       32      0     12      0   100%
pyspark/sql/types.py                                 703     48    390     32    91%
pyspark/sql/udf.py                                   141     32     50      9    74%
pyspark/sql/utils.py                                  90      9     27      3    88%
pyspark/sql/window.py                                 72      4     22      6    89%
pyspark/statcounter.py                                78     24     20      7    64%
pyspark/status.py                                     22      0      6      2    93%
pyspark/storagelevel.py                               27      0      0      0   100%
pyspark/streaming/__init__.py                          4      0      0      0   100%
pyspark/streaming/context.py                         140     20     58     10    83%
pyspark/streaming/dstream.py                         251     23    124     16    88%
pyspark/streaming/kinesis.py                          25     14      6      0    35%
pyspark/streaming/listener.py                         24      8      0      0    67%
pyspark/streaming/tests/__init__.py                    0      0      0      0   100%
pyspark/streaming/tests/test_context.py              127      0     30      3    98%
pyspark/streaming/tests/test_dstream.py              421      9    101      8    97%
pyspark/streaming/tests/test_kinesis.py               48     31     14      0    34%
pyspark/streaming/tests/test_listener.py             114     18     26      3    81%
pyspark/streaming/util.py                             81      6     24      2    92%
pyspark/taskcontext.py                                87     52     24      0    32%
pyspark/testing/__init__.py                            0      0      0      0   100%
pyspark/testing/mllibutils.py                          9      0      0      0   100%
pyspark/testing/mlutils.py                            90      3     22      3    95%
pyspark/testing/sqlutils.py                          129      6     18      1    95%
pyspark/testing/streamingutils.py                     92     12     38      3    84%
pyspark/testing/utils.py                              82      5     14      3    90%
pyspark/tests/__init__.py                              0      0      0      0   100%
pyspark/tests/test_appsubmit.py                       97      0      6      0   100%
pyspark/tests/test_broadcast.py                      102      0     30      1    99%
pyspark/tests/test_conf.py                            21      0      6      0   100%
pyspark/tests/test_context.py                        229      2     18      2    98%
pyspark/tests/test_daemon.py                          42      1      6      0    98%
pyspark/tests/test_install_spark.py                   39      2      4      1    93%
pyspark/tests/test_join.py                            42      0      4      0   100%
pyspark/tests/test_profiler.py                        64      0     10      0   100%
pyspark/tests/test_rdd.py                            598      7    172      5    98%
pyspark/tests/test_rddbarrier.py                      24      0      4      1    96%
pyspark/tests/test_readwrite.py                      148      0     32      0   100%
pyspark/tests/test_serializers.py                    166      1     20      1    99%
pyspark/tests/test_shuffle.py                        117      2     52      1    98%
pyspark/tests/test_taskcontext.py                    212      1     60      6    97%
pyspark/tests/test_util.py                            51      1     12      2    95%
pyspark/tests/test_worker.py                         156     12     32      2    93%
pyspark/traceback_utils.py                            38      4     14      4    85%
pyspark/util.py                                       87     48     32      2    38%
pyspark/version.py                                     1      0      0      0   100%
pyspark/worker.py                                    388    175    182     17    51%
------------------------------------------------------------------------------------
TOTAL                                              30760   4907   7829    759    82%
Generating HTML files for PySpark coverage under /home/jenkins/workspace/spark-master-test-sbt-hadoop-3.2-hive-2.3/python/test_coverage/htmlcov
/home/jenkins/workspace/spark-master-test-sbt-hadoop-3.2-hive-2.3
[error] 'SPARK_TEST_KEY' environment variable was not set. Unable to post PySpark coverage results.
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
[Checks API] No suitable checks publisher found.
Finished: FAILURE