SuccessConsole Output

Skipping 9,291 KB.. Full Log
[INFO] Building jar: /home/jenkins/workspace/spark-master-test-python-arm/external/kinesis-asl-assembly/target/spark-streaming-kinesis-asl-assembly_2.12-3.2.0-SNAPSHOT-sources.jar
[INFO] 
[INFO] --- maven-source-plugin:3.1.0:test-jar-no-fork (create-source-jar) @ spark-streaming-kinesis-asl-assembly_2.12 ---
[INFO] Building jar: /home/jenkins/workspace/spark-master-test-python-arm/external/kinesis-asl-assembly/target/spark-streaming-kinesis-asl-assembly_2.12-3.2.0-SNAPSHOT-test-sources.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Spark Project Parent POM 3.2.0-SNAPSHOT:
[INFO] 
[INFO] Spark Project Parent POM ........................... SUCCESS [  4.055 s]
[INFO] Spark Project Tags ................................. SUCCESS [  7.181 s]
[INFO] Spark Project Sketch ............................... SUCCESS [  7.583 s]
[INFO] Spark Project Local DB ............................. SUCCESS [  1.753 s]
[INFO] Spark Project Networking ........................... SUCCESS [  3.635 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [  1.664 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [  9.526 s]
[INFO] Spark Project Launcher ............................. SUCCESS [  1.803 s]
[INFO] Spark Project Core ................................. SUCCESS [03:02 min]
[INFO] Spark Project ML Local Library ..................... SUCCESS [ 38.452 s]
[INFO] Spark Project GraphX ............................... SUCCESS [ 47.409 s]
[INFO] Spark Project Streaming ............................ SUCCESS [01:22 min]
[INFO] Spark Project Catalyst ............................. SUCCESS [04:07 min]
[INFO] Spark Project SQL .................................. SUCCESS [06:54 min]
[INFO] Spark Project ML Library ........................... SUCCESS [05:02 min]
[INFO] Spark Project Tools ................................ SUCCESS [ 13.790 s]
[INFO] Spark Project Hive ................................. SUCCESS [03:09 min]
[INFO] Spark Project REPL ................................. SUCCESS [ 40.876 s]
[INFO] Spark Project YARN Shuffle Service ................. SUCCESS [ 33.952 s]
[INFO] Spark Project YARN ................................. SUCCESS [01:39 min]
[INFO] Spark Project Mesos ................................ SUCCESS [01:28 min]
[INFO] Spark Project Hive Thrift Server ................... SUCCESS [01:39 min]
[INFO] Spark Project Assembly ............................. SUCCESS [  3.785 s]
[INFO] Kafka 0.10+ Token Provider for Streaming ........... SUCCESS [ 46.232 s]
[INFO] Spark Integration for Kafka 0.10 ................... SUCCESS [01:04 min]
[INFO] Kafka 0.10+ Source for Structured Streaming ........ SUCCESS [01:54 min]
[INFO] Spark Kinesis Integration .......................... SUCCESS [01:08 min]
[INFO] Spark Project Examples ............................. SUCCESS [01:20 min]
[INFO] Spark Integration for Kafka 0.10 Assembly .......... SUCCESS [  5.115 s]
[INFO] Spark Avro ......................................... SUCCESS [01:55 min]
[INFO] Spark Project Kinesis Assembly ..................... SUCCESS [  9.360 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  40:25 min
[INFO] Finished at: 2021-05-12T12:12:04+08:00
[INFO] ------------------------------------------------------------------------
+ echo '=========== PySpark test ==========='
=========== PySpark test ===========
+ source /home/jenkins/venv-test/py36/bin/activate
++ '[' /home/jenkins/venv-test/py36/bin/activate = /tmp/jenkins804458062984602373.sh ']'
++ deactivate nondestructive
++ unset -f pydoc
++ '[' -z '' ']'
++ '[' -z '' ']'
++ '[' -n /bin/bash ']'
++ hash -r
++ '[' -z '' ']'
++ unset VIRTUAL_ENV
++ '[' '!' nondestructive = nondestructive ']'
++ VIRTUAL_ENV=/home/jenkins/venv/py36
++ export VIRTUAL_ENV
++ _OLD_VIRTUAL_PATH=/usr/lib/jvm/java-1.8.0-openjdk-arm64/bin:/usr/lib/jvm/java-1.8.0-openjdk-arm64/bin:/usr/lib/jvm/java-1.8.0-openjdk-arm64/bin:/usr/lib/jvm/java-1.8.0-openjdk-arm64/bin:/usr/lib/jvm/java-1.8.0-openjdk-arm64/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
++ PATH=/home/jenkins/venv/py36/bin:/usr/lib/jvm/java-1.8.0-openjdk-arm64/bin:/usr/lib/jvm/java-1.8.0-openjdk-arm64/bin:/usr/lib/jvm/java-1.8.0-openjdk-arm64/bin:/usr/lib/jvm/java-1.8.0-openjdk-arm64/bin:/usr/lib/jvm/java-1.8.0-openjdk-arm64/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
++ export PATH
++ '[' -z '' ']'
++ '[' -z '' ']'
++ _OLD_VIRTUAL_PS1=
++ '[' x '!=' x ']'
+++ basename /home/jenkins/venv/py36
++ PS1='(py36) '
++ export PS1
++ alias pydoc
++ true
++ '[' -n /bin/bash ']'
++ hash -r
+ ./python/run-tests --python-executables=python3.6
Running PySpark tests. Output is in /home/jenkins/workspace/spark-master-test-python-arm/python/unit-tests.log
Will test against the following Python executables: ['python3.6']
Will test the following Python modules: ['pyspark-core', 'pyspark-ml', 'pyspark-mllib', 'pyspark-pandas', 'pyspark-resource', 'pyspark-sql', 'pyspark-streaming']
python3.6 python_implementation is CPython
python3.6 version is: Python 3.6.8
Starting test(python3.6): pyspark.ml.tests.test_algorithms
Starting test(python3.6): pyspark.ml.tests.test_base
Starting test(python3.6): pyspark.ml.tests.test_evaluation
Starting test(python3.6): pyspark.ml.tests.test_feature
Finished test(python3.6): pyspark.ml.tests.test_base (16s)
Starting test(python3.6): pyspark.ml.tests.test_image
Finished test(python3.6): pyspark.ml.tests.test_evaluation (21s)
Starting test(python3.6): pyspark.ml.tests.test_linalg
Finished test(python3.6): pyspark.ml.tests.test_image (18s)
Starting test(python3.6): pyspark.ml.tests.test_param
Finished test(python3.6): pyspark.ml.tests.test_feature (35s)
Starting test(python3.6): pyspark.ml.tests.test_persistence
Finished test(python3.6): pyspark.ml.tests.test_param (22s)
Starting test(python3.6): pyspark.ml.tests.test_pipeline
Finished test(python3.6): pyspark.ml.tests.test_linalg (38s)
Starting test(python3.6): pyspark.ml.tests.test_stat
Finished test(python3.6): pyspark.ml.tests.test_pipeline (6s)
Starting test(python3.6): pyspark.ml.tests.test_training_summary
Finished test(python3.6): pyspark.ml.tests.test_stat (17s)
Starting test(python3.6): pyspark.ml.tests.test_tuning
Finished test(python3.6): pyspark.ml.tests.test_algorithms (96s)
Starting test(python3.6): pyspark.ml.tests.test_util
Finished test(python3.6): pyspark.ml.tests.test_persistence (71s)
Starting test(python3.6): pyspark.ml.tests.test_wrapper
Finished test(python3.6): pyspark.ml.tests.test_training_summary (44s)
Starting test(python3.6): pyspark.mllib.tests.test_algorithms
Finished test(python3.6): pyspark.ml.tests.test_util (26s)
Starting test(python3.6): pyspark.mllib.tests.test_feature
Finished test(python3.6): pyspark.ml.tests.test_wrapper (20s)
Starting test(python3.6): pyspark.mllib.tests.test_linalg
Finished test(python3.6): pyspark.mllib.tests.test_feature (37s)
Starting test(python3.6): pyspark.mllib.tests.test_stat
Finished test(python3.6): pyspark.mllib.tests.test_stat (30s)
Starting test(python3.6): pyspark.mllib.tests.test_streaming_algorithms
Finished test(python3.6): pyspark.mllib.tests.test_algorithms (82s)
Starting test(python3.6): pyspark.mllib.tests.test_util
Finished test(python3.6): pyspark.mllib.tests.test_util (13s)
Starting test(python3.6): pyspark.pandas.tests.indexes.test_base
Finished test(python3.6): pyspark.mllib.tests.test_linalg (77s)
Starting test(python3.6): pyspark.pandas.tests.indexes.test_category
Finished test(python3.6): pyspark.pandas.tests.indexes.test_base (0s)
Starting test(python3.6): pyspark.pandas.tests.indexes.test_datetime
Finished test(python3.6): pyspark.pandas.tests.indexes.test_category (0s)
Starting test(python3.6): pyspark.pandas.tests.plot.test_frame_plot
Finished test(python3.6): pyspark.pandas.tests.indexes.test_datetime (0s)
Starting test(python3.6): pyspark.pandas.tests.plot.test_frame_plot_matplotlib
Finished test(python3.6): pyspark.pandas.tests.plot.test_frame_plot (0s)
Starting test(python3.6): pyspark.pandas.tests.plot.test_frame_plot_plotly
Finished test(python3.6): pyspark.pandas.tests.plot.test_frame_plot_matplotlib (0s)
Starting test(python3.6): pyspark.pandas.tests.plot.test_series_plot
Finished test(python3.6): pyspark.pandas.tests.plot.test_frame_plot_plotly (0s)
Starting test(python3.6): pyspark.pandas.tests.plot.test_series_plot_matplotlib
Finished test(python3.6): pyspark.pandas.tests.plot.test_series_plot (0s)
Starting test(python3.6): pyspark.pandas.tests.plot.test_series_plot_plotly
Finished test(python3.6): pyspark.pandas.tests.plot.test_series_plot_matplotlib (0s)
Starting test(python3.6): pyspark.pandas.tests.test_categorical
Finished test(python3.6): pyspark.pandas.tests.plot.test_series_plot_plotly (0s)
Starting test(python3.6): pyspark.pandas.tests.test_config
Finished test(python3.6): pyspark.pandas.tests.test_categorical (0s)
Starting test(python3.6): pyspark.pandas.tests.test_csv
Finished test(python3.6): pyspark.pandas.tests.test_config (0s)
Starting test(python3.6): pyspark.pandas.tests.test_dataframe
Finished test(python3.6): pyspark.pandas.tests.test_csv (0s)
Starting test(python3.6): pyspark.pandas.tests.test_dataframe_conversion
Finished test(python3.6): pyspark.pandas.tests.test_dataframe (0s)
Starting test(python3.6): pyspark.pandas.tests.test_dataframe_spark_io
Finished test(python3.6): pyspark.pandas.tests.test_dataframe_conversion (0s)
Starting test(python3.6): pyspark.pandas.tests.test_default_index
Finished test(python3.6): pyspark.pandas.tests.test_dataframe_spark_io (0s)
Starting test(python3.6): pyspark.pandas.tests.test_expanding
Finished test(python3.6): pyspark.pandas.tests.test_default_index (0s)
Starting test(python3.6): pyspark.pandas.tests.test_extension
Finished test(python3.6): pyspark.pandas.tests.test_expanding (0s)
Starting test(python3.6): pyspark.pandas.tests.test_frame_spark
Finished test(python3.6): pyspark.pandas.tests.test_extension (0s)
Starting test(python3.6): pyspark.pandas.tests.test_groupby
Finished test(python3.6): pyspark.pandas.tests.test_frame_spark (0s)
Starting test(python3.6): pyspark.pandas.tests.test_indexing
Finished test(python3.6): pyspark.pandas.tests.test_groupby (0s)
Starting test(python3.6): pyspark.pandas.tests.test_indexops_spark
Finished test(python3.6): pyspark.pandas.tests.test_indexing (0s)
Starting test(python3.6): pyspark.pandas.tests.test_internal
Finished test(python3.6): pyspark.pandas.tests.test_indexops_spark (0s)
Starting test(python3.6): pyspark.pandas.tests.test_namespace
Finished test(python3.6): pyspark.pandas.tests.test_internal (0s)
Starting test(python3.6): pyspark.pandas.tests.test_numpy_compat
Finished test(python3.6): pyspark.pandas.tests.test_namespace (0s)
Starting test(python3.6): pyspark.pandas.tests.test_ops_on_diff_frames
Finished test(python3.6): pyspark.pandas.tests.test_numpy_compat (0s)
Starting test(python3.6): pyspark.pandas.tests.test_ops_on_diff_frames_groupby
Finished test(python3.6): pyspark.pandas.tests.test_ops_on_diff_frames (0s)
Starting test(python3.6): pyspark.pandas.tests.test_ops_on_diff_frames_groupby_expanding
Finished test(python3.6): pyspark.pandas.tests.test_ops_on_diff_frames_groupby (0s)
Starting test(python3.6): pyspark.pandas.tests.test_ops_on_diff_frames_groupby_rolling
Finished test(python3.6): pyspark.pandas.tests.test_ops_on_diff_frames_groupby_expanding (0s)
Starting test(python3.6): pyspark.pandas.tests.test_repr
Finished test(python3.6): pyspark.pandas.tests.test_ops_on_diff_frames_groupby_rolling (0s)
Starting test(python3.6): pyspark.pandas.tests.test_reshape
Finished test(python3.6): pyspark.pandas.tests.test_repr (0s)
Starting test(python3.6): pyspark.pandas.tests.test_rolling
Finished test(python3.6): pyspark.pandas.tests.test_reshape (0s)
Starting test(python3.6): pyspark.pandas.tests.test_series
Finished test(python3.6): pyspark.pandas.tests.test_rolling (0s)
Starting test(python3.6): pyspark.pandas.tests.test_series_conversion
Finished test(python3.6): pyspark.pandas.tests.test_series (0s)
Starting test(python3.6): pyspark.pandas.tests.test_series_datetime
Finished test(python3.6): pyspark.pandas.tests.test_series_conversion (0s)
Starting test(python3.6): pyspark.pandas.tests.test_series_string
Finished test(python3.6): pyspark.pandas.tests.test_series_datetime (0s)
Starting test(python3.6): pyspark.pandas.tests.test_sql
Finished test(python3.6): pyspark.pandas.tests.test_series_string (0s)
Starting test(python3.6): pyspark.pandas.tests.test_stats
Finished test(python3.6): pyspark.pandas.tests.test_sql (0s)
Starting test(python3.6): pyspark.pandas.tests.test_typedef
Finished test(python3.6): pyspark.pandas.tests.test_stats (0s)
Starting test(python3.6): pyspark.pandas.tests.test_utils
Finished test(python3.6): pyspark.pandas.tests.test_typedef (0s)
Starting test(python3.6): pyspark.pandas.tests.test_window
Finished test(python3.6): pyspark.pandas.tests.test_utils (0s)
Starting test(python3.6): pyspark.sql.tests.test_arrow
Finished test(python3.6): pyspark.pandas.tests.test_window (0s)
Starting test(python3.6): pyspark.sql.tests.test_catalog
Finished test(python3.6): pyspark.sql.tests.test_arrow (0s) ... 69 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_column
Finished test(python3.6): pyspark.sql.tests.test_catalog (20s)
Starting test(python3.6): pyspark.sql.tests.test_conf
Finished test(python3.6): pyspark.sql.tests.test_column (22s)
Starting test(python3.6): pyspark.sql.tests.test_context
Finished test(python3.6): pyspark.sql.tests.test_conf (11s)
Starting test(python3.6): pyspark.sql.tests.test_dataframe
Finished test(python3.6): pyspark.sql.tests.test_context (22s)
Starting test(python3.6): pyspark.sql.tests.test_datasources
Finished test(python3.6): pyspark.sql.tests.test_datasources (22s)
Starting test(python3.6): pyspark.sql.tests.test_functions
Finished test(python3.6): pyspark.sql.tests.test_dataframe (51s) ... 3 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_group
Finished test(python3.6): pyspark.sql.tests.test_group (19s)
Starting test(python3.6): pyspark.sql.tests.test_pandas_cogrouped_map
Finished test(python3.6): pyspark.sql.tests.test_pandas_cogrouped_map (0s) ... 16 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_pandas_grouped_map
Finished test(python3.6): pyspark.sql.tests.test_pandas_grouped_map (0s) ... 21 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_pandas_map
Finished test(python3.6): pyspark.sql.tests.test_pandas_map (0s) ... 7 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_pandas_udf
Finished test(python3.6): pyspark.sql.tests.test_pandas_udf (0s) ... 6 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_pandas_udf_grouped_agg
Finished test(python3.6): pyspark.sql.tests.test_functions (38s)
Starting test(python3.6): pyspark.sql.tests.test_pandas_udf_scalar
Finished test(python3.6): pyspark.sql.tests.test_pandas_udf_grouped_agg (0s) ... 16 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_pandas_udf_typehints
Finished test(python3.6): pyspark.sql.tests.test_pandas_udf_scalar (0s) ... 51 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_pandas_udf_window
Finished test(python3.6): pyspark.sql.tests.test_pandas_udf_typehints (0s) ... 10 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_readwriter
Finished test(python3.6): pyspark.sql.tests.test_pandas_udf_window (0s) ... 14 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_serde
Finished test(python3.6): pyspark.mllib.tests.test_streaming_algorithms (158s)
Starting test(python3.6): pyspark.sql.tests.test_session
Finished test(python3.6): pyspark.sql.tests.test_serde (27s)
Starting test(python3.6): pyspark.sql.tests.test_streaming
Finished test(python3.6): pyspark.sql.tests.test_readwriter (32s)
Starting test(python3.6): pyspark.sql.tests.test_types
Finished test(python3.6): pyspark.sql.tests.test_session (38s)
Starting test(python3.6): pyspark.sql.tests.test_udf
Finished test(python3.6): pyspark.sql.tests.test_streaming (40s)
Starting test(python3.6): pyspark.sql.tests.test_utils
Finished test(python3.6): pyspark.sql.tests.test_types (43s)
Starting test(python3.6): pyspark.streaming.tests.test_context
Finished test(python3.6): pyspark.sql.tests.test_utils (12s)
Starting test(python3.6): pyspark.streaming.tests.test_dstream
Finished test(python3.6): pyspark.streaming.tests.test_context (22s)
Starting test(python3.6): pyspark.streaming.tests.test_kinesis
Finished test(python3.6): pyspark.streaming.tests.test_kinesis (0s) ... 2 tests were skipped
Starting test(python3.6): pyspark.streaming.tests.test_listener
Finished test(python3.6): pyspark.sql.tests.test_udf (41s)
Starting test(python3.6): pyspark.tests.test_appsubmit
Finished test(python3.6): pyspark.ml.tests.test_tuning (351s)
Starting test(python3.6): pyspark.tests.test_broadcast
Finished test(python3.6): pyspark.streaming.tests.test_listener (9s)
Starting test(python3.6): pyspark.tests.test_conf
Finished test(python3.6): pyspark.tests.test_conf (18s)
Starting test(python3.6): pyspark.tests.test_context
Finished test(python3.6): pyspark.tests.test_broadcast (36s)
Starting test(python3.6): pyspark.tests.test_daemon
Finished test(python3.6): pyspark.tests.test_daemon (4s)
Starting test(python3.6): pyspark.tests.test_install_spark
Finished test(python3.6): pyspark.tests.test_install_spark (22s)
Starting test(python3.6): pyspark.tests.test_join
Finished test(python3.6): pyspark.tests.test_join (11s)
Starting test(python3.6): pyspark.tests.test_profiler
Finished test(python3.6): pyspark.tests.test_context (55s)
Starting test(python3.6): pyspark.tests.test_rdd
Finished test(python3.6): pyspark.tests.test_profiler (12s)
Starting test(python3.6): pyspark.tests.test_rddbarrier
Finished test(python3.6): pyspark.tests.test_appsubmit (90s)
Starting test(python3.6): pyspark.tests.test_readwrite
Finished test(python3.6): pyspark.tests.test_rddbarrier (8s)
Starting test(python3.6): pyspark.tests.test_serializers
Finished test(python3.6): pyspark.streaming.tests.test_dstream (117s)
Starting test(python3.6): pyspark.tests.test_shuffle
Finished test(python3.6): pyspark.tests.test_serializers (12s)
Starting test(python3.6): pyspark.tests.test_taskcontext
Finished test(python3.6): pyspark.tests.test_shuffle (12s)
Starting test(python3.6): pyspark.tests.test_util
Finished test(python3.6): pyspark.tests.test_readwrite (22s)
Starting test(python3.6): pyspark.tests.test_worker
Finished test(python3.6): pyspark.tests.test_util (6s)
Starting test(python3.6): pyspark.accumulators
Finished test(python3.6): pyspark.accumulators (8s)
Starting test(python3.6): pyspark.broadcast
Finished test(python3.6): pyspark.broadcast (6s)
Starting test(python3.6): pyspark.conf
Finished test(python3.6): pyspark.tests.test_worker (18s)
Starting test(python3.6): pyspark.context
Finished test(python3.6): pyspark.conf (4s)
Starting test(python3.6): pyspark.ml.classification
Finished test(python3.6): pyspark.context (23s)
Starting test(python3.6): pyspark.ml.clustering
Finished test(python3.6): pyspark.tests.test_taskcontext (58s)
Starting test(python3.6): pyspark.ml.evaluation
Finished test(python3.6): pyspark.ml.evaluation (26s)
Starting test(python3.6): pyspark.ml.feature
Finished test(python3.6): pyspark.ml.clustering (45s)
Starting test(python3.6): pyspark.ml.fpm
Finished test(python3.6): pyspark.tests.test_rdd (128s)
Starting test(python3.6): pyspark.ml.functions
Finished test(python3.6): pyspark.ml.classification (86s)
Starting test(python3.6): pyspark.ml.image
Finished test(python3.6): pyspark.ml.fpm (26s)
Starting test(python3.6): pyspark.ml.linalg.__init__
Finished test(python3.6): pyspark.ml.linalg.__init__ (0s)
Starting test(python3.6): pyspark.ml.recommendation
Finished test(python3.6): pyspark.ml.functions (19s)
Starting test(python3.6): pyspark.ml.regression
Finished test(python3.6): pyspark.ml.image (8s)
Starting test(python3.6): pyspark.ml.stat
Finished test(python3.6): pyspark.ml.stat (27s)
Starting test(python3.6): pyspark.ml.tuning
Finished test(python3.6): pyspark.ml.recommendation (40s)
Starting test(python3.6): pyspark.mllib.classification
Finished test(python3.6): pyspark.ml.regression (55s)
Starting test(python3.6): pyspark.mllib.clustering
Finished test(python3.6): pyspark.ml.feature (91s)
Starting test(python3.6): pyspark.mllib.evaluation
Finished test(python3.6): pyspark.ml.tuning (37s)
Starting test(python3.6): pyspark.mllib.feature
Finished test(python3.6): pyspark.mllib.evaluation (24s)
Starting test(python3.6): pyspark.mllib.fpm
Finished test(python3.6): pyspark.mllib.classification (43s)
Starting test(python3.6): pyspark.mllib.linalg.__init__
Finished test(python3.6): pyspark.mllib.linalg.__init__ (0s)
Starting test(python3.6): pyspark.mllib.linalg.distributed
Finished test(python3.6): pyspark.mllib.feature (32s)
Starting test(python3.6): pyspark.mllib.random
Finished test(python3.6): pyspark.mllib.fpm (25s)
Starting test(python3.6): pyspark.mllib.recommendation
Finished test(python3.6): pyspark.mllib.random (15s)
Starting test(python3.6): pyspark.mllib.regression
Finished test(python3.6): pyspark.mllib.clustering (60s)
Starting test(python3.6): pyspark.mllib.stat.KernelDensity
Finished test(python3.6): pyspark.mllib.stat.KernelDensity (0s)
Starting test(python3.6): pyspark.mllib.stat._statistics
Finished test(python3.6): pyspark.mllib.stat._statistics (22s)
Starting test(python3.6): pyspark.mllib.tree
Finished test(python3.6): pyspark.mllib.regression (34s)
Starting test(python3.6): pyspark.mllib.util
Finished test(python3.6): pyspark.mllib.linalg.distributed (67s)
Starting test(python3.6): pyspark.pandas.accessors
Finished test(python3.6): pyspark.pandas.accessors (0s)
Starting test(python3.6): pyspark.pandas.base
Finished test(python3.6): pyspark.pandas.base (0s)
Starting test(python3.6): pyspark.pandas.categorical
Finished test(python3.6): pyspark.mllib.recommendation (47s)
Starting test(python3.6): pyspark.pandas.config
Finished test(python3.6): pyspark.pandas.categorical (0s)
Starting test(python3.6): pyspark.pandas.datetimes
Finished test(python3.6): pyspark.pandas.config (0s)
Starting test(python3.6): pyspark.pandas.exceptions
Finished test(python3.6): pyspark.pandas.datetimes (0s)
Starting test(python3.6): pyspark.pandas.extensions
Finished test(python3.6): pyspark.pandas.exceptions (0s)
Starting test(python3.6): pyspark.pandas.frame
Finished test(python3.6): pyspark.pandas.extensions (0s)
Starting test(python3.6): pyspark.pandas.generic
Finished test(python3.6): pyspark.pandas.frame (0s)
Starting test(python3.6): pyspark.pandas.groupby
Finished test(python3.6): pyspark.pandas.generic (0s)
Starting test(python3.6): pyspark.pandas.indexes.base
Finished test(python3.6): pyspark.pandas.groupby (0s)
Starting test(python3.6): pyspark.pandas.indexes.category
Finished test(python3.6): pyspark.pandas.indexes.base (0s)
Starting test(python3.6): pyspark.pandas.indexes.datetimes
Finished test(python3.6): pyspark.pandas.indexes.category (0s)
Starting test(python3.6): pyspark.pandas.indexes.multi
Finished test(python3.6): pyspark.pandas.indexes.datetimes (0s)
Starting test(python3.6): pyspark.pandas.indexes.numeric
Finished test(python3.6): pyspark.pandas.indexes.numeric (0s)
Starting test(python3.6): pyspark.pandas.indexing
Finished test(python3.6): pyspark.pandas.indexes.multi (0s)
Starting test(python3.6): pyspark.pandas.internal
Finished test(python3.6): pyspark.pandas.indexing (0s)
Starting test(python3.6): pyspark.pandas.ml
Finished test(python3.6): pyspark.pandas.internal (0s)
Starting test(python3.6): pyspark.pandas.mlflow
Finished test(python3.6): pyspark.pandas.ml (0s)
Starting test(python3.6): pyspark.pandas.namespace
Finished test(python3.6): pyspark.pandas.mlflow (0s)
Starting test(python3.6): pyspark.pandas.numpy_compat
Finished test(python3.6): pyspark.pandas.namespace (0s)
Starting test(python3.6): pyspark.pandas.series
Finished test(python3.6): pyspark.pandas.numpy_compat (0s)
Starting test(python3.6): pyspark.pandas.spark.accessors
Finished test(python3.6): pyspark.pandas.series (0s)
Starting test(python3.6): pyspark.pandas.spark.utils
Finished test(python3.6): pyspark.pandas.spark.accessors (0s)
Starting test(python3.6): pyspark.pandas.sql_processor
Finished test(python3.6): pyspark.mllib.tree (22s)
Starting test(python3.6): pyspark.pandas.strings
Finished test(python3.6): pyspark.pandas.spark.utils (0s)
Starting test(python3.6): pyspark.pandas.typedef.typehints
Finished test(python3.6): pyspark.pandas.sql_processor (0s)
Starting test(python3.6): pyspark.pandas.utils
Finished test(python3.6): pyspark.pandas.strings (0s)
Starting test(python3.6): pyspark.pandas.window
Finished test(python3.6): pyspark.pandas.typedef.typehints (0s)
Starting test(python3.6): pyspark.profiler
Finished test(python3.6): pyspark.pandas.utils (0s)
Starting test(python3.6): pyspark.rdd
Finished test(python3.6): pyspark.pandas.window (0s)
Starting test(python3.6): pyspark.resource.tests.test_resources
Finished test(python3.6): pyspark.resource.tests.test_resources (7s)
Starting test(python3.6): pyspark.serializers
Finished test(python3.6): pyspark.mllib.util (21s)
Starting test(python3.6): pyspark.shuffle
Finished test(python3.6): pyspark.profiler (9s)
Starting test(python3.6): pyspark.sql.avro.functions
Finished test(python3.6): pyspark.shuffle (0s)
Starting test(python3.6): pyspark.sql.catalog
Finished test(python3.6): pyspark.serializers (11s)
Starting test(python3.6): pyspark.sql.column
Finished test(python3.6): pyspark.sql.catalog (16s)
Starting test(python3.6): pyspark.sql.conf
Finished test(python3.6): pyspark.sql.avro.functions (17s)
Starting test(python3.6): pyspark.sql.context
Finished test(python3.6): pyspark.sql.conf (7s)
Starting test(python3.6): pyspark.sql.dataframe
Finished test(python3.6): pyspark.rdd (40s)
Starting test(python3.6): pyspark.sql.functions
Finished test(python3.6): pyspark.sql.column (29s)
Starting test(python3.6): pyspark.sql.group
Finished test(python3.6): pyspark.sql.context (23s)
Starting test(python3.6): pyspark.sql.pandas.conversion
Finished test(python3.6): pyspark.sql.pandas.conversion (8s)
Starting test(python3.6): pyspark.sql.pandas.group_ops
Finished test(python3.6): pyspark.sql.pandas.group_ops (14s)
Starting test(python3.6): pyspark.sql.pandas.map_ops
Finished test(python3.6): pyspark.sql.group (27s)
Starting test(python3.6): pyspark.sql.pandas.serializers
Finished test(python3.6): pyspark.sql.pandas.serializers (0s)
Starting test(python3.6): pyspark.sql.pandas.typehints
Finished test(python3.6): pyspark.sql.pandas.typehints (0s)
Starting test(python3.6): pyspark.sql.pandas.types
Finished test(python3.6): pyspark.sql.pandas.types (0s)
Starting test(python3.6): pyspark.sql.pandas.utils
Finished test(python3.6): pyspark.sql.pandas.utils (0s)
Starting test(python3.6): pyspark.sql.readwriter
Finished test(python3.6): pyspark.sql.pandas.map_ops (12s)
Starting test(python3.6): pyspark.sql.session
Finished test(python3.6): pyspark.sql.dataframe (53s)
Starting test(python3.6): pyspark.sql.streaming
Finished test(python3.6): pyspark.sql.readwriter (23s)
Starting test(python3.6): pyspark.sql.types
Finished test(python3.6): pyspark.sql.streaming (16s)
Starting test(python3.6): pyspark.sql.udf
Finished test(python3.6): pyspark.sql.functions (62s)
Starting test(python3.6): pyspark.sql.window
Finished test(python3.6): pyspark.sql.session (22s)
Starting test(python3.6): pyspark.streaming.util
Finished test(python3.6): pyspark.streaming.util (0s)
Starting test(python3.6): pyspark.util
Finished test(python3.6): pyspark.util (0s)
Finished test(python3.6): pyspark.sql.types (8s)
Finished test(python3.6): pyspark.sql.udf (14s)
Finished test(python3.6): pyspark.sql.window (14s)
Tests passed in 938 seconds

Skipped tests in pyspark.sql.tests.test_arrow with python3.6:
    test_createDataFrame_column_name_encoding (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_does_not_modify_input (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_empty_partition (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_fallback_disabled (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_fallback_enabled (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_respect_session_timezone (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_toggle (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_with_array_type (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_with_float_index (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_with_incorrect_schema (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_with_int_col_names (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_with_map_type (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_with_names (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_with_schema (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_with_single_data_type (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDateFrame_with_category_type (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_filtered_frame (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_no_partition_frame (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_no_partition_toPandas (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_null_conversion (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_pandas_round_trip (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_pandas_self_destruct (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_propagates_spark_exception (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_schema_conversion_roundtrip (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_timestamp_dst (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_timestamp_nat (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_toPandas_arrow_toggle (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_toPandas_batch_order (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_toPandas_fallback_disabled (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_toPandas_fallback_enabled (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_toPandas_respect_session_timezone (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_toPandas_with_array_type (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_toPandas_with_map_type (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_toPandas_with_map_type_nulls (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_column_name_encoding (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_does_not_modify_input (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_empty_partition (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_fallback_disabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_fallback_enabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_respect_session_timezone (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_toggle (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_with_array_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_with_float_index (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_with_incorrect_schema (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_with_int_col_names (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_with_map_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_with_names (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_with_schema (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDataFrame_with_single_data_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_createDateFrame_with_category_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_filtered_frame (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_no_partition_frame (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_no_partition_toPandas (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_null_conversion (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_pandas_round_trip (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_pandas_self_destruct (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_propagates_spark_exception (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_schema_conversion_roundtrip (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_timestamp_dst (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_timestamp_nat (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_toPandas_arrow_toggle (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_toPandas_batch_order (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_toPandas_fallback_disabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_toPandas_fallback_enabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_toPandas_respect_session_timezone (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_toPandas_with_array_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_toPandas_with_map_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_toPandas_with_map_type_nulls (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_exception_by_max_results (pyspark.sql.tests.test_arrow.MaxResultArrowTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'

Skipped tests in pyspark.sql.tests.test_dataframe with python3.6:
    test_create_dataframe_required_pandas_not_found (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Required Pandas was found.'
    test_to_pandas_required_pandas_not_found (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Required Pandas was found.'
    test_query_execution_listener_on_collect_with_arrow (pyspark.sql.tests.test_dataframe.QueryExecutionListenerTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'

Skipped tests in pyspark.sql.tests.test_pandas_cogrouped_map with python3.6:
    test_case_insensitive_grouping_column (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_complex_group_by (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_different_schemas (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_empty_group_by (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_left_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_mixed_scalar_udfs_followed_by_cogrouby_apply (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_right_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_self_join (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_simple (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_with_key_complex (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_with_key_left (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_with_key_left_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_with_key_right (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_with_key_right_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_wrong_args (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_wrong_return_type (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'

Skipped tests in pyspark.sql.tests.test_pandas_grouped_map with python3.6:
    test_array_type_correct (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_case_insensitive_grouping_column (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_coerce (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_column_order (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_complex_groupby (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_datatype_string (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_decorator (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_empty_groupby (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_grouped_over_window (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_grouped_over_window_with_key (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_grouped_with_empty_partition (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_mixed_scalar_udfs_followed_by_groupby_apply (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_positional_assignment_conf (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_register_grouped_map_udf (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_self_join_with_pandas (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_supported_types (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_timestamp_dst (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_udf_with_key (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_unsupported_types (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_wrong_args (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_wrong_return_type (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'

Skipped tests in pyspark.sql.tests.test_pandas_map with python3.6:
    test_chain_map_partitions_in_pandas (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_different_output_length (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_empty_iterator (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_empty_rows (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_map_partitions_in_pandas (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_multiple_columns (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_self_join (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'

Skipped tests in pyspark.sql.tests.test_pandas_udf with python3.6:
    test_pandas_udf_arrow_overflow (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_pandas_udf_basic (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_pandas_udf_decorator (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_pandas_udf_detect_unsafe_type_conversion (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_stopiteration_in_udf (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_udf_wrong_arg (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'

Skipped tests in pyspark.sql.tests.test_pandas_udf_grouped_agg with python3.6:
    test_alias (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_array_type (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_basic (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_complex_expressions (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_complex_groupby (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_grouped_with_empty_partition (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_grouped_without_group_by_clause (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_invalid_args (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_manual (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_mixed_sql (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_mixed_udfs (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_multiple_udfs (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_no_predicate_pushdown_through (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_register_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_retain_group_columns (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_unsupported_types (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'

Skipped tests in pyspark.sql.tests.test_pandas_udf_scalar with python3.6:
    test_datasource_with_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_mixed_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_mixed_udf_and_sql (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_nondeterministic_vectorized_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_nondeterministic_vectorized_udf_in_aggregate (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_pandas_udf_nested_arrays (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_pandas_udf_tokenize (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_register_nondeterministic_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_register_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_scalar_iter_udf_close (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_scalar_iter_udf_close_early (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_scalar_iter_udf_init (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_timestamp_dst (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_type_annotation (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_udf_category_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_array_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_chained (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_chained_struct_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_check_config (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_complex (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_datatype_string (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_dates (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_decorator (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_empty_partition (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_exception (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_invalid_length (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_map_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_nested_struct (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_null_array (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_null_binary (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_null_boolean (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_null_byte (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_null_decimal (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_null_double (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_null_float (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_null_int (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_null_long (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_null_short (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_null_string (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_return_scalar (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_return_timestamp_tz (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_string_in_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_struct_complex (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_struct_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_struct_with_empty_partition (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_timestamps (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_timestamps_respect_session_timezone (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_unsupported_types (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_varargs (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_vectorized_udf_wrong_return_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'

Skipped tests in pyspark.sql.tests.test_pandas_udf_typehints with python3.6:
    test_group_agg_udf_type_hint (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_ignore_type_hint_in_cogroup_apply_in_pandas (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_ignore_type_hint_in_group_apply_in_pandas (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_ignore_type_hint_in_map_in_pandas (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_scalar_iter_udf_type_hint (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_scalar_udf_type_hint (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_type_annotation_group_agg (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_type_annotation_negative (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_type_annotation_scalar (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_type_annotation_scalar_iter (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'

Skipped tests in pyspark.sql.tests.test_pandas_udf_window with python3.6:
    test_array_type (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_bounded_mixed (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_bounded_simple (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_growing_window (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_invalid_args (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_mixed_sql (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_mixed_sql_and_udf (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_mixed_udf (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_multiple_udfs (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_replace_existing (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_shrinking_window (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_simple (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_sliding_window (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'
    test_without_partitionBy (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'PyArrow >= 1.0.0 must be installed; however, it was not found.'

Skipped tests in pyspark.streaming.tests.test_kinesis with python3.6:
    test_kinesis_stream (pyspark.streaming.tests.test_kinesis.KinesisStreamTests) ... skipped "Skipping all Kinesis Python tests as environmental variable 'ENABLE_KINESIS_TESTS' was not set."
    test_kinesis_stream_api (pyspark.streaming.tests.test_kinesis.KinesisStreamTests) ... skipped "Skipping all Kinesis Python tests as environmental variable 'ENABLE_KINESIS_TESTS' was not set."
Archiving artifacts
Finished: SUCCESS