Starting test(python3.6): pyspark.sql.tests.test_catalog
Finished test(python3.6): pyspark.mllib.tests.test_util (15s)
Starting test(python3.6): pyspark.sql.tests.test_column
Finished test(python3.6): pyspark.mllib.tests.test_stat (30s)
Starting test(python3.6): pyspark.sql.tests.test_conf
Finished test(python3.6): pyspark.sql.tests.test_conf (14s)
Starting test(python3.6): pyspark.sql.tests.test_context
Finished test(python3.6): pyspark.sql.tests.test_catalog (23s)
Starting test(python3.6): pyspark.sql.tests.test_dataframe
Finished test(python3.6): pyspark.sql.tests.test_column (24s)
Starting test(python3.6): pyspark.sql.tests.test_datasources
Finished test(python3.6): pyspark.sql.tests.test_arrow (41s)
Starting test(python3.6): pyspark.sql.tests.test_functions
Finished test(python3.6): pyspark.mllib.tests.test_algorithms (83s)
Starting test(python3.6): pyspark.sql.tests.test_group
Finished test(python3.6): pyspark.mllib.tests.test_linalg (78s)
Starting test(python3.6): pyspark.sql.tests.test_pandas_cogrouped_map
Finished test(python3.6): pyspark.sql.tests.test_datasources (29s)
Starting test(python3.6): pyspark.sql.tests.test_pandas_grouped_map
Finished test(python3.6): pyspark.sql.tests.test_context (36s)
Starting test(python3.6): pyspark.sql.tests.test_pandas_map
Finished test(python3.6): pyspark.sql.tests.test_group (24s)
Starting test(python3.6): pyspark.sql.tests.test_pandas_udf
Finished test(python3.6): pyspark.sql.tests.test_functions (43s)
Starting test(python3.6): pyspark.sql.tests.test_pandas_udf_grouped_agg
Finished test(python3.6): pyspark.sql.tests.test_dataframe (63s) ... 2 tests were skipped
Starting test(python3.6): pyspark.sql.tests.test_pandas_udf_scalar
Finished test(python3.6): pyspark.sql.tests.test_pandas_map (30s)
Starting test(python3.6): pyspark.sql.tests.test_pandas_udf_typehints
Finished test(python3.6): pyspark.sql.tests.test_pandas_udf (34s)
Starting test(python3.6): pyspark.sql.tests.test_pandas_udf_window
Finished test(python3.6): pyspark.sql.tests.test_pandas_cogrouped_map (49s)
Starting test(python3.6): pyspark.sql.tests.test_readwriter
Finished test(python3.6): pyspark.sql.tests.test_pandas_grouped_map (62s)
Starting test(python3.6): pyspark.sql.tests.test_serde
Finished test(python3.6): pyspark.sql.tests.test_pandas_udf_typehints (30s)
Starting test(python3.6): pyspark.sql.tests.test_session
Finished test(python3.6): pyspark.sql.tests.test_readwriter (38s)
Starting test(python3.6): pyspark.sql.tests.test_streaming
Finished test(python3.6): pyspark.sql.tests.test_serde (30s)
Starting test(python3.6): pyspark.sql.tests.test_types
Finished test(python3.6): pyspark.sql.tests.test_pandas_udf_window (62s)
Starting test(python3.6): pyspark.sql.tests.test_udf
Finished test(python3.6): pyspark.sql.tests.test_session (42s)
Starting test(python3.6): pyspark.sql.tests.test_utils
Finished test(python3.6): pyspark.mllib.tests.test_streaming_algorithms (181s)
Starting test(pypy): pyspark.sql.avro.functions
Finished test(python3.6): pyspark.sql.tests.test_pandas_udf_scalar (88s)
Starting test(pypy): pyspark.sql.catalog
Finished test(python3.6): pyspark.sql.tests.test_utils (14s)
Starting test(pypy): pyspark.sql.column
Finished test(python3.6): pyspark.sql.tests.test_streaming (40s)
Starting test(pypy): pyspark.sql.conf
Finished test(pypy): pyspark.sql.avro.functions (19s)
Starting test(pypy): pyspark.sql.context
Finished test(pypy): pyspark.sql.conf (9s)
Starting test(pypy): pyspark.sql.dataframe
Finished test(pypy): pyspark.sql.catalog (18s)
Starting test(pypy): pyspark.sql.functions
Finished test(python3.6): pyspark.sql.tests.test_pandas_udf_grouped_agg (117s)
Starting test(pypy): pyspark.sql.group
Finished test(python3.6): pyspark.sql.tests.test_types (52s)
Starting test(pypy): pyspark.sql.pandas.conversion
Finished test(python3.6): pyspark.ml.tests.test_tuning (259s)
Starting test(pypy): pyspark.sql.pandas.group_ops
Finished test(pypy): pyspark.sql.context (25s)
Starting test(pypy): pyspark.sql.pandas.map_ops
Finished test(pypy): pyspark.sql.pandas.conversion (9s)
Starting test(pypy): pyspark.sql.pandas.serializers
Finished test(pypy): pyspark.sql.pandas.serializers (0s)
Starting test(pypy): pyspark.sql.pandas.typehints
Finished test(pypy): pyspark.sql.pandas.typehints (0s)
Starting test(pypy): pyspark.sql.pandas.types
Finished test(pypy): pyspark.sql.column (33s)
Starting test(pypy): pyspark.sql.pandas.utils
Finished test(pypy): pyspark.sql.pandas.types (0s)
Starting test(pypy): pyspark.sql.readwriter
Finished test(pypy): pyspark.sql.pandas.utils (0s)
Starting test(pypy): pyspark.sql.session
Finished test(pypy): pyspark.sql.pandas.group_ops (13s)
Starting test(pypy): pyspark.sql.streaming
Finished test(python3.6): pyspark.sql.tests.test_udf (60s)
Starting test(pypy): pyspark.sql.types
Finished test(pypy): pyspark.sql.pandas.map_ops (13s)
Starting test(pypy): pyspark.sql.udf
Finished test(pypy): pyspark.sql.group (34s)
Starting test(pypy): pyspark.sql.window
Finished test(pypy): pyspark.sql.types (11s)
Starting test(python2.7): pyspark.ml.classification
Finished test(pypy): pyspark.sql.streaming (20s)
Starting test(python2.7): pyspark.ml.clustering
Finished test(pypy): pyspark.sql.session (27s)
Starting test(python2.7): pyspark.ml.evaluation
Finished test(pypy): pyspark.sql.readwriter (29s)
Starting test(python2.7): pyspark.ml.feature
Finished test(pypy): pyspark.sql.udf (22s)
Starting test(python2.7): pyspark.ml.fpm
Finished test(pypy): pyspark.sql.window (21s)
Starting test(python2.7): pyspark.ml.functions
Finished test(pypy): pyspark.sql.dataframe (72s)
Starting test(python2.7): pyspark.ml.image
Finished test(pypy): pyspark.sql.functions (70s)
Starting test(python2.7): pyspark.ml.linalg.__init__
Finished test(python2.7): pyspark.ml.linalg.__init__ (0s)
Starting test(python2.7): pyspark.ml.recommendation
Finished test(python2.7): pyspark.ml.evaluation (29s)
Starting test(python2.7): pyspark.ml.regression
Finished test(python2.7): pyspark.ml.functions (18s)
Starting test(python2.7): pyspark.ml.stat
Finished test(python2.7): pyspark.ml.fpm (24s)
Starting test(python2.7): pyspark.ml.tuning
Finished test(python2.7): pyspark.ml.image (8s)
Starting test(python2.7): pyspark.mllib.classification
Finished test(python2.7): pyspark.ml.clustering (52s)
Starting test(python2.7): pyspark.mllib.clustering
Finished test(python2.7): pyspark.ml.stat (32s)
Starting test(python2.7): pyspark.mllib.evaluation
Finished test(python2.7): pyspark.ml.tuning (37s)
Starting test(python2.7): pyspark.mllib.feature
Finished test(python2.7): pyspark.mllib.classification (41s)
Starting test(python2.7): pyspark.mllib.fpm
Finished test(python2.7): pyspark.ml.regression (55s)
Starting test(python2.7): pyspark.mllib.linalg.__init__
Finished test(python2.7): pyspark.mllib.linalg.__init__ (0s)
Starting test(python2.7): pyspark.mllib.linalg.distributed
Finished test(python2.7): pyspark.ml.classification (94s)
Starting test(python2.7): pyspark.mllib.random
Finished test(python2.7): pyspark.mllib.evaluation (24s)
Starting test(python2.7): pyspark.mllib.recommendation
Finished test(python2.7): pyspark.mllib.fpm (24s)
Starting test(python2.7): pyspark.mllib.regression
Finished test(python2.7): pyspark.mllib.feature (29s)
Starting test(python2.7): pyspark.mllib.stat.KernelDensity
Finished test(python2.7): pyspark.mllib.stat.KernelDensity (0s)
Starting test(python2.7): pyspark.mllib.stat._statistics
Finished test(python2.7): pyspark.mllib.random (14s)
Starting test(python2.7): pyspark.mllib.tree
Finished test(python2.7): pyspark.mllib.clustering (58s)
Starting test(python2.7): pyspark.mllib.util
Finished test(python2.7): pyspark.ml.feature (109s)
Starting test(python2.7): pyspark.sql.avro.functions
Finished test(python2.7): pyspark.mllib.stat._statistics (22s)
Starting test(python2.7): pyspark.sql.catalog
Finished test(python2.7): pyspark.mllib.tree (23s)
Starting test(python2.7): pyspark.sql.column
Finished test(python2.7): pyspark.mllib.util (22s)
Starting test(python2.7): pyspark.sql.conf
Finished test(python2.7): pyspark.sql.avro.functions (18s)
Starting test(python2.7): pyspark.sql.context
Finished test(python2.7): pyspark.mllib.recommendation (43s)
Starting test(python2.7): pyspark.sql.dataframe
Finished test(python2.7): pyspark.mllib.regression (34s)
Starting test(python2.7): pyspark.sql.functions
Finished test(python2.7): pyspark.sql.conf (8s)
Starting test(python2.7): pyspark.sql.group
Finished test(python2.7): pyspark.sql.catalog (16s)
Starting test(python2.7): pyspark.sql.pandas.conversion
Finished test(python2.7): pyspark.ml.recommendation (114s)
Starting test(python2.7): pyspark.sql.pandas.group_ops
Finished test(python2.7): pyspark.mllib.linalg.distributed (57s)
Starting test(python2.7): pyspark.sql.pandas.map_ops
Finished test(python2.7): pyspark.sql.pandas.conversion (7s)
Starting test(python2.7): pyspark.sql.pandas.serializers
Finished test(python2.7): pyspark.sql.pandas.serializers (0s)
Starting test(python2.7): pyspark.sql.pandas.typehints
Finished test(python2.7): pyspark.sql.pandas.typehints (0s)
Starting test(python2.7): pyspark.sql.pandas.types
Finished test(python2.7): pyspark.sql.pandas.types (0s)
Starting test(python2.7): pyspark.sql.pandas.utils
Finished test(python2.7): pyspark.sql.pandas.utils (0s)
Starting test(python2.7): pyspark.sql.readwriter
Finished test(python2.7): pyspark.sql.context (21s)
Starting test(python2.7): pyspark.sql.session
Finished test(python2.7): pyspark.sql.pandas.group_ops (12s)
Starting test(python2.7): pyspark.sql.streaming
Finished test(python2.7): pyspark.sql.pandas.map_ops (13s)
Starting test(python2.7): pyspark.sql.types
Finished test(python2.7): pyspark.sql.column (31s)
Starting test(python2.7): pyspark.sql.udf
Finished test(python2.7): pyspark.sql.types (11s)
Starting test(python2.7): pyspark.sql.window
Finished test(python2.7): pyspark.sql.group (33s)
Starting test(python3.6): pyspark.ml.classification
Finished test(python2.7): pyspark.sql.streaming (21s)
Starting test(python3.6): pyspark.ml.clustering
Finished test(python2.7): pyspark.sql.readwriter (30s)
Starting test(python3.6): pyspark.ml.evaluation
Finished test(python2.7): pyspark.sql.session (27s)
Starting test(python3.6): pyspark.ml.feature
Finished test(python2.7): pyspark.sql.udf (23s)
Starting test(python3.6): pyspark.ml.fpm
Finished test(python2.7): pyspark.sql.window (21s)
Starting test(python3.6): pyspark.ml.functions
Finished test(python2.7): pyspark.sql.functions (68s)
Starting test(python3.6): pyspark.ml.image
Finished test(python2.7): pyspark.sql.dataframe (69s)
Starting test(python3.6): pyspark.ml.linalg.__init__
Finished test(python3.6): pyspark.ml.linalg.__init__ (0s)
Starting test(python3.6): pyspark.ml.recommendation
Finished test(python3.6): pyspark.ml.fpm (24s)
Starting test(python3.6): pyspark.ml.regression
Finished test(python3.6): pyspark.ml.functions (18s)
Starting test(python3.6): pyspark.ml.stat
Finished test(python3.6): pyspark.ml.evaluation (29s)
Starting test(python3.6): pyspark.ml.tuning
Finished test(python3.6): pyspark.ml.image (8s)
Starting test(python3.6): pyspark.mllib.classification
Finished test(python3.6): pyspark.ml.clustering (52s)
Starting test(python3.6): pyspark.mllib.clustering
Finished test(python3.6): pyspark.ml.stat (31s)
Starting test(python3.6): pyspark.mllib.evaluation
Finished test(python3.6): pyspark.ml.tuning (35s)
Starting test(python3.6): pyspark.mllib.feature
Finished test(python3.6): pyspark.mllib.classification (42s)
Starting test(python3.6): pyspark.mllib.fpm
Finished test(python3.6): pyspark.ml.regression (52s)
Starting test(python3.6): pyspark.mllib.linalg.__init__
Finished test(python3.6): pyspark.mllib.linalg.__init__ (0s)
Starting test(python3.6): pyspark.mllib.linalg.distributed
Finished test(python3.6): pyspark.mllib.evaluation (23s)
Starting test(python3.6): pyspark.mllib.random
Finished test(python3.6): pyspark.ml.classification (92s)
Starting test(python3.6): pyspark.mllib.recommendation
Finished test(python3.6): pyspark.mllib.feature (28s)
Starting test(python3.6): pyspark.mllib.regression
Finished test(python3.6): pyspark.mllib.fpm (21s)
Starting test(python3.6): pyspark.mllib.stat.KernelDensity
Finished test(python3.6): pyspark.mllib.stat.KernelDensity (0s)
Starting test(python3.6): pyspark.mllib.stat._statistics
Finished test(python3.6): pyspark.mllib.random (13s)
Starting test(python3.6): pyspark.mllib.tree
Finished test(python3.6): pyspark.mllib.clustering (54s)
Starting test(python3.6): pyspark.mllib.util
Finished test(python3.6): pyspark.ml.feature (104s)
Starting test(python3.6): pyspark.sql.avro.functions
Finished test(python3.6): pyspark.mllib.stat._statistics (20s)
Starting test(python3.6): pyspark.sql.catalog
Finished test(python3.6): pyspark.mllib.tree (22s)
Starting test(python3.6): pyspark.sql.column
Finished test(python3.6): pyspark.sql.avro.functions (16s)
Starting test(python3.6): pyspark.sql.conf
Finished test(python3.6): pyspark.mllib.util (20s)
Starting test(python3.6): pyspark.sql.context
Finished test(python3.6): pyspark.mllib.regression (32s)
Starting test(python3.6): pyspark.sql.dataframe
Finished test(python3.6): pyspark.mllib.recommendation (43s)
Starting test(python3.6): pyspark.sql.functions
Finished test(python3.6): pyspark.ml.recommendation (104s)
Starting test(python3.6): pyspark.sql.group
Finished test(python3.6): pyspark.sql.conf (7s)
Starting test(python3.6): pyspark.sql.pandas.conversion
Finished test(python3.6): pyspark.sql.catalog (15s)
Starting test(python3.6): pyspark.sql.pandas.group_ops
Finished test(python3.6): pyspark.sql.pandas.conversion (7s)
Starting test(python3.6): pyspark.sql.pandas.map_ops
Finished test(python3.6): pyspark.mllib.linalg.distributed (60s)
Starting test(python3.6): pyspark.sql.pandas.serializers
Finished test(python3.6): pyspark.sql.pandas.serializers (0s)
Starting test(python3.6): pyspark.sql.pandas.typehints
Finished test(python3.6): pyspark.sql.pandas.typehints (0s)
Starting test(python3.6): pyspark.sql.pandas.types
Finished test(python3.6): pyspark.sql.pandas.types (0s)
Starting test(python3.6): pyspark.sql.pandas.utils
Finished test(python3.6): pyspark.sql.pandas.utils (0s)
Starting test(python3.6): pyspark.sql.readwriter
Finished test(python3.6): pyspark.sql.pandas.group_ops (12s)
Starting test(python3.6): pyspark.sql.session
Finished test(python3.6): pyspark.sql.context (21s)
Starting test(python3.6): pyspark.sql.streaming
Finished test(python3.6): pyspark.sql.pandas.map_ops (13s)
Starting test(python3.6): pyspark.sql.types
Finished test(python3.6): pyspark.sql.column (30s)
Starting test(python3.6): pyspark.sql.udf
Finished test(python3.6): pyspark.sql.group (30s)
Starting test(python3.6): pyspark.sql.window
Finished test(python3.6): pyspark.sql.types (10s)
Finished test(python3.6): pyspark.sql.streaming (19s)
Finished test(python3.6): pyspark.sql.session (25s)
Finished test(python3.6): pyspark.sql.readwriter (27s)
Finished test(python3.6): pyspark.sql.udf (22s)
Finished test(python3.6): pyspark.sql.window (19s)
Finished test(python3.6): pyspark.sql.dataframe (59s)
Finished test(python3.6): pyspark.sql.functions (58s)
Tests passed in 945 seconds
Skipped tests in pyspark.sql.tests.test_arrow with pypy:
test_createDataFrame_column_name_encoding (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_does_not_modify_input (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_fallback_disabled (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_fallback_enabled (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_respect_session_timezone (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_toggle (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_with_array_type (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_with_incorrect_schema (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_with_int_col_names (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_with_names (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_with_schema (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_with_single_data_type (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_filtered_frame (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_no_partition_frame (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_null_conversion (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_pandas_round_trip (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_propagates_spark_exception (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_schema_conversion_roundtrip (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_timestamp_dst (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_timestamp_nat (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_toPandas_arrow_toggle (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_toPandas_batch_order (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_toPandas_fallback_disabled (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_toPandas_fallback_enabled (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_toPandas_respect_session_timezone (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_toPandas_with_array_type (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_column_name_encoding (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_does_not_modify_input (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_fallback_disabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_fallback_enabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_respect_session_timezone (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_toggle (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_with_array_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_with_incorrect_schema (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_with_int_col_names (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_with_names (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_with_schema (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_createDataFrame_with_single_data_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_filtered_frame (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_no_partition_frame (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_null_conversion (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_pandas_round_trip (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_propagates_spark_exception (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_schema_conversion_roundtrip (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_timestamp_dst (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_timestamp_nat (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_toPandas_arrow_toggle (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_toPandas_batch_order (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_toPandas_fallback_disabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_toPandas_fallback_enabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_toPandas_respect_session_timezone (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_toPandas_with_array_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_exception_by_max_results (pyspark.sql.tests.test_arrow.MaxResultArrowTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
Skipped tests in pyspark.sql.tests.test_dataframe with pypy:
test_create_dataframe_from_pandas_with_dst (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_create_dataframe_from_pandas_with_timestamp (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_to_pandas (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_to_pandas_avoid_astype (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_to_pandas_from_empty_dataframe (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_to_pandas_from_mixed_dataframe (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_to_pandas_from_null_dataframe (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_to_pandas_on_cross_join (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_to_pandas_with_duplicated_column_names (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_query_execution_listener_on_collect_with_arrow (pyspark.sql.tests.test_dataframe.QueryExecutionListenerTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
Skipped tests in pyspark.sql.tests.test_pandas_cogrouped_map with pypy:
test_complex_group_by (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_different_schemas (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_empty_group_by (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_left_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_mixed_scalar_udfs_followed_by_cogrouby_apply (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_right_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_simple (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_with_key_complex (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_with_key_left (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_with_key_left_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_with_key_right (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_with_key_right_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_wrong_args (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_wrong_return_type (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
Skipped tests in pyspark.sql.tests.test_pandas_grouped_map with pypy:
test_array_type_correct (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_coerce (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_column_order (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_complex_groupby (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_datatype_string (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_decorator (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_empty_groupby (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_grouped_over_window (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_grouped_over_window_with_key (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_grouped_with_empty_partition (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_mixed_scalar_udfs_followed_by_grouby_apply (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_positional_assignment_conf (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_register_grouped_map_udf (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_self_join_with_pandas (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_supported_types (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_timestamp_dst (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_udf_with_key (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_unsupported_types (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_wrong_args (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_wrong_return_type (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
Skipped tests in pyspark.sql.tests.test_pandas_map with pypy:
test_chain_map_partitions_in_pandas (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_different_output_length (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_empty_iterator (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_empty_rows (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_map_partitions_in_pandas (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_multiple_columns (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
Skipped tests in pyspark.sql.tests.test_pandas_udf with pypy:
test_pandas_udf_arrow_overflow (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_pandas_udf_basic (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_pandas_udf_decorator (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_pandas_udf_detect_unsafe_type_conversion (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_stopiteration_in_udf (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_udf_wrong_arg (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
Skipped tests in pyspark.sql.tests.test_pandas_udf_grouped_agg with pypy:
test_alias (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_array_type (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_basic (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_complex_expressions (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_complex_groupby (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_grouped_with_empty_partition (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_grouped_without_group_by_clause (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_invalid_args (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_manual (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_mixed_sql (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_mixed_udfs (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_multiple_udfs (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_no_predicate_pushdown_through (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_register_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_retain_group_columns (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_unsupported_types (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
Skipped tests in pyspark.sql.tests.test_pandas_udf_scalar with pypy:
test_datasource_with_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_mixed_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_mixed_udf_and_sql (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_nondeterministic_vectorized_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_nondeterministic_vectorized_udf_in_aggregate (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_pandas_udf_nested_arrays (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_pandas_udf_tokenize (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_register_nondeterministic_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_register_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_scalar_iter_udf_close (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_scalar_iter_udf_close_early (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_scalar_iter_udf_init (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_timestamp_dst (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_type_annotation (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_array_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_chained (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_chained_struct_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_check_config (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_complex (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_datatype_string (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_dates (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_decorator (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_empty_partition (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_exception (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_invalid_length (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_nested_struct (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_null_array (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_null_binary (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_null_boolean (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_null_byte (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_null_decimal (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_null_double (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_null_float (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_null_int (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_null_long (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_null_short (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_null_string (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_return_scalar (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_return_timestamp_tz (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_string_in_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_struct_complex (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_struct_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_struct_with_empty_partition (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_timestamps (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_timestamps_respect_session_timezone (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_unsupported_types (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_varargs (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_vectorized_udf_wrong_return_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
Skipped tests in pyspark.sql.tests.test_pandas_udf_typehints with pypy:
test_group_agg_udf_type_hint (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_ignore_type_hint_in_cogroup_apply_in_pandas (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_ignore_type_hint_in_group_apply_in_pandas (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_ignore_type_hint_in_map_in_pandas (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_scalar_iter_udf_type_hint (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_scalar_udf_type_hint (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_type_annotation_group_agg (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_type_annotation_negative (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_type_annotation_scalar (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_type_annotation_scalar_iter (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
Skipped tests in pyspark.sql.tests.test_pandas_udf_window with pypy:
test_array_type (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_bounded_mixed (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_bounded_simple (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_growing_window (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_invalid_args (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_mixed_sql (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_mixed_sql_and_udf (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_mixed_udf (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_multiple_udfs (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_replace_existing (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_shrinking_window (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_simple (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_sliding_window (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
test_without_partitionBy (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped 'Pandas >= 0.23.2 must be installed; however, it was not found.'
Skipped tests in pyspark.sql.tests.test_types with pypy:
test_row_without_field_sorting (pyspark.sql.tests.test_types.DataTypeVerificationTests) ... skipped 'Create Row without sorting fields'
test_infer_binary_type (pyspark.sql.tests.test_types.TypesTests) ... skipped 'only Python 3 infers bytes as binary type'
Skipped tests in pyspark.sql.tests.test_arrow with python2.7:
test_createDataFrame_column_name_encoding (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_does_not_modify_input (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_fallback_disabled (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_fallback_enabled (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_respect_session_timezone (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_toggle (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_with_array_type (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_with_incorrect_schema (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_with_int_col_names (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_with_names (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_with_schema (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_with_single_data_type (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_filtered_frame (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_no_partition_frame (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_null_conversion (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_pandas_round_trip (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_propagates_spark_exception (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_schema_conversion_roundtrip (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_timestamp_dst (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_timestamp_nat (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_toPandas_arrow_toggle (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_toPandas_batch_order (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_toPandas_fallback_disabled (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_toPandas_fallback_enabled (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_toPandas_respect_session_timezone (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_toPandas_with_array_type (pyspark.sql.tests.test_arrow.ArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_column_name_encoding (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_does_not_modify_input (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_fallback_disabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_fallback_enabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_respect_session_timezone (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_toggle (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_with_array_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_with_incorrect_schema (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_with_int_col_names (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_with_names (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_with_schema (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_createDataFrame_with_single_data_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_filtered_frame (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_no_partition_frame (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_null_conversion (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_pandas_round_trip (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_propagates_spark_exception (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_schema_conversion_roundtrip (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_timestamp_dst (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_timestamp_nat (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_toPandas_arrow_toggle (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_toPandas_batch_order (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_toPandas_fallback_disabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_toPandas_fallback_enabled (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_toPandas_respect_session_timezone (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_toPandas_with_array_type (pyspark.sql.tests.test_arrow.EncryptionArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_exception_by_max_results (pyspark.sql.tests.test_arrow.MaxResultArrowTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
Skipped tests in pyspark.sql.tests.test_dataframe with python2.7:
test_create_dataframe_from_pandas_with_dst (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_create_dataframe_from_pandas_with_timestamp (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_to_pandas (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_to_pandas_avoid_astype (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_to_pandas_from_empty_dataframe (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_to_pandas_from_mixed_dataframe (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_to_pandas_from_null_dataframe (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_to_pandas_on_cross_join (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_to_pandas_with_duplicated_column_names (pyspark.sql.tests.test_dataframe.DataFrameTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_query_execution_listener_on_collect_with_arrow (pyspark.sql.tests.test_dataframe.QueryExecutionListenerTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
Skipped tests in pyspark.sql.tests.test_pandas_cogrouped_map with python2.7:
test_complex_group_by (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_different_schemas (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_empty_group_by (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_left_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_mixed_scalar_udfs_followed_by_cogrouby_apply (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_right_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_simple (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_with_key_complex (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_with_key_left (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_with_key_left_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_with_key_right (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_with_key_right_group_empty (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_wrong_args (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_wrong_return_type (pyspark.sql.tests.test_pandas_cogrouped_map.CogroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
Skipped tests in pyspark.sql.tests.test_pandas_grouped_map with python2.7:
test_array_type_correct (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_coerce (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_column_order (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_complex_groupby (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_datatype_string (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_decorator (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_empty_groupby (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_grouped_over_window (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_grouped_over_window_with_key (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_grouped_with_empty_partition (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_mixed_scalar_udfs_followed_by_grouby_apply (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_positional_assignment_conf (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_register_grouped_map_udf (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_self_join_with_pandas (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_supported_types (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_timestamp_dst (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_udf_with_key (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_unsupported_types (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_wrong_args (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_wrong_return_type (pyspark.sql.tests.test_pandas_grouped_map.GroupedMapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
Skipped tests in pyspark.sql.tests.test_pandas_map with python2.7:
test_chain_map_partitions_in_pandas (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_different_output_length (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_empty_iterator (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_empty_rows (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_map_partitions_in_pandas (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_multiple_columns (pyspark.sql.tests.test_pandas_map.MapInPandasTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
Skipped tests in pyspark.sql.tests.test_pandas_udf with python2.7:
test_pandas_udf_arrow_overflow (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_pandas_udf_basic (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_pandas_udf_decorator (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_pandas_udf_detect_unsafe_type_conversion (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_stopiteration_in_udf (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_udf_wrong_arg (pyspark.sql.tests.test_pandas_udf.PandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
Skipped tests in pyspark.sql.tests.test_pandas_udf_grouped_agg with python2.7:
test_alias (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_array_type (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_basic (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_complex_expressions (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_complex_groupby (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_grouped_with_empty_partition (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_grouped_without_group_by_clause (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_invalid_args (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_manual (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_mixed_sql (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_mixed_udfs (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_multiple_udfs (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_no_predicate_pushdown_through (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_register_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_retain_group_columns (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_unsupported_types (pyspark.sql.tests.test_pandas_udf_grouped_agg.GroupedAggPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
Skipped tests in pyspark.sql.tests.test_pandas_udf_scalar with python2.7:
test_datasource_with_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_mixed_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_mixed_udf_and_sql (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_nondeterministic_vectorized_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_nondeterministic_vectorized_udf_in_aggregate (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_pandas_udf_nested_arrays (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_pandas_udf_tokenize (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_register_nondeterministic_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_register_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_scalar_iter_udf_close (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_scalar_iter_udf_close_early (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_scalar_iter_udf_init (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_timestamp_dst (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_type_annotation (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_array_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_basic (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_chained (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_chained_struct_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_check_config (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_complex (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_datatype_string (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_dates (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_decorator (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_empty_partition (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_exception (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_invalid_length (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_nested_struct (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_null_array (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_null_binary (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_null_boolean (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_null_byte (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_null_decimal (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_null_double (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_null_float (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_null_int (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_null_long (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_null_short (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_null_string (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_return_scalar (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_return_timestamp_tz (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_string_in_udf (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_struct_complex (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_struct_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_struct_with_empty_partition (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_timestamps (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_timestamps_respect_session_timezone (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_unsupported_types (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_varargs (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_vectorized_udf_wrong_return_type (pyspark.sql.tests.test_pandas_udf_scalar.ScalarPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
Skipped tests in pyspark.sql.tests.test_pandas_udf_typehints with python2.7:
test_group_agg_udf_type_hint (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_ignore_type_hint_in_cogroup_apply_in_pandas (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_ignore_type_hint_in_group_apply_in_pandas (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_ignore_type_hint_in_map_in_pandas (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_scalar_iter_udf_type_hint (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_scalar_udf_type_hint (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_type_annotation_group_agg (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_type_annotation_negative (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_type_annotation_scalar (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_type_annotation_scalar_iter (pyspark.sql.tests.test_pandas_udf_typehints.PandasUDFTypeHintsTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
Skipped tests in pyspark.sql.tests.test_pandas_udf_window with python2.7:
test_array_type (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_bounded_mixed (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_bounded_simple (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_growing_window (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_invalid_args (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_mixed_sql (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_mixed_sql_and_udf (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_mixed_udf (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_multiple_udfs (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_replace_existing (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_shrinking_window (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_simple (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_sliding_window (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
test_without_partitionBy (pyspark.sql.tests.test_pandas_udf_window.WindowPandasUDFTests) ... skipped u'Pandas >= 0.23.2 must be installed; however, your version was 0.19.2.'
Skipped tests in pyspark.sql.tests.test_types with python2.7:
test_row_without_field_sorting (pyspark.sql.tests.test_types.DataTypeVerificationTests) ... skipped 'Create Row without sorting fields'
test_infer_binary_type (pyspark.sql.tests.test_types.TypesTests) ... skipped 'only Python 3 infers bytes as binary type'
Skipped tests in pyspark.sql.tests.test_dataframe with python3.6:
test_create_dataframe_required_pandas_not_found (pyspark.sql.tests.test_dataframe.DataFrameTests) ... SKIP (0.000s)
test_to_pandas_required_pandas_not_found (pyspark.sql.tests.test_dataframe.DataFrameTests) ... SKIP (0.000s)
========================================================================
Running PySpark packaging tests
========================================================================
Constructing virtual env for testing
Using conda virtual environments
Testing pip installation with python 3.6
Using /tmp/tmp.d2O1DtcgkL for virtualenv
Collecting package metadata: ...working... done
Solving environment: ...working... done
## Package Plan ##
environment location: /tmp/tmp.d2O1DtcgkL/3.6
added / updated specs:
- numpy
- pandas
- pip
- python=3.6
- setuptools
The following packages will be downloaded:
package | build
---------------------------|-----------------
intel-openmp-2020.1 | 217 940 KB
libffi-3.3 | he6710b0_1 54 KB
mkl-2020.1 | 217 200.5 MB
ncurses-6.2 | he6710b0_1 1.1 MB
openssl-1.1.1g | h7b6447c_0 3.8 MB
pip-20.0.2 | py36_3 1.9 MB
python-3.6.10 | h7579374_2 33.9 MB
pytz-2020.1 | py_0 239 KB
setuptools-46.2.0 | py36_0 674 KB
sqlite-3.31.1 | h62c20be_1 2.0 MB
xz-5.2.5 | h7b6447c_0 438 KB
------------------------------------------------------------
Total: 245.5 MB
The following NEW packages will be INSTALLED:
_libgcc_mutex pkgs/main/linux-64::_libgcc_mutex-0.1-main
blas pkgs/free/linux-64::blas-1.0-mkl
ca-certificates pkgs/main/linux-64::ca-certificates-2020.1.1-0
certifi pkgs/main/linux-64::certifi-2020.4.5.1-py36_0
intel-openmp pkgs/main/linux-64::intel-openmp-2020.1-217
ld_impl_linux-64 pkgs/main/linux-64::ld_impl_linux-64-2.33.1-h53a641e_7
libedit pkgs/main/linux-64::libedit-3.1.20181209-hc058e9b_0
libffi pkgs/main/linux-64::libffi-3.3-he6710b0_1
libgcc-ng pkgs/main/linux-64::libgcc-ng-9.1.0-hdf63c60_0
libgfortran-ng pkgs/main/linux-64::libgfortran-ng-7.3.0-hdf63c60_0
libstdcxx-ng pkgs/main/linux-64::libstdcxx-ng-9.1.0-hdf63c60_0
mkl pkgs/main/linux-64::mkl-2020.1-217
mkl-service pkgs/main/linux-64::mkl-service-2.3.0-py36he904b0f_0
mkl_fft pkgs/main/linux-64::mkl_fft-1.0.15-py36ha843d7b_0
mkl_random pkgs/main/linux-64::mkl_random-1.1.0-py36hd6b4f25_0
ncurses pkgs/main/linux-64::ncurses-6.2-he6710b0_1
numpy pkgs/main/linux-64::numpy-1.18.1-py36h4f9e942_0
numpy-base pkgs/main/linux-64::numpy-base-1.18.1-py36hde5b4d6_1
openssl pkgs/main/linux-64::openssl-1.1.1g-h7b6447c_0
pandas pkgs/main/linux-64::pandas-1.0.3-py36h0573a6f_0
pip pkgs/main/linux-64::pip-20.0.2-py36_3
python pkgs/main/linux-64::python-3.6.10-h7579374_2
python-dateutil pkgs/main/noarch::python-dateutil-2.8.1-py_0
pytz pkgs/main/noarch::pytz-2020.1-py_0
readline pkgs/main/linux-64::readline-8.0-h7b6447c_0
setuptools pkgs/main/linux-64::setuptools-46.2.0-py36_0
six pkgs/main/linux-64::six-1.14.0-py36_0
sqlite pkgs/main/linux-64::sqlite-3.31.1-h62c20be_1
tk pkgs/main/linux-64::tk-8.6.8-hbc83047_0
wheel pkgs/main/linux-64::wheel-0.34.2-py36_0
xz pkgs/main/linux-64::xz-5.2.5-h7b6447c_0
zlib pkgs/main/linux-64::zlib-1.2.11-h7b6447c_3
Downloading and Extracting Packages
xz-5.2.5 | 438 KB | | 0%
xz-5.2.5 | 438 KB | ########## | 100%
pip-20.0.2 | 1.9 MB | | 0%
pip-20.0.2 | 1.9 MB | #######9 | 79%
pip-20.0.2 | 1.9 MB | ########## | 100%
pytz-2020.1 | 239 KB | | 0%
pytz-2020.1 | 239 KB | #########5 | 95%
pytz-2020.1 | 239 KB | ########## | 100%
openssl-1.1.1g | 3.8 MB | | 0%
openssl-1.1.1g | 3.8 MB | #######6 | 77%
openssl-1.1.1g | 3.8 MB | #########9 | 99%
openssl-1.1.1g | 3.8 MB | ########## | 100%
sqlite-3.31.1 | 2.0 MB | | 0%
sqlite-3.31.1 | 2.0 MB | ######## | 81%
sqlite-3.31.1 | 2.0 MB | ########## | 100%
libffi-3.3 | 54 KB | | 0%
libffi-3.3 | 54 KB | ########## | 100%
mkl-2020.1 | 200.5 MB | | 0%
mkl-2020.1 | 200.5 MB | 2 | 3%
mkl-2020.1 | 200.5 MB | 6 | 7%
mkl-2020.1 | 200.5 MB | # | 11%
mkl-2020.1 | 200.5 MB | #4 | 14%
mkl-2020.1 | 200.5 MB | #8 | 18%
mkl-2020.1 | 200.5 MB | ##2 | 22%
mkl-2020.1 | 200.5 MB | ##6 | 26%
mkl-2020.1 | 200.5 MB | ##9 | 30%
mkl-2020.1 | 200.5 MB | ###3 | 34%
mkl-2020.1 | 200.5 MB | ###7 | 38%
mkl-2020.1 | 200.5 MB | ####1 | 42%
mkl-2020.1 | 200.5 MB | ####5 | 45%
mkl-2020.1 | 200.5 MB | ####9 | 49%
mkl-2020.1 | 200.5 MB | #####3 | 53%
mkl-2020.1 | 200.5 MB | #####7 | 57%
mkl-2020.1 | 200.5 MB | ###### | 61%
mkl-2020.1 | 200.5 MB | ######4 | 65%
mkl-2020.1 | 200.5 MB | ######8 | 69%
mkl-2020.1 | 200.5 MB | #######2 | 73%
mkl-2020.1 | 200.5 MB | #######6 | 77%
mkl-2020.1 | 200.5 MB | #######9 | 79%
mkl-2020.1 | 200.5 MB | ########1 | 81%
mkl-2020.1 | 200.5 MB | ########2 | 83%
mkl-2020.1 | 200.5 MB | ########3 | 84%
mkl-2020.1 | 200.5 MB | ########4 | 85%
mkl-2020.1 | 200.5 MB | ########5 | 85%
mkl-2020.1 | 200.5 MB | ########5 | 85%
mkl-2020.1 | 200.5 MB | ########5 | 86%
mkl-2020.1 | 200.5 MB | ########6 | 86%
mkl-2020.1 | 200.5 MB | ########6 | 86%
mkl-2020.1 | 200.5 MB | ########6 | 86%
mkl-2020.1 | 200.5 MB | ########6 | 87%
mkl-2020.1 | 200.5 MB | ########6 | 87%
mkl-2020.1 | 200.5 MB | ########6 | 87%
mkl-2020.1 | 200.5 MB | ########6 | 87%
mkl-2020.1 | 200.5 MB | ########7 | 87%
mkl-2020.1 | 200.5 MB | ########7 | 87%
mkl-2020.1 | 200.5 MB | ########7 | 87%
mkl-2020.1 | 200.5 MB | ########7 | 87%
mkl-2020.1 | 200.5 MB | ########7 | 87%
mkl-2020.1 | 200.5 MB | ########7 | 88%
mkl-2020.1 | 200.5 MB | ########7 | 88%
mkl-2020.1 | 200.5 MB | ########7 | 88%
mkl-2020.1 | 200.5 MB | ########7 | 88%
mkl-2020.1 | 200.5 MB | ########7 | 88%
mkl-2020.1 | 200.5 MB | ########8 | 88%
mkl-2020.1 | 200.5 MB | ########8 | 88%
mkl-2020.1 | 200.5 MB | ########8 | 88%
mkl-2020.1 | 200.5 MB | ########8 | 88%
mkl-2020.1 | 200.5 MB | ########8 | 88%
mkl-2020.1 | 200.5 MB | ########8 | 88%
mkl-2020.1 | 200.5 MB | ########8 | 89%
mkl-2020.1 | 200.5 MB | ########8 | 89%
mkl-2020.1 | 200.5 MB | ########8 | 89%
mkl-2020.1 | 200.5 MB | ########8 | 89%
mkl-2020.1 | 200.5 MB | ########8 | 89%
mkl-2020.1 | 200.5 MB | ########9 | 89%
mkl-2020.1 | 200.5 MB | ########9 | 89%
mkl-2020.1 | 200.5 MB | ########9 | 89%
mkl-2020.1 | 200.5 MB | ########9 | 89%
mkl-2020.1 | 200.5 MB | ########9 | 89%
mkl-2020.1 | 200.5 MB | ########9 | 90%
mkl-2020.1 | 200.5 MB | ########9 | 90%
mkl-2020.1 | 200.5 MB | ########9 | 90%
mkl-2020.1 | 200.5 MB | ########9 | 90%
mkl-2020.1 | 200.5 MB | ########9 | 90%
mkl-2020.1 | 200.5 MB | ######### | 90%
mkl-2020.1 | 200.5 MB | ######### | 90%
mkl-2020.1 | 200.5 MB | ######### | 90%
mkl-2020.1 | 200.5 MB | ######### | 90%
mkl-2020.1 | 200.5 MB | ######### | 90%
mkl-2020.1 | 200.5 MB | ######### | 91%
mkl-2020.1 | 200.5 MB | ######### | 91%
mkl-2020.1 | 200.5 MB | ######### | 91%
mkl-2020.1 | 200.5 MB | ######### | 91%
mkl-2020.1 | 200.5 MB | ######### | 91%
mkl-2020.1 | 200.5 MB | #########1 | 91%
mkl-2020.1 | 200.5 MB | #########1 | 91%
mkl-2020.1 | 200.5 MB | #########1 | 91%
mkl-2020.1 | 200.5 MB | #########1 | 91%
mkl-2020.1 | 200.5 MB | #########1 | 91%
mkl-2020.1 | 200.5 MB | #########1 | 92%
mkl-2020.1 | 200.5 MB | #########1 | 92%
mkl-2020.1 | 200.5 MB | #########1 | 92%
mkl-2020.1 | 200.5 MB | #########1 | 92%
mkl-2020.1 | 200.5 MB | #########1 | 92%
mkl-2020.1 | 200.5 MB | #########1 | 92%
mkl-2020.1 | 200.5 MB | #########2 | 92%
mkl-2020.1 | 200.5 MB | #########2 | 92%
mkl-2020.1 | 200.5 MB | #########2 | 92%
mkl-2020.1 | 200.5 MB | #########2 | 92%
mkl-2020.1 | 200.5 MB | #########2 | 92%
mkl-2020.1 | 200.5 MB | #########2 | 93%
mkl-2020.1 | 200.5 MB | #########2 | 93%
mkl-2020.1 | 200.5 MB | #########2 | 93%
mkl-2020.1 | 200.5 MB | #########2 | 93%
mkl-2020.1 | 200.5 MB | #########2 | 93%
mkl-2020.1 | 200.5 MB | #########3 | 93%
mkl-2020.1 | 200.5 MB | #########3 | 93%
mkl-2020.1 | 200.5 MB | #########3 | 93%
mkl-2020.1 | 200.5 MB | #########3 | 93%
mkl-2020.1 | 200.5 MB | #########3 | 93%
mkl-2020.1 | 200.5 MB | #########3 | 94%
mkl-2020.1 | 200.5 MB | #########3 | 94%
mkl-2020.1 | 200.5 MB | #########3 | 94%
mkl-2020.1 | 200.5 MB | #########3 | 94%
mkl-2020.1 | 200.5 MB | #########3 | 94%
mkl-2020.1 | 200.5 MB | #########4 | 94%
mkl-2020.1 | 200.5 MB | #########4 | 94%
mkl-2020.1 | 200.5 MB | #########4 | 94%
mkl-2020.1 | 200.5 MB | #########4 | 94%
mkl-2020.1 | 200.5 MB | #########4 | 94%
mkl-2020.1 | 200.5 MB | #########4 | 95%
mkl-2020.1 | 200.5 MB | #########4 | 95%
mkl-2020.1 | 200.5 MB | #########4 | 95%
mkl-2020.1 | 200.5 MB | #########4 | 95%
mkl-2020.1 | 200.5 MB | #########4 | 95%
mkl-2020.1 | 200.5 MB | #########5 | 95%
mkl-2020.1 | 200.5 MB | #########5 | 95%
mkl-2020.1 | 200.5 MB | #########5 | 95%
mkl-2020.1 | 200.5 MB | #########5 | 95%
mkl-2020.1 | 200.5 MB | #########5 | 95%
mkl-2020.1 | 200.5 MB | #########5 | 96%
mkl-2020.1 | 200.5 MB | #########5 | 96%
mkl-2020.1 | 200.5 MB | #########5 | 96%
mkl-2020.1 | 200.5 MB | #########5 | 96%
mkl-2020.1 | 200.5 MB | #########5 | 96%
mkl-2020.1 | 200.5 MB | #########5 | 96%
mkl-2020.1 | 200.5 MB | #########6 | 96%
mkl-2020.1 | 200.5 MB | #########6 | 96%
mkl-2020.1 | 200.5 MB | #########6 | 96%
mkl-2020.1 | 200.5 MB | #########6 | 96%
mkl-2020.1 | 200.5 MB | #########6 | 96%
mkl-2020.1 | 200.5 MB | #########6 | 97%
mkl-2020.1 | 200.5 MB | #########6 | 97%
mkl-2020.1 | 200.5 MB | #########6 | 97%
mkl-2020.1 | 200.5 MB | #########6 | 97%
mkl-2020.1 | 200.5 MB | #########6 | 97%
mkl-2020.1 | 200.5 MB | #########7 | 97%
mkl-2020.1 | 200.5 MB | #########7 | 97%
mkl-2020.1 | 200.5 MB | #########7 | 97%
mkl-2020.1 | 200.5 MB | #########7 | 97%
mkl-2020.1 | 200.5 MB | #########7 | 97%
mkl-2020.1 | 200.5 MB | #########7 | 98%
mkl-2020.1 | 200.5 MB | #########7 | 98%
mkl-2020.1 | 200.5 MB | #########7 | 98%
mkl-2020.1 | 200.5 MB | #########7 | 98%
mkl-2020.1 | 200.5 MB | #########7 | 98%
mkl-2020.1 | 200.5 MB | #########8 | 98%
mkl-2020.1 | 200.5 MB | #########8 | 98%
mkl-2020.1 | 200.5 MB | #########8 | 98%
mkl-2020.1 | 200.5 MB | #########8 | 98%
mkl-2020.1 | 200.5 MB | #########8 | 98%
mkl-2020.1 | 200.5 MB | #########8 | 99%
mkl-2020.1 | 200.5 MB | #########8 | 99%
mkl-2020.1 | 200.5 MB | #########8 | 99%
mkl-2020.1 | 200.5 MB | #########8 | 99%
mkl-2020.1 | 200.5 MB | #########8 | 99%
mkl-2020.1 | 200.5 MB | #########9 | 99%
mkl-2020.1 | 200.5 MB | #########9 | 99%
mkl-2020.1 | 200.5 MB | #########9 | 99%
mkl-2020.1 | 200.5 MB | #########9 | 99%
mkl-2020.1 | 200.5 MB | #########9 | 99%
mkl-2020.1 | 200.5 MB | #########9 | 100%
mkl-2020.1 | 200.5 MB | #########9 | 100%
mkl-2020.1 | 200.5 MB | #########9 | 100%
mkl-2020.1 | 200.5 MB | #########9 | 100%
mkl-2020.1 | 200.5 MB | #########9 | 100%
mkl-2020.1 | 200.5 MB | ########## | 100%
ncurses-6.2 | 1.1 MB | | 0%
ncurses-6.2 | 1.1 MB | #######9 | 79%
ncurses-6.2 | 1.1 MB | ########## | 100%
intel-openmp-2020.1 | 940 KB | | 0%
intel-openmp-2020.1 | 940 KB | ########6 | 87%
intel-openmp-2020.1 | 940 KB | ########## | 100%
python-3.6.10 | 33.9 MB | | 0%
python-3.6.10 | 33.9 MB | #8 | 18%
python-3.6.10 | 33.9 MB | #### | 41%
python-3.6.10 | 33.9 MB | ######2 | 63%
python-3.6.10 | 33.9 MB | #######6 | 77%
python-3.6.10 | 33.9 MB | ########7 | 88%
python-3.6.10 | 33.9 MB | #########5 | 96%
python-3.6.10 | 33.9 MB | ########## | 100%
setuptools-46.2.0 | 674 KB | | 0%
setuptools-46.2.0 | 674 KB | ########5 | 85%
setuptools-46.2.0 | 674 KB | ########## | 100%
Preparing transaction: ...working... done
Verifying transaction: ...working... done
Executing transaction: ...working... done
#
# To activate this environment, use:
# > conda activate /tmp/tmp.d2O1DtcgkL/3.6
#
# To deactivate an active environment, use:
# > conda deactivate
#
Creating pip installable source dist
running sdist
running egg_info
creating pyspark.egg-info
writing pyspark.egg-info/PKG-INFO
writing dependency_links to pyspark.egg-info/dependency_links.txt
writing requirements to pyspark.egg-info/requires.txt
writing top-level names to pyspark.egg-info/top_level.txt
writing manifest file 'pyspark.egg-info/SOURCES.txt'
package init file 'deps/bin/__init__.py' not found (or not a regular file)
package init file 'deps/sbin/__init__.py' not found (or not a regular file)
package init file 'deps/jars/__init__.py' not found (or not a regular file)
package init file 'pyspark/python/pyspark/__init__.py' not found (or not a regular file)
package init file 'lib/__init__.py' not found (or not a regular file)
package init file 'deps/data/__init__.py' not found (or not a regular file)
package init file 'deps/licenses/__init__.py' not found (or not a regular file)
package init file 'deps/examples/__init__.py' not found (or not a regular file)
reading manifest file 'pyspark.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no previously-included files matching '*.py[cod]' found anywhere in distribution
warning: no previously-included files matching '__pycache__' found anywhere in distribution
warning: no previously-included files matching '.DS_Store' found anywhere in distribution
writing manifest file 'pyspark.egg-info/SOURCES.txt'
running check
creating pyspark-3.1.0.dev0
creating pyspark-3.1.0.dev0/deps
creating pyspark-3.1.0.dev0/deps/bin
creating pyspark-3.1.0.dev0/deps/data
creating pyspark-3.1.0.dev0/deps/data/graphx
creating pyspark-3.1.0.dev0/deps/data/mllib
creating pyspark-3.1.0.dev0/deps/data/mllib/als
creating pyspark-3.1.0.dev0/deps/data/mllib/images
creating pyspark-3.1.0.dev0/deps/data/mllib/images/origin
creating pyspark-3.1.0.dev0/deps/data/mllib/images/origin/kittens
creating pyspark-3.1.0.dev0/deps/data/mllib/images/partitioned
creating pyspark-3.1.0.dev0/deps/data/mllib/images/partitioned/cls=kittens
creating pyspark-3.1.0.dev0/deps/data/mllib/images/partitioned/cls=kittens/date=2018-01
creating pyspark-3.1.0.dev0/deps/data/mllib/ridge-data
creating pyspark-3.1.0.dev0/deps/data/streaming
creating pyspark-3.1.0.dev0/deps/examples
creating pyspark-3.1.0.dev0/deps/examples/ml
creating pyspark-3.1.0.dev0/deps/examples/mllib
creating pyspark-3.1.0.dev0/deps/examples/sql
creating pyspark-3.1.0.dev0/deps/examples/sql/streaming
creating pyspark-3.1.0.dev0/deps/examples/streaming
creating pyspark-3.1.0.dev0/deps/jars
creating pyspark-3.1.0.dev0/deps/licenses
creating pyspark-3.1.0.dev0/deps/sbin
creating pyspark-3.1.0.dev0/lib
creating pyspark-3.1.0.dev0/pyspark
creating pyspark-3.1.0.dev0/pyspark.egg-info
creating pyspark-3.1.0.dev0/pyspark/ml
creating pyspark-3.1.0.dev0/pyspark/ml/linalg
creating pyspark-3.1.0.dev0/pyspark/ml/param
creating pyspark-3.1.0.dev0/pyspark/mllib
creating pyspark-3.1.0.dev0/pyspark/mllib/linalg
creating pyspark-3.1.0.dev0/pyspark/mllib/stat
creating pyspark-3.1.0.dev0/pyspark/python
creating pyspark-3.1.0.dev0/pyspark/python/pyspark
creating pyspark-3.1.0.dev0/pyspark/resource
creating pyspark-3.1.0.dev0/pyspark/sql
creating pyspark-3.1.0.dev0/pyspark/sql/avro
creating pyspark-3.1.0.dev0/pyspark/sql/pandas
creating pyspark-3.1.0.dev0/pyspark/streaming
copying files to pyspark-3.1.0.dev0...
copying MANIFEST.in -> pyspark-3.1.0.dev0
copying README.md -> pyspark-3.1.0.dev0
copying setup.cfg -> pyspark-3.1.0.dev0
copying setup.py -> pyspark-3.1.0.dev0
copying deps/bin/beeline -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/beeline.cmd -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/docker-image-tool.sh -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/find-spark-home -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/find-spark-home.cmd -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/load-spark-env.cmd -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/load-spark-env.sh -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/pyspark -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/pyspark.cmd -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/pyspark2.cmd -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/run-example -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/run-example.cmd -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/spark-class -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/spark-class.cmd -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/spark-class2.cmd -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/spark-shell -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/spark-shell.cmd -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/spark-shell2.cmd -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/spark-sql -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/spark-sql.cmd -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/spark-sql2.cmd -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/spark-submit -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/spark-submit.cmd -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/spark-submit2.cmd -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/sparkR -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/sparkR.cmd -> pyspark-3.1.0.dev0/deps/bin
copying deps/bin/sparkR2.cmd -> pyspark-3.1.0.dev0/deps/bin
copying deps/data/graphx/followers.txt -> pyspark-3.1.0.dev0/deps/data/graphx
copying deps/data/graphx/users.txt -> pyspark-3.1.0.dev0/deps/data/graphx
copying deps/data/mllib/gmm_data.txt -> pyspark-3.1.0.dev0/deps/data/mllib
copying deps/data/mllib/iris_libsvm.txt -> pyspark-3.1.0.dev0/deps/data/mllib
copying deps/data/mllib/kmeans_data.txt -> pyspark-3.1.0.dev0/deps/data/mllib
copying deps/data/mllib/pagerank_data.txt -> pyspark-3.1.0.dev0/deps/data/mllib
copying deps/data/mllib/pic_data.txt -> pyspark-3.1.0.dev0/deps/data/mllib
copying deps/data/mllib/sample_binary_classification_data.txt -> pyspark-3.1.0.dev0/deps/data/mllib
copying deps/data/mllib/sample_fpgrowth.txt -> pyspark-3.1.0.dev0/deps/data/mllib
copying deps/data/mllib/sample_isotonic_regression_libsvm_data.txt -> pyspark-3.1.0.dev0/deps/data/mllib
copying deps/data/mllib/sample_kmeans_data.txt -> pyspark-3.1.0.dev0/deps/data/mllib
copying deps/data/mllib/sample_lda_data.txt -> pyspark-3.1.0.dev0/deps/data/mllib
copying deps/data/mllib/sample_lda_libsvm_data.txt -> pyspark-3.1.0.dev0/deps/data/mllib
copying deps/data/mllib/sample_libsvm_data.txt -> pyspark-3.1.0.dev0/deps/data/mllib
copying deps/data/mllib/sample_linear_regression_data.txt -> pyspark-3.1.0.dev0/deps/data/mllib
copying deps/data/mllib/sample_movielens_data.txt -> pyspark-3.1.0.dev0/deps/data/mllib
copying deps/data/mllib/sample_multiclass_classification_data.txt -> pyspark-3.1.0.dev0/deps/data/mllib
copying deps/data/mllib/sample_svm_data.txt -> pyspark-3.1.0.dev0/deps/data/mllib
copying deps/data/mllib/streaming_kmeans_data_test.txt -> pyspark-3.1.0.dev0/deps/data/mllib
copying deps/data/mllib/als/sample_movielens_ratings.txt -> pyspark-3.1.0.dev0/deps/data/mllib/als
copying deps/data/mllib/als/test.data -> pyspark-3.1.0.dev0/deps/data/mllib/als
copying deps/data/mllib/images/license.txt -> pyspark-3.1.0.dev0/deps/data/mllib/images
copying deps/data/mllib/images/origin/license.txt -> pyspark-3.1.0.dev0/deps/data/mllib/images/origin
copying deps/data/mllib/images/origin/kittens/not-image.txt -> pyspark-3.1.0.dev0/deps/data/mllib/images/origin/kittens
copying deps/data/mllib/images/partitioned/cls=kittens/date=2018-01/not-image.txt -> pyspark-3.1.0.dev0/deps/data/mllib/images/partitioned/cls=kittens/date=2018-01
copying deps/data/mllib/ridge-data/lpsa.data -> pyspark-3.1.0.dev0/deps/data/mllib/ridge-data
copying deps/data/streaming/AFINN-111.txt -> pyspark-3.1.0.dev0/deps/data/streaming
copying deps/examples/als.py -> pyspark-3.1.0.dev0/deps/examples
copying deps/examples/avro_inputformat.py -> pyspark-3.1.0.dev0/deps/examples
copying deps/examples/kmeans.py -> pyspark-3.1.0.dev0/deps/examples
copying deps/examples/logistic_regression.py -> pyspark-3.1.0.dev0/deps/examples
copying deps/examples/pagerank.py -> pyspark-3.1.0.dev0/deps/examples
copying deps/examples/parquet_inputformat.py -> pyspark-3.1.0.dev0/deps/examples
copying deps/examples/pi.py -> pyspark-3.1.0.dev0/deps/examples
copying deps/examples/sort.py -> pyspark-3.1.0.dev0/deps/examples
copying deps/examples/status_api_demo.py -> pyspark-3.1.0.dev0/deps/examples
copying deps/examples/transitive_closure.py -> pyspark-3.1.0.dev0/deps/examples
copying deps/examples/wordcount.py -> pyspark-3.1.0.dev0/deps/examples
copying deps/examples/ml/aft_survival_regression.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/als_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/anova_test_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/binarizer_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/bisecting_k_means_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/bucketed_random_projection_lsh_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/bucketizer_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/chi_square_test_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/chisq_selector_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/correlation_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/count_vectorizer_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/cross_validator.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/dataframe_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/dct_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/decision_tree_classification_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/decision_tree_regression_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/elementwise_product_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/estimator_transformer_param_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/feature_hasher_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/fm_classifier_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/fm_regressor_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/fpgrowth_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/fvalue_test_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/gaussian_mixture_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/generalized_linear_regression_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/gradient_boosted_tree_classifier_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/gradient_boosted_tree_regressor_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/imputer_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/index_to_string_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/interaction_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/isotonic_regression_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/kmeans_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/lda_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/linear_regression_with_elastic_net.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/linearsvc.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/logistic_regression_summary_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/logistic_regression_with_elastic_net.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/max_abs_scaler_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/min_hash_lsh_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/min_max_scaler_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/multiclass_logistic_regression_with_elastic_net.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/multilayer_perceptron_classification.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/n_gram_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/naive_bayes_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/normalizer_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/one_vs_rest_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/onehot_encoder_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/pca_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/pipeline_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/polynomial_expansion_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/power_iteration_clustering_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/prefixspan_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/quantile_discretizer_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/random_forest_classifier_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/random_forest_regressor_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/rformula_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/robust_scaler_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/sql_transformer.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/standard_scaler_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/stopwords_remover_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/string_indexer_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/summarizer_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/tf_idf_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/tokenizer_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/train_validation_split.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/variance_threshold_selector_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/vector_assembler_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/vector_indexer_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/vector_size_hint_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/vector_slicer_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/ml/word2vec_example.py -> pyspark-3.1.0.dev0/deps/examples/ml
copying deps/examples/mllib/binary_classification_metrics_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/bisecting_k_means_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/correlations.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/correlations_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/decision_tree_classification_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/decision_tree_regression_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/elementwise_product_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/fpgrowth_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/gaussian_mixture_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/gaussian_mixture_model.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/gradient_boosting_classification_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/gradient_boosting_regression_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/hypothesis_testing_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/hypothesis_testing_kolmogorov_smirnov_test_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/isotonic_regression_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/k_means_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/kernel_density_estimation_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/kmeans.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/latent_dirichlet_allocation_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/linear_regression_with_sgd_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/logistic_regression.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/logistic_regression_with_lbfgs_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/multi_class_metrics_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/multi_label_metrics_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/naive_bayes_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/normalizer_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/pca_rowmatrix_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/power_iteration_clustering_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/random_forest_classification_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/random_forest_regression_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/random_rdd_generation.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/ranking_metrics_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/recommendation_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/regression_metrics_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/sampled_rdds.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/standard_scaler_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/stratified_sampling_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/streaming_k_means_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/streaming_linear_regression_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/summary_statistics_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/svd_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/svm_with_sgd_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/tf_idf_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/word2vec.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/mllib/word2vec_example.py -> pyspark-3.1.0.dev0/deps/examples/mllib
copying deps/examples/sql/arrow.py -> pyspark-3.1.0.dev0/deps/examples/sql
copying deps/examples/sql/basic.py -> pyspark-3.1.0.dev0/deps/examples/sql
copying deps/examples/sql/datasource.py -> pyspark-3.1.0.dev0/deps/examples/sql
copying deps/examples/sql/hive.py -> pyspark-3.1.0.dev0/deps/examples/sql
copying deps/examples/sql/streaming/structured_kafka_wordcount.py -> pyspark-3.1.0.dev0/deps/examples/sql/streaming
copying deps/examples/sql/streaming/structured_network_wordcount.py -> pyspark-3.1.0.dev0/deps/examples/sql/streaming
copying deps/examples/sql/streaming/structured_network_wordcount_windowed.py -> pyspark-3.1.0.dev0/deps/examples/sql/streaming
copying deps/examples/streaming/hdfs_wordcount.py -> pyspark-3.1.0.dev0/deps/examples/streaming
copying deps/examples/streaming/network_wordcount.py -> pyspark-3.1.0.dev0/deps/examples/streaming
copying deps/examples/streaming/network_wordjoinsentiments.py -> pyspark-3.1.0.dev0/deps/examples/streaming
copying deps/examples/streaming/queue_stream.py -> pyspark-3.1.0.dev0/deps/examples/streaming
copying deps/examples/streaming/recoverable_network_wordcount.py -> pyspark-3.1.0.dev0/deps/examples/streaming
copying deps/examples/streaming/sql_network_wordcount.py -> pyspark-3.1.0.dev0/deps/examples/streaming
copying deps/examples/streaming/stateful_network_wordcount.py -> pyspark-3.1.0.dev0/deps/examples/streaming
copying deps/jars/HikariCP-2.5.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/JLargeArrays-1.5.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/JTransforms-3.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/RoaringBitmap-0.7.45.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/ST4-4.0.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/activation-1.1.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/aircompressor-0.10.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/algebra_2.12-2.0.0-M2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/antlr-runtime-3.5.2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/antlr4-runtime-4.7.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/aopalliance-1.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/aopalliance-repackaged-2.6.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/apacheds-i18n-2.0.0-M15.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/apacheds-kerberos-codec-2.0.0-M15.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/api-asn1-api-1.0.0-M20.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/api-util-1.0.0-M20.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/arpack_combined_all-0.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/arrow-format-0.15.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/arrow-memory-0.15.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/arrow-vector-0.15.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/audience-annotations-0.5.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/automaton-1.11-8.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/avro-1.8.2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/avro-ipc-1.8.2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/avro-mapred-1.8.2-hadoop2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/azure-storage-2.0.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/bonecp-0.8.0.RELEASE.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/breeze-macros_2.12-1.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/breeze_2.12-1.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/cats-kernel_2.12-2.0.0-M4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/cglib-2.2.1-v20090111.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/chill-java-0.9.5.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/chill_2.12-0.9.5.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-beanutils-1.7.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-cli-1.2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-codec-1.10.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-collections-3.2.2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-compiler-3.0.16.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-compress-1.9.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-configuration-1.6.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-crypto-1.0.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-dbcp-1.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-digester-1.8.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-httpclient-3.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-io-2.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-lang-2.6.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-lang3-3.9.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-logging-1.2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-math3-3.4.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-net-3.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-pool-1.5.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/commons-text-1.6.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/compress-lzf-1.0.3.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/core-1.1.2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/curator-client-2.7.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/curator-framework-2.7.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/curator-recipes-2.7.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/datanucleus-api-jdo-4.2.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/datanucleus-core-4.1.17.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/datanucleus-rdbms-4.1.19.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/derby-10.12.1.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/flatbuffers-java-1.9.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/generex-1.0.2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/gmetric4j-1.0.10.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/gson-2.2.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/guava-14.0.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/guice-3.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hadoop-annotations-2.7.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hadoop-auth-2.7.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hadoop-aws-2.7.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hadoop-azure-2.7.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hadoop-client-2.7.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hadoop-common-2.7.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hadoop-hdfs-2.7.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hadoop-mapreduce-client-app-2.7.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hadoop-mapreduce-client-common-2.7.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hadoop-mapreduce-client-core-2.7.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hadoop-mapreduce-client-jobclient-2.7.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hadoop-mapreduce-client-shuffle-2.7.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hadoop-openstack-2.7.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hadoop-yarn-api-2.7.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hadoop-yarn-client-2.7.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hadoop-yarn-common-2.7.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hadoop-yarn-server-common-2.7.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hadoop-yarn-server-web-proxy-2.7.4.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hive-beeline-2.3.7.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hive-cli-2.3.7.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hive-common-2.3.7.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hive-exec-2.3.7-core.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hive-jdbc-2.3.7.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hive-llap-client-2.3.7.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hive-llap-common-2.3.7.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hive-metastore-2.3.7.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hive-serde-2.3.7.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hive-shims-0.23-2.3.7.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hive-shims-2.3.7.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hive-shims-common-2.3.7.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hive-shims-scheduler-2.3.7.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hive-storage-api-2.7.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hive-vector-code-gen-2.3.7.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hk2-api-2.6.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hk2-locator-2.6.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/hk2-utils-2.6.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/htrace-core-3.1.0-incubating.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/httpclient-4.5.6.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/httpcore-4.4.12.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/istack-commons-runtime-3.0.8.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/ivy-2.4.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jackson-annotations-2.10.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jackson-core-2.10.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jackson-core-asl-1.9.13.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jackson-databind-2.10.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jackson-dataformat-cbor-2.10.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jackson-dataformat-yaml-2.10.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jackson-jaxrs-1.9.13.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jackson-mapper-asl-1.9.13.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jackson-module-jaxb-annotations-2.10.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jackson-module-paranamer-2.10.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jackson-module-scala_2.12-2.10.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jackson-xc-1.9.13.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jakarta.activation-api-1.2.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jakarta.annotation-api-1.3.5.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jakarta.inject-2.6.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jakarta.validation-api-2.0.2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jakarta.ws.rs-api-2.1.6.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jakarta.xml.bind-api-2.3.2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/janino-3.0.16.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/javassist-3.25.0-GA.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/javax.inject-1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/javax.jdo-3.2.0-m3.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/javax.servlet-api-3.1.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/javolution-5.5.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jaxb-api-2.2.2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jaxb-runtime-2.3.2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jcl-over-slf4j-1.7.30.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jdo-api-3.0.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jersey-client-2.30.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jersey-common-2.30.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jersey-container-servlet-2.30.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jersey-container-servlet-core-2.30.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jersey-hk2-2.30.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jersey-media-jaxb-2.30.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jersey-server-2.30.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jettison-1.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jetty-6.1.26.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jetty-client-9.4.18.v20190429.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jetty-continuation-9.4.18.v20190429.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jetty-http-9.4.18.v20190429.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jetty-io-9.4.18.v20190429.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jetty-jndi-9.4.18.v20190429.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jetty-plus-9.4.18.v20190429.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jetty-proxy-9.4.18.v20190429.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jetty-security-9.4.18.v20190429.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jetty-server-9.4.18.v20190429.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jetty-servlet-9.4.18.v20190429.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jetty-servlets-9.4.18.v20190429.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jetty-sslengine-6.1.26.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jetty-util-6.1.26.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jetty-util-9.4.18.v20190429.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jetty-webapp-9.4.18.v20190429.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jetty-xml-9.4.18.v20190429.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jline-2.14.6.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/joda-time-2.10.5.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jodd-core-3.5.2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jpam-1.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/json-1.8.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/json4s-ast_2.12-3.6.6.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/json4s-core_2.12-3.6.6.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/json4s-jackson_2.12-3.6.6.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/json4s-scalap_2.12-3.6.6.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jsp-api-2.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jsr305-3.0.2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jta-1.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/jul-to-slf4j-1.7.30.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/kryo-shaded-4.0.2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/kubernetes-client-4.7.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/kubernetes-model-4.7.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/kubernetes-model-common-4.7.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/leveldbjni-all-1.8.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/libfb303-0.9.3.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/libthrift-0.12.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/log4j-1.2.17.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/logging-interceptor-3.12.6.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/lz4-java-1.7.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/machinist_2.12-0.6.8.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/macro-compat_2.12-1.1.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/mesos-1.4.0-shaded-protobuf.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/metrics-core-4.1.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/metrics-graphite-4.1.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/metrics-jmx-4.1.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/metrics-json-4.1.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/metrics-jvm-4.1.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/minlog-1.3.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/netty-all-4.1.47.Final.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/objenesis-2.5.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/okhttp-3.12.6.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/okio-1.15.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/opencsv-2.3.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/orc-core-1.5.10.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/orc-mapreduce-1.5.10.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/orc-shims-1.5.10.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/oro-2.0.8.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/osgi-resource-locator-1.0.3.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/paranamer-2.8.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/parquet-column-1.10.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/parquet-common-1.10.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/parquet-encoding-1.10.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/parquet-format-2.4.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/parquet-hadoop-1.10.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/parquet-jackson-1.10.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/pmml-model-1.4.8.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/protobuf-java-2.5.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/py4j-0.10.9.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/pyrolite-4.30.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/remotetea-oncrpc-1.1.2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/scala-collection-compat_2.12-2.1.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/scala-compiler-2.12.10.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/scala-library-2.12.10.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/scala-parser-combinators_2.12-1.1.2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/scala-reflect-2.12.10.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/scala-xml_2.12-1.2.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/shapeless_2.12-2.3.3.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/shims-0.7.45.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/slf4j-api-1.7.30.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/slf4j-log4j12-1.7.30.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/snakeyaml-1.24.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/snappy-java-1.1.7.5.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-assembly_2.12-3.1.0-SNAPSHOT-tests.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-assembly_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-catalyst_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-core_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-ganglia-lgpl_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-graphx_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-hadoop-cloud_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-hive-thriftserver_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-hive_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-kubernetes_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-kvstore_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-launcher_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-mesos_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-mllib-local_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-mllib_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-network-common_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-network-shuffle_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-repl_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-sketch_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-sql_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-streaming_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-tags_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-unsafe_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spark-yarn_2.12-3.1.0-SNAPSHOT.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spire-macros_2.12-0.17.0-M1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spire-platform_2.12-0.17.0-M1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spire-util_2.12-0.17.0-M1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spire_2.12-0.17.0-M1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/spotbugs-annotations-3.1.9.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/stax-api-1.0-2.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/stax-api-1.0.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/stream-2.9.6.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/super-csv-2.2.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/threeten-extra-1.5.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/transaction-api-1.1.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/univocity-parsers-2.8.3.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/unused-1.0.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/velocity-1.5.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/xbean-asm7-shaded-4.15.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/xercesImpl-2.12.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/xml-apis-1.4.01.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/xmlenc-0.52.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/xz-1.5.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/zjsonpatch-0.3.0.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/zookeeper-3.4.14.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/jars/zstd-jni-1.4.4-3.jar -> pyspark-3.1.0.dev0/deps/jars
copying deps/licenses/LICENSE-AnchorJS.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-CC0.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-bootstrap.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-cloudpickle.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-copybutton.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-d3.min.js.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-dagre-d3.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-datatables.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-graphlib-dot.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-heapq.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-join.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-jquery.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-json-formatter.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-matchMedia-polyfill.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-modernizr.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-mustache.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-py4j.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-respond.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-sbt-launch-lib.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-sorttable.js.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/licenses/LICENSE-vis-timeline.txt -> pyspark-3.1.0.dev0/deps/licenses
copying deps/sbin/spark-config.sh -> pyspark-3.1.0.dev0/deps/sbin
copying deps/sbin/spark-daemon.sh -> pyspark-3.1.0.dev0/deps/sbin
copying deps/sbin/start-history-server.sh -> pyspark-3.1.0.dev0/deps/sbin
copying deps/sbin/stop-history-server.sh -> pyspark-3.1.0.dev0/deps/sbin
copying lib/py4j-0.10.9-src.zip -> pyspark-3.1.0.dev0/lib
copying lib/pyspark.zip -> pyspark-3.1.0.dev0/lib
copying pyspark/__init__.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/_globals.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/accumulators.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/broadcast.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/cloudpickle.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/conf.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/context.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/daemon.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/files.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/find_spark_home.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/heapq3.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/java_gateway.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/join.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/profiler.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/rdd.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/rddsampler.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/resourceinformation.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/resultiterable.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/serializers.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/shell.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/shuffle.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/statcounter.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/status.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/storagelevel.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/taskcontext.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/traceback_utils.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/util.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/version.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark/worker.py -> pyspark-3.1.0.dev0/pyspark
copying pyspark.egg-info/PKG-INFO -> pyspark-3.1.0.dev0/pyspark.egg-info
copying pyspark.egg-info/SOURCES.txt -> pyspark-3.1.0.dev0/pyspark.egg-info
copying pyspark.egg-info/dependency_links.txt -> pyspark-3.1.0.dev0/pyspark.egg-info
copying pyspark.egg-info/requires.txt -> pyspark-3.1.0.dev0/pyspark.egg-info
copying pyspark.egg-info/top_level.txt -> pyspark-3.1.0.dev0/pyspark.egg-info
copying pyspark/ml/__init__.py -> pyspark-3.1.0.dev0/pyspark/ml
copying pyspark/ml/base.py -> pyspark-3.1.0.dev0/pyspark/ml
copying pyspark/ml/classification.py -> pyspark-3.1.0.dev0/pyspark/ml
copying pyspark/ml/clustering.py -> pyspark-3.1.0.dev0/pyspark/ml
copying pyspark/ml/common.py -> pyspark-3.1.0.dev0/pyspark/ml
copying pyspark/ml/evaluation.py -> pyspark-3.1.0.dev0/pyspark/ml
copying pyspark/ml/feature.py -> pyspark-3.1.0.dev0/pyspark/ml
copying pyspark/ml/fpm.py -> pyspark-3.1.0.dev0/pyspark/ml
copying pyspark/ml/functions.py -> pyspark-3.1.0.dev0/pyspark/ml
copying pyspark/ml/image.py -> pyspark-3.1.0.dev0/pyspark/ml
copying pyspark/ml/pipeline.py -> pyspark-3.1.0.dev0/pyspark/ml
copying pyspark/ml/recommendation.py -> pyspark-3.1.0.dev0/pyspark/ml
copying pyspark/ml/regression.py -> pyspark-3.1.0.dev0/pyspark/ml
copying pyspark/ml/stat.py -> pyspark-3.1.0.dev0/pyspark/ml
copying pyspark/ml/tree.py -> pyspark-3.1.0.dev0/pyspark/ml
copying pyspark/ml/tuning.py -> pyspark-3.1.0.dev0/pyspark/ml
copying pyspark/ml/util.py -> pyspark-3.1.0.dev0/pyspark/ml
copying pyspark/ml/wrapper.py -> pyspark-3.1.0.dev0/pyspark/ml
copying pyspark/ml/linalg/__init__.py -> pyspark-3.1.0.dev0/pyspark/ml/linalg
copying pyspark/ml/param/__init__.py -> pyspark-3.1.0.dev0/pyspark/ml/param
copying pyspark/ml/param/_shared_params_code_gen.py -> pyspark-3.1.0.dev0/pyspark/ml/param
copying pyspark/ml/param/shared.py -> pyspark-3.1.0.dev0/pyspark/ml/param
copying pyspark/mllib/__init__.py -> pyspark-3.1.0.dev0/pyspark/mllib
copying pyspark/mllib/classification.py -> pyspark-3.1.0.dev0/pyspark/mllib
copying pyspark/mllib/clustering.py -> pyspark-3.1.0.dev0/pyspark/mllib
copying pyspark/mllib/common.py -> pyspark-3.1.0.dev0/pyspark/mllib
copying pyspark/mllib/evaluation.py -> pyspark-3.1.0.dev0/pyspark/mllib
copying pyspark/mllib/feature.py -> pyspark-3.1.0.dev0/pyspark/mllib
copying pyspark/mllib/fpm.py -> pyspark-3.1.0.dev0/pyspark/mllib
copying pyspark/mllib/random.py -> pyspark-3.1.0.dev0/pyspark/mllib
copying pyspark/mllib/recommendation.py -> pyspark-3.1.0.dev0/pyspark/mllib
copying pyspark/mllib/regression.py -> pyspark-3.1.0.dev0/pyspark/mllib
copying pyspark/mllib/tree.py -> pyspark-3.1.0.dev0/pyspark/mllib
copying pyspark/mllib/util.py -> pyspark-3.1.0.dev0/pyspark/mllib
copying pyspark/mllib/linalg/__init__.py -> pyspark-3.1.0.dev0/pyspark/mllib/linalg
copying pyspark/mllib/linalg/distributed.py -> pyspark-3.1.0.dev0/pyspark/mllib/linalg
copying pyspark/mllib/stat/KernelDensity.py -> pyspark-3.1.0.dev0/pyspark/mllib/stat
copying pyspark/mllib/stat/__init__.py -> pyspark-3.1.0.dev0/pyspark/mllib/stat
copying pyspark/mllib/stat/_statistics.py -> pyspark-3.1.0.dev0/pyspark/mllib/stat
copying pyspark/mllib/stat/distribution.py -> pyspark-3.1.0.dev0/pyspark/mllib/stat
copying pyspark/mllib/stat/test.py -> pyspark-3.1.0.dev0/pyspark/mllib/stat
copying pyspark/python/pyspark/shell.py -> pyspark-3.1.0.dev0/pyspark/python/pyspark
copying pyspark/resource/__init__.py -> pyspark-3.1.0.dev0/pyspark/resource
copying pyspark/resource/executorrequests.py -> pyspark-3.1.0.dev0/pyspark/resource
copying pyspark/resource/resourceprofile.py -> pyspark-3.1.0.dev0/pyspark/resource
copying pyspark/resource/resourceprofilebuilder.py -> pyspark-3.1.0.dev0/pyspark/resource
copying pyspark/resource/taskrequests.py -> pyspark-3.1.0.dev0/pyspark/resource
copying pyspark/sql/__init__.py -> pyspark-3.1.0.dev0/pyspark/sql
copying pyspark/sql/catalog.py -> pyspark-3.1.0.dev0/pyspark/sql
copying pyspark/sql/column.py -> pyspark-3.1.0.dev0/pyspark/sql
copying pyspark/sql/conf.py -> pyspark-3.1.0.dev0/pyspark/sql
copying pyspark/sql/context.py -> pyspark-3.1.0.dev0/pyspark/sql
copying pyspark/sql/dataframe.py -> pyspark-3.1.0.dev0/pyspark/sql
copying pyspark/sql/functions.py -> pyspark-3.1.0.dev0/pyspark/sql
copying pyspark/sql/group.py -> pyspark-3.1.0.dev0/pyspark/sql
copying pyspark/sql/readwriter.py -> pyspark-3.1.0.dev0/pyspark/sql
copying pyspark/sql/session.py -> pyspark-3.1.0.dev0/pyspark/sql
copying pyspark/sql/streaming.py -> pyspark-3.1.0.dev0/pyspark/sql
copying pyspark/sql/types.py -> pyspark-3.1.0.dev0/pyspark/sql
copying pyspark/sql/udf.py -> pyspark-3.1.0.dev0/pyspark/sql
copying pyspark/sql/utils.py -> pyspark-3.1.0.dev0/pyspark/sql
copying pyspark/sql/window.py -> pyspark-3.1.0.dev0/pyspark/sql
copying pyspark/sql/avro/__init__.py -> pyspark-3.1.0.dev0/pyspark/sql/avro
copying pyspark/sql/avro/functions.py -> pyspark-3.1.0.dev0/pyspark/sql/avro
copying pyspark/sql/pandas/__init__.py -> pyspark-3.1.0.dev0/pyspark/sql/pandas
copying pyspark/sql/pandas/conversion.py -> pyspark-3.1.0.dev0/pyspark/sql/pandas
copying pyspark/sql/pandas/functions.py -> pyspark-3.1.0.dev0/pyspark/sql/pandas
copying pyspark/sql/pandas/group_ops.py -> pyspark-3.1.0.dev0/pyspark/sql/pandas
copying pyspark/sql/pandas/map_ops.py -> pyspark-3.1.0.dev0/pyspark/sql/pandas
copying pyspark/sql/pandas/serializers.py -> pyspark-3.1.0.dev0/pyspark/sql/pandas
copying pyspark/sql/pandas/typehints.py -> pyspark-3.1.0.dev0/pyspark/sql/pandas
copying pyspark/sql/pandas/types.py -> pyspark-3.1.0.dev0/pyspark/sql/pandas
copying pyspark/sql/pandas/utils.py -> pyspark-3.1.0.dev0/pyspark/sql/pandas
copying pyspark/streaming/__init__.py -> pyspark-3.1.0.dev0/pyspark/streaming
copying pyspark/streaming/context.py -> pyspark-3.1.0.dev0/pyspark/streaming
copying pyspark/streaming/dstream.py -> pyspark-3.1.0.dev0/pyspark/streaming
copying pyspark/streaming/kinesis.py -> pyspark-3.1.0.dev0/pyspark/streaming
copying pyspark/streaming/listener.py -> pyspark-3.1.0.dev0/pyspark/streaming
copying pyspark/streaming/util.py -> pyspark-3.1.0.dev0/pyspark/streaming
Writing pyspark-3.1.0.dev0/setup.cfg
creating dist
Creating tar archive
Build timed out (after 300 minutes). Marking the build as failed.
Build was aborted
Archiving artifacts
/home/jenkins/workspace/NewSparkPullRequestBuilder@2/dev/run-pip-tests: line 72: 98813 Terminated python3 setup.py sdist
Cleaning up temporary directory - /tmp/tmp.d2O1DtcgkL
Recording test results
Finished: FAILURE
![[Jenkins]](/jenkins/static/02af5841/images/jenkins-header-logo-v2.svg){kind=logo}
Console Output