FailedConsole Output

Skipping 7,179 KB.. Full Log
qTaKoEttlJQNjBwdjEwsFayAwAsE8VZpQAAAA==- Byte APIs (2 milliseconds)
[info] - Short APIs (6 milliseconds)
[info] - Int APIs (5 milliseconds)
[info] - Long APIs (5 milliseconds)
[info] - Float APIs (5 milliseconds)
[info] - Double APIs (5 milliseconds)
[info] - String APIs (2 milliseconds)
[info] - CalendarInterval APIs (1 millisecond)
[info] - Int Array (0 milliseconds)
[info] - toArray for primitive types (5 milliseconds)
[info] - Int Map (2 milliseconds)
[info] - Struct Column (0 milliseconds)
[info] - Nest Array in Array (1 millisecond)
[info] - Nest Struct in Array (1 millisecond)
[info] - Nest Array in Struct (1 millisecond)
[info] - Nest Struct in Struct (0 milliseconds)
[info] - ColumnarBatch basic (3 milliseconds)
[info] - Convert rows (3 milliseconds)
[info] - multinomial logistic regression with intercept with elasticnet regularization (47 seconds, 228 milliseconds)
[info] - assign from latest offsets (failOnDataLoss: false) (7 seconds, 952 milliseconds)
[info] - list file <filepath> (10 seconds, 97 milliseconds)
[info] - Random flat schema (7 seconds, 742 milliseconds)
[info] - assign from earliest offsets (failOnDataLoss: false) (6 seconds, 36 milliseconds)
[info] - assign from specific offsets (failOnDataLoss: false) (3 seconds, 914 milliseconds)
[info] - apply hiveconf from cli command (12 seconds, 242 milliseconds)
[info] - multinomial logistic regression without intercept with elasticnet regularization (19 seconds, 879 milliseconds)
[info] - evaluate on test set (1 second, 826 milliseconds)
[info] - subscribing topic by name from latest offsets (failOnDataLoss: false) (9 seconds, 55 milliseconds)
[info] - evaluate with labels that are not doubles (807 milliseconds)
[info] - statistics on training data (411 milliseconds)
[info] - SPARK-21451: spark.sql.warehouse.dir should respect options in --hiveconf (12 seconds, 553 milliseconds)
[info] - subscribing topic by name from earliest offsets (failOnDataLoss: false) (6 seconds, 967 milliseconds)
[info] - logistic regression with sample weights (7 seconds, 831 milliseconds)
[info] - set family (1 second, 403 milliseconds)
[info] - subscribing topic by name from specific offsets (failOnDataLoss: false) (4 seconds, 45 milliseconds)
[info] - set initial model (1 second, 981 milliseconds)
[info] - binary logistic regression with all labels the same (488 milliseconds)
[info] - Random nested schema (30 seconds, 653 milliseconds)
[info] - exceeding maximum capacity should throw an error (3 milliseconds)
[info] - create columnar batch from Arrow column vectors (4 milliseconds)
[info] - Decimal API (1 millisecond)
[info] - Binary APIs (1 millisecond)
[info] - WritableColumnVector.reserve(): requested capacity is negative (0 milliseconds)
[info] InnerJoinSuite:
[info] - inner join, one match per row using BroadcastHashJoin (build=left) (100 milliseconds)
[info] - inner join, one match per row using BroadcastHashJoin (build=right) (40 milliseconds)
[info] - inner join, one match per row using ShuffledHashJoin (build=left) (66 milliseconds)
[info] - inner join, one match per row using ShuffledHashJoin (build=right) (44 milliseconds)
[info] - inner join, one match per row using SortMergeJoin (127 milliseconds)
[info] - inner join, one match per row using CartesianProduct (40 milliseconds)
[info] - inner join, one match per row using BroadcastNestedLoopJoin build left (32 milliseconds)
[info] - inner join, one match per row using BroadcastNestedLoopJoin build right (27 milliseconds)
[info] - multiclass logistic regression with all labels the same (866 milliseconds)
[info] - inner join, multiple matches using BroadcastHashJoin (build=left) (81 milliseconds)
[info] - inner join, multiple matches using BroadcastHashJoin (build=right) (32 milliseconds)
[info] - inner join, multiple matches using ShuffledHashJoin (build=left) (46 milliseconds)
[info] - inner join, multiple matches using ShuffledHashJoin (build=right) (35 milliseconds)
[info] - compressed storage for constant label (218 milliseconds)
[info] - inner join, multiple matches using SortMergeJoin (88 milliseconds)
[info] - inner join, multiple matches using CartesianProduct (43 milliseconds)
[info] - inner join, multiple matches using BroadcastNestedLoopJoin build left (37 milliseconds)
[info] - inner join, multiple matches using BroadcastNestedLoopJoin build right (30 milliseconds)
[info] - inner join, no matches using BroadcastHashJoin (build=left) (66 milliseconds)
[info] - inner join, no matches using BroadcastHashJoin (build=right) (31 milliseconds)
[info] - inner join, no matches using ShuffledHashJoin (build=left) (39 milliseconds)
[info] - inner join, no matches using ShuffledHashJoin (build=right) (33 milliseconds)
[info] - inner join, no matches using SortMergeJoin (60 milliseconds)
[info] - inner join, no matches using CartesianProduct (16 milliseconds)
[info] - inner join, no matches using BroadcastNestedLoopJoin build left (25 milliseconds)
[info] - inner join, no matches using BroadcastNestedLoopJoin build right (28 milliseconds)
[info] - inner join, null safe using BroadcastHashJoin (build=left) (109 milliseconds)
[info] - inner join, null safe using BroadcastHashJoin (build=right) (38 milliseconds)
[info] - inner join, null safe using ShuffledHashJoin (build=left) (56 milliseconds)
[info] - inner join, null safe using ShuffledHashJoin (build=right) (38 milliseconds)
[info] - inner join, null safe using SortMergeJoin (85 milliseconds)
[info] - inner join, null safe using CartesianProduct (32 milliseconds)
[info] - inner join, null safe using BroadcastNestedLoopJoin build left (33 milliseconds)
[info] - inner join, null safe using BroadcastNestedLoopJoin build right (30 milliseconds)
[info] - SPARK-15822 - test structs as keys using BroadcastHashJoin (build=left) (157 milliseconds)
[info] - SPARK-15822 - test structs as keys using BroadcastHashJoin (build=right) (54 milliseconds)
[info] - SPARK-15822 - test structs as keys using ShuffledHashJoin (build=left) (95 milliseconds)
[info] - SPARK-15822 - test structs as keys using ShuffledHashJoin (build=right) (69 milliseconds)
[info] - SPARK-15822 - test structs as keys using SortMergeJoin (114 milliseconds)
[info] - SPARK-15822 - test structs as keys using CartesianProduct (42 milliseconds)
[info] - SPARK-15822 - test structs as keys using BroadcastNestedLoopJoin build left (42 milliseconds)
[info] - SPARK-15822 - test structs as keys using BroadcastNestedLoopJoin build right (24 milliseconds)
[info] ExistenceJoinSuite:
[info] - test single condition (equal) for left semi join using ShuffledHashJoin (159 milliseconds)
[info] - test single condition (equal) for left semi join using BroadcastHashJoin (99 milliseconds)
[info] - test single condition (equal) for left semi join using SortMergeJoin (308 milliseconds)
[info] - test single condition (equal) for left semi join using BroadcastNestedLoopJoin build left (78 milliseconds)
[info] - test single condition (equal) for left semi join using BroadcastNestedLoopJoin build right (51 milliseconds)
[info] - test composed condition (equal & non-equal) for left semi join using ShuffledHashJoin (89 milliseconds)
[info] - test composed condition (equal & non-equal) for left semi join using BroadcastHashJoin (99 milliseconds)
[info] - test composed condition (equal & non-equal) for left semi join using SortMergeJoin (255 milliseconds)
[info] - test composed condition (equal & non-equal) for left semi join using BroadcastNestedLoopJoin build left (89 milliseconds)
[info] - test composed condition (equal & non-equal) for left semi join using BroadcastNestedLoopJoin build right (74 milliseconds)
[info] - test composed condition (both non-equal) for left semi join using ShuffledHashJoin (0 milliseconds)
[info] - test composed condition (both non-equal) for left semi join using BroadcastHashJoin (0 milliseconds)
[info] - test composed condition (both non-equal) for left semi join using SortMergeJoin (1 millisecond)
[info] - test composed condition (both non-equal) for left semi join using BroadcastNestedLoopJoin build left (92 milliseconds)
[info] - test composed condition (both non-equal) for left semi join using BroadcastNestedLoopJoin build right (73 milliseconds)
[info] - test single condition (equal) for left Anti join using ShuffledHashJoin (102 milliseconds)
[info] - test single condition (equal) for left Anti join using BroadcastHashJoin (77 milliseconds)
[info] - test single condition (equal) for left Anti join using SortMergeJoin (262 milliseconds)
[info] - test single condition (equal) for left Anti join using BroadcastNestedLoopJoin build left (57 milliseconds)
[info] - test single condition (equal) for left Anti join using BroadcastNestedLoopJoin build right (45 milliseconds)
[info] - test single unique condition (equal) for left Anti join using ShuffledHashJoin (217 milliseconds)
[info] - test single unique condition (equal) for left Anti join using BroadcastHashJoin (169 milliseconds)
[info] - test single unique condition (equal) for left Anti join using SortMergeJoin (397 milliseconds)
[info] - test single unique condition (equal) for left Anti join using BroadcastNestedLoopJoin build left (165 milliseconds)
[info] - test single unique condition (equal) for left Anti join using BroadcastNestedLoopJoin build right (146 milliseconds)
[info] - test composed condition (equal & non-equal) test for anti join using ShuffledHashJoin (78 milliseconds)
[info] - test composed condition (equal & non-equal) test for anti join using BroadcastHashJoin (72 milliseconds)
[info] - SPARK-21451: Apply spark.hadoop.* configurations (12 seconds, 437 milliseconds)
[info] JdbcConnectionUriSuite:
[info] - test composed condition (equal & non-equal) test for anti join using SortMergeJoin (245 milliseconds)
[info] - test composed condition (equal & non-equal) test for anti join using BroadcastNestedLoopJoin build left (90 milliseconds)
[info] - test composed condition (equal & non-equal) test for anti join using BroadcastNestedLoopJoin build right (48 milliseconds)
[info] - test composed condition (both non-equal) for anti join using ShuffledHashJoin (0 milliseconds)
[info] - test composed condition (both non-equal) for anti join using BroadcastHashJoin (1 millisecond)
[info] - test composed condition (both non-equal) for anti join using SortMergeJoin (0 milliseconds)
[info] - test composed condition (both non-equal) for anti join using BroadcastNestedLoopJoin build left (79 milliseconds)
[info] - test composed condition (both non-equal) for anti join using BroadcastNestedLoopJoin build right (78 milliseconds)
[info] - test composed unique condition (both non-equal) for anti join using ShuffledHashJoin (71 milliseconds)
[info] - test composed unique condition (both non-equal) for anti join using BroadcastHashJoin (68 milliseconds)
[info] - test composed unique condition (both non-equal) for anti join using SortMergeJoin (264 milliseconds)
[info] - test composed unique condition (both non-equal) for anti join using BroadcastNestedLoopJoin build left (62 milliseconds)
[info] - test composed unique condition (both non-equal) for anti join using BroadcastNestedLoopJoin build right (49 milliseconds)
[info] ParquetEncodingSuite:
[info] - All Types Dictionary (411 milliseconds)
[info] - All Types Null (352 milliseconds)
[info] - Read row group containing both dictionary and plain encoded pages (195 milliseconds)
[info] BasicWriteTaskStatsTrackerSuite:
[info] - No files in run (0 milliseconds)
[info] - Missing File (1 millisecond)
[info] - Empty filename is forwarded (1 millisecond)
[info] - Null filename is only picked up in final status (0 milliseconds)
[info] - 0 byte file (8 milliseconds)
[info] - File with data (8 milliseconds)
[info] - Open file (5 milliseconds)
[info] - Two files (7 milliseconds)
[info] - Three files, last one empty (16 milliseconds)
[info] - Three files, one not found (13 milliseconds)
[info] StreamingInnerJoinSuite:
[info] - compressed coefficients (7 seconds, 587 milliseconds)
[info] - subscribing topic by pattern from latest offsets (failOnDataLoss: false) (10 seconds, 99 milliseconds)
[info] - numClasses specified in metadata/inferred (356 milliseconds)
00:04:02.336 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.338 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.340 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.342 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.344 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.346 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.348 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.350 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.404 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.406 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.408 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.410 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.412 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.414 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.416 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.419 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.472 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.475 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.478 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.481 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 4 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.845 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.847 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.849 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.850 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.852 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.854 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.856 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.857 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.902 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.903 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.906 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.910 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.912 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.914 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.918 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.921 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.971 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.978 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.983 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:02.988 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
[info] - stream stream inner join on non-time column (3 seconds, 555 milliseconds)
[info] - read/write (3 seconds, 680 milliseconds)
00:04:04.756 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.759 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.761 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.765 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.768 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.772 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.776 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.779 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.846 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.848 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.851 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.853 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.855 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.857 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.859 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.862 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.922 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.926 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.929 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:04.932 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
[info] - should support all NumericType labels and weights, and not support other types (1 second, 84 milliseconds)
00:04:05.315 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.319 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.321 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.324 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.326 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.330 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.333 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.336 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.433 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.436 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.439 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.442 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.446 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.451 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.455 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.459 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.542 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.550 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.557 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:05.564 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 3 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
[info] - string params should be case-insensitive (1 second, 198 milliseconds)
[info] - toString (1 millisecond)
00:04:06.460 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.462 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.464 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.466 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.478 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.483 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.487 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.490 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.582 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.584 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.586 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.589 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.591 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.593 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.595 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.597 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.664 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.671 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.674 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:06.679 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
[info] - stream stream inner join on windows - without watermark (4 seconds, 256 milliseconds)
[info] GBTClassifierSuite:
00:04:08.653 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.656 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.658 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.660 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.662 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.663 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.666 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.668 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.739 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.743 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.747 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.751 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.755 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.758 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.762 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.766 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.856 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.861 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.866 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:08.870 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 2 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
[info] - subscribing topic by pattern from earliest offsets (failOnDataLoss: false) (8 seconds, 917 milliseconds)
00:04:10.011 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:10.014 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:10.019 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:10.022 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:10.026 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:10.030 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:10.034 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:10.037 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:10.134 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:10.136 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:10.141 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:10.144 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
[info] - params (63 milliseconds)
00:04:10.147 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:10.149 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:10.150 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:10.153 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:10.241 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:10.247 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:10.254 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:10.261 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 5 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
[info] - stream stream inner join on windows - with watermark (3 seconds, 629 milliseconds)
[info] - subscribing topic by pattern from specific offsets (failOnDataLoss: false) (4 seconds, 937 milliseconds)
[info] - bad source options (11 milliseconds)
[info] - unsupported kafka configs (10 milliseconds)
[info] - get offsets from case insensitive parameters (3 milliseconds)
[info] - Kafka column types (1 second, 89 milliseconds)
[info] - ensure continuous stream is being used (124 milliseconds)
[info] - stream stream inner join with time range - with watermark - one side condition (4 seconds, 639 milliseconds)
[info] - read Kafka transactional messages: read_committed (3 seconds, 752 milliseconds)
[info] - GBTClassifier: default params (9 seconds, 982 milliseconds)
[info] - setThreshold, getThreshold (3 milliseconds)
[info] - stream stream inner join with time range - with watermark - two side conditions (5 seconds, 295 milliseconds)
[info] - stream stream inner join without equality predicate (135 milliseconds)
00:04:22.085 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.088 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.092 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.094 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.097 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.099 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.101 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.105 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.171 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.175 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.179 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.182 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.184 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.186 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.190 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.193 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.260 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.264 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.268 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
00:04:22.274 WARN org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider: The state for version 1 doesn't exist in loadedMaps. Reading snapshot file and delta files if needed...Note that this is normal for the first batch of starting query.
[info] - stream stream self join (1 second, 357 milliseconds)
[info] - locality preferences of StateStoreAwareZippedRDD (14 milliseconds)
[info] - read Kafka transactional messages: read_uncommitted (3 seconds, 394 milliseconds)
[info] - join between three streams (942 milliseconds)
[info] - streaming join should require HashClusteredDistribution from children (740 milliseconds)
[info] StreamingOuterJoinSuite:
[info] - SPARK-27494: read kafka record containing null key/values. (2 seconds, 167 milliseconds)
[info] - left outer early state exclusion on left (2 seconds, 850 milliseconds)
[info] KafkaContinuousSourceTopicDeletionSuite:
[info] - left outer early state exclusion on right (2 seconds, 698 milliseconds)
[info] - ensure continuous stream is being used (139 milliseconds)
[info] - thresholds prediction (11 seconds, 645 milliseconds)
[info] - right outer early state exclusion on left (2 seconds, 579 milliseconds)
[info] - right outer early state exclusion on right (2 seconds, 420 milliseconds)
[info] - subscribing topic by pattern with topic deletions (5 seconds, 270 milliseconds)
[info] - SPARK-17819 Support default database in connection URIs (1 second, 133 milliseconds)
[info] - windowed left outer join (3 seconds, 92 milliseconds)
[info] KafkaContinuousSourceStressForDontFailOnDataLossSuite:
[info] - GBTClassifier: Predictor, Classifier methods (7 seconds, 382 milliseconds)
[info] HiveMetastoreLazyInitializationSuite:
[info] - windowed right outer join (3 seconds, 248 milliseconds)
[info] - prediction on single instance (4 seconds, 251 milliseconds)
[info] - GBT parameter stepSize should be in interval (0, 1] (1 millisecond)
[info] - left outer with watermark range condition (3 seconds, 485 milliseconds)
[info] - right outer with watermark range condition (3 seconds, 648 milliseconds)
[info] - Binary classification with continuous features: Log Loss (10 seconds, 321 milliseconds)
[info] - lazily initialize Hive client (13 seconds, 178 milliseconds)
[info] SparkSQLEnvSuite:
[info] - Checkpointing (902 milliseconds)
[info] - left outer join with non-key condition violated (8 seconds, 717 milliseconds)
[info] SQLMetricsSuite:
[info] - LocalTableScanExec computes metrics in collect and take (94 milliseconds)
[info] - Filter metrics (97 milliseconds)
[info] - WholeStageCodegen metrics (72 milliseconds)
[info] - Aggregate metrics (415 milliseconds)
00:04:58.730 WARN org.apache.spark.scheduler.TaskSetManager: Stage 6 contains a task of very large size (3013 KB). The maximum recommended task size is 100 KB.
00:05:00.747 WARN org.apache.spark.scheduler.TaskSetManager: Stage 9 contains a task of very large size (3021 KB). The maximum recommended task size is 100 KB.
[info] - Aggregate metrics: track avg probe (3 seconds, 409 milliseconds)
[info] - ObjectHashAggregate metrics (144 milliseconds)
00:05:01.344 WARN org.apache.spark.sql.execution.metric.SQLMetricsSuite: Due to a race condition, we miss some jobs and cannot verify the metric values
[info] - Sort metrics (40 milliseconds)
[info] - SortMergeJoin metrics (187 milliseconds)
[info] - SPARK-29604 external listeners should be initialized with Spark classloader (7 seconds, 555 milliseconds)
[error] running /home/jenkins/workspace/spark-branch-2.4-test-sbt-hadoop-2.6/build/sbt -Phadoop-2.6 -Pkubernetes -Pflume -Phive-thriftserver -Pyarn -Pkafka-0-8 -Pspark-ganglia-lgpl -Pkinesis-asl -Phive -Pmesos test ; process was terminated by signal 9
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Finished: FAILURE