Check KeyValueGroupedDataset toString: Named KV-pair | 24 ms | Passed |
Check KeyValueGroupedDataset toString: Single data | 17 ms | Passed |
Check KeyValueGroupedDataset toString: Unnamed KV-pair | 41 ms | Passed |
Check KeyValueGroupedDataset toString: over length schema | 25 ms | Passed |
Check RelationalGroupedDataset toString: Single data | 8 ms | Passed |
Check RelationalGroupedDataset toString: over length schema | 33 ms | Passed |
Dataset should support flat input object to be null | 34 ms | Passed |
Dataset should throw RuntimeException if top-level product input object is null | 6 ms | Passed |
Java encoder | 0.18 sec | Passed |
Java encoder self join | 77 ms | Passed |
Kryo encoder | 0.29 sec | Passed |
Kryo encoder self join | 88 ms | Passed |
Kryo encoder: check the schema mismatch when converting DataFrame to Dataset | 13 ms | Passed |
Map | 0.48 sec | Passed |
REGEX column specification | 0.71 sec | Passed |
SPARK-11436: we should rebind right encoder when join 2 datasets | 0.1 sec | Passed |
SPARK-11894: Incorrect results are returned when using null | 0.16 sec | Passed |
SPARK-12404: Datatype Helper Serializability | 75 ms | Passed |
SPARK-12478: top level null field | 0.2 sec | Passed |
SPARK-13440: Resolving option fields | 83 ms | Passed |
SPARK-13540 Dataset of nested class defined in Scala object | 57 ms | Passed |
SPARK-14000: case class with tuple type field | 72 ms | Passed |
SPARK-14696: implicit encoders for boxed types | 0.19 sec | Passed |
SPARK-14838: estimating sizeInBytes in operators with ObjectProducer shouldn't fail | 0.38 sec | Passed |
SPARK-15097: implicits on dataset's spark can be imported | 85 ms | Passed |
SPARK-15112: EmbedDeserializerInFilter should not optimize plan fragment that changes schema | 0.14 sec | Passed |
SPARK-15381: physical object operator should define `reference` correctly | 0.19 sec | Passed |
SPARK-15441: Dataset outer join | 0.14 sec | Passed |
SPARK-15632: typed filter should preserve the underlying logical schema | 6 ms | Passed |
SPARK-16853: select, case class and tuple | 0.24 sec | Passed |
SPARK-16995: flat mapping on Dataset containing a column created with lit/expr | 0.51 sec | Passed |
SPARK-17460: the sizeInBytes in Statistics shouldn't overflow to a negative number | 0.19 sec | Passed |
SPARK-18125: Spark generated code causes CompileException | 0.58 sec | Passed |
SPARK-18189: Fix serialization issue in KeyValueGroupedDataset | 0.3 sec | Passed |
SPARK-18284: Serializer should have correct nullable value | 0.25 sec | Passed |
SPARK-18746: add implicit encoder for BigDecimal, date, timestamp | 0.49 sec | Passed |
SPARK-19896: cannot have circular references in case class | 24 ms | Passed |
SPARK-20125: option of map | 0.1 sec | Passed |
SPARK-20399: do not unescaped regex pattern when ESCAPED_STRING_LITERALS is enabled | 0.43 sec | Passed |
SPARK-21538: Attribute resolution inconsistency in Dataset API | 0.59 sec | Passed |
SPARK-21567: Dataset should work with type alias | 0.53 sec | Passed |
SPARK-22442: Generate correct field names for special characters | 0.33 sec | Passed |
SPARK-22472: add null check for top-level primitive values | 0.51 sec | Passed |
SPARK-23025: Add support for null type in scala reflection | 57 ms | Passed |
SPARK-23614: Union produces incorrect results when caching is used | 0.84 sec | Passed |
SPARK-23627: provide isEmpty in DataSet | 42 ms | Passed |
SPARK-23835: null primitive data type should throw NullPointerException | 49 ms | Passed |
SPARK-24548: Dataset with tuple encoders should have correct schema | 0.15 sec | Passed |
SPARK-24569: Option of primitive types are mistakenly mapped to struct type | 0.24 sec | Passed |
SPARK-24571: filtering of string values by char literal | 0.21 sec | Passed |
SPARK-24762: Enable top-level Option of Product encoders | 0.21 sec | Passed |
SPARK-24762: Resolving Option[Product] field | 94 ms | Passed |
SPARK-24762: joinWith on Option[Product] | 0.19 sec | Passed |
SPARK-24762: select Option[Product] field | 0.19 sec | Passed |
SPARK-24762: typed agg on Option[Product] type | 0.62 sec | Passed |
SPARK-25108 Fix the show method to display the full width character alignment problem | 0.12 sec | Passed |
SPARK-25153: Improve error messages for columns with dots/periods | 70 ms | Passed |
SPARK-25942: typed aggregation on primitive type | 0.32 sec | Passed |
SPARK-25942: typed aggregation on product type | 0.33 sec | Passed |
SPARK-26085: fix key attribute name for atomic type for typed aggregation | 14 ms | Passed |
SPARK-26233: serializer should enforce decimal precision and scale | 0.43 sec | Passed |
SPARK-26366: return nulls which are not filtered in except | 0.33 sec | Passed |
SPARK-26690: checkpoints should be executed with an execution id | 59 ms | Passed |
SPARK-31854: Invoke in MapElementsExec should not propagate null | 0.24 sec | Passed |
SPARK-8288: class with only a companion object constructor | 0.13 sec | Passed |
active should be the same instance after dataset operations | 4 ms | Passed |
as | 0.37 sec | Passed |
as case class - reordered fields by name | 70 ms | Passed |
as case class - tail | 57 ms | Passed |
as case class - take | 58 ms | Passed |
as case class / collect | 61 ms | Passed |
as map of case class - reorder fields by name | 84 ms | Passed |
as seq of case class - reorder fields by name | 74 ms | Passed |
as tuple | 75 ms | Passed |
change encoder with compatible schema | 0.47 sec | Passed |
checkAnswer should compare map correctly | 0.16 sec | Passed |
checkpoint() - basic (eager = false, reliable = false) | 0.23 sec | Passed |
checkpoint() - basic (eager = false, reliable = true) | 0.37 sec | Passed |
checkpoint() - basic (eager = true, reliable = false) | 0.34 sec | Passed |
checkpoint() - basic (eager = true, reliable = true) | 0.53 sec | Passed |
checkpoint() - should preserve partitioning information (eager = false, reliable = false) | 0.73 sec | Passed |
checkpoint() - should preserve partitioning information (eager = false, reliable = true) | 0.93 sec | Passed |
checkpoint() - should preserve partitioning information (eager = true, reliable = false) | 0.69 sec | Passed |
checkpoint() - should preserve partitioning information (eager = true, reliable = true) | 0.97 sec | Passed |
coalesce, repartition | 0.25 sec | Passed |
cogroup | 0.27 sec | Passed |
cogroup with complex data | 0.31 sec | Passed |
cogroup's left and right side has field with same name | 0.33 sec | Passed |
collect, first, and take should use encoders for serialization | 0.13 sec | Passed |
createTempView | 39 ms | Passed |
dropDuplicates | 0.78 sec | Passed |
dropDuplicates: columns with same column name | 0.33 sec | Passed |
emptyDataset | 77 ms | Passed |
filter | 72 ms | Passed |
filter and then select | 83 ms | Passed |
foreach | 59 ms | Passed |
foreachPartition | 53 ms | Passed |
give nice error message when the real number of fields doesn't match encoder schema | 18 ms | Passed |
groupBy function, flatMap | 0.17 sec | Passed |
groupBy function, keys | 0.53 sec | Passed |
groupBy function, map | 0.21 sec | Passed |
groupBy function, mapValues, flatMap | 0.43 sec | Passed |
groupBy function, reduce | 0.15 sec | Passed |
groupBy single field class, count | 0.18 sec | Passed |
grouping key and grouped value has field with same name | 0.25 sec | Passed |
identity map for primitive arrays | 0.39 sec | Passed |
implicit encoder for LocalDate and Instant | 0.23 sec | Passed |
isStreaming returns false for static Dataset | 21 ms | Passed |
isStreaming returns true after static and streaming Dataset join | 13 ms | Passed |
isStreaming returns true for streaming Dataset | 3 ms | Passed |
joinWith class with primitive, toDF | 0.2 sec | Passed |
joinWith join types | 16 ms | Passed |
joinWith tuple with primitive, expression | 0.12 sec | Passed |
joinWith, flat schema | 80 ms | Passed |
map | 0.11 sec | Passed |
map and group by with class data | 0.29 sec | Passed |
map may generate wrong java code for wide table | 2.8 sec | Passed |
map with type change with less attributes | 0.17 sec | Passed |
map with type change with the exact matched number of attributes | 0.19 sec | Passed |
mapped dataset should resolve duplicated attributes for self join | 0.69 sec | Passed |
mayTruncate for bytes | 4 ms | Passed |
multi-level joinWith | 0.16 sec | Passed |
range | 0.35 sec | Passed |
rdd with generic case class | 0.19 sec | Passed |
reduce | 38 ms | Passed |
row nullability mismatch | 61 ms | Passed |
runtime null check for RowEncoder | 71 ms | Passed |
runtime nullability check | 0.17 sec | Passed |
sample fraction should be on interval [0, 1] without replacement | 4 ms | Passed |
sample fraction should not be negative with replacement | 55 ms | Passed |
sample with replacement | 83 ms | Passed |
sample with seed results shouldn't depend on downstream usage | 0.25 sec | Passed |
sample without replacement | 68 ms | Passed |
select | 97 ms | Passed |
select 2 | 35 ms | Passed |
select 2, primitive and class | 75 ms | Passed |
select 2, primitive and class, fields reordered | 88 ms | Passed |
select 2, primitive and tuple | 80 ms | Passed |
self join | 0.1 sec | Passed |
show() should show contents of the underlying logical plan | 0.18 sec | Passed |
show() should show inner nested products as rows | 81 ms | Passed |
support inner class in Dataset | 0.17 sec | Passed |
tail should not accept minus value | 5 ms | Passed |
tail with different numbers | 0.46 sec | Passed |
toDS | 64 ms | Passed |
toDS should compare map with byte array keys correctly | 0.35 sec | Passed |
toDS with RDD | 0.24 sec | Passed |
toString | 23 ms | Passed |
tuple should handle null object correctly | 61 ms | Passed |
typed aggregation: expr | 0.27 sec | Passed |
typed aggregation: expr, expr | 0.28 sec | Passed |
typed aggregation: expr, expr, expr | 0.82 sec | Passed |
typed aggregation: expr, expr, expr, expr | 0.32 sec | Passed |
typed aggregation: expr, expr, expr, expr, expr | 0.6 sec | Passed |
typed aggregation: expr, expr, expr, expr, expr, expr | 0.54 sec | Passed |
typed aggregation: expr, expr, expr, expr, expr, expr, expr | 0.8 sec | Passed |
typed aggregation: expr, expr, expr, expr, expr, expr, expr, expr | 0.57 sec | Passed |
verify mismatching field names fail with a good error | 31 ms | Passed |