4 in reading dates/timestamps | 10 sec | Passed |
Array data types | 1.3 sec | Passed |
Avro source v2: same result with different orders of data filters and partition filters | 1 sec | Passed |
Avro source v2: support partition pruning | 1.2 sec | Passed |
Avro source v2: support passing data filters to FileScan without partitionFilters | 0.82 sec | Passed |
Complex Union Type | 1.2 sec | Passed |
Date field type | 0.53 sec | Passed |
Detect recursive loop | 1 ms | Passed |
Ignore corrupt Avro file if flag IGNORE_CORRUPT_FILES enabled | 1.8 sec | Passed |
Lots of nulls | 0.77 sec | Passed |
SPARK-24836: checking the ignoreExtension option | 0.84 sec | Passed |
SPARK-24836: ignoreExtension must override hadoop's config | 0.15 sec | Passed |
SPARK-24881: write with compression - avro options | 2.3 sec | Passed |
SPARK-27858 Union type: More than one non-null type | 0.2 sec | Passed |
SPARK-31183: rebasing dates in write | 1.8 sec | Passed |
SPARK-31183: rebasing microseconds timestamps in write | 1.3 sec | Passed |
SPARK-31183: rebasing milliseconds timestamps in write | 2.2 sec | Passed |
SPARK-31327: Write Spark version into Avro file metadata | 0.63 sec | Passed |
SQL test insert overwrite | 0.97 sec | Passed |
Struct field type | 0.56 sec | Passed |
Throws IOException on reading corrupt Avro file if flag IGNORE_CORRUPT_FILES disabled | 13 ms | Passed |
Union of a single type | 0.26 sec | Passed |
Validate namespace in avro file that has nested records with the same name | 0.36 sec | Passed |
avro extension by default | 0.35 sec | Passed |
check empty namespace - toAvroType | 0 ms | Passed |
check namespace - toAvroType | 1 ms | Passed |
conversion to avro and back | 0.93 sec | Passed |
conversion to avro and back with namespace | 1.1 sec | Passed |
convert formats | 1.2 sec | Passed |
converting some specific sparkSQL types to avro | 1 sec | Passed |
correctly read long as date/timestamp type | 0.53 sec | Passed |
does not coerce null date/timestamp value to 0 epoch | 0.37 sec | Passed |
dsl test | 0.12 sec | Passed |
error handling for unsupported Interval data types | 0.19 sec | Passed |
log a warning of ignoreExtension deprecation | 0.88 sec | Passed |
old avro data source name works | 0.1 sec | Passed |
read avro file partitioned | 0.93 sec | Passed |
read avro with user defined schema: read non-exist columns | 0.46 sec | Passed |
read avro with user defined schema: read partial columns | 0.59 sec | Passed |
reading and writing partitioned data | 5.1 sec | Passed |
reading from invalid path throws exception | 0.48 sec | Passed |
reading from multiple paths | 0.4 sec | Passed |
rearrange internal schema | 0.63 sec | Passed |
request no fields | 0.14 sec | Passed |
resolve avro data source | 7 ms | Passed |
saving avro that has nested records with the same name | 0.67 sec | Passed |
saving avro that has nested records with the same name inside a map | 0.66 sec | Passed |
saving avro that has nested records with the same name inside an array | 0.7 sec | Passed |
sql test | 98 ms | Passed |
support Null data types | 1 sec | Passed |
support of globbed paths | 0.27 sec | Passed |
support of various data types | 1.8 sec | Passed |
support user provided avro schema | 0.17 sec | Passed |
support user provided avro schema for writing / reading fields with different ordering | 0.89 sec | Passed |
support user provided avro schema for writing non-nullable enum type | 0.93 sec | Passed |
support user provided avro schema for writing non-nullable fixed type | 1 sec | Passed |
support user provided avro schema for writing nullable enum type | 1 sec | Passed |
support user provided avro schema for writing nullable fixed type | 1 sec | Passed |
support user provided avro schema with defaults for missing fields | 0.11 sec | Passed |
support user provided non-nullable avro schema for nullable catalyst schema without any null record | 0.92 sec | Passed |
test load with non-Avro file | 0.74 sec | Passed |
test save and load | 0.96 sec | Passed |
throw exception if unable to write with user provided Avro schema | 1 sec | Passed |
union(float, double) is read as double | 0.36 sec | Passed |
union(float, double, null) is read as nullable double | 0.16 sec | Passed |
union(int, long) is read as long | 0.34 sec | Passed |
write with compression - sql configs | 4.9 sec | Passed |