Test Result : FileStreamSourceSuite

0 failures (±0)
60 tests (±0)
Took 1 min 10 sec.

All Tests

Test nameDurationStatus
0 log format3 msPassed
0 offset json format3 msPassed
0 offset long format1 msPassed
FileStreamSource - latestFirst2.4 secPassed
FileStreamSource schema: json, existing files, no schema81 msPassed
FileStreamSource schema: json, existing files, schema15 msPassed
FileStreamSource schema: json, no existing files, no schema24 msPassed
FileStreamSource schema: no path7 msPassed
FileStreamSource schema: orc, existing files, no schema0.34 secPassed
FileStreamSource schema: orc, existing files, schema0.26 secPassed
FileStreamSource schema: parquet, existing files, no schema0.35 secPassed
FileStreamSource schema: parquet, existing files, schema0.23 secPassed
FileStreamSource schema: path doesn't exist (with schema) should throw exception12 msPassed
FileStreamSource schema: path doesn't exist (without schema) should throw exception10 msPassed
FileStreamSource schema: text, existing files, no schema20 msPassed
FileStreamSource schema: text, existing files, schema20 msPassed
FileStreamSource schema: text, no existing files, no schema16 msPassed
Once2.1 secPassed
Option pathGlobFilter1.3 secPassed
SPARK-17165 should not track the list of seen files indefinitely1.6 secPassed
SPARK-17372 - write file names to WAL as Array[String]9.9 secPassed
SPARK-18433: Improve DataSource option keys to be more case-insensitive0 msPassed
SPARK-19813: Ignore maxFileAge when maxFilesPerTrigger and latestFirst is used1.1 secPassed
SPARK-21996 read from text files -- file name has space0.21 secPassed
SPARK-21996 read from text files generated by file sink -- file name has space0.45 secPassed
SPARK-26629: multiple file sources work with restarts when a source does not have data6.9 secPassed
SPARK-28651: force streaming file source to be nullable89 msPassed
SeenFilesMap0 msPassed
SeenFilesMap should only consider a file old if it is earlier than last purge time1 msPassed
SeenFilesMap with fileNameOnly = true0.23 secPassed
SourceFileArchiver - different filesystems between source and archive2 msPassed
SourceFileArchiver - fail when base archive path matches source pattern4 msPassed
Throw UnsupportedOperationException on configuring archive when source path refers the output dir of FileStreamSink0.14 secPassed
Throw UnsupportedOperationException on configuring delete when source path refers the output dir of FileStreamSink0.21 secPassed
compact interval metadata log1.6 secPassed
do not recheck that files exist during getBatch0.42 secPassed
explain0.35 secPassed
fault tolerance0.69 secPassed
get arbitrary batch from FileStreamSource1.6 secPassed
input row metrics0.46 secPassed
max files per trigger2.1 secPassed
max files per trigger - incorrect values0.35 secPassed
move completed files to archive directory when archive option is enabled2.1 secPassed
read data from outputs of another streaming query1.5 secPassed
read from json files0.86 secPassed
read from json files with inferring schema1.7 secPassed
read from orc files2 secPassed
read from orc files with changing schema7.4 secPassed
read from parquet files1.6 secPassed
read from parquet files with changing schema2.1 secPassed
read from text files1.5 secPassed
read from textfile1.1 secPassed
read new files in nested directories with globbing4.5 secPassed
read new files in partitioned table with globbing, should not read partition data1.2 secPassed
read new files in partitioned table without globbing, should read partition data1 secPassed
reading from json files inside partitioned directory1.5 secPassed
reading from json files with changing schema0.96 secPassed
remove completed files when remove option is enabled0.8 secPassed
start before another streaming query, and read its output0.6 secPassed
when schema inference is turned on, should read partition data1.4 secPassed