Test Result : FileStreamSourceSuite

0 failures (±0)
61 tests (+9)
Took 1 min 15 sec.

All Tests

Test nameDurationStatus
0 log format95 msPassed
0 offset json format2 msPassed
0 offset long format1 msPassed
FileStreamSource - latestFirst0.56 secPassed
FileStreamSource schema: json, existing files, no schema69 msPassed
FileStreamSource schema: json, existing files, schema13 msPassed
FileStreamSource schema: json, no existing files, no schema12 msPassed
FileStreamSource schema: no path8 msPassed
FileStreamSource schema: orc, existing files, no schema0.11 secPassed
FileStreamSource schema: orc, existing files, schema98 msPassed
FileStreamSource schema: parquet, existing files, no schema0.19 secPassed
FileStreamSource schema: parquet, existing files, schema0.11 secPassed
FileStreamSource schema: path doesn't exist (with schema) should throw exception8 msPassed
FileStreamSource schema: path doesn't exist (without schema) should throw exception8 msPassed
FileStreamSource schema: text, existing files, no schema10 msPassed
FileStreamSource schema: text, existing files, schema10 msPassed
FileStreamSource schema: text, no existing files, no schema10 msPassed
Once0.99 secPassed
Option pathGlobFilter1.3 secPassed
SPARK-17165 should not track the list of seen files indefinitely2.3 secPassed
SPARK-17372 - write file names to WAL as Array[String]10 secPassed
SPARK-18433: Improve DataSource option keys to be more case-insensitive0 msPassed
SPARK-19813: Ignore maxFileAge when maxFilesPerTrigger and latestFirst is used0.33 secPassed
SPARK-21996 read from text files -- file name has space2.3 secPassed
SPARK-21996 read from text files generated by file sink -- file name has space2.4 secPassed
SPARK-26629: multiple file sources work with restarts when a source does not have data3.3 secPassed
SPARK-28651: force streaming file source to be nullable35 msPassed
SPARK-31935: Hadoop file system config should be effective in data source options9 msPassed
SeenFilesMap0 msPassed
SeenFilesMap should only consider a file old if it is earlier than last purge time0 msPassed
SeenFilesMap with fileNameOnly = true1 msPassed
SourceFileArchiver - different filesystems between source and archive2 msPassed
SourceFileArchiver - fail when base archive path matches source pattern3 msPassed
Throw UnsupportedOperationException on configuring archive when source path refers the output dir of FileStreamSink2.7 secPassed
Throw UnsupportedOperationException on configuring delete when source path refers the output dir of FileStreamSink0.22 secPassed
compact interval metadata log2.7 secPassed
do not recheck that files exist during getBatch59 msPassed
explain0.29 secPassed
fault tolerance0.51 secPassed
get arbitrary batch from FileStreamSource0.72 secPassed
input row metrics0.2 secPassed
max files per trigger1.8 secPassed
max files per trigger - incorrect values0.8 secPassed
move completed files to archive directory when archive option is enabled1.2 secPassed
read data from outputs of another streaming query6.2 secPassed
read from json files0.6 secPassed
read from json files with inferring schema0.24 secPassed
read from orc files2.2 secPassed
read from orc files with changing schema7.8 secPassed
read from parquet files8.7 secPassed
read from parquet files with changing schema3.6 secPassed
read from text files0.83 secPassed
read from textfile0.61 secPassed
read new files in nested directories with globbing0.82 secPassed
read new files in partitioned table with globbing, should not read partition data0.63 secPassed
read new files in partitioned table without globbing, should read partition data0.86 secPassed
reading from json files inside partitioned directory0.27 secPassed
reading from json files with changing schema2.8 secPassed
remove completed files when remove option is enabled0.87 secPassed
start before another streaming query, and read its output0.58 secPassed
when schema inference is turned on, should read partition data1 secPassed