Test Result : FileStreamSourceSuite

0 failures (±0)

61 tests (±0)

Took 30 sec.

All Tests

Test name	Duration	Status
0 log format	2 ms	Passed
0 offset json format	2 ms	Passed
0 offset long format	0 ms	Passed
FileStreamSource - latestFirst	0.65 sec	Passed
FileStreamSource schema: json, existing files, no schema	52 ms	Passed
FileStreamSource schema: json, existing files, schema	12 ms	Passed
FileStreamSource schema: json, no existing files, no schema	11 ms	Passed
FileStreamSource schema: no path	6 ms	Passed
FileStreamSource schema: orc, existing files, no schema	0.21 sec	Passed
FileStreamSource schema: orc, existing files, schema	0.17 sec	Passed
FileStreamSource schema: parquet, existing files, no schema	0.23 sec	Passed
FileStreamSource schema: parquet, existing files, schema	0.14 sec	Passed
FileStreamSource schema: path doesn't exist (with schema) should throw exception	8 ms	Passed
FileStreamSource schema: path doesn't exist (without schema) should throw exception	7 ms	Passed
FileStreamSource schema: text, existing files, no schema	11 ms	Passed
FileStreamSource schema: text, existing files, schema	11 ms	Passed
FileStreamSource schema: text, no existing files, no schema	12 ms	Passed
Once	1.1 sec	Passed
Option pathGlobFilter	0.46 sec	Passed
SPARK-17165 should not track the list of seen files indefinitely	1.3 sec	Passed
SPARK-17372 - write file names to WAL as Array[String]	5.3 sec	Passed
SPARK-18433: Improve DataSource option keys to be more case-insensitive	1 ms	Passed
SPARK-19813: Ignore maxFileAge when maxFilesPerTrigger and latestFirst is used	0.28 sec	Passed
SPARK-21996 read from text files -- file name has space	0.22 sec	Passed
SPARK-21996 read from text files generated by file sink -- file name has space	0.53 sec	Passed
SPARK-26629: multiple file sources work with restarts when a source does not have data	0.9 sec	Passed
SPARK-28651: force streaming file source to be nullable	25 ms	Passed
SPARK-31935: Hadoop file system config should be effective in data source options	8 ms	Passed
SeenFilesMap	0 ms	Passed
SeenFilesMap should only consider a file old if it is earlier than last purge time	1 ms	Passed
SeenFilesMap with fileNameOnly = true	1 ms	Passed
SourceFileArchiver - different filesystems between source and archive	1 ms	Passed
SourceFileArchiver - fail when base archive path matches source pattern	2 ms	Passed
Throw UnsupportedOperationException on configuring archive when source path refers the output dir of FileStreamSink	0.1 sec	Passed
Throw UnsupportedOperationException on configuring delete when source path refers the output dir of FileStreamSink	92 ms	Passed
compact interval metadata log	0.83 sec	Passed
do not recheck that files exist during getBatch	51 ms	Passed
explain	0.25 sec	Passed
fault tolerance	0.57 sec	Passed
get arbitrary batch from FileStreamSource	0.69 sec	Passed
input row metrics	0.18 sec	Passed
max files per trigger	1.4 sec	Passed
max files per trigger - incorrect values	0.19 sec	Passed
move completed files to archive directory when archive option is enabled	1 sec	Passed
read data from outputs of another streaming query	1 sec	Passed
read from json files	0.52 sec	Passed
read from json files with inferring schema	0.23 sec	Passed
read from orc files	1 sec	Passed
read from orc files with changing schema	1.2 sec	Passed
read from parquet files	0.88 sec	Passed
read from parquet files with changing schema	1.2 sec	Passed
read from text files	0.61 sec	Passed
read from textfile	0.69 sec	Passed
read new files in nested directories with globbing	0.91 sec	Passed
read new files in partitioned table with globbing, should not read partition data	0.74 sec	Passed
read new files in partitioned table without globbing, should read partition data	0.7 sec	Passed
reading from json files inside partitioned directory	0.24 sec	Passed
reading from json files with changing schema	0.57 sec	Passed
remove completed files when remove option is enabled	0.81 sec	Passed
start before another streaming query, and read its output	0.41 sec	Passed
when schema inference is turned on, should read partition data	0.89 sec	Passed