SPARK-18342: commit fails when rename fails | 25 ms | Passed |
SPARK-18416: do not create temp delta file until the store is updated | 98 ms | Passed |
SPARK-19677: Committing a delta file atop an existing one should not fail on HDFS | 32 ms | Passed |
SPARK-21145: Restarted queries create new provider instances | 0.63 sec | Passed |
SPARK-34270: StateStoreMetrics.combine should not override individual metrics | 4 ms | Passed |
StateStore.get | 77 ms | Passed |
abort - with codec lz4 | 46 ms | Passed |
abort - with codec lzf | 45 ms | Passed |
abort - with codec org.apache.spark.io.LZ4CompressionCodec | 46 ms | Passed |
abort - with codec org.apache.spark.io.LZFCompressionCodec | 46 ms | Passed |
abort - with codec org.apache.spark.io.SnappyCompressionCodec | 46 ms | Passed |
abort - with codec org.apache.spark.io.ZStdCompressionCodec | 46 ms | Passed |
abort - with codec snappy | 46 ms | Passed |
abort - with codec zstd | 46 ms | Passed |
cleaning | 0.47 sec | Passed |
corrupted file handling | 0.25 sec | Passed |
error writing [version].delta cancels the output stream | 99 ms | Passed |
expose metrics with custom metrics to StateStoreMetrics | 98 ms | Passed |
failure after committing with MAX_BATCHES_TO_RETAIN_IN_MEMORY set to 1 | 0.13 sec | Passed |
get, put, remove, commit, and all data iterator - with codec lz4 | 0.21 sec | Passed |
get, put, remove, commit, and all data iterator - with codec lzf | 0.21 sec | Passed |
get, put, remove, commit, and all data iterator - with codec org.apache.spark.io.LZ4CompressionCodec | 0.2 sec | Passed |
get, put, remove, commit, and all data iterator - with codec org.apache.spark.io.LZFCompressionCodec | 0.2 sec | Passed |
get, put, remove, commit, and all data iterator - with codec org.apache.spark.io.SnappyCompressionCodec | 0.2 sec | Passed |
get, put, remove, commit, and all data iterator - with codec org.apache.spark.io.ZStdCompressionCodec | 0.19 sec | Passed |
get, put, remove, commit, and all data iterator - with codec snappy | 0.21 sec | Passed |
get, put, remove, commit, and all data iterator - with codec zstd | 0.22 sec | Passed |
getStore with invalid versions - with codec lz4 | 58 ms | Passed |
getStore with invalid versions - with codec lzf | 58 ms | Passed |
getStore with invalid versions - with codec org.apache.spark.io.LZ4CompressionCodec | 58 ms | Passed |
getStore with invalid versions - with codec org.apache.spark.io.LZFCompressionCodec | 58 ms | Passed |
getStore with invalid versions - with codec org.apache.spark.io.SnappyCompressionCodec | 58 ms | Passed |
getStore with invalid versions - with codec org.apache.spark.io.ZStdCompressionCodec | 58 ms | Passed |
getStore with invalid versions - with codec snappy | 59 ms | Passed |
getStore with invalid versions - with codec zstd | 58 ms | Passed |
maintenance | 0.92 sec | Passed |
no cache data with MAX_BATCHES_TO_RETAIN_IN_MEMORY set to 0 | 98 ms | Passed |
numKeys metrics - with codec lz4 | 97 ms | Passed |
numKeys metrics - with codec lzf | 0.15 sec | Passed |
numKeys metrics - with codec org.apache.spark.io.LZ4CompressionCodec | 95 ms | Passed |
numKeys metrics - with codec org.apache.spark.io.LZFCompressionCodec | 94 ms | Passed |
numKeys metrics - with codec org.apache.spark.io.SnappyCompressionCodec | 96 ms | Passed |
numKeys metrics - with codec org.apache.spark.io.ZStdCompressionCodec | 95 ms | Passed |
numKeys metrics - with codec snappy | 97 ms | Passed |
numKeys metrics - with codec zstd | 96 ms | Passed |
removing while iterating - with codec lz4 | 50 ms | Passed |
removing while iterating - with codec lzf | 48 ms | Passed |
removing while iterating - with codec org.apache.spark.io.LZ4CompressionCodec | 48 ms | Passed |
removing while iterating - with codec org.apache.spark.io.LZFCompressionCodec | 48 ms | Passed |
removing while iterating - with codec org.apache.spark.io.SnappyCompressionCodec | 48 ms | Passed |
removing while iterating - with codec org.apache.spark.io.ZStdCompressionCodec | 48 ms | Passed |
removing while iterating - with codec snappy | 48 ms | Passed |
removing while iterating - with codec zstd | 48 ms | Passed |
reports memory usage | 40 ms | Passed |
reports memory usage on current version | 40 ms | Passed |
retaining only two latest versions when MAX_BATCHES_TO_RETAIN_IN_MEMORY set to 2 | 0.13 sec | Passed |
snapshotting | 0.55 sec | Passed |
two concurrent StateStores - one for read-only and one for read-write - with codec lz4 | 98 ms | Passed |
two concurrent StateStores - one for read-only and one for read-write - with codec lzf | 97 ms | Passed |
two concurrent StateStores - one for read-only and one for read-write - with codec org.apache.spark.io.LZ4CompressionCodec | 0.1 sec | Passed |
two concurrent StateStores - one for read-only and one for read-write - with codec org.apache.spark.io.LZFCompressionCodec | 97 ms | Passed |
two concurrent StateStores - one for read-only and one for read-write - with codec org.apache.spark.io.SnappyCompressionCodec | 98 ms | Passed |
two concurrent StateStores - one for read-only and one for read-write - with codec org.apache.spark.io.ZStdCompressionCodec | 97 ms | Passed |
two concurrent StateStores - one for read-only and one for read-write - with codec snappy | 98 ms | Passed |
two concurrent StateStores - one for read-only and one for read-write - with codec zstd | 95 ms | Passed |