spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From German Schiavon <gschiavonsp...@gmail.com>
Subject Property spark.sql.streaming.minBatchesToRetain
Date Tue, 09 Mar 2021 12:27:11 GMT
Hello all,

I wanted to ask if this property is still active? I can't find it in the
doc https://spark.apache.org/docs/latest/configuration.html or anywhere in
the code(only in Tests).

If so, should we remove it?

val MIN_BATCHES_TO_RETAIN = buildConf("spark.sql.streaming.minBatchesToRetain")
  .internal()
  .doc("The minimum number of batches that must be retained and made
recoverable.")
  .version("2.1.1")
  .intConf
  .createWithDefault(100)

Mime
View raw message