iceberg_compaction_commit_batch_size
Number of merged data files that background Iceberg compaction accumulates before publishing them in a new snapshot. Compaction results are published in any case once there are no candidates left to compact, so this setting only bounds how long already merged files stay unpublished while compaction keeps finding new work.0 restores the old behaviour
of publishing only when compaction runs out of candidates - a state that is never reached while the table keeps
receiving new data files, so every merged output is then written to object storage and never referenced by a snapshot.
iceberg_compaction_data_cleanup
The time after which the data will be deleted.iceberg_compaction_delay_bias
Minimum time of delay between 2 background compaction operations.iceberg_compaction_max_bytes_in_data_file
Max bytes of an iceberg parquet data file produced by compaction. Defaults to the maximum so that compaction merges eligible files into as few output files as possible.iceberg_compaction_max_rows_in_data_file
Max rows of an iceberg parquet data file produced by compaction. Defaults to the maximum so that compaction merges eligible files into as few output files as possible. Keeping this above the size compaction can actually produce would make every output file stay belowiceberg_data_file_size_lower_threshold_compaction and be re-selected forever.