What's new in Apache Spark 3.5.0 - watermark propagation
Waitingforcode
NOVEMBER 1, 2023
Watermark, or rather multiple watermarks management, has been a thorn in the side of Apache Spark Structured Streaming. It has improved in the previous release (3.4.0) but still had some room for improvement. Well, it did have because the 3.5.0 release brought a serious fix for the multiple watermarks scenario.
Let's personalize your content