Waitingforcode
APRIL 15, 2023
In my long - but not long enough! - journey with Apache Spark I've met the "checkpointing" world in the context of Structured Streaming mostly. But this term also applies to other modules including Apache Spark SQL, so batch processing!
Confessions of a Data Guy
APRIL 15, 2023
PySpark. One of those things to hate and love, well … kinda hard not to love. PySpark is the abstraction that lets a bazillion Data Engineers forget about that blight Scala and cuddle their wonderfully soft and ever-kind Python code, while choking down gobs of data like some Harkonnen glutton. But, that comes with […] The post The Dog Days of PySpark appeared first on Confessions of a Data Guy.
Expert insights. Personalized for you.
130 
Let's personalize your content