Skip to main content
DatabricksPySparkSnowflakeApache Airflow
Code Keys/PySpark Academy/Module 33
PYSPARK ACADEMY • MODULE 33

Streaming Advanced

Ingest continuous streams with readStream, ensure exactly-once recovery with checkpoints, apply event-time watermarking, and execute stream-stream joins.

Production📚 10 Lessons⭐ 0 / 8450 XP⏳ In Progress
0 / 10 Lessons Completed (0%)
CHALLENGE CURRICULUM

Module Lessons

0 / 10 Complete
LESSON 271

🔓 Structured Streaming Source with readStream

⏱ 3 Mins • ⭐ 800 XP • Production

Start Mission →
LESSON 272

🔒 Fault-Tolerant Checkpointing with writeStream

⏱ 3 Mins • ⭐ 810 XP • Production

LESSON 273

🔒 Streaming Output Modes: Append vs Complete vs Update

⏱ 3 Mins • ⭐ 820 XP • Production

LESSON 274

🔒 Event-Time Watermarking with withWatermark()

⏱ 3 Mins • ⭐ 830 XP • Production

LESSON 275

🔒 Tumbling Time Window Aggregations

⏱ 3 Mins • ⭐ 840 XP • Production

LESSON 276

🔒 Sliding (Hopping) Time Window Aggregations

⏱ 3 Mins • ⭐ 850 XP • Production

LESSON 277

🔒 Stream-Static Join for Real-Time Dimension Enrichment

⏱ 3 Mins • ⭐ 860 XP • Production

LESSON 278

🔒 Stream-Stream Join with Watermarking and Interval Constraints

⏱ 3 Mins • ⭐ 870 XP • Production

LESSON 279

🔒 Custom Micro-Batch Writing with foreachBatch

⏱ 3 Mins • ⭐ 880 XP • Production

LESSON 280

🔒 Production Real-Time Streaming Pipeline

⏱ 3 Mins • ⭐ 890 XP • Production

← Previous ModuleNext Module →