Injecting Current Date with current_date()

How do we stamp the current execution date onto all ingested records in an ETL pipeline?

Intermediate⏱ 2 Minutes⭐ 300 XP

🤔 THE QUESTION

How do we stamp the current execution date onto all ingested records in an ETL pipeline?

💡 WHAT IS IT?

current_date() returns the current calendar date as a DateType Column evaluated at query execution time.

🎯 WHAT IS IT USED FOR?

Batch ETL partitioning, daily audit stamping, and tracking lakehouse ingestion dates.

💻 EXAMPLE

from pyspark.sql.functions import current_date

df = df.withColumn("ingestion_date", current_date())

Practice typing production-grade PySpark code for Injecting Current Date with current_date().