Injecting Constant Literals with lit()

How do we append a constant environment tag to every record using the lit() function?

Intermediate⏱ 2 Minutes⭐ 260 XP

🤔 THE QUESTION

How do we append a constant environment tag to every record using the lit() function?

💡 WHAT IS IT?

lit() converts a primitive Python string, integer, or float into a Spark Column literal.

🎯 WHAT IS IT USED FOR?

Tagging pipeline source systems, environment identifiers, partition keys, and audit metadata.

💻 EXAMPLE

from pyspark.sql.functions import lit

df = df.withColumn("environment", lit("PRODUCTION"))

Practice typing production-grade PySpark code for Injecting Constant Literals with lit().