Format Validation via Regular Expressions

How can we validate that string fields like emails, phone numbers, or zip codes match expected standard regex formats?

Advanced⏱ 3 Minutes⭐ 830 XP

🤔 THE QUESTION

How can we validate that string fields like emails, phone numbers, or zip codes match expected standard regex formats?

💡 WHAT IS IT?

rlike() tests strings against regular expressions returning boolean true for compliant patterns.

🎯 WHAT IS IT USED FOR?

Validating email format compliance and zip code formats before marketing pipeline activation.

💻 EXAMPLE

df_valid_email = df.filter(col("email").rlike("^[a-zA-Z0-9._%+-]+@[a-zA-Z0-9.-]+\\.[a-zA-Z]{2,}$"))

Practice typing production-grade PySpark code for Format Validation via Regular Expressions.