Skip to main content
DatabricksPySparkSnowflakeApache Airflow
← Code Keys Overview/PySpark Developer Track
⚡ PYSPARK ENGINEERING ACADEMY

Production PySpark Developer

Master distributed Apache Spark transformations, window analytics, and enterprise data engineering pipelines through hands-on touch typing.

▶
START FIRST LESSONLesson 01: Import PySpark
→
PROGRESS0 / 300 Lessons (0%)
EARNED XP0 / 206,665 XP
CURRICULUM DEPTH35 Modules • 300 Lessons
TRACK COMPLETION0%

PySpark Curriculum Roadmap

Select a module to view lessons. Practice touch typing on live PySpark DataFrame queries.

▼MODULE 01

PySpark Foundations

Beginner
0 / 8
+1040 XP🟢 In ProgressOverview ↗
LESSON 01+100 XP

Import PySpark

▶ Start Mission →
LESSON 02+110 XP

Import SparkSession

LESSON 03+120 XP

Create SparkSession

LESSON 04+130 XP

Local Master Configuration

LESSON 05+135 XP

SparkContext Awareness

LESSON 06+140 XP

Create DataFrame from In-Memory Data

LESSON 07+145 XP

Display DataFrame Contents

LESSON 08+160 XP

Basic End-to-End PySpark Workflow

▶MODULE 02

DataFrames Fundamentals

Beginner
0 / 8
+1195 XP🔒 LockedOverview ↗
▶MODULE 03

Reading Data

Beginner
0 / 8
+1420 XP🔒 LockedOverview ↗
▶MODULE 04

Selecting Data

Beginner
0 / 8
+1480 XP🔒 LockedOverview ↗
▶MODULE 05

Filtering Data

Beginner
0 / 8
+1550 XP🔒 LockedOverview ↗
▶MODULE 06

Column Transformations

Intermediate
0 / 8
+2330 XP🔒 LockedOverview ↗
▶MODULE 07

String Functions

Intermediate
0 / 8
+2540 XP🔒 LockedOverview ↗
▶MODULE 08

Date & Timestamp Functions

Intermediate
0 / 8
+2700 XP🔒 LockedOverview ↗
▶MODULE 09

Handling NULL Values

Intermediate
0 / 8
+2900 XP🔒 LockedOverview ↗
▶MODULE 10

Aggregations

Intermediate
0 / 8
+3130 XP🔒 LockedOverview ↗
▶MODULE 11

GROUP BY

Intermediate
0 / 8
+3390 XP🔒 LockedOverview ↗
▶MODULE 12

JOINs

Intermediate
0 / 8
+3610 XP🔒 LockedOverview ↗
▶MODULE 13

Advanced JOINs

Advanced
0 / 8
+4390 XP🔒 LockedOverview ↗
▶MODULE 14

Window Functions

Advanced
0 / 8
+4770 XP🔒 LockedOverview ↗
▶MODULE 15

Advanced Window Analytics

Advanced
0 / 8
+5350 XP🔒 LockedOverview ↗
▶MODULE 16

PySpark SQL

Advanced
0 / 8
+5400 XP🔒 LockedOverview ↗
▶MODULE 17

Schemas & Data Types

Advanced
0 / 8
+5520 XP🔒 LockedOverview ↗
▶MODULE 18

Nested & Complex Data

Advanced
0 / 8
+5870 XP🔒 LockedOverview ↗
▶MODULE 19

UDFs & Advanced Functions

Expert
0 / 8
+6400 XP🔒 LockedOverview ↗
▶MODULE 20

Pandas UDFs & Vectorized Processing

Expert
0 / 8
+6900 XP🔒 LockedOverview ↗
▶MODULE 21

File Formats & Data Engineering

Expert
0 / 8
+7310 XP🔒 LockedOverview ↗
▶MODULE 22

Performance & Optimization

Expert
0 / 8
+7700 XP🔒 LockedOverview ↗
▶MODULE 23

Structured Streaming

Production
0 / 8
+9630 XP🔒 LockedOverview ↗
▶MODULE 24

Production Data Engineering

Production
0 / 8
+11280 XP🔒 LockedOverview ↗
▶MODULE 25

PySpark Production Challenges

Production
0 / 8
+14250 XP🔒 LockedOverview ↗
▶MODULE 26

Advanced Transformations

Advanced
0 / 10
+8450 XP🔒 LockedOverview ↗
▶MODULE 27

Data Quality

Advanced
0 / 10
+8450 XP🔒 LockedOverview ↗
▶MODULE 28

Deduplication

Advanced
0 / 10
+8450 XP🔒 LockedOverview ↗
▶MODULE 29

Advanced Windows

Advanced
0 / 10
+8450 XP🔒 LockedOverview ↗
▶MODULE 30

Performance Engineering

Expert
0 / 10
+8450 XP🔒 LockedOverview ↗
▶MODULE 31

Spark SQL Advanced

Expert
0 / 10
+8450 XP🔒 LockedOverview ↗
▶MODULE 32

File & Storage Engineering

Expert
0 / 10
+8450 XP🔒 LockedOverview ↗
▶MODULE 33

Streaming Advanced

Production
0 / 10
+8450 XP🔒 LockedOverview ↗
▶MODULE 34

Data Engineering Scenarios

Production
0 / 10
+8450 XP🔒 LockedOverview ↗
▶MODULE 35

PySpark Expert Capstone

Production
0 / 10
+8560 XP🔒 LockedOverview ↗