Hard PySpark problems

16 hard PySpark coding problems for senior data engineer interviews. Write DataFrame code and get graded instantly.

• Three-Day Login Streak · Hard · Window Functions
• Subtotals with ROLLUP · Hard · Pivot, Unpivot & Rollup
• All Combinations with CUBE · Hard · Pivot, Unpivot & Rollup
• Pivot with Several Aggregations · Hard · Pivot, Unpivot & Rollup
• Trailing 3 Calendar Days (Range Frame) · Hard · Window Functions
• Forward-Fill Missing Readings · Hard · Window Functions
• Sessionize a Clickstream · Hard · Window Functions
• Consecutive Status Runs (Gaps and Islands) · Hard · Window Functions
• Build an SCD Type 2 History · Hard · Window Functions
• Upsert: Merge New Records into a Table · Hard · Window Functions
• Price Valid at Order Time (Range Join) · Hard · Joins
• Reconcile Two Sources (Full Outer Join) · Hard · Joins
• Fill Missing Dates (Calendar Spine) · Hard · Joins
• Customers Who Bought Every Product · Hard · Joins
• Conversion Funnel · Hard · Aggregations
• Monthly Retention by Cohort · Hard · Joins

Browse

Topics: Window Functions · Joins · Aggregations · Pivot, Unpivot & Rollup · Arrays · Null Handling · Conditional Logic · Dates · Filtering & Selection · Strings

Difficulty: Easy · Medium · Hard · PySpark interview roadmap · All problems