Data Engineering Concepts

Master essential concepts through comprehensive series on Python, SQL, and cloud data processing patterns

Data Architecture: From Lake to Mesh

A comprehensive series on modern data architectures — Data Lake, Warehouse, Lakehouse, Data Mesh, Microsoft Fabric, Table Formats, and real-time streaming patterns. Companion to the Data's Grand Tour presentation.

Architecture Series

Data Architecture: From Lake to Mesh

01 Data Jargon 101: The Vocabulary of Modern Data Architecture 6 min read 02 Data Lake: The Foundation of Modern Data Architecture 4 min read 03 Modern Data Warehouse: Schema-on-Write at Cloud Scale 4 min read 04 Data Lakehouse: The Best of Both Worlds 5 min read 05 Data Mesh: Decentralising Data Ownership 5 min read 06 Microsoft Fabric: The Unified Analytics Platform 5 min read 07 Table Formats Revolution: Delta Lake, Iceberg & Hudi 6 min read 08 Architecture Comparison & Decision Framework 5 min read 09 Architecture Patterns: Medallion, Lambda, Kappa & Beyond 6 min read 10 Real-Time Data Architecture: Streaming at Scale 6 min read 11 Unstructured Data & Vector Embeddings in Modern Data Pipelines 6 min read 12 Data Architecture Glossary: A Business User's Reference 10 min read 13 Your Data Architecture Learning Path 5 min read

Azure & Cloud Data Engineering

Cloud data engineering patterns and Azure-specific implementations

Azure Series

Azure & Cloud Data Engineering

Cloud data engineering patterns and Azure-specific implementations

01 Azure Data Lake & Storage: Getting Started Guide 9 min read 02 Azure Data Factory: Orchestrating Data Pipelines 2 min read

Ensemble Models: From Trees to XGBoost

A hands-on series covering Decision Trees, Random Forests, Gradient Boosting, and XGBoost — from theory and math to practical Python pipelines with hyperparameter tuning.

Ensemble-Learning Series

Ensemble Models: From Trees to XGBoost

A hands-on series covering Decision Trees, Random Forests, Gradient Boosting, and XGBoost — from theory and math to practical Python pipelines with hyperparameter tuning.

01 Ensemble Models Part 1: Decision Trees & Random Forest 6 min read 02 Ensemble Models Part 2: Gradient Boosting & XGBoost 5 min read 03 Ensemble Models Part 3: Practical Pipeline & Hyperparameter Tuning 4 min read

Python Data Processing

Master data manipulation, analysis, and visualization with Python's powerful ecosystem

🐼 Pandas Series

Advanced Pandas Techniques & Optimization

Deep dive into advanced Pandas patterns, performance optimization, and complex data operations.

01 Pandas 101: Data Manipulation in Python 2 min read 02 Subsetting a DataFrame in Pandas 7 min read 03 pandas groupby() — A Practical Guide 6 min read 04 Advanced pandas GroupBy and Window Functions 7 min read

🔥 Polars Series

From Pandas to Polars: Complete Migration Guide

Master the next-generation DataFrame library with expression-based programming, lazy evaluation, and blazing-fast performance.

01 From Pandas to Polars: A Paradigm Shift in DataFrame Processing 10 min read 03 Mastering Polars Data Types and Missing Values 3 min read 08 Advanced Polars Expressions: String Operations & Complex Data Types 6 min read

⚡ PySpark Series

From Pandas to PySpark: Distributed Data Engineering

Learn PySpark from a Pandas perspective — covering Spark SQL, window functions, joins, datetime operations, schema handling, and performance optimization.

01 PySpark Data Patterns: From Pandas User to Spark Developer 7 min read 02 PySpark Datetime Cheatsheet — For Pandas Users 6 min read 03 Python Logging Module — A Brief Course for Pandas & PySpark Users 7 min read 04 Filtering Large DataFrames in PySpark: isin vs Broadcast Join 8 min read 05 Spark Schema Handling: Infer, Define, or Cast? 4 min read

SQL & Database Patterns

Learn query patterns, optimization techniques, and database best practices

Sql Series

SQL & Database Patterns

Learn query patterns, optimization techniques, and database best practices

01 SQL Basics & Query Patterns 8 min read 02 Advanced SQL: Window Functions & CTEs 2 min read