#Data Architecture

Tags: 14 posts

September 19, 2025 3 min read

Data's Grand Tour: Navigating the Modern Data Architecture Maze

We’re excited to share the complete materials from our session at Flo 2025: Data’s Grand Tour — Navigating the Modern Data Architecture Maze. This 45-minute presentation covers the full landscape of modern data architectures, from …
September 19, 2025 5 min read

Your Data Architecture Learning Path

This guide maps out the recommended reading order through the Data Architecture series and points you to the best external resources for hands-on learning at each stage. Whether you’re a complete beginner or an experienced engineer filling …
September 19, 2025 10 min read

Data Architecture Glossary: A Business User's Reference

This glossary is written for business users, product managers, and data-adjacent stakeholders who need to understand what their data engineering teams are talking about. Each term includes a plain-English definition, the business impact it has, and a …
September 19, 2025 6 min read

Unstructured Data & Vector Embeddings in Modern Data Pipelines

For decades, data platforms focused almost exclusively on structured data — rows and columns in relational tables. But 80–90% of enterprise data is unstructured: emails, documents, call recordings, product images, sensor readings, social media posts, …
September 19, 2025 6 min read

Real-Time Data Architecture: Streaming at Scale

Real-time data architecture answers a fundamental business question: “What is happening right now?” — fraud happening in the last 30 seconds, system anomalies in the last 5 minutes, inventory changes in the last hour. This guide covers …
September 19, 2025 6 min read

Architecture Patterns: Medallion, Lambda, Kappa & Beyond

Understanding individual architectures (Lake, Warehouse, Lakehouse) is one thing — but how do you actually pattern your data flows within them? This article covers the recurring design patterns that appear across every modern data platform. Medallion …
September 19, 2025 5 min read

Architecture Comparison & Decision Framework

After exploring each architecture in depth, the critical question becomes: how do you choose? This article provides a structured comparison and a practical decision framework to help you select the right architecture for your organisation’s …
September 19, 2025 6 min read

Table Formats Revolution: Delta Lake, Iceberg & Hudi

Open table formats are the technological revolution at the heart of the modern data lakehouse. They transform simple object storage (ADLS, S3, GCS) — which is fundamentally immutable and lacks any concept of transactions — into reliable, queryable, …
September 19, 2025 5 min read

Microsoft Fabric: The Unified Analytics Platform

Microsoft Fabric (generally available since November 2023) is Microsoft’s answer to the fragmentation of the modern data stack. Rather than stitching together Azure Synapse, Azure Data Factory, Azure Data Lake, Power BI, and Azure Machine …
September 19, 2025 5 min read

Data Mesh: Decentralising Data Ownership

Data Mesh is not just a technology choice — it is a socio-technical paradigm shift in how organisations think about data ownership, responsibility, and architecture. Coined by Zhamak Dehghani at ThoughtWorks in 2019, it challenges the centralised …