#data-architecture

ART TCH

SE Sendoa Moronta

The Hard Parts of Dimensional Modeling

Grain, multi-valued dimensions, temporal facts and the edge cases that break otherwise correct analytical models

Aug 11, 2026 · 11 min read · 0 claps paywalled #data-engineering #data-architecture #data-modeling

ART TCH ECO

MA Manoj Gupta

The 4 Principles of Data Mesh Explained — With a Real Banking Architecture

In my previous article, “Data Mesh Explained Simply: Why Traditional Data Teams Don’t Scale,” I explained why centralized data teams often…

Aug 08, 2026 · 6 min read · 0 claps #data-mesh-architecture #data-architecture #data-mesh-implementation

ART TCH MKT AI

MY MyData Insights

How to Design a Medallion Architecture for Manufacturing Data: A Practical Guide

Turn fragmented ERP, MES, SCADA and IoT data into trusted analytics with a Bronze–Silver–Gold Medallion Architecture — the layers, the…

Aug 04, 2026 · 5 min read · 0 claps #medallion-architecture #manufacturing-analytics #data-platforms

AI ART TCH

LE Leohuang

【硬核大師班】Agent 上線後都在偷偷胡說八道？深度拆解複合型 AI (Compound AI) 與 Mosaic AI Agent Evaluation 評估演算法

前言：那個被「非確定性輸出」徹底擊潰的 QA 團隊

Aug 02, 2026 · 6 min read · 0 claps #databricks #ai-agent #mosaicaiagentevaluation

ART TCH

AV Avigarg

Snowflake Dynamic Tables Just Got Smarter with Adaptive Refresh

How Adaptive Refresh differs from AUTO — and why it matters for real-world data pipelines

Aug 01, 2026 · 5 min read · 0 claps paywalled #snowflake #snowflake-dynamic-table #data-engineering

ART

KA Kanerika Inc

Top 10 Data Strategy Companies in 2026: How to Find the Right Partner for Your Program

Every data strategy pitch deck reads the same. A maturity assessment, a target-state architecture, a phased roadmap, a promise to align…

Jul 28, 2026 · 10 min read · 0 claps #data-strategy #data-strategy-consulting #data-architecture

AI ART TCH

LE Leohuang

【硬核大師班】AI 只能看不能動？深度拆解 Databricks LTAP 引擎與 Genie Agent 的全雙工自主架構

前言：那個「只會出張嘴」的殘缺 AI 助理

Jul 25, 2026 · 8 min read · 0 claps #databricks #ltap #databricks-genie

ART ECO HUM TCH

TE Techloom.ai Pvt Ltd

Database Normalization: A Complete Guide to Organizing Databases Efficiently

Every modern application relies on well-organized data. Whether you’re building an e-commerce platform, banking system, or student portal…

Jul 21, 2026 · 8 min read · 0 claps #database-normalization #rdbms #database-design

ART TCH MKT

SU Sudibyo Dwicahyo

Data Warehouse di Era Modern Big Data Architecture: Masih Relevan atau Mulai Tergantikan?

Pertanyaan ini muncul ketika dari postingan sebelumnya menyebutkan bahwa Data Lakehouse merupakan pendekatan modern terkait kebutuhan…

Jul 20, 2026 · 6 min read · 0 claps #data-analytics #big-data #data-architecture

ART TCH MDA MKT

BR Bran Kop, Engineer @Conformal, Founder of aiHQ · Towards Data Engineering

Batch and Streaming: Two Sides of the Data Architecture Coin

Every system that processes data eventually confronts one fundamental question: When is the data complete enough to be moved to the compute…

Jul 17, 2026 · 5 min read · 28 claps #data-engineering #stream-processing #data-architecture

ART TCH AI SCI

RU Rutvij Acharya · Towards Data Engineering

The Data Engineering Landscape Is Shifting Fast. Here’s What Actually Matters.

By Rutvij Acharya — Lead Data & Integration Engineer | SnapLogic Architect

Jul 15, 2026 · 8 min read · 54 claps #data-science #data-architecture #data-engineering

ART TCH AI

KU Kushalvishwa · Towards Data Engineering

When Should You Use Liquid Clustering? A Practitioner’s Benchmark of Lakehouse Layout Strategies”

Liquid Clustering vs ZOrder Benchmark

Jul 15, 2026 · 8 min read · 5 claps #data-engineering #data-lakehouse #programming

ART AI SCI HUM

BE Bernd Wessely · AI Advances

Why IT Should Embrace Its Black Sheep

From Shadow IT to Digital Mirror — Why the secret solutions developed by business units are the most precise requirements for Enterprise IT

Jul 15, 2026 · 8 min read · 200 claps paywalled #enterprise-architecture #software-development #data-science

ART

MU Muthupalaniappan Ramanathan

We Saved Millions Without Optimizing a Single Query

The architectural decision that changed how we thought about data platforms forever.

Jul 14, 2026 · 3 min read · 0 claps #data #data-architecture #data-lake

ART MKT

VA varleneheidi

Lead to Account Matching for Salesforce: Full Setup Guide

Lead to Account Matching for Salesforce is the process of connecting a new Lead record to the correct existing Account before it gets…

Jul 14, 2026 · 6 min read · 0 claps #salesforce #revops #data-architecture

ART TCH

JA Jaco van der Laan · Towards Data Engineering

Source Modeling: The Missing Workflow

Every data platform assumes the source model is a given. In banks, it almost never is — here’s the workflow nobody named and the role…

Jul 13, 2026 · 8 min read · 1 claps paywalled #data-engineering #data-modeling #data-architecture

AI ART TCH MDA

NA Naveena · Towards Data Engineering

How We Replaced Text-to-SQL Wrappers with a Warehouse-Native Cortex Layer for ITAM Compliance

A compliance manager asks: “Show me unattested IBM DB2 installations.”

Jul 12, 2026 · 5 min read · 0 claps #snowflake #data-engineering #generative-ai

AI ART

MA Max Krupenin

From hand-built to self-building: how data platforms evolve in the AI era

Non-members can read for free by clicking my friend link

Jul 12, 2026 · 12 min read · 1 claps #semantic-layer #agentic-ai #context-engineering

AI ART

IG Igor Terzic

AI Can See Your Data. But It Can’t See Your Business.

Why Complete Metadata may be the missing foundation of Enterprise AI.

Jul 11, 2026 · 11 min read · 0 claps #artificial-intelligence #data-governance #enterprise-architecture

AI ART MKT ECO SOC

MY MyData Insights

Autonomous Data Agents for Operations: What Works

Autonomous data agents for operational analytics are being deployed in manufacturing and supply chain right now. Most of the live…

Jul 08, 2026 · 6 min read · 0 claps #data-agents #autonomous #manufacturing

AI ART TCH GEN

SA Saša Mitrović · Snowflake Builders Blog: Data Engineers, App Developers, AI, & Data Science

Six Things Enterprise Architects Get Wrong About the Operational–Analytical Chasm — and How to…

The operational–analytical chasm is where agentic strategies go to die.

Jul 07, 2026 · 12 min read · 0 claps #agentic-enterprise #data-architecture #data-engineering

ART TCH

ME Mehulbudasana

Data Lake vs Data Fabric: Which One Does Your Enterprise Actually Need?

Introduction

Jul 07, 2026 · 7 min read · 0 claps #data-lake #data-fabric #comparison

ART TCH

SE Sendoa Moronta

Beyond Cron: Why Event-Driven Execution Is Changing Apache Airflow

Apache Airflow is no longer just a scheduler. It is gradually becoming an event-aware orchestration platform where data availability…

Jul 07, 2026 · 5 min read · 52 claps #apache-airflow #data-engineering #data-platforms

ART TCH SOC

BA Balu Rathinam · Towards Data Engineering

Database Architecture Starts Before Database Selection

Are We Asking the Right Questions?

Jul 06, 2026 · 5 min read · 0 claps #data-architecture #database #data-engineering

AI ART TCH MDA ECO

FO FOLAKE SOWONOYE

Why AI in Insurance Fails Without a Universal Semantic Layer Strategy

A Snowflake architect’s view on why Cortex Analyst, BI dashboards, and your actuaries need to agree on what “loss ratio” means before any…

Jul 05, 2026 · 7 min read · 0 claps #data-architecture #snowflake #artificial-intelligence

AI ART ECO TCH HUM

RA Ramkumarchoudhary

Data Engineering, Data Architecture & AI Professional

Experienced Data Engineering, Data Management, and Governance professional with 10+ years of experience in enterprise data platforms and 4+…

Jul 05, 2026 · 1 min read · 0 claps #data-architecture #machine-learning-python #agentic-ai-architecture

ART TCH MDA

ES EslamAsfour

MirrorMaker 2 in Production — How We Built a Real-Time Data Backbone Across Organizations

Imagine a customer visits an electronics subsidiary’s app to purchase a high-end gaming laptop, only to find the item is currently out of…

Jul 04, 2026 · 11 min read · 5 claps #apache-kafka #data-replication #data-engineering

ART TCH

KA Kavika Roy · DataToBiz

Aiding Modern Enterprises, DataToBiz Rolls Out a Scalable Lakehouse Architecture

Traditional data warehouses and lakes are reaching their limits, and time-consuming access to these is no longer acceptable in modern…

Jul 03, 2026 · 3 min read · 1 claps #data-lakehouse #data-architecture #modern-data-stack

ART TCH

SI Sini Sahadevan · Towards Data Engineering

Beyond Metadata: 15 Factors to Consider When Designing a Metadata-Driven Data Ingestion (MDDI)…

Introduction

Jul 02, 2026 · 3 min read · 0 claps #data-architecture #enterprise-architecture #data-engineering

AI ART TCH

AA Aasir Waseer · Data Science Collective

RevOps Isn’t Accounting Anymore. It’s Architecture.

What three days of building a group-level data layer taught me about where this function is actually headed in 2026

Jul 02, 2026 · 4 min read · 0 claps paywalled #business-intelligence #artificial-intelligence #data-architecture

ART ECO

SR Srivatsan Sundaravaradan

Dimensional Modeling & Data Vault 2.0 — A PM’s Deep Dive

The Core Idea

Jul 01, 2026 · 5 min read · 0 claps #data-architecture #data-vault-modeling #product-data-management

AI ART TCH HUM

RA Rajanikant Vellaturi · Data Engineer Things

The Agentic Lakehouse: A Practical Enterprise Pattern for Trusted AI Agents

Introduction

Jun 29, 2026 · 4 min read · 30 claps #data-engineering #data-architecture #data-lakehouse

ART TCH

BD BDhar

Escaping the Data Landfill: Right-Tooling Cloudera

In my last post, we looked at how unmanaged data lakes degenerate into an accidental data landfill due to a lack of deterministic…

Jun 25, 2026 · 4 min read · 1 claps #hadoop #big-data #data-architecture

ART LIF

TI TigerGraph · TigerGraph

Customer Data Platforms Depend on Relationship-Aware Identity

Customer identity is a relationship problem.

Jun 24, 2026 · 4 min read · 0 claps #customer-data-platform #identity-resolution #graph-database

ART TCH MKT

SE Sendoa Moronta

Beyond state:modified: Understanding dbt State as an Incremental Compilation Engine

How manifest diffing, graph reconciliation, and deferred resolution enable scalable analytics engineering at enterprise scale.

Jun 23, 2026 · 5 min read · 2 claps paywalled #dbt #data-engineering #analytics-engineering

ART TCH HUM AI

RO Rohan Mistry · Data Science Collective

The 12 Data Architecture Patterns Every Data Engineer Should Master in 2026

From Lakehouse and Medallion to Data Mesh and Event-Driven systems — understand the architectures behind modern data platforms.

Jun 23, 2026 · 6 min read · 395 claps paywalled #data-architecture #data-engineering #big-data

ART ECO TCH

MA Mayankrauthan

❄️ Snowflake Architecture: Redefining the Modern Data Warehouse

Organizations often struggle with the limitations of on-premises data warehouses — rigid infrastructure, costly upgrades, and limited…

Jun 20, 2026 · 2 min read · 25 claps #snowflake #snowflake-architecture #cloud-computing

AI ART TCH ECO

SA Satish Kumar

Snowflake CoWork: What Architects Need to Know Before Their Teams Start Using It

CoWork Series Article 1: The multi-agent architecture behind Snowflake’s conversational interface

Jun 20, 2026 · 8 min read · 3 claps #snowflake #snowflake-cortex-ai #data-engineering

AI ART TCH

CD CData Software · CData Software

Batch Integration vs. Real-Time Integration: Pros, Cons, and AI Impacts

Every enterprise data pipeline reflects a choice, whether deliberate or inherited: how quickly does data need to move from where it lives…

Jun 19, 2026 · 8 min read · 0 claps #data-integration #real-time-data #artificial-intelligence

ART TCH

NG Ángel Álvarez Pascua · Towards Data Engineering

Apache Spark WTF??? ✈️ Come Fly With Me🧑‍✈️

Welcome to the airport. Keep your boarding pass close and your schema assumptions closer. Spark 4 just opened a new terminal for JSON, XML…

Jun 17, 2026 · 39 min read · 0 claps #apache-spark #data-engineering #data-architecture

ART TCH MKT

OC OceanBase User Group · From Zero To seekdb

Why One System Beats Two: From Separate TP and AP Stacks to One Unified Engine

How to Consolidate TP and AP Workloads into One System Without Sacrificing Performance

Jun 16, 2026 · 9 min read · 51 claps #database #data-architecture #real-time-analytics

ART TCH

RA Rathanak SENG

រចនាបទ​មួយ​នៃ​ Lakehouse ដែល​ខ្ញុំ​បាន​បង្កើត​។

មូលដ្ឋាន​មួយ​ដែលអាចរក្សាទុកទិន្នន័យទាំងអស់របស់អ្នក ក្នុងតម្លៃទាប​ និងផ្តល់នូវទំនុក​ចិត្ត​​ខ្ពស់​ក្នុងការទាញយកទៅប្រើប្រាស់ (Query)។

Jun 16, 2026 · 4 min read · 0 claps #data-engineering #data-architecture #data-lakehouse

AI ART ECO LIF

CH Changhun Shin (신창훈) | Founder, CS-NRRM™

From Observation to Framework: The Architecture of a 4,300-Day Longitudinal Archive

Mapping the structural architecture, chronological continuity, and non-medical boundaries of a 12-year longitudinal archive.

Jun 16, 2026 · 2 min read · 0 claps #longitudinal-data #data-architecture #artificial-intelligence

ART TCH HUM AI

TE Teja Naidu

Understanding Snowflake Architecture: Storage, Compute, and Cloud Services Explained

Learning Snowflake Series | Topic 3

Jun 15, 2026 · 4 min read · 0 claps #snowflake #data-engineering #cloud-computing

AI ART TCH MKT

AR Archstack

Most Data Teams Don’t Have an AI Problem. They Have a Data

Every company wants AI.

Jun 15, 2026 · 3 min read · 0 claps #artificial-intelligence #data-engineering #snowflake

AI ART BIO SCI

L7 L7 Informatics

Why Life Sciences Manufacturing AI Keeps Failing at the Finish Line

by Kevin McMahon

Jun 15, 2026 · 5 min read · 2 claps #manufacturing #life-sciences #ai

ART TCH

HA Hanish Savla

Gold Is Not Just Aggregated Silver — Designing for Business Questions

Series: Building an Enterprise Data Platform on Databricks — Part 3 of 5

Jun 15, 2026 · 8 min read · 0 claps #data-engineering #databricks #apache-spark

AI ART TCH SCI

RE René Luijk · Data Engineer Things

Three Lessons Learned Building Data Platforms From Scratch

The case for boring tools, smaller ambitions, and building for the team you have

Jun 15, 2026 · 4 min read · 30 claps #data-engineering #data-science #ai

ART MKT LIF SPT

MI Miles Bennett

The Churn Rate of Distance: Why 99% of Long-Distance Funnels Collapse Before the First Flight (And…

Stop optimizing for top-of-funnel matches. A cold, analytical breakdown of user churn, attention retention, and how to stabilize your…

Jun 14, 2026 · 6 min read · 0 claps #online-dating #customer-retention #strategy

ART TCH

HA Halfbloodangel

Workflow Orchestration & DataOps Orchestration: A Deep Dive into Airflow, Dagster, Prefect, Kestra…

Introduction

Jun 12, 2026 · 26 min read · 100 claps #workflow-orchestration #data-engineering #data-architecture