#databricks

TCH

AY Ayushjoshi

Databricks Data Layout Explained: Partitioning, OPTIMIZE, Z-ORDER & Liquid Clustering

If you’ve worked with Databricks, you’ve probably heard these four terms: Partitioning. OPTIMIZE. Z-ORDER. Liquid Clustering.

Aug 19, 2026 · 12 min read · 1 claps #databricks #partitioning #liquid-clustering

AI TCH MDA

LE Leohuang

【硬核大師班】Agent 暴走與失憶的終極解藥？深度拆解 Unity AI Gateway 執行期路由與 Agent Memory 持久化架構

前言：那個被 API 帳單與失憶 Agent 逼瘋的平台團隊

Aug 16, 2026 · 5 min read · 0 claps #databricks #ai-agent #unity-ai-gateway

AI TCH

LE Leohuang

【硬核大師班】AI 寫 Code 怕搞垮系統？深度拆解 Genie App Builder 氣氛編程與 Agent 沙盒隔離的底層架構

前言：那個被「野生 AI 應用」戳出無數資安天坑的 IT 團隊

Aug 16, 2026 · 5 min read · 0 claps #databricks #ai-agents-in-action #zero-trust

TCH

GU Gustavo Ferratti · Forja ML (PT-BR)

Microbatch, NRT ou RTM no DB

Saudações, pessoal! Tudo em riba?

Aug 11, 2026 · 18 min read · 0 claps #realtime #databricks #near-real-time

TCH

JA Jayasurya Pilli

How to Make the Most of Genie Code for Databricks Certification Exam Prep

Preparing for the Databricks Data Engineer Associate or Professional certification?

Aug 10, 2026 · 4 min read · 0 claps #databricks-certification #databricks-basics #databricks

TCH

DA DataWithRohit

Databricks Lakeflow Jobs — The Ultimate Associate & Professional Exam Guide

Repair Runs, Multi-Task Jobs, Dependencies, Task Values, Triggers, Parameters, Queueing, Monitoring & Exam Traps

Aug 09, 2026 · 15 min read · 0 claps #databricks #databricks-certification #apache-spark

TCH

DA DataWithRohit

Databricks Professional Exam Guide: Python File Dependencies, Relative Imports & Python Wheels

As Databricks projects grow, notebooks often evolve from simple, self-contained units into larger applications containing reusable…

Aug 08, 2026 · 11 min read · 0 claps #databricks #databricks-certification #apache-spark

TCH AI SCI

UD Uday Sahu

Databricks in the Real World: How Modern Organizations Turn Data into Business Value

Part 9 : Cost Optimization, Security, Career Roadmap & Final Thoughts

Aug 05, 2026 · 7 min read · 2 claps #cost-optimization #databricks #security

ART TCH ECO

CH Chirag Venkateshaiah

Bronze, and the confidently wrong fix

Where the schema tells you it’s fine and isn’t — plus the pivot that reversed a decision I’d pinned in writing specifically so it wouldn’t…

Aug 04, 2026 · 7 min read · 1 claps #software-development #databricks #data-warehouse

TCH MDA

DA DataWithRohit

Databricks Stream-Static Joins: The Exam-Ready Guide for Associate and Professional Certifications

How stateless enrichment works, how Delta Lake snapshots behave, where streaming state really appears

Aug 04, 2026 · 25 min read · 0 claps #databricks #spark #apache-spark

AI TCH

LE Leohuang

【硬核大師班】告別 ETL 搬運與天價 SaaS：深度拆解 CustomerLake 與 Lakewatch，看 Genie Agent 如何顛覆 CDP 與 SIEM 架構

前言：那個被「反向 ETL (Reverse ETL)」拖垮的資料架構

Aug 02, 2026 · 6 min read · 0 claps #databricks #ai-agent #lakewatch

AI ART TCH

LE Leohuang

【硬核大師班】Agent 上線後都在偷偷胡說八道？深度拆解複合型 AI (Compound AI) 與 Mosaic AI Agent Evaluation 評估演算法

前言：那個被「非確定性輸出」徹底擊潰的 QA 團隊

Aug 02, 2026 · 6 min read · 0 claps #databricks #ai-agent #mosaicaiagentevaluation

AI TCH

LE Leohuang

【硬核大師班】多智能體協作的底層拓樸：深度拆解 Genie Agent 的元控制路由、統一記憶體與零信任沙盒

前言：當單體 AI 淪為「無狀態」的孤島

Jul 31, 2026 · 6 min read · 0 claps #databricks #ai-agent #databricks-genie

AI TCH

LE Leohuang

【硬核大師班】告別失控的提示詞：深度拆解 Genie Agent 本體論圖譜與零信任自主推理架構

前言：那個被「機率模型」吞噬的企業級 AI

Jul 31, 2026 · 6 min read · 0 claps #databricks #ai-agent #databricks-genie

AI ART TCH

BH Bharani · DevOps.dev

Omnigent Explained Simply: Why AI Agents Need a Manager

Imagine This…

Jul 31, 2026 · 5 min read · 0 claps paywalled #omnigent #databricks #agent-harness

AI TCH

NG Ángel Álvarez Pascua · Towards Data Engineering

🤖 SDA 05: Profiling Source Data — Distributions, Nulls, Formats, and Outliers

SDA 04 gave the Synthetic Data Agent a governed map of the data estate. It can see tables, columns, types, tags, comments, and declared…

Jul 31, 2026 · 19 min read · 0 claps #databricks #synthetic-data #data-engineering

TCH SPT

FU Furqanhassan

Why Your Databricks Bill Keeps Climbing (And Nobody Can Explain Why)

If you’ve ever been asked “why did our Databricks spend jump 40% this quarter?” and had no real answer — you’re not alone. It’s one of the…

Jul 29, 2026 · 3 min read · 0 claps #data-analysis #databricks #data-migration-service

TCH MDA

DA DataWithRohit

Databricks Dynamic Views: Exam-Ready Guide for the Data Engineer Associate and Professional…

Data Masking, Row-Level Security, Column-Level Security

Jul 29, 2026 · 14 min read · 3 claps #databricks #databricks-certification #data-governance

TCH MDA

MA Mamata

Understanding Databricks Auto Loader vs Delta Lake Schema Evolution: Lessons from a Real Debugging…

While building a streaming ingestion pipeline in Databricks, I came across a behaviour that completely confused me.

Jul 28, 2026 · 4 min read · 6 claps #big-data #delta-lake #autoloader

TCH

IR Iryna Bundzylo

I Tested Four Databricks ETL Tools, So You Don’t Have To

One migration, four tools, and a lot of notes on who complained the most along the way.

Jul 28, 2026 · 6 min read · 0 claps #etl #etl-tool #databricks

TCH

DA DataWithRohit

A Complete Associate and Professional Exam Guide on CDC and CDF

Change Data Capture questions may appear simple, often combine several related concepts:

Jul 28, 2026 · 29 min read · 2 claps #databricks #spark #apache-spark

ART TCH MDA

BH Bharani

Dead Letter Queue (DLQ) Explained Simply: Why One Bad Record Shouldn’t Stop Your Entire Pipeline

Architecture Patterns Series — Episode 7

Jul 27, 2026 · 3 min read · 0 claps paywalled #dead-letter-queue #architecture #databricks

ART MDA TCH AI

BH Bharani · DevOps.dev

Dead Letter Queue (DLQ) Explained Simply: Why One Bad Record Shouldn’t Stop a Million Good Ones

YouTube Video URL : https://youtu.be/pOJzL6ytnfo

Jul 27, 2026 · 4 min read · 1 claps paywalled #dead-letter-queue #apache-spark #databricks

TCH

HA Harshalsant

How I Passed the Databricks Certified Data Engineer Professional Exam (My Preparation Strategy)

I’m happy to share that I successfully cleared the Databricks Certified Data Engineer Professional certification.

Jul 27, 2026 · 4 min read · 1 claps #databricks-certification #databricks

AI TCH SCI

NI Niklas Arft · SkelTech GmbH

The Art of Proof: A Systematic Framework for Measuring Use Case Value

A working demo is not proof. A systematic framework for measuring the real business value of a data and AI use case.

Jul 26, 2026 · 5 min read · 0 claps #azure-databricks #six-sigma #databricks

TCH

HU Hubert Dudek databricks MVP · Databricks Community Articles

Databricks News: ZeroOps, DABs, Indexes, Genie, sandboxes, migration from PowerBI, secrets [VIDEO]

Video and article covering the most important updates.

Jul 25, 2026 · 5 min read · 186 claps paywalled #databricks #databricks-news #dab

AI ART TCH

LE Leohuang

【硬核大師班】AI 只能看不能動？深度拆解 Databricks LTAP 引擎與 Genie Agent 的全雙工自主架構

前言：那個「只會出張嘴」的殘缺 AI 助理

Jul 25, 2026 · 8 min read · 0 claps #databricks #ltap #databricks-genie

TCH AI

RO Rohini

Build an End-to-End ETL Pipeline Using Azure Blob Storage, Azure Databricks & Azure SQL Database

Azure Blob Storage to Azure SQL Using Azure Databricks: A Step-by-Step ETL Pipeline

Jul 24, 2026 · 5 min read · 2 claps #databricks #microsoft-azure #blob-storage

TCH

DA DataWithRohit

Databricks Lakeflow Connect: The Complete Certification Guide to Managed and Standard Connectors

Lakeflow Connect is the ingestion layer of the Databricks data engineering platform. It provides a range of options — from fully managed…

Jul 23, 2026 · 15 min read · 0 claps #databricks #azure-databricks #databricks-certification

TCH

DA DataWithRohit

Databricks Expectations Explained: A Complete Associate and Professional Certification Guide

Warn, drop, or fail? Master the data-quality scenarios that repeatedly appear in Databricks exams

Jul 22, 2026 · 15 min read · 1 claps #databricks #databricks-certification #apache-spark

TCH

DA DataWithRohit

Databricks Data Engineer Associate Exam Prep: Auto Loader and COPY INTO

A practical, scenario-based guide to file ingestion, schema evolution, notifications, overwrites, idempotency, and important certification…

Jul 21, 2026 · 17 min read · 3 claps #databricks #autoloader #data-engineering

TCH

PU Pusp Kumar vyas

Liquid Clustering Explained: A Smarter Alternative to Partitioning and Z-ORDER in Delta Lake

Why Traditional Partitioning Becomes a Problem

Jul 19, 2026 · 8 min read · 3 claps #databricks #delta-lake #liquid-clustering

TCH

KO Komal Belavi

From Slow Queries to Faster Insights: Optimizing an E-Commerce Data Platform with Delta Lake

Impact of Data Growth on Query Performance

Jul 17, 2026 · 4 min read · 1 claps #databricks #databricks-clustering #databricks-optimization

TCH SPT

KU Kushalvishwa · Towards Data Engineering

How to Handle Long-Running Jobs in Databricks: A Practical PySpark Playbook

By Kushal Vishwakarma

Jul 16, 2026 · 3 min read · 1 claps #data-engineering #databricks #pyspark

TCH MDA AI SCI

BR Brahma, The Data Engineer. · Databricks Developer Community

Serverless Notebooks Feel Better When Work Comes Back with You

A smoother session restore experience can help notebook work continue with less interruption and less friction

Jul 15, 2026 · 2 min read · 0 claps #databricks #data-engineer-skills #databricks-basics

ECO TCH

MA Marco Österlin · The Semantic Layer

Your Data Catalog Has 1 million Assets and Nobody Can Find Anything. Here Are the KPIs That Fix It.

A data catalog with 1 million data assets and a 1 percent search success rate is not a catalog. It is a graveyard with a search bar. The…

Jul 15, 2026 · 13 min read · 1 claps #data-catalog #metadata-management #data-governance

AI ART TCH

KE Kevin McCarthy · Databricks for Startups

The Signals Before the Failure: Proactive Pipeline Maintenance with Genie ZeroOps

By Kevin McCarthy (Solutions Architect)

Jul 14, 2026 · 6 min read · 7 claps #databricks #data-engineering #ai-agent

TCH

DA Daniel Hunt · Snowflake Builders Blog: Data Engineers, App Developers, AI, & Data Science

Iceberg Catalogs: Below the Surface

A reproducible scorecard for Iceberg catalogs on openness and interoperability, to help you avoid Iceberg catalog lock-in.

Jul 14, 2026 · 16 min read · 6 claps #apache-iceberg #snowflake #databricks

AI TCH

KO Kobai

How a Leading Energy Company Cut Integration Time by Up to 40% with Semantic Context on Databricks

One of the world’s largest energy companies red uced data integration time by up to 40%, reported a significant improvement in data…

Jul 14, 2026 · 6 min read · 0 claps #semantic-layer #ai #databricks

TCH MDA

BR Brahma, The Data Engineer. · Databricks Developer Community

Search Becomes More Valuable When It Feels Real-Time

Fresh data, fast retrieval, and live business context can make search far more useful

Jul 14, 2026 · 2 min read · 0 claps paywalled #databricks #data-engineer #data-engineer-skills

ART TCH

JA Jaco van der Laan · Towards Data Engineering

Source Modeling: The Missing Workflow

Every data platform assumes the source model is a given. In banks, it almost never is — here’s the workflow nobody named and the role…

Jul 13, 2026 · 8 min read · 1 claps paywalled #data-engineering #data-modeling #data-architecture

TCH MDA GEN

IS Ishwarya Modika · Towards Data Engineering

Beyond Secret Scopes: How Unity Catalog Brings Real Governance to Databricks Secrets

Fine-grained, auditable access control finally comes to Databricks secrets — here’s what changed and how to use it.

Jul 12, 2026 · 4 min read · 3 claps #databricks #databricks-unity-catalog #data-engineering

TCH

BR BricksNotes for Data Engineers · Towards Data Engineering

Databricks Is Moving Fast, and the Data + AI World Should Pay Attention.

If you missed the Summit, the bigger story is not just the number of announcements. It is the direction behind them.

Jul 12, 2026 · 4 min read · 25 claps #databricks #data-engineering #big-data

ECO TCH

MA Manish Kumar

Databricks Data + AI Summit 2026 : One Platform to Replace Your Entire Data & AI Stack ?

“AGI is already here. AI doesn’t have an intelligence problem it has a context problem.” With those provocative words, Databricks CEO Ali…

Jul 11, 2026 · 13 min read · 10 claps #databricks #azure-databricks #data-engineering

TCH

GE G e o r g i a n · Towards Data Engineering

Managing Network Security on Databricks SQL Serverless

What Regulated Industries Need to Know and Implement

Jul 11, 2026 · 8 min read · 0 claps #databricks #azure #aws

TCH AI SCI

BR Brahma, The Data Engineer. · Databricks Developer Community

Custom URLs Make Databricks Feel More Like a Real Enterprise Platform

Custom URLs Make Databricks Feel More Like a Real Enterprise Platform

Jul 10, 2026 · 4 min read · 0 claps #databricks #databricks-basics #data-engineering

TCH

SA Satadru · Data Engineer Things

Join Order Matters! Understanding how Modern Query Optimizers Think

Okay, I could have started this blog with a question: “Does the order of tables in a SQL JOIN matter?”

Jul 10, 2026 · 6 min read · 28 claps #query-optimization #snowflake #data-engineering

AI ART TCH HUM

AI AI on Databricks

Traces Blog: Why Trace in Databricks? Go Beyond Evaluations and Into Business Value

Author: Jordan Soldo, Solutions Architect

Jul 10, 2026 · 5 min read · 14 claps #genie #databricks #mlflow

SCI TCH

SC Scott Grzybowski · Databricks Platform SME

Deploying Azure Databricks with RFC-6598 Shared Address Space: Zero Routable IP Consumption

How to run large VNet-injected Databricks workspaces without spending a single routable IPv4 address — using an RFC-6598 “island” network…

Jul 08, 2026 · 9 min read · 1 claps #azure-databricks #databricks #networking

TCH HUM MKT AI

YI Yingzhao Ouyang · Towards Data Engineering

Teaching Graphify to Understand Databricks Notebooks

A side quest from my “Build Your Own LinkedIn Analytics” project

Jul 08, 2026 · 9 min read · 7 claps #databricks #ai-coding #claude