Author

Eric Sun

@eric-sun

TCH

Data Dependency Driven Orchestration

AirFlow and Prefect are probably the most popular schedulers in 2021. They are both more data-aware than the traditional orchestration…

Jan 11, 2021 · 10 min read · 188 claps #orchestration #data-trigger #state-store

TCH

Data Lake continues to offer better and better Cost Performance with the new features and integration patterns. With the summits of both…

Jul 03, 2024 · 4 min read · 181 claps #olap #icebergs #index

TCH

ER Eric Sun · The Startup

The super success of Spark in the ETL area also showed that many paradigms in the traditional data warehouse are indeed critical and useful

Mar 16, 2020 · 8 min read · 180 claps #delta-lake #icebergs #hudi

Sorting the records in columnar data format is a critical design considerations that many of us have not paid attention. Let’s leverage it.

Mar 16, 2020 · 8 min read · 66 claps paywalled #columnar #big-data #performance-tuning

TCH

This week (2020–11–10) was really big for System on a Chip: first Apple M1, and then followed by MediaTek MT8195/MT8192. But why on earth…

Nov 22, 2020 · 5 min read · 50 claps #soc #apple-m1 #mediatek

ER Eric Sun · The Startup

This article describes a query proxy architecture pattern and trade-off which abstract SOME of the hurdles for online services or tools to…

May 16, 2026 · 6 min read · 29 claps #query #proxy #big-data

TCH DSN

The orchestration layer that runs half the internet is quietly becoming the wrong abstraction for the workloads that matter most.

Apr 27, 2026 · 15 min read · 0 claps #k8s #stateful #orchestration

TCH HUM

Why Star Schema Breaks Most Cloud Warehouses? A look at why join-containing materialized views with transparent query rewrite are the rule…

Jun 04, 2026 · 4 min read · 0 claps #materializedviews #query-optimization #semantics