#real-time-streaming-data

MDA AI

KN Knowledgator Engineering

Real-time GLiNER for PII reduction workflows

GLiNER has become a standard for NER and PII reduction workflows. It’s much faster than LLMs, as it doesn’t need an autoregressive…

Jul 24, 2026 · 6 min read · 51 claps #ner #pii-detection #information-extraction

ECO MDA MKT

RI Rifify Io

Why One Track “Blew Up”: A Quick Breakdown and How to Repeat the Success

When your track suddenly gets millions of streams, it is not just a pleasant surprise — it is a valuable case to analyze. This guide will…

Jul 09, 2026 · 3 min read · 0 claps #music-marketing #music-promotion #music-analytics

ART TCH HUM MDA AI

MR Mr Sinchan Banerjee

Real-Time Feature Stores: Architecture, Mistakes, and How to Fix Them

By Sinchan Banerjee — Director of Enterprise Data Architecture | Author, Scalable Data Architecture with Java (Packt)

Jun 10, 2026 · 7 min read · 0 claps #data-engineering #machine-learning #real-time-streaming-data

TCH MDA MKT

JA Jatin Agrawal

Cost Optimization in Real-Time Streaming Systems

Introduction

May 17, 2026 · 6 min read · 0 claps #real-time-analytics #cost-optimization #data-pipeline

ART TCH MDA MKT

AH Ahsan Hussain

Apache Kafka — Architecture for beginners

Streaming Systems Part 1: producers, partitions, leaders, followers, consumer groups — and one record’s journey through them all.

May 12, 2026 · 8 min read · 1 claps #apache-kafka #apache-kafka-tutorial #real-time-streaming-data

MDA

AT Atef Arfaoui

Building a Real-Time Data Platform (Part 4- final):

Making It Production-Ready

Apr 19, 2026 · 5 min read · 3 claps #data-platforms #real-time-streaming-data #kafka-schema-registry

ECO HUM MDA AI SCI DSN

HE Hecate

How to Grab Real-Time Free Financial Market Data: A Step-by-Step Tutorial

In today’s data-driven world, access to real-time financial market data is crucial for traders, investors, and developers building…

Apr 14, 2026 · 3 min read · 7 claps paywalled #financial-data-api #data-visualization #data-science

TCH MDA

AT Atef Arfaoui

Building a Real-Time Data Platform (Part 2):

Micro-batch felt like cheating. The Spark pipeline from Part 1 worked, but that 30-second delay nagged at me. What if an event could be…

Mar 27, 2026 · 6 min read · 7 claps #apache-flink #data-engineering #real-time-streaming-data

ART TCH MDA DSN

AT Atef Arfaoui

Building a Real-Time Data Platform (Part 1):

What does it take to go from raw e-commerce events to a live dashboard? Not a batch job that runs overnight — a pipeline that shows you…

Mar 27, 2026 · 6 min read · 44 claps #data-engineering #data-visualization #software-engineering

TCH MDA

SS SSK

Server-Sent Events

Learn when to use SSE instead of WebSockets for one-way real-time streaming, with Node.js code examples.

Feb 28, 2026 · 3 min read · 0 claps #server-sent-events #nodejs #websocket

MDA DSN

AN Anuragkumbhare

System Design: Designing a Stock Ticker & Trading System

Stock trading systems are among the most demanding distributed systems in the world.

Jan 28, 2026 · 3 min read · 0 claps #design-systems #high-frequency-trading #distributed-systems

MDA MKT

DO DolphinDB

Real-Time Decision-Making: How AI and Low-Latency Computing Are Reshaping Digital Twins

Digital twins have long been understood as high-fidelity replicas of the physical world. Whether modeling entire cities through GIS systems…

Jan 20, 2026 · 4 min read · 10 claps #digital-twin #ai-infra #real-time-streaming-data

AI MDA MKT

TO topsoftbot

Boost Fan Growth and Artist Exposure with AIOStream's Streaming Data Insights

In the bustling world of streaming platforms, merely releasing music or having your work ready is no longer enough. With recommendation…

Jan 05, 2026 · 6 min read · 0 claps #spotify-for-artists #fan-growth #music-promotion

ART TCH MDA

AL Aliakbar Hosseinzadeh

Data Architecture Patterns — Kappa Architecture (Stream-First Data Pipelines for Real-Time…

If your data never stops moving — clicks, sensor signals, transactions, network events — traditional “batch-first” thinking starts to feel…

Dec 30, 2025 · 3 min read · 1 claps #kappa-architecture #real-time-streaming-data #event-streaming

MDA

BU Bulgakov Daniil · Tabby Insights

Our Feature Store Saga: From Spark to Scale

Hi, I am Dan, Staff Data Engineer from Data Services Team and this is Pimp My ML Process Show.

Dec 22, 2025 · 7 min read · 22 claps #dwh #ml-platform #data-platforms

MDA LIF

GA Gang Tao

New Orleans Current 2025 Observations

Current is Confluent’s annual flagship technology conference, focusing on the Data Streaming field, similar to Apple’s WWDC or Google’s I/O…

Nov 02, 2025 · 28 min read · 0 claps #streaming-processing #real-time-streaming-data #timeplus

TCH MDA

GA Gang Tao

The Past and Present of Stream Processing — A Panoramic View of Open-Source Stream Processing…

In my previous series of articles about the past and present of stream processing, I introduced the development history, technical…

Oct 25, 2025 · 12 min read · 2 claps #streaming-processing #real-time-streaming-data #timeplus

AI TCH MDA SCI

GA Gang Tao

The Past and Present of Stream Processing (Part 26): The Ark Built by Independent Developers —…

ArkFlow, released in early 2025, is an experimental Rust-based stream processing engine with a unique feature: deep integration with AI/ML…

Oct 24, 2025 · 8 min read · 0 claps #streaming-processing #real-time-streaming-data #timeplus

TCH MDA

GA Gang Tao

The Past and Present of Stream Processing (Part 25): Where Does the Stream Arroyo Flow?

Arroyo is a distributed stream processing engine dedicated to solving a core challenge in modern data infrastructure: enabling engineers…

Oct 22, 2025 · 10 min read · 1 claps #streaming-processing #timeplus #real-time-streaming-data

TCH MDA

TH ThamizhElango Natarajan

Complete Guide: Setting Up Apache Pulsar in Kubernetes

Introduction

Oct 04, 2025 · 13 min read · 0 claps paywalled #apache-pulsar #kubernetes #cloud-native

TCH MDA

KE Keertisharmawork

Engineering a Scalable, Explainable, Real-Time Anomaly Detection System Using Databricks DLT and…

In the contemporary landscape of hyper-connected digital infrastructure, large-scale organizations rely heavily on sensor telemetry for…

Sep 04, 2025 · 5 min read · 2 claps #dlt #real-time-streaming-data #prtg-network-monitor

ART TCH MDA

BY Byte-Sized Wisdom

Streaming Interview Pattern #7: Retention Cohort

Retention is one of those metrics that every product manager obsesses over, and every data engineer has to calculate at some point. This…

Aug 22, 2025 · 3 min read · 0 claps paywalled #data-engineering #interview-questions #modern-data-architecture

TCH MDA

GH Ghita EL AMLAQUI · AWS in Plain English

Stream, Process, and Store Data Efficiently with Amazon Kinesis and S3

Introduction

Mar 07, 2025 · 5 min read · 3 claps #aws #kinesis-firehose #kinesis-data-stream

TCH MDA

DE DeltaStream

Exploring Pattern Recognition using MATCH_RECOGNIZE

by Charles Tan

Sep 20, 2024 · 7 min read · 2 claps #apache-flink #data-engineering #ksql

MDA

DI Divyansh Goyal

Publisher-Subscriber Communication Model

In the digital age, where data flows constantly between systems and users, efficient communication is crucial. One of the most powerful…

Sep 08, 2024 · 3 min read · 0 claps #near-real-time #real-time-streaming-data #messageservices

MDA AI

RI Richardson Gunde

Chatting with Videos: Unlocking Insights with Qwen-VL-2B

Hey there, video enthusiasts! Ever wondered how to extract information from your favorite YouTube clips or even have a conversation with a…

Sep 07, 2024 · 9 min read · 7 claps #large-vision-models #qwen-2 #ui-interaction

MDA

HE Henk van Cann · Happy Blockchains

CESR, one of Sam Smith’s inventions, is as controversial as it is genius.

The main takeaway from this article is a kind of work assignment (“Me?!?” ‘Yeah, you!’): I’d like you to try and match the unique features…

Nov 08, 2021 · 7 min read · 53 claps #autonomic-identifiers #ssi #real-time-streaming-data