← Back to list

Why StarRocks Is Better Than Elasticsearch for Edge Computing and CDN Log Analytics

Content delivery networks are the invisible backbone of the modern internet. Every video stream, every product page load, every API…

Mark Anderson · 2026-05-27 03:23 · 0 claps · 17.9 min read
#starrocks #elasticsearch #cdn #edge-computing
Open on Medium ↗
Wiki topics: GRW · Growth & Analytics

Why StarRocks Is Better Than Elasticsearch for Edge Computing and CDN Log Analytics

Content delivery networks are the invisible backbone of the modern internet. Every video stream, every product page load, every API response, every software update download, and every static asset request is routed through a global mesh of edge points of presence (PoPs) — and every one of those interactions generates a log record. A mid-size CDN serving 500,000 requests per second across 200 PoPs produces over 43 billion log records per day, each carrying a dense payload of metadata: client IP, edge PoP identifier, cache status (hit, miss, revalidation, bypass), origin server address, HTTP status code, response time breakdown (DNS resolution, TCP connect, TLS handshake, time-to-first-byte, total transfer time), request URL, content type, bytes delivered, protocol version (HTTP/1.1, HTTP/2, HTTP/3 with QUIC), geographic coordinates of the requesting client, ASN and ISP of the client network, TLS cipher suite, compression encoding, request headers (User-Agent, Referer, Accept-Language), edge-computed response headers, rate limiting decisions, WAF rule matches, bot detection scores, and edge worker execution metadata. For CDN operations teams, platform engineering organizations, and the customers who depend on reliable content delivery, this data is the foundation of CDN analytics: understanding cache efficiency, diagnosing latency anomalies, optimizing PoP placement, enforcing fair-use policies, billing customers based on bandwidth consumption, detecting DDoS attacks at the edge, and capacity planning for traffic growth across hundreds of globally distributed locations.

Elasticsearch and the ELK stack have been the default choice for ingesting and querying CDN logs for over a decade. Akamai’s DataStream 2 supports direct log streaming to Elasticsearch, Fastly provides real-time log streaming endpoints compatible with the ELK stack, and Cloudflare’s Logpush integrates with Elasticsearch-based analytics pipelines. But as CDN architectures evolve — from dozens of PoPs to hundreds, from simple cache-and-serve to sophisticated edge computing platforms running customer code at the network edge, from basic hit-rate dashboards to multi-dimensional analytics driving automated traffic steering, real-time anomaly detection, and usage-based billing — Elasticsearch’s document-oriented architecture fractures under the weight of analytical workloads it was never designed to serve. In this post, we examine why StarRocks is the superior platform for edge computing and CDN log analytics, drawing on architectural comparisons and real-world production evidence from organizations that have confronted these challenges at scale.

What Edge Computing and CDN Log Analytics Demands

A comprehensive CDN analytics platform must serve multiple stakeholders with fundamentally different query patterns:

  1. Cache performance analytics — CDN operations teams need real-time and historical visibility into cache hit ratios across every dimension: by PoP, by content type, by origin server, by customer account, by URL pattern, by geographic region, and by time granularity ranging from per-second to per-month. They need to identify cache-busting request patterns — URL parameters that create millions of unique cache keys for functionally identical content — and quantify their impact on origin load. They need to compare cache efficiency before and after configuration changes (TTL adjustments, cache key normalization rules, stale-while-revalidate policies) across specific PoP populations and customer segments simultaneously.
  2. Latency analysis and anomaly detection — performance engineering teams need to decompose end-to-end response time into its constituent stages (DNS, TCP, TLS, TTFB, transfer) across billions of requests, grouped by any combination of PoP, client geography, ISP, protocol version, content type, and time window. They need to detect latency regressions — a p99 TTFB increase at a specific PoP serving traffic from a particular ASN — before customers notice, and correlate those regressions with concurrent events: origin server deployments, BGP route changes, PoP capacity constraints, or edge worker code updates.
  3. Edge computing execution analytics — as CDN platforms increasingly support edge computing (Cloudflare Workers, Akamai EdgeWorkers, Fastly Compute), engineering teams need to analyze edge function execution: invocation counts by function, execution time distributions, memory consumption, error rates, cold start frequencies, subrequest patterns, and CPU time consumption — all broken down by PoP, customer account, and time window. When an edge function exhibits degraded performance or elevated error rates at specific PoPs, engineers need to drill from aggregate metrics to individual execution traces within seconds.
  4. Traffic steering and load balancing analytics — network engineering teams need to understand how traffic flows across the PoP topology: which PoPs are absorbing traffic from which client geographies, how effectively DNS-based and anycast-based traffic steering distributes load, where capacity headroom is thin, and how traffic patterns shift during regional events (sporting events, elections, natural disasters) that create geographic traffic surges. These analytics drive automated traffic steering decisions that route requests away from congested PoPs to underutilized ones — decisions that must be informed by fresh, accurate data across millions of concurrent connections.
  5. Usage-based billing and customer analytics — commercial CDN providers bill customers based on bandwidth consumption, request counts, edge compute execution time, and premium feature usage (image optimization, video transcoding, WAF rules evaluated). These billing metrics must be exact — not approximate — because they directly determine revenue. Customer success teams need usage trend analytics showing growth trajectories, seasonal patterns, and feature adoption rates to inform account management and capacity planning conversations.
  6. Security analytics at the edge — security operations teams need to analyze WAF rule matches, bot detection verdicts, rate limiting decisions, and DDoS mitigation actions across billions of requests. They need to correlate attack patterns across PoPs to distinguish distributed attacks from localized anomalies, identify IP ranges and ASNs that consistently trigger security rules, and quantify the false positive rate of detection algorithms by cross-referencing security verdicts with subsequent request behavior.
  7. PoP capacity planning and infrastructure optimization — infrastructure teams need to forecast bandwidth, compute, and storage requirements at each PoP based on historical traffic patterns, customer growth projections, content type evolution (the shift from static assets to video streaming to edge-computed dynamic content), and geographic demand trends. These forecasts drive multi-million-dollar hardware procurement and colocation lease decisions with 12-to-24-month lead times — accuracy is not optional.

Let’s examine where Elasticsearch struggles and where StarRocks excels across these requirements.

Where Elasticsearch Falls Short for CDN Log Analytics

Approximate Aggregations Corrupt Billing and Cache Metrics

The most consequential limitation of Elasticsearch for CDN analytics is its approximate approach to distributed aggregations. When a billing system queries “total bytes delivered per customer per billing period” using a terms aggregation across multiple shards, Elasticsearch collects top-N term candidates from each shard independently before merging. Because no single shard has a global view of the data distribution, the final merged result can silently undercount or omit customers — particularly those whose traffic is distributed evenly across shards rather than concentrated on one.

Elasticsearch exposes a doc_count_error_upper_bound field, but this only applies when sorting by document count in descending order. For billing-critical aggregations that combine request counts with weighted metrics — total bytes per customer, average TTFB per PoP per content type, 95th-percentile response time per origin server — the error cannot even be estimated. When a CDN provider bills a customer $0.01 per GB and the monthly invoice is based on an aggregation that silently omits 2% of traffic due to shard-level sampling, the revenue leakage on a customer delivering 500 TB per month amounts to $100,000 per billing cycle. Multiply this across hundreds of enterprise customers and the financial impact is staggering.

Cache hit ratio calculations are equally vulnerable. A terms aggregation computing cache status distribution (hit, miss, bypass, revalidation) per PoP per content type can silently exclude PoPs or content categories from the result, producing an artificially inflated or deflated overall hit ratio. Operations teams making capacity decisions based on these numbers — adding origin capacity because the cache hit ratio appears to be declining — may be responding to an arithmetic artifact rather than a real trend.

No Native Joins for Cross-Domain Correlation

CDN analytics requires correlating data from fundamentally different domains. Edge request logs must be joined with origin server performance data to compute cache-to-origin amplification ratios. WAF rule match logs must be joined with client reputation databases to assess detection accuracy. Edge compute execution logs must be joined with customer account configuration data to attribute resource consumption to specific customer tiers and pricing plans. PoP capacity metrics must be joined with traffic flow data to identify infrastructure constraints before they cause service degradation.

Elasticsearch has no native cross-index joins. The standard workaround — denormalization — means embedding origin server metadata, customer account details, WAF rule definitions, and PoP capacity specifications into every request log document at ingestion time. For a CDN processing 43 billion requests per day, this denormalization creates catastrophic data bloat: a 400-byte request log record balloons to 2KB or more when enriched with flattened customer, origin, security, and infrastructure context. When a customer upgrades their pricing plan, when a WAF rule definition is updated, or when a PoP’s capacity specification changes, every associated log document must be reindexed. For a major customer generating billions of requests per month, this reindexing cascade is operationally prohibitive and creates a window during which queries return stale enrichment data — a billing accuracy risk and a security analytics blind spot.

No Window Functions for Trend Analysis and Anomaly Detection

CDN analytics is inherently temporal and comparative. Detecting latency anomalies requires comparing current percentile distributions against historical baselines — is today’s p99 TTFB at the Tokyo PoP significantly different from the 30-day rolling average? Forecasting capacity requirements demands computing growth trends — what is the month-over-month bandwidth growth rate at each PoP, weighted by content type mix? Evaluating edge worker deployments requires before-and-after comparisons — did the latest code release change error rates, execution time distributions, or cold start frequencies at specific PoPs?

Elasticsearch’s Query DSL and ES|QL provide no window function support. Every temporal trend analysis, every running average, every rank calculation, every lead/lag comparison requires either exporting raw data to an external tool or building fragile approximations through date histogram aggregations that cannot express the inter-row relationships that window functions compute natively. For a performance engineering team trying to detect a p99 latency regression that started 47 minutes ago at three PoPs serving Southeast Asian traffic, the inability to compute rolling percentile comparisons in-database transforms what should be a 10-second diagnostic query into a 30-minute data export and analysis exercise — an eternity during a service degradation incident.

High Cardinality Destroys Aggregation on CDN Dimensions

CDN log data is inherently high-cardinality across multiple dimensions simultaneously. Client IP addresses span millions of unique values per hour. Request URLs — even after path normalization — can produce tens of millions of unique keys when query parameters, API versions, and dynamic path segments are included. User-Agent strings proliferate into hundreds of thousands of unique values across browser versions, operating system variants, and bot identifiers. Edge PoP identifiers, origin server addresses, ASN numbers, TLS cipher suites, and edge function identifiers create additional high-cardinality dimensions.

Elasticsearch’s aggregation engine relies on Global Ordinals — an enumeration of every unique value in a field — that must be rebuilt whenever new segments are created. For high-cardinality fields, recomputing Global Ordinals consumes substantial heap memory and CPU time. The queries CDN teams need most — “top URLs by bandwidth consumption across all PoPs for the last 24 hours” touching tens of millions of unique URL keys, or “latency percentiles by client ASN” spanning 70,000+ autonomous system numbers — are precisely the queries where Elasticsearch’s architecture performs worst, producing either slow responses or triggering circuit breaker exceptions that abort the query entirely.

Production evaluations have documented this behavior explicitly: aggregating on fields with millions of unique values requires building in-memory Global Ordinals structures, and the first query after a segment refresh experiences massive latency spikes — sometimes tens of seconds — while these structures are rebuilt. For CDN analytics where freshness is measured in seconds and queries run continuously, these periodic latency spikes create blind spots in operational monitoring.

JVM Memory Pressure During Traffic Surges

CDN traffic exhibits extreme temporal variance. A viral social media post can increase request rates at affected PoPs by 100x within minutes. Scheduled events — product launches, ticket sales, sports broadcasts — create predictable but massive traffic spikes. DDoS attacks generate enormous volumes of request logs that must be ingested and analyzed in real time. Seasonal patterns (holiday shopping, back-to-school, year-end) create sustained elevation across weeks.

Elasticsearch’s aggregation engine runs on the JVM and holds aggregation state in heap memory. During traffic surges, when CDN analytics is most critical — operations teams need to understand whether the surge is legitimate traffic or an attack, whether PoPs have sufficient capacity, whether cache efficiency is holding — garbage collection pauses become longer and less predictable. JVM heap pressure from concurrent ingestion and analytical queries creates a vicious cycle: ingestion slows because the JVM is spending time in garbage collection, which increases the freshness gap of the analytics, which reduces the value of the monitoring system precisely when it is needed most.

Storage Costs Explode for Retention at CDN Scale

CDN log retention requirements are driven by billing dispute resolution (customers may contest charges months after the fact), security forensics (attack pattern analysis requires historical baselines spanning months or years), compliance requirements (financial services and government customers may require log retention for regulatory audits), and capacity planning (accurate traffic forecasting requires at least 12–18 months of historical data to capture seasonal patterns). At 43 billion records per day, even modest retention periods generate petabyte-scale datasets.

Elasticsearch stores all data on local SSDs with full inverted indexing — including inverted indexes on numeric fields (bytes delivered, response time, edge compute CPU time) that will only ever be aggregated, never searched by keyword. The inability to natively tier cold CDN log data to cost-effective object storage — keeping only the most recent data on fast local storage while moving historical logs to S3-compatible storage — makes Elasticsearch one of the most expensive platforms for the multi-month or multi-year CDN log retention that operations, billing, and compliance teams require. Organizations running Elasticsearch for CDN log analytics at scale routinely report that storage costs consume 60–70% of their total analytics infrastructure budget.

Why StarRocks Excels at Edge Computing and CDN Log Analytics

Exact Aggregation Results for Billing and Operational Metrics

StarRocks performs true distributed aggregations through its Massively Parallel Processing (MPP) architecture. Every backend node processes its local data partition and contributes to a globally accurate result through the query execution pipeline. There is no shard-level candidate list, no approximation, and no error bounds.

When a billing report states that customer ACME-Corp consumed exactly 487,293.847 GB across 12,847,293,441 requests during the current billing period, those numbers are exact. When a cache performance dashboard shows that the Frankfurt PoP achieved a 94.73% cache hit ratio on video content with exactly 2,847,293 cache misses, that metric is precise. Production evaluations processing hundreds of millions of records have confirmed that StarRocks achieved 100% accurate aggregation results — while Elasticsearch struggled with accuracy on the same workloads. For CDN providers where aggregation accuracy directly determines customer invoices and capacity planning decisions, exact aggregations are not a nice-to-have — they are a financial and operational requirement.

Native Multi-Table Joins for Cross-Domain Correlation

StarRocks’ cost-based optimizer (CBO) and vectorized join execution engine eliminate the need to denormalize CDN log records. Analytics teams can maintain a clean relational schema — edge request logs as the primary fact table, with dimension tables for customer accounts, origin server configurations, PoP infrastructure specifications, WAF rule definitions, edge function deployments, and client reputation data — and join them at query time with performance that rivals pre-joined flat tables.

This is not a theoretical advantage. Real-world deployments have demonstrated that StarRocks can join billion-row fact tables with large dimension tables in seconds — the kind of join scale required when correlating every edge request in a 24-hour window with its full customer, origin, security, and infrastructure context. For incident investigations where a performance engineer needs to determine whether a latency regression at specific PoPs correlates with a particular origin server deployment, a WAF rule change, or an edge worker code update, StarRocks’ native join capability turns what would be a multi-hour correlation exercise with Elasticsearch’s denormalized documents into a sub-minute interactive query.

Consider a typical cross-domain correlation query: “For customer X, show me the cache hit ratio by content type at each PoP, joined with the PoP’s current capacity utilization, filtered to PoPs where hit ratio dropped more than 5 percentage points week-over-week.” In Elasticsearch, this query is impossible to express — it requires joining request logs with PoP capacity metrics and computing week-over-week comparisons, neither of which Elasticsearch supports natively. In StarRocks, it is a straightforward SQL query that returns in seconds.

Full ANSI SQL for Trend Analysis and Anomaly Detection

StarRocks supports full ANSI SQL, including the window functions, CTEs, and analytical functions that CDN analytics demands:

  • Window functions for temporal anomaly detection: computing rolling percentiles of TTFB at each PoP and flagging when the current value exceeds the 30-day rolling p95 by more than 2 standard deviations. Computing month-over-month bandwidth growth rates per customer for billing forecasting. Ranking PoPs by cache efficiency within each geographic region to identify underperformers.
  • CTEs for multi-step analytical pipelines: first identify edge requests with TTFB exceeding the p99 threshold, then join to origin server logs to determine whether the latency originated at the edge or the origin, then group by PoP and origin to pinpoint the specific edge-to-origin path causing degradation, then rank paths by impact (affected request volume × excess latency) — all in a single SQL statement that executes in seconds.
  • GROUPING SETS and ROLLUP for hierarchical CDN reporting: simultaneously computing cache hit ratios by PoP, by region, by content type, by customer, and by all combinations thereof in a single pass over the data — producing the multi-dimensional dashboard metrics that CDN operations teams need without running dozens of separate queries.
  • Percentile functions for latency SLA monitoring: computing exact p50, p95, p99, and p99.9 latency values across billions of requests, grouped by customer, PoP, and content type. When a customer’s SLA specifies that p95 TTFB must remain below 50ms at all PoPs, StarRocks can verify compliance across every dimension combination with a single query — not an approximation derived from Elasticsearch’s percentile_ranks aggregation that trades accuracy for speed.

Columnar Storage and Vectorized Execution for CDN-Scale Throughput

CDN log analytics queries are overwhelmingly columnar in nature. A cache hit ratio calculation touches only the cache status column and a few grouping columns out of the 30+ columns in a typical CDN log record. A latency percentile computation touches only the timing columns. A bandwidth billing query touches only the bytes-delivered column and customer identifier.

StarRocks’ columnar storage format reads only the columns referenced by each query, skipping the remaining 80–90% of the data. Combined with the vectorized execution engine that processes data in batches using SIMD instructions — achieving orders of magnitude more throughput per CPU cycle than Elasticsearch’s row-based Java document processing — StarRocks delivers the kind of scan throughput that CDN-scale analytics demands. Where Elasticsearch must deserialize entire JSON documents to extract a single field, StarRocks reads only the needed columns in a compact, compressed, cache-friendly format.

For a query scanning 24 hours of CDN logs — 43 billion records — to compute cache hit ratios by PoP and content type, StarRocks’ columnar storage reduces the effective I/O by 10–15x compared to Elasticsearch’s document-oriented format. Combined with encoding-level compression (dictionary encoding for low-cardinality fields like cache status and content type, delta encoding for timestamps, LZ4 for variable-length fields), StarRocks achieves compression ratios of 5:1 to 10:1 — meaning a dataset that requires 100TB in Elasticsearch can be stored in 10–20TB in StarRocks.

Real-Time Ingestion for Streaming Edge Logs

CDN log analytics demands real-time freshness. When a latency anomaly begins at an edge PoP, operations teams need to detect it within seconds, not minutes. When a DDoS attack starts, security teams need to see the traffic pattern immediately. When an edge function deployment causes elevated error rates, engineering teams need to identify the regression before it impacts significant customer traffic.

StarRocks’ native Routine Load enables direct streaming ingestion from Kafka without external ETL tools, achieving data freshness of approximately 10 seconds from edge event occurrence to queryable state. CDN log pipelines that stream events from edge PoPs through Kafka to StarRocks deliver the real-time visibility that operations teams need during incidents. StarRocks’ Stream Load API provides an additional high-throughput ingestion path for batch and micro-batch log delivery patterns.

Unlike Elasticsearch, where heavy ingestion competes with analytical queries for JVM heap and causes GC-induced latency spikes on both workloads, StarRocks’ architecture isolates ingestion from query execution. The separation of storage-layer ingestion from query-layer processing means that a traffic surge that doubles ingestion volume does not degrade analytical query performance — the exact operational guarantee that CDN teams need during the incidents when analytics matters most.

Materialized Views for Precomputed Dashboard Metrics

CDN operations involve many recurring metric patterns: per-minute cache hit ratios by PoP, hourly bandwidth consumption by customer, daily latency percentile summaries by region and content type, and rolling 7-day traffic trend comparisons. Computing these from raw CDN log tables containing billions of rows on every dashboard refresh is wasteful and slow.

StarRocks’ asynchronous materialized views pre-aggregate CDN log data into the metrics teams need, and the optimizer’s transparent query rewrite automatically routes queries to materialized views without changes to application SQL. In production deployments, this capability has demonstrated over 10x dashboard query performance improvement, achieving thousands of queries per second with p99 latency under 130ms. For CDN monitoring dashboards serving dozens of operations engineers simultaneously — each watching different PoP clusters, customer segments, and traffic dimensions — materialized views transform the workload from cluster-straining real-time scans into low-latency lookups that scale linearly with concurrent users.

A particularly powerful pattern for CDN analytics is the cascading materialized view: a base materialized view aggregates raw request logs into per-minute, per-PoP, per-content-type summaries, and a second-level materialized view further aggregates those summaries into hourly and daily rollups. Queries automatically route to the appropriate aggregation level based on the time granularity requested — second-level queries hit the raw data, minute-level queries hit the first materialized view, and hour- and day-level queries hit the second — delivering consistent sub-second latency regardless of the time range span.

Storage Tiering for Cost-Effective Long-Term Retention

StarRocks’ shared-data architecture enables transparent storage tiering between fast local cache and cost-effective object storage (S3, GCS, Azure Blob, MinIO). Recent CDN logs — the last 24–72 hours that drive real-time monitoring — reside in local NVMe cache for maximum query performance. Historical logs — the weeks, months, and years of data needed for billing dispute resolution, security forensics, and capacity forecasting — reside in object storage at a fraction of the cost.

The query engine transparently fetches data from the appropriate tier with intelligent cache prefetching that minimizes the performance impact of querying historical data. For a CDN provider retaining 18 months of log data to capture full seasonal traffic cycles, storage tiering typically reduces total storage costs by 60–80% compared to Elasticsearch’s all-SSD architecture — transforming CDN log retention from a budget crisis into a manageable operational expense.

This cost advantage is multiplicative with StarRocks’ superior compression. A dataset that consumes 100TB of SSD storage in Elasticsearch might require only 15TB in StarRocks after columnar compression — and of that 15TB, only 1–2TB needs to reside on fast local cache, with the remainder in object storage at $0.023/GB/month. The combined savings routinely exceed 90% of the original Elasticsearch storage bill.

High Concurrency for Multi-Tenant CDN Dashboards

Commercial CDN providers offer analytics dashboards to their customers — each customer viewing their own traffic patterns, cache performance, latency metrics, and security events filtered to their account. A CDN with 500 enterprise customers, each with 5–10 active dashboard users, generates 2,500–5,000 concurrent analytical queries at peak.

StarRocks’ architecture is designed for high-concurrency analytical workloads. The combination of materialized views (reducing per-query compute cost), the cost-based optimizer (generating efficient execution plans that minimize resource consumption), and the vectorized execution engine (maximizing throughput per CPU cycle) enables StarRocks to serve thousands of concurrent queries with consistent sub-second latency. Production deployments have demonstrated sustained throughput of 1,000+ queries per second with p99 latency under 200ms — the kind of concurrency headroom that a multi-tenant CDN analytics platform demands.

Elasticsearch’s concurrency ceiling is fundamentally lower. Each analytical query consumes JVM heap for aggregation state, and the fixed heap size (typically 26–30GB) creates a hard upper bound on concurrent analytical complexity. Under 500 concurrent dashboard queries with multi-dimensional aggregations, Elasticsearch clusters routinely experience heap pressure, GC pauses, and cascading slowdowns that degrade the experience for all users simultaneously.

A Concrete Architecture: CDN Log Analytics on StarRocks

To illustrate how these advantages compose into a production system, consider a CDN analytics platform processing 500,000 requests per second across 200 PoPs:

Schema design: A primary edge_requests fact table using StarRocks' Duplicate Key model, partitioned by date and bucketed by PoP identifier, contains the raw request log fields. Dimension tables for customers, pop_infrastructure, origin_servers, waf_rules, and edge_functions maintain current configuration and metadata. A client_reputation table, updated hourly from threat intelligence feeds, provides IP-level risk scoring.

Ingestion pipeline: Edge PoPs stream request logs to regional Kafka clusters. StarRocks Routine Load consumers ingest from Kafka with configurable micro-batch intervals (typically 5–10 seconds), delivering queryable freshness within 10 seconds of the edge event.

Materialized view hierarchy:

  • Level 1: Per-minute aggregates by PoP, customer, content type, and cache status — supporting real-time operational dashboards.
  • Level 2: Per-hour aggregates with latency percentiles (p50, p95, p99) — supporting SLA monitoring and trend analysis.
  • Level 3: Per-day rollups with full dimensional breakdowns — supporting billing, capacity planning, and executive reporting.

Query patterns: Real-time operational queries hit Level 1 materialized views and return in under 100ms. Ad-hoc investigation queries join raw edge_requests with dimension tables and return in 2-5 seconds for single-day scans. Billing queries aggregate Level 3 materialized views and return in under 1 second. Historical trend analyses spanning months use window functions over Level 2 or Level 3 views and return in 3-10 seconds.

Storage economics: At 43 billion records per day averaging 400 bytes raw, daily ingestion is approximately 17TB raw. With StarRocks’ columnar compression achieving 7:1, stored size is approximately 2.4TB per day. With 90-day hot retention on local NVMe and 18-month total retention in object storage, the total storage footprint is approximately 220TB in local cache plus 1.3PB in object storage — compared to approximately 9.2PB of SSD storage that the same retention would require in Elasticsearch.

Conclusion

Edge computing and CDN log analytics sits at the intersection of extreme data volume, extreme dimensional cardinality, extreme freshness requirements, and extreme accuracy demands — a combination that systematically exposes every architectural limitation of Elasticsearch’s document-oriented, JVM-dependent, inverted-index-centric design. StarRocks’ MPP architecture with exact distributed aggregations, native multi-table joins, full ANSI SQL with window functions, columnar storage with vectorized execution, real-time streaming ingestion, materialized view acceleration, object storage tiering, and high-concurrency query serving provides a purpose-built analytical foundation that transforms CDN log data from an operational burden into a strategic asset. For CDN providers and enterprises operating edge infrastructure at scale, the migration from Elasticsearch to StarRocks is not merely an optimization — it is an architectural correction that aligns the analytical engine with the analytical workload.


메타데이터
post_id
7ed2f48184bd
slug
why-starrocks-is-better-than-elasticsearch-for-edge-computing-and-cdn-log-analytics-7ed2f48184bd
url
https://medium.com/@indomitability/why-starrocks-is-better-than-elasticsearch-for-edge-computing-and-cdn-log-analytics-7ed2f48184bd
canonical_url
https://medium.com/@indomitability/why-starrocks-is-better-than-elasticsearch-for-edge-computing-and-cdn-log-analytics-7ed2f48184bd
author_url
https://medium.com/@indomitability
status
ok
fetched_at
2026-06-10 15:53:41