Skip to content

Introducing columnar storage for high-performance analytics

For years, DX has equipped every customer with a fully‑managed, tenant‑isolated Postgres data lake—perfect for high‑frequency event tracking, real‑time dashboards, and sub‑second transactional workloads. That OLTP layer still powers mission‑critical flows such as CI/CD deployment logs, alerting rules, and live productivity metrics.

But when engineering leaders want to slice years of data, join massive tables, or run heavy time‑series analyses, row‑oriented Postgres can hit a performance wall. Complex aggregates stall, dashboards time out, and analysts revert to offline extracts—breaking the promise of a single system of record.

Today, we’re excited to remove this ceiling by introducing columnar storage. With this launch, DX now offers every customer the option to add a dedicated OLAP database—built on a vectorized columnar engine and Apache Iceberg tables.

This new analytical layer is automatically synchronized with each tenant’s Postgres database, giving customers a seamless bridge between real-time transactional data and fast, scalable analytics. Think of it as a purpose‑built analytics turbine sitting beside your operational store.

In benchmarks, our columnar layer delivers 10x to 100x faster analytical query performance compared to traditional Postgres. Queries that previously took tens of seconds or minutes—or needed to be batched offline—now return in seconds, even over hundreds of millions of records.

With columnar storage, DX customers can now:

  • Run deep historical analyses of developer activity across years
  • Explore time-based trends at scale, such as DORA metrics
  • Perform high-granularity aggregations across repositories, teams, or tools
  • Enable AI-powered insights and anomaly detection on large datasets

What makes this update especially powerful is that you don’t need to choose between transactional and analytical performance. With DX, you now get both—synchronized automatically.

This dual-architecture unlocks new possibilities across engineering organizations, from platform teams investigating build pipeline efficiency, to leaders analyzing tool adoption trends, to AI agents scanning for anomalies in developer workflows.

Columnar storage is now available to all DX customers. We’re rolling it out starting late Q2 and continuing through Q3. If you’re interested in enabling this feature for your account, please reach out to your DX account manager.

 

Published
May 12, 2025