Aiger Data
Pattern 04 · Many sources, one view

Many sources, one consumption view.

A data estate accumulated through years of growth and acquisition has fragmented into a tangle that buries the data team in maintenance and leaves business teams arguing about which number is right.

Exercises · Data · Trust

The situation

An enterprise’s data estate has grown through years of organic growth and acquisitions into hundreds of source systems, none of which agree with each other and most of which the original architects have moved on from. Business teams stitch the consolidated view together by hand each cycle, in spreadsheets that grow more fragile each quarter. Reports across functions contradict each other regularly. The data team is buried in pipeline maintenance and ad-hoc requests; analysis happens at the margins.

The default move is a single-platform migration — pick the consolidating platform, move everything onto it, retire the rest. It is clean on a slide. It is unfinishable in reality at the scale of an acquisition-built estate. Years pass; the migration’s centre of gravity drifts; the original outcome recedes.

The discipline

The discipline is to design for hybrid, because hybrid is what the operational reality actually is. Use the right tool for each class of source: the high-performance engine for the platform-native data, the lake for the long tail and the analytics workloads, and a unified semantic layer above both so the consumption view is one regardless of where the data physically lives.

The migration itself happens in phased waves — the highest-priority sources first, validated, in production. Each subsequent wave is easier because the patterns have settled. The ingestion is then operated as a discipline — a managed service with quality SLAs, lineage, and stewardship — rather than as a parade of one-off project deliveries.

What changes for the organisation is not the volume of data. It is what the data team’s time is spent on. Pipeline maintenance recedes. Stewardship and quality become the steady-state work. The argument moves from which number is right to what the numbers mean.

Where it sits

This pattern exercises data and trust together. Data, because the foundation being built IS a data foundation — entity-resolved, semantically consistent, lineage-traceable. Trust, because the governance operating model — stewardship roles, quality SLAs, lineage as a first-class artefact — is exactly the trust infrastructure the autonomous enterprise needs.

In the practical sequence, this pattern is often the lighthouse-and-foundation work the second stage describes. The unified consumption view is the lighthouse use case; the hybrid platform and the managed ingestion are the foundations being built underneath it.