Is Data Unification a process problem?
Dec 23, 2024
Physical unification of spacecraft has a long track record of success-from the Apollo-Soyuz mission that connected 5-foot nozzles after traveling ~1 million miles to SpaceX’s recent recapture of its 400-foot Starship with “chopsticks”. Enterprise data unification has a less glamorous history. While declarations of victory abound, the reality is not pretty. Every data analyst knows that joining two simple datasets is still cumbersome, and an enterprise data-merge involving multiple systems is near-impossible. Most organizations struggle to unify data on customers, suppliers and products. Why? The textbook answer is that it is a “process” problem. But if this were true, surely many disciplined companies would have executed “best practices” already. It is time to admit that the problem is deeper. Data unification is a logical problem, not just a physical one. And logical data management has not kept pace with data complexity. Closing this gap requires a new wave of innovation.