What is a Black Box?

In his book, The Unaccountability Machine, Dan Davies borrows the engineering idea of the “black box” and applies it to corporate and political life.

A black box is simple to describe and maddening to manage. You can see what goes in. You can see what comes out. But the internal circuitry—the rules, incentives, feedback loops—are opaque, even to the people nominally in charge. Modern institutions are full of them: compliance functions, risk models, procurement systems, algorithmic dashboards. Each has its own embedded logic and optimizes for something. Often not what you think.

The managerial temptation is to peer inside and “fix” the gears. Davies’ point is that this instinct is frequently futile. In sufficiently complex systems, you cannot micromanage internal logic without breaking something else. The black box will produce output—results, errors, noise—according to its design and constraints.

So effective leadership looks less like command and control, and more like calibration. You watch the outputs and detect patterns. You adjust inputs and incentives. In other words: you manage the interface, not the machinery.

---