Discussion about this post

User's avatar
Keith Lowery's avatar

For several years I was a principal engineer at Amazon and I was a periodic member of the "availability team" which did post-mortem analysis of every event that caused the web site to go down. Amazon is/was the most operationally competent company I have ever worked for but the scale at which they operated required a level of complexity that no one could really get their arms around. No one fully understood the inter-relationships and dependencies between all the micro-services. The system required intense, continuous automated monitoring to achieve our goals in terms of uptime/availability. (At one point, fully 20% of the entire system's compute capacity was being consumed merely to process faux requests that checked on whether the system was up.) Everything you say about the challenges of complex systems is true. But I will offer a couple of other observations.

First, when faced with complex systems, human beings have a strong propensity to develop superstitious explanations for the visible phenomena they observe. (The last talk I gave to the engineering organization before leaving Amazon was called "Superstitious Architectures: How to Avoid Them".) Prying understanding from complex systems is hard and people are often happy to settle for superstition. (I offer as evidence a lot of what the lay press is saying about AI right now.) What this means in practice is that complexity causes human actors to operate in a state of greater general ignorance. Not a happy circumstance when the sh*t hits the fan.

Second, people are being driven to despair of their own human agency as their dependence on technology they can never understand grows. This is not entirely accidental I suspect and is probably even a little sinister. This has the effect of increasing dependency within the general population and reducing the sum total of initiative in the population at large.

Your advice to focus on simplifying our own lives is wise and even prescient I suspect.

Thanks for this essay.

Expand full comment
Richard's avatar

Excellent essay.

The failure cascade of complex systems is not limited to war. Consider the collapse of Just in Time inventory systems during the COVID lockdowns. One bottleneck proved to be able to shutdown whole industries. A major disaster loomed when the Governor of Pennsylvania shut down all of the rest stops and restaurants along the PA interstates. This effectively cut the major supply line to NYC. President Trump and the President of the Teamsters "explained" things and got the order rescinded.

Going back to the defense of Israel, they had apparently forgotten the failure of the Bar Lev Line in 1973. Technology aside crust defenses are inherently fragile. See also Maginot Line and Great Wall of China. If you depend solely on a crust defense, once the enemy breaks the crust, they have a free run in the vacuum behind the crust. What is needed is defense in depth to contain the attack while larger forces mobilize to drive it back. Especially in an age of terrorism, an armed citizenry is indispensable. Citizens are the targets of terrorism so by definition they are the first to fight. Behind them are police, regional military (National Guard in an American context) and then the regular military.

Expand full comment
83 more comments...

No posts