Executive Summary
Organizational theory is riven by an often unacknowledged schism. The dominant paradigm, Managerial Optimism, treats dysfunction as a pathology that superior leadership, better design, culture change, or human-capital engineering can correct. A minority tradition, Structural Pessimism, treats dysfunction as physics: an inevitable byproduct of complexity, hierarchy, and the limits of formal systems.
The paper examines 19 contemporary and classic texts, alongside research in cybernetics, sociology, and critical management studies. Managerial Optimism offers psychological comfort and a sense of agency; Structural Pessimism provides the more robust explanation for why organizational failure persists. (In this paper's terms, the optimist tradition is labeled "the Mirror" and the structural tradition "the Cage.")
Fixability Theories
The optimist tradition follows a medical model: a healthy organization is rational and frictionless, and deviations have removable causes such as a toxic leader, misaligned incentives, poor culture, or missing skills. Fifteen of the 19 texts fall here, in three groups: engineers who tune the organization as a machine, therapists who heal its culture, and heroes who wield it as an instrument of a visionary leader. The paper also reads newer practices (skills-based organizations, Agile, OKRs) as high-modernist attempts to force legibility on complex human systems rather than solutions to structural problems.
Structural Theories
Only four of the 19 texts substantially support the structural view: Cyert and March's A Behavioral Theory of the Firm, Jackall's Moral Mazes, Perrow's Complex Organizations, and the Shafritz, Ott, and Jang anthology that collects them. The structural account rests on scale and the compression of capability, incompleteness, legibility (after James C. Scott), and legal and fiduciary constraint.
The Evidence
The paper concludes that what is called dysfunction is often the system working as designed: bureaucracy that slows innovation secures legal defensibility, silos secure unit accountability, and apparent managerial stupidity is an adaptation to patrimonial loyalty. Optimistic tools fail because they attack behavior rather than the structure that produces it. Faster data processing in algorithmic management does not solve incompleteness; it lets organizations make mistakes faster.
Key References
A Behavioral Theory of the Firm.
Moral Mazes: The World of Corporate Managers.
Complex Organizations: A Critical Essay.