Crow Intelligence

Tag: philosophy of science

  • The Limits of Algorithmic Economic Planning: Why Data Can’t Replace Democracy

    The Limits of Algorithmic Economic Planning: Why Data Can’t Replace Democracy

    TL;DR

    Big Data and AI cannot solve the fundamental problems that have always plagued comprehensive social planning. Historical failures (Soviet shortages), philosophical limits (theory underdetermination), and reflexive feedback loops still apply to algorithmic systems. While machine learning excels in narrow, stable domains like meteorology and industrial optimization, it distorts complex social systems when given sweeping control over economic coordination. The dream of replacing democratic deliberation with algorithmic optimization ignores essential insights from economics, philosophy, and history about the nature of social knowledge and human choice.

    China’s government is building the world’s most ambitious experiment in data-driven governance. Under its new digital ID system, citizens submit facial scans and personal information to police databases, then use anonymized identities to access online services. The state maintains a comprehensive ledger of every person’s digital activity while companies see only streams of anonymous data. Chinese planners envision this as creating a unified national “data ocean” – treating data as a factor of production alongside labor, capital, and land. The goal is to harness unprecedented information flows to optimize economic coordination and social management through algorithmic systems.

    The dream of scientific management refuses to die. From Soviet planning bureaus to today’s tech evangelists promising “real-time economics,” each generation rediscovers the appeal of replacing messy human judgment with algorithmic precision.

    (more…)
  • Statistical Thinking as Philosophy: Essential Readings – Part I.

    Statistical Thinking as Philosophy: Essential Readings – Part I.

    “Philosophy of science without history of science is empty; history of science without philosophy of science is blind.” — Imre Lakatos

    Statistics isn’t just a collection of mathematical techniques—it’s a way of thinking about the world, addressing uncertainty, and drawing conclusions from incomplete information. As data scientists, machine learning engineers, and AI practitioners, we often apply statistical methods without reflecting on their theoretical foundations. Yet our work implicitly embodies philosophical stances about knowledge, evidence, and inference.

    This series presents foundational readings that shed light on the philosophical aspects of statistics. They are not intended to turn data practitioners into philosophers, but to offer accessible ways to reflect on the assumptions that underlie our daily work.

    (more…)
  • Building Resilient Tech Teams: The Theory-Building Approach

    Building Resilient Tech Teams: The Theory-Building Approach

    In this article, I argue that tech teams’ success depends not only on their technical skills but also on their ability to collectively build and refine theories about their work. Drawing from Peter Naur’s Programming as Theory Building, I will explore how shared understanding, tacit knowledge, and cognitive diversity contribute to resilient teams capable of delivering sustainable solutions.

    Many tech teams struggle despite having talented individuals. They deliver initial solutions efficiently but falter when requirements change, key team members leave, or when they need to pivot. These failures often stem not from technical incompetence but from insufficient theory-building—the lack of a shared, evolving understanding that transcends documentation and enables adaptation.

    (more…)
  • Falsifiable Hypotheses: How Popper’s Philosophy Transformed My Data Science Practice

    Falsifiable Hypotheses: How Popper’s Philosophy Transformed My Data Science Practice

    WHEN a carefully designed data science initiative falters despite months of development and substantial investment, the root cause often lies not in the algorithms themselves but in epistemology—our approach to knowledge. Behind failed recommendation systems and underperforming predictive models frequently lies a common oversight: the absence of clearly defined conditions under which the underlying hypothesis would be considered disproven.

    Karl Popper formalized this as the demarcation problem: what separates genuine science from pseudoscience is its willingness to articulate the conditions under which a theory would be abandoned. This seemingly academic distinction has transformed my journey from enterprise software developer to successful startup founder, providing a robust framework for both technical decisions and business pivots.

    While technology practitioners rarely discuss philosophy of science or quote Roman philosophers, these frameworks offer practical armor against the most expensive mistakes in data science. In my experience, combining Popperian falsification with Stoic acceptance of reality creates something powerful—a methodology that ruthlessly tests hypotheses while enabling the emotional discipline to abandon failed approaches, however personally or professionally painful.

    (more…)
  • The Language of Economic Research: How Ideology Shapes Economic Discourse

    The Language of Economic Research: How Ideology Shapes Economic Discourse

    A groundbreaking study, Political Language in Economics,  reveals how political ideology shapes economic research by analyzing academic writing patterns using machine learning techniques. The researchers found that economists’ political leanings, predicted from their writing style, correlate with their empirical findings on policy-relevant issues: conservative economists tend to find evidence supporting free-market policies. In contrast, liberal economists discover data backing government intervention. They also documented clear ideological sorting across different fields, with labor economics attracting more liberal scholars while finance and macroeconomics drawing more conservative ones. This correlation between ideology and research findings flows through even technical academic papers that are supposedly objective.

    Does this mean economics is just subjective pseudo-science? No! As philosophy of science showed us, there is no such thing as truly objective science – as Kuhn and Feyerabend demonstrated, even physics contains subjective elements. The dismal science is no exception. While this study offers valuable insights, it could benefit from more modern topic modeling approaches and the rich toolkit of corpus linguistics to deepen our understanding of how ideology manifests in economic discourse.

    (more…)