The Calculator Problem: From Tools to Disempowerment

Article 1 of 4: Culture, Knowledge, and Illich’s Threshold

This is the first in a series about institutional violence and the blueprints we’re handed for how to live. I’ll start with technology, move to time, then to the body itself, before revealing the frame connecting them all.

My method is philosophical but grounded. As a data scientist with neuroscience training and an endurance athlete, I’ve spent years watching tools I thought I controlled slowly begin to control me. Let’s begin: How do you know when a tool has crossed from helping you to disabling you?

I. The Student Becomes the Master

I have two relationships with AI that teach me everything about Ivan Illich’s concept of tools crossing a threshold.

In data science, AI is my student. I describe what I want; AI generates code. I review it with fifteen years of expertise. I can smell bad architecture, spot hidden bugs. AI amplifies my capacity. I remain the architect. This is what Illich called a convivial tool.

In web development, AI is my master. I describe what I want and AI generates structures I mostly trust but can’t fully evaluate. I know I’ll eventually need an expert to audit this work. To tell me what I’ve built. This is frightening.

Same person. Same tool. Different outcomes.

The variable isn’t technology. The variable is my relationship to the underlying knowledge. In data science, I have culture, intuitive wisdom accumulated over years. In web development, I have knowledge from documentation, but lack the culture. The feel of when something’s wrong.

AI in the hands of someone with culture is an amplifier. AI in the hands of someone with only knowledge is a replacement. And replacement means atrophy.

II. The Panopticon in Your Pocket

I quit Facebook in 2009. Yet Strava captured me completely.

The progression was somehow textbook but at that time, didn’t felt it hidden behind goodwill: Healthy tracking became unhealthy competition. Routes chosen for segment opportunities rather than beauty. My boss noticed my morning runs why wasn’t I in the office? Strangers messaged: “I saw you on the bike path.” The city became a panopticon.

Finally, running was no longer running. It was data generation. A workout that wasn’t tracked didn’t happen. The felt sense of effort, the intimate knowledge of what my body could do, all subordinated to what the app said I did.

I quit after three years. But here’s what disturbs me: I knew better. I have a master’s in neuropsychology. I understood reward systems, dopamine circuits, how external validation reshapes motivation. And I still got captured.

If I couldn’t see the threshold until I’d crossed it, what hope does anyone else have?

III. Culture vs. Knowledge

Ivan Illich identified a pattern: Tools that start by empowering people eventually cross a threshold where they begin disabling them.

Think about calculators and mathematics. If you understand multiplication, have an intuitive feel for magnitudes, then a calculator amplifies your capacity. But if you reach for the calculator from the start, you never develop the number sense that tells you when it’s given you an absurd answer. You’ve outsourced not just execution but the culture of mathematics.

Knowledge is transferable, codified, it’s what’s in textbooks. You can acquire it quickly. AI can have it.

Culture is embodied, accumulated through practice. It’s the aesthetic sense of when code “smells” wrong even if it compiles. The intuition about which approach will be elegant versus chaotic. The feel of when your body needs rest versus laziness. AI cannot have this. If you let AI do your work for you, you’ll never develop it.

This is the violence of premature optimization. We skip the struggle and jump to solutions. We get the answer but miss the education.

AI can analyse and athlete’s data and help optimise its training but will never feel the soreness of its muscles mental fatigue from travels and life. We need this real life experience to interpret today’s AI.

IV. The Statistical Climax We Can’t See

My deepest fear: What if we can’t see the threshold because we’re riding the wave?

We’re in the middle of an AI revolution. Every month brings impossible capabilities. Those who don’t adapt risk being left behind. But what if we’re already past the peak? What if optimal AI use was two years ago? What if most of us already collectively crossed into dependency?

I watch younger developers, brilliant people, who’ve never coded without AI. They generate complex applications in hours. But when I ask them to explain architectural decisions without running code, they struggle. They can prompt but can’t debug. They’re faster than me by every metric that matters to employers.

But they can’t read their own code. And they don’t know that they can’t.

This is Illich’s nightmare: the disabling profession. And because everyone adopts simultaneously, there’s no control group. We won’t know what we’ve lost until we try to do something requiring the capacity we’ve let atrophy, and discover it’s gone.

V. Take home message

What can you do to mitigate take over control ?

Notice when you’ve lost capacity. Can you still do it without the tool? If not, you’ve crossed the threshold.
Protect deliberate friction. Sometimes code without AI. Sometimes train without tracking. Feel what struggle teaches.
Distinguish culture from knowledge. You can look up facts. You can’t look up intuition. Guard capacities that take years to develop.
Be suspicious of speed. Optimization usually means something’s being sacrificed. Make sure you know what.

Im my next article, I’ll examine time itself, how institutions colonize our circadian rhythms the same way Strava colonized my running. How sleep becomes the last ungovernable space.

For now: What capacity are you losing without realizing it? And is the convenience worth the cost?

Next: “Sleep as Rebellion—The Body’s Refusal”

Sources: Ivan Illich, Tools for Conviviality (1973); Shoshana Zuboff, The Surveillance Capitalism (2019); Matthew Crawford, Shop Class as Soulcraft (2009); Albert Camus, The Myth of Sisyphus (1942)