When Systems Decide What Counts

AI, aged care, and the quiet reshaping of a human life

pexels-pavel-danilyuk

The email arrives—as it did recently for thousands of workers in one of Australia’s most admired tech companies.

Not a conversation. Not a meeting. Not even a phone call.

An email.

Hundreds—sometimes thousands—of people are learning, in a few carefully worded paragraphs, that their roles no longer exist. The explanation is clean, almost frictionless.

The company is “leaning into AI.”

The structure is being “simplified.”

The future requires “efficiency.”

And beneath it all, a quieter message sits, unspoken but understood:

It wasn’t us. It was technology.

That line has been sitting with me.

Because technology doesn’t make decisions. People do.

Around the same time, I have been watching another system at work—one much closer to home. The Australian Aged Care system. Here, the language is different, but the pattern feels familiar.

Recent changes to Aged Care assessment are moving toward computer-based algorithms to assess what level of support a person is deemed to need. And, reportedly, it cannot be overridden by humans. What was once a conversation is becoming a calculation.

And while that may improve consistency at scale, it raises a quieter question:

What happens when a life is reduced to what a system can measure?

On the surface, it sounds supportive. Sensible, even.

But sit with it for a moment, and something subtle emerges.

Two very different domains. Work. Care.

And yet, the same quiet pattern runs through both.

The system makes certain behaviours easy—and in doing so, it quietly reshapes what counts.

In the workplace, systems now make it easy to:

• measure output

• standardise tasks

• replace human effort with machine-generated alternatives

• remove the friction of difficult conversations

What becomes harder—and therefore less visible—is everything that does not fit neatly into those measures:

• loyalty

• judgment

• experience

• tacit knowledge

• care for the work itself

A lifetime of capability becomes invisible to systems that no longer know how to recognise it.

In Aged Care, the pattern is different, but no less powerful.

The system makes it easy to:

• transfer responsibility

• outsource daily tasks

• increase service use

• spend unnecessary funds

What becomes harder—and therefore less visible—is:

• maintaining your capability

• preserving your independence

• exercising your judgment about real needs

Recently, while reviewing my father’s aged care package with him, we discussed the surplus in his account. His provider had gently encouraged him to see what he could spend those funds on. His response was “I don’t need anything more right now.” His quiet refusal is a form of agency. But the system is not designed to reward that.

This is not a critique of any one organisation. Nor is it an argument against technology or support systems. These systems do many things well. They make modern life possible.

But they share a common orientation:

Systems are designed to optimise themselves — not to preserve human capability or dignity.

And over time, that matters.

Because capability is not static. It is either used or it fades. Either expressed, or it becomes invisible—even to ourselves.

For those of us thinking about aging, this is not an abstract concern.

It is the terrain we are living in.

We are moving through systems that:

• prioritise efficiency

• reward convenience

• and quietly invite us to hand over responsibility

Sometimes that invitation looks like progress.

Sometimes it looks like support.

Sometimes it looks like relief.

But underneath, a question remains:

What happens to a life when less is required of it?

I am not anti-technology.

In fact, I am using it every day to extend my own capability in ways I could not have imagined even a few years ago. But I am paying attention. Because the same tool that expands individual capability can, at scale, reduce the need for it.

So the question is not:

Is AI good or bad?

Is the system working or not?

The question is:

What is this system making easy—and what is it quietly taking away?

Aging well, in this environment, is not about keeping up.

It is about staying awake.

It is about continuing to:

• build capability

• use it

• express it

• and take responsibility for where it is applied

Even when—especially when—the system makes it easy not to.

Because no system will preserve your agency for you.

A lifetime of capability, left unused, does not disappear in a moment.

It erodes quietly. One small, easy decision at a time.

---