A Principle That Feels Reassuring
In almost every conversation about AI and software delivery, one principle keeps returning as the safe answer: keep humans in the loop. It sounds reassuring. It sounds responsible. It sounds like the natural counterbalance to systems that are getting faster, more capable, and increasingly harder to fully inspect. But I’ve been wondering lately if we are treating that principle as a destination, while it may actually be something else entirely. A temporary phase. A bridge. A comfort model we hold onto while the ground is still moving beneath us.
The SDLC Starts to Feel Less Stable
As AI moves deeper into the software delivery lifecycle, the old mental model of the SDLC starts to feel less stable. At first, the role of AI seemed clear enough. A copilot here, a code suggestion there, maybe some generated test cases or documentation. But that framing already feels outdated. We are now looking at systems that can interpret requirements, generate code, assemble tests, draft technical documents, prepare deployments, analyze runtime signals, and increasingly participate across the full chain of delivery. If that chain becomes executable from end to end, does it still make sense to imagine humans actively sitting inside every step? Or are we projecting today’s governance instincts onto a future architecture that may not actually need them in the same way?
The Dark-Factory Thought Experiment
That question is what brought me to the image of a dark factory. Manufacturing has known the metaphor for years: a factory that can run without humans physically present on the floor. What makes it harder to dismiss today is that, in software delivery, this no longer sounds entirely hypothetical. Some teams already talk as though they are operating early forms of it in production: intent goes in, artifacts are generated, validation runs automatically, deployments are prepared or executed, telemetry flows back, and the system adjusts inside predefined boundaries.
So perhaps the more unsettling thought is not that dark-factory SDLC might arrive one day, but that fragments of it may already be appearing while we are still speaking the language of transition. We may still describe software delivery as a human-led chain with AI assistance layered onto it, even as parts of that chain start behaving more like an autonomous production system. If that is true, then the vocabulary of the SDLC may already be lagging behind the architecture it is trying to describe.
And that leaves a question hanging in the air. If the loop can already run for meaningful stretches without direct human touch, what exactly remains of human-in-the-loop as a durable design principle? Is it still the destination? Or is it beginning to look more like an intermediate phase — one that makes sense while autonomy is still uneven, but not necessarily forever?
Is Human-in-the-Loop a Destination or a Transition?
And if that is even partially true, what does that do to the familiar idea of human-in-the-loop? Is it really the long-term model? Or is it more like an intermediate state that appears during the transition from manual delivery to autonomous delivery? It is easy to imagine that first phase: AI assists humans. It is also easy to imagine the second: AI executes, humans approve. But I keep wondering about that middle stage. Does it really scale? Or does it slowly collapse under its own weight?
When Review Turns Into Queue Processing
Because once AI starts producing work at machine speed, the volume changes everything. More code. More tests. More recommendations. More deployment proposals. More warnings. More generated artifacts. More decisions. In that environment, does human review become stronger, or does it gradually thin out into something more ceremonial? People can only absorb so much. At some point, governance stress sets in. Reviewers are no longer reviewing in the real sense of the word. They are processing. Approving. Clearing the queue. Trying to keep the flow moving. And that raises an uncomfortable possibility: maybe the danger is not only that humans leave the loop. Maybe the danger is that they remain inside it as exhausted button-clickers, while everyone continues pretending the presence of approval still equals the presence of judgment.
The Difference Between Approval and Control
That distinction keeps pulling at me. A visible checkpoint is not the same as understanding. A click is not the same as accountability. A formal approval does not automatically mean meaningful control took place. So what are we actually protecting when we insist on humans remaining inside every machine-driven step? Are we preserving safety? Or are we preserving the appearance of safety, because it still fits our current mental model of governance?
Could the Loop Quietly Stop Needing Us?
And if that is true, another question follows. Could the deeper shift be that the loop itself starts to stop needing humans at the operational level? Not because humans no longer matter, but because the mechanics of the loop increasingly favor automation. Repetitive coding, standard test generation, routine documentation, deployment choreography, first-line monitoring interpretation, large parts of technical translation, perhaps even chunks of issue triage and remediation — these all begin to look like activities that can be pulled into bounded autonomous systems. Not trivial work. Not unimportant work. Just work that may become increasingly machine-executable.
Maybe Humans Move Outward, Not Away
So perhaps the more interesting question is not “Will humans disappear?” but “From where do they disappear?” Maybe they do not disappear from software delivery altogether. Maybe they disappear from the flow, while remaining deeply present around it. That possibility feels important to me. Humans still define intent. Humans still decide what kind of risk is acceptable. Humans still shape architecture boundaries, reversibility, trust models, policy rules, and escalation paths. Humans still investigate anomalies, challenge outcomes, and redesign the system when it drifts away from the values or objectives it was supposed to serve. In that framing, the human role does not vanish. It moves. Upward. Outward. Toward the design of the factory rather than participation in each movement inside it.
A Different Kind of Engineering Work
I suspect that shift is already visible in small ways. In more agentic environments, engineers seem to spend less time only producing artifacts and more time thinking about constraints, auditability, rollback, identity, boundary conditions, and the question of what the system is allowed to do on its own. That makes me wonder if part of the future of engineering is not manual authorship of every step, but authorship of the behavioral substrate that governs autonomous delivery. That line of thinking also resonates with a broader possibility I explored elsewhere: that software itself may gradually dissolve into runtime behavior, policy, and dynamically assembled capabilities rather than fixed applications and static interfaces. And it seems connected to the broader enterprise reality that AI maturity may depend less on raw model capability and more on governance design, trust boundaries, and adaptive control structures.
Not Every Domain Will Move at the Same Speed
Of course, this does not mean all domains move in the same way or at the same speed. It is easy to imagine a darker, more autonomous model emerging first in internal tooling, highly testable platforms, bounded workflows, and lower-regulation environments. It is harder to imagine the same pace in healthcare, finance, defense, or critical infrastructure. But even there, I find myself asking: is the difference permanent, or only temporal? If autonomous delivery becomes sufficiently reliable, sufficiently reversible, and sufficiently auditable, how long will organizations keep defending human presence in every operational step? At what point does that begin to look less like prudence and more like attachment to an older mode of control?
The Question Beneath the Question
That may be the real question underneath all of this. Not “Should humans remain in the loop?” but “What kind of loop are we heading toward?” One that still fundamentally depends on continuous human participation? Or one that gradually becomes autonomous enough that human value is expressed mostly through design, intervention, and accountability at the edges?
Planting the Seed
I do not see this as a directive statement. More as a seed worth planting. Because if dark-factory SDLC is even directionally plausible, then human-in-the-loop may not be the enduring principle many assume it to be. It may simply be the language of a transition period — the phrase we use while we are still learning how much autonomy we can tolerate, how much trust we can engineer, and how much of software delivery is really craft, versus coordination machinery waiting to be absorbed by a new abstraction layer.
A Final Thought
Maybe humans will remain in the loop far longer than I think. Maybe they won’t. But I do keep coming back to the same thought: perhaps the future of AI-driven SDLC is not ultimately about keeping humans inside the flow, but about deciding what kind of factory we are building around them.
And if that is true, then the most unsettling possibility may not be that humans disappear.
It may be that the loop quietly stops asking for them.