“Loop Engineering” Is Hitting a Ceiling. Human Steering Is the Missing Layer.
Automated verification has made AI coding more reliable, but it cannot determine whether the system is being taken in the right direction.For more than 2,000 hours, I used AI to build KoraUS, a social platform that eventually grew to more than 153 route applications.I began with no software…
Automated verification has made AI coding more reliable, but it cannot determine whether the system is being taken in the right direction.For more than 2,000 hours, I used AI to build KoraUS, a social platform that eventually grew to more than 153 route applications.I began with no software development experience. My background was in hardware engineering and building data storage systems, so I understood architecture, troubleshooting, and system dependencies. I did not know the languages or frameworks required to build a modern social platform.AI filled that gap. It generated code faster than I could have learned to write it, explained unfamiliar concepts, and allowed me to build something that would otherwise have required an entire development team.It also made the same structural mistakes over and over.As the system grew, I documented six recurring failure modes:Band-Aid Fixes: Correcting the visible symptom without resolving the underlying logic.Assumptions: Filling missing context with a plausible answer that conflicts with the actual system.Drift: Moving incrementally away from the original architecture with each seemingly reasonable edit.Hallucinations: Inventing files, parameters, database fields, configuration settings, or system behavior that does not exist.Lack of Common Sense: Producing code that is technically valid but makes no practical sense within the larger system.The Path of Least Resistance: Choosing the easiest local fix instead of protecting the architectural rule that should remain authoritative.The six recurring AI failure modes reinforce one another, often driven by a lack of common sense and the path of least resistance.Newer models, coding agents, automated test loops, and multi-agent review systems have reduced some of these problems considerably. They can search more files, run tests, inspect errors, compare implementations, and revise their own work before returning it.I use the term “loop engineering” to describe this growing approach: surround the model with automated execution, testing, reviewing, and correction loops until the output reaches an acceptable state.It is a major improvement. It is also reaching a boundary.What Loop Engineering Does WellEarly AI coding often followed a simple pattern. The user described a task, the model generated code, and the user discovered whether it worked. That process placed nearly the entire verification burden on the human.Agentic coding systems have added multiple layers between the initial request and the final output. An agent can now inspect the repository, change several files, run the compiler, execute tests, read the failures, correct the code, and repeat the process. Another agent may review the changes, identify missing cases, or compare the implementation against a written plan.These loops are especially effective against the first four failure modes.A hallucinated file can be caught because the file does not exist. A nonexistent parameter can be caught by the compiler. A broken import can be found by the build process. A failed assumption about a database column can be exposed by inspecting the schema. Tests can reveal that an edit broke an existing behavior.The result is more reliable code and less manual work. Problems that once required several conversations can sometimes be found and corrected before the agent returns control to the user.This is real progress, but it is easy to interpret it too broadly.A verification loop can determine whether the implementation matches the information it has been given. It cannot guarantee that this information represents the whole system truth.A Passing Test Is Not the Same as a Correct DirectionThis distinction became increasingly important as KoraUS grew.A localized change could compile successfully, pass its tests, and work exactly as requested while still weakening the architecture.For example, imagine that a price shown on the frontend does not match the price produced by the backend. The fastest fix may be to override the displayed value in the frontend. The interface now shows the expected amount, the component test passes, and the visible problem disappears.The system is still wrong. The backend remains authoritative for the transaction, while the frontend is presenting a different version of reality. The patch corrected the symptom by creating a second source of truth.An automated loop may validate that the frontend now displays the desired number. A reviewing agent may confirm that the changed component behaves correctly. If every agent begins with the same incomplete premise, each layer of verification can approve the same architectural mistake.The problem is no longer whether the code works. The problem is whether that code should exist at all.This is where lack of common sense and the path of least resistance become much harder to automate. They require someone to understand what the system is trying to preserve, which component owns the truth, and what future behavior may be built on top of the current decision.Those questions cannot always be answered by examining the changed file or running another test.Automation Can Build on Top of a False PremiseThe danger is not limited to an AI agent making one bad change. A larger danger appears when automated systems continue building on top of it.Once an incorrect assumption enters the working context, every later step may treat it as fact. One agent implements it. Another writes tests around it. A third reviews the implementation against the same requirement. The loop becomes internally consistent, but the original premise remains wrong.More agents do not automatically create more truth. Sometimes they create stronger agreement around the same mistake.This resembles a well-managed team receiving an incorrect specification. The programmers may follow the specification perfectly. The tests may confirm the required behavior. The project can still produce the wrong system because execution quality cannot compensate for a false starting point.AI accelerates this process. It can generate the implementation, supporting tests, documentation, and follow-up changes before the human notices that the foundation was incorrect.The better the automation becomes, the more important it is to distinguish execution confidence from architectural confidence.Why Common Sense Is Hard to Test“Common sense” can sound vague, but in a software system it often means understanding consequences that were not written into the immediate task.Should a deleted post continue influencing a recommendation score? Should the frontend be allowed to determine a purchase price? Should a permissions problem be resolved by changing the underlying state, or by bypassing the permission check? Should a new feature create another source of truth, or reuse the existing authoritative record? Should a failed operation be hidden from the user, or should the system expose the failure and preserve an accurate state?The code may allow several of these approaches. More than one may compile and pass a narrowly written test. Only one may preserve the intended behavior of the system.Automated verification is strongest when correctness can be expressed as a rule. It is weaker when the main question is which rule should govern the system.A test can enforce an invariant after a human defines it. It cannot reliably decide whether the invariant itself is complete, current, or appropriate.The Return of Human SteeringFor a while, much of the excitement around agentic coding focused on removing the human from the process. If one agent could write code, another could review it, and a third could test it, perhaps the system could eventually operate with minimal supervision.My experience points toward a different model. The human does not disappear. The human moves upward.AI performs more of the implementation, searching, testing, comparison, and correction. The operator becomes responsible for preserving system truth across those activities.That role includes knowing:Which component owns each important decisionWhich records are authoritativeWhich business rules must remain invariantWhich previous attempts failed and whyWhether the requested fix addresses a cause or hides a symptomWhether a local improvement creates a larger contradictionWhether all agents are working from a verified premiseThis is not traditional line-by-line programming. It is closer to architectural management.The operator may write less code while becoming more responsible for the integrity of the system. That is not a temporary limitation caused by immature models. It may be the stable governance structure for serious AI-assisted development.My Workflow Changed Before the Technology DidWhen I began building KoraUS, I asked AI for solutions. If something failed, I described the symptom and requested another fix.That worked while the system was small enough to hold loosely in one conversation.As the platform expanded, that method became dangerous. Each local solution could affect authentication, feeds, permissions, media, payments, trust rules, or user ownership. AI could not maintain a persistent and truthful model of all those relationships simply because we had discussed them before.I had to change how I managed it.Instead of beginning with “fix this,” I began asking:What does the runtime evidence show?Which layer owns this behavior?What is the current authoritative state?Has this logic already been implemented elsewhere?Which invariant must remain true after the change?Are we correcting the cause or making the symptom disappear?What evidence will prove that the proposed explanation is correct?The improvement did not come only from a better model. It came from changing the relationship between the operator and the model. AI remained the rapid technical executor. I became the keeper of continuity.Loop Engineering Still MattersNone of this means automated loops have failed.They are becoming a necessary part of AI-assisted development. They reduce routine mistakes, expand the amount of context an agent can inspect, and provide evidence that would otherwise require substantial manual work.The mistake is treating verification loops as substitutes for judgment.Loop engineering works best inside boundaries established by someone who understands the system. Tests, agents, repository instructions, architecture documents, and automated reviewers can reinforce those boundaries. They cannot guarantee that the boundaries reflect reality unless a human continues verifying the assumptions beneath them.The practical model is not AI autonomy or constant human micromanagement. It is layered responsibility.AI handles rapid execution and mechanical verification. The human preserves purpose, architecture, and system truth.The Last Mile Is GovernanceThe difficult leap in AI-assisted software engineering is often described as moving from 80 percent automation to 99 percent automation.I am no longer convinced that the remaining gap is mainly an engineering problem. It may be a governance problem.Who decides what the system is supposed to protect?Who notices when every agent is following the wrong premise?Who distinguishes a successful test from a successful architecture?Who stops the loop when the easiest solution violates the larger design?These responsibilities do not disappear when the models improve. In some cases, they become more important because better models can act faster, modify more of the system, and produce more convincing evidence that their work is correct.After more than 2,000 hours building a 153-route platform with AI, I do not see human oversight as a temporary crutch.I see it as the governance model.That conclusion became one of the central lessons in my book, AI: The Perpetual Intern. The book documents the six recurring failure modes through the actual process of building KoraUS, including how my own role changed as the system became too complex for plausible local answers to substitute for verified truth.Every new coding paradigm will promise to reduce these six patterns. Some will make substantial progress. The useful question is not whether the latest method eliminates the need for human involvement. It is which failures it reduces, which ones remain, and whether its increased speed makes the remaining failures more difficult to detect.Loop engineering is not the end of human steering. It is the reason human steering must become more disciplined.This story is published on Generative AI. Connect with us on LinkedIn and follow Zeniteq to stay in the loop with the latest AI stories.Subscribe to our newsletter and YouTube channel to stay updated with the latest news and updates on generative AI. Let’s shape the future of AI together!“Loop Engineering” Is Hitting a Ceiling. Human Steering Is the Missing Layer. was originally published in Generative AI on Medium, where people are continuing the conversation by highlighting and responding to this story.Source: Generative AI Pub — Published — Category: Image AI