Skip to content
Enterprise AI 4 min read Featured

Enterprise AI fails at four places

When an enterprise AI initiative fails, the post-mortem usually blames the model. It is almost never the model. The failures cluster at four predictable seams: context, governance, evaluation, and operating model.

There is a ritual that follows a failed enterprise AI initiative. Someone asks what went wrong, and the answer comes back: the model was not good enough, or the model hallucinated, or we need to wait for the next model. The remedy proposed is always another model. And the next initiative, built on the better model, fails in the same way - because the model was never where the failure was.

In nearly every enterprise AI failure I have seen up close, the model performed roughly as advertised. The initiative still failed, because it broke at one of four seams that have nothing to do with model quality. The four are predictable enough to name in advance: context, governance, evaluation, and operating model. Knowing where the failures cluster is most of the work of avoiding them.

One: context

The first and most common failure is that the model is asked to reason without the context the task actually requires. It is given a generic capability and a prompt, and expected to produce an enterprise-specific answer it has no way to ground. The result is fluent, confident, and wrong in ways that are hard to catch precisely because the fluency masks the missing grounding.

This is not a model problem and a better model will not fix it. The model cannot know your policies, your precedents, your entities, and your obligations unless those are assembled, governed, and supplied to it. The failure is upstream, in the absence of a context layer that makes situated knowledge legible to the system. Fix the model and you get the same wrong answer, more eloquently.

Two: governance

The second failure is that the system produces outputs no one can defend. There is no record of what context a decision used, no legible reasoning behind it, no real accountability when it matters. This works fine in a demo and fails the first time the output is challenged - by an auditor, a regulator, a customer, or a court.

The question that kills ungoverned enterprise AI is never “is this answer good?” It is “can you show me why this answer was given, on what authority, and who is accountable for it?” A system that cannot answer that is not deployable in any setting where the answer matters, regardless of how capable its model is.

Governance is not a compliance afterthought to be added before launch. It is an architectural property that has to be designed in from the start, because the reasoning and the records cannot be reconstructed after the fact - they have to be captured as decisions are made.

Three: evaluation

The third failure is quieter and more dangerous because it hides the other three. The organization has no rigorous way to know whether the system is actually working. It went to production on the strength of a few impressive examples and a general sense that the outputs “looked good,” with no measurement tied to the decisions the system actually influences.

Without real evaluation, every other failure becomes invisible. Context decays and no one notices because nothing measures the resulting drop in quality. Governance gaps go undetected because nothing tests them. The system degrades silently, and the first signal anyone receives is an incident. Demo-driven deployment is the single most reliable predictor of an enterprise AI failure, because it ships the system before there is any instrument capable of telling you it has broken.

Four: operating model

The fourth failure is organizational, and it is the one technical teams most consistently underestimate. The system is built and even works, but the organization around it has not changed to absorb it. Roles, incentives, escalation paths, and ownership still assume the old way of working. No one owns the system’s outputs. No one is responsible for its context staying fresh. No one’s job description includes keeping it honest.

A capable system dropped into an unchanged operating model gets quietly routed around. People keep doing what they did before, the system becomes shelfware with a great benchmark score, and the initiative is declared a failure of the technology. It was a failure to redesign the work around the technology - a different problem with a different owner.

Why naming the four matters

These four are not independent, and that is the practical point. Weak context makes evaluation harder. Missing governance makes failures undetectable. An unchanged operating model means no one is positioned to fix any of it. They compound, which is why blaming the model is so seductive - it offers a single, purchasable explanation for what is actually a systemic gap across four dimensions, none of which a procurement decision can close.

This is the structure behind the enterprise GenAI architect framework: treating an enterprise AI initiative as a design problem across context, governance, evaluation, and operating model simultaneously, with the model as a replaceable component rather than the centerpiece. Design all four and the model becomes the easy part. Design none of them and no model, however good, will save the initiative.

The next time an enterprise AI effort fails and someone reaches for a better model, the more useful question is which of the four seams it broke at. The answer is almost never “the model.” It is almost always one of the four things nobody designed.

Related essays

All essays →

Letters from a Founding Architect

Get the next essay in your inbox