Labs

Most AI investments fail because nobody agreed on where they were starting

Written by Intevity | Jul 28, 2026, 3:04:43 PM

Almost every enterprise we talk to is investing in AI, and almost none of them can tell you, in specific terms, where they currently stand. They can tell you what they’ve bought and what they want. The middle, the part that determines whether the buying gets them to the wanting, is usually a blur.

That gap is where most AI budgets go to die. Not because the technology doesn’t work, and not because the ambition is wrong, but because the organization skipped the step where everyone agrees on the actual starting point. You cannot plan a route without knowing where you are, and “we’re doing some AI stuff” is not a location.

LEVEL 1LEVEL 2LEVEL 3LEVEL 4LEVEL 5Chief executiveL4Chief technologyL3Head of dataL2Chief financialL4VP engineeringL5same company · same quarter · five different answers, and nobody in the room knows they disagreeThe meeting this model is designed to end: five executives, five private answers, and no shared starting point.

We use a simple model with clients to fix that. It lays out AI solution maturity as five levels, from ad-hoc experiments to fully integrated autonomous systems. It isn’t academic. Its entire purpose is to end the meeting where five executives each think the company is at a different level and none of them realize they disagree.

LEVEL 1AD-HOC &REACTIVE(Basic Chatbot)SOLUTIONBasic rule-based chatbot.CHARACTERISTICSPre-scripted responses,limited context, disconnectedfrom core data.USE CASESimple FAQs.LEVEL 2STRUCTURED &AUGMENTED(RAG-Enabled Chatbot)SOLUTIONChatbot with RAG (retrieval-augmented generation).CHARACTERISTICSAccesses specific externaldocuments, better context,but still relies on manualretrieval triggers.USE CASEKnowledge base search.LEVEL 3SYSTEMATIC &EXPOSED(MCP Servers)SOLUTIONMCP (Model ContextProtocol) servers.CHARACTERISTICSStandardized APIs exposingdata and tools systematically,enabling model tool-use andproactive data access.USE CASEAutomated workflowsand data actions.LEVEL 4INTEGRATED &UNIFIED(Semantic Layer)SOLUTIONEnterprise semantic layer.CHARACTERISTICSUnified data definitions,shared business contextacross tools, abstractionover raw data.USE CASECross-platform analyticsand insights.LEVEL 5OPTIMIZED &AUTONOMOUS(Adaptive AI Agents)SOLUTIONFully autonomous AI agents.CHARACTERISTICSSelf-learning, goal-oriented,dynamically executes complexmulti-step strategies understrategic oversight.USE CASEEnd-to-end processautomation.Progression of capability, integration, and strategic value.The AI solution maturity model: five levels from ad-hoc chatbots to adaptive agents, and what each one actually looks like in practice.

The five levels, and why the jumps matter more than the levels

Level 1: Ad-hoc and reactive. A basic chatbot with pre-scripted responses, disconnected from your core data. Useful for simple FAQs, and roughly where a weekend prototype lands. Most organizations have something at this level, and many mistake it for having “done AI.”

Level 2: Structured and augmented. A chatbot with retrieval-augmented generation, so it can pull from your actual documents and give better-grounded answers. This is where a lot of enterprises are right now, and it’s a real step up, but it still depends on manual retrieval and narrow use cases. It answers questions. It doesn’t do work.

Level 3: Systematic and exposed. Your data and tools are exposed to AI systematically, through standardized interfaces (MCP servers are the current mechanism). This is the level where AI stops being a place you go to ask questions and starts being something that can take action inside your workflows. The jump from Level 2 to Level 3 is the first one that requires real architectural work rather than just a better tool.

Level 4: Integrated and unified. A semantic layer sits across your systems, giving AI shared, consistent business context rather than a pile of raw data it has to interpret from scratch. This is where cross-platform analysis and genuinely useful insight become possible, because the AI understands what your data means, not just what it says. This is the level most transformation programs are actually aiming at, even when they describe it as something else.

Level 5: Optimized and autonomous. Self-learning, goal-oriented agents that execute complex multi-step work under strategic oversight. Real, but further out for most enterprises than the vendor demos suggest, and not a level you should be targeting until the ones beneath it are solid.

The levels themselves are useful, but the more important insight is about the jumps between them. The jump from 1 to 2 is buying a better tool. The jump from 2 to 3 is architectural, because you have to expose your systems in a structured way. The jump from 3 to 4 is organizational, because a semantic layer requires agreement across departments about what your data actually means. Each jump is a different kind of work, funded from a different budget, and owned by a different part of the organization. Teams that don’t understand which jump they’re attempting tend to fund the wrong one.

THE JUMPKIND OF WORKWHO OWNS ITFUNDED FROM12Buy a better toolProcurementIT or a line of businessTooling line item23Expose your systemsArchitecturalEngineering and platformCapital project34Agree what your data meansOrganizationalEvery data-owning departmentTransformation program45Hand over the decisionsOperationalRisk, legal, operationsNot until 1–4 are solidTeams that don’t know which jump they’re attempting tend to fund the wrong one.The jumps are the real unit of work. Each one is a different kind of project, with a different owner and a different budget line.

Why knowing your level is worth money

This isn’t a framework for its own sake. Placing yourself accurately on this curve has direct financial consequences, in three ways.

It stops you from buying the wrong thing. The single most common failure we see is an organization trying to buy its way to Level 4 while its data foundation is still at Level 1. They purchase an expensive platform that promises autonomous agents, deploy it on top of ungoverned data, and get an expensive disappointment. The platform wasn’t the problem. The sequencing was. Knowing your level tells you what the next dollar should buy, which is almost never the thing the most aggressive vendor is selling.

BUYING LEVEL 4 ON A LEVEL 1 FOUNDATIONAutonomous agent platformexpensive · promises Level 4Ungoverned data · still Level 1!SEQUENCING THAT HOLDSThen the platform earns its price3 → 4 shared meaning across systems2 → 3 systems exposed to tools1 → 2 AI reaches your real dataeach step delivers value on its ownThe platform wasn’t the problem. The sequencing was.The most expensive mistake in enterprise AI isn’t buying the wrong platform. It’s buying the right platform in the wrong order.

It makes the roadmap fundable. “We want to be more AI-driven” doesn’t get a budget. “We’re at Level 2, the specific thing blocking Level 3 is that our systems aren’t exposed through a structured interface, and here’s the cost and return of closing that gap” gets a budget. The maturity curve turns a vague ambition into a sequence of fundable steps, each of which delivers value on its own rather than requiring you to bet everything on a distant end state.

It sets expectations that survive contact with reality. A board that thinks the company is at Level 4 will judge a Level 3 result as a failure, even when Level 3 was the right target and the team executed it well. Agreeing on the starting point is how you make sure the organization is measuring progress against reality instead of against a demo it saw once.

How to place yourself

If you’re trying to locate your own organization on this curve, skip the self-assessment questionnaire and ask three concrete questions instead.

Can our AI systems actually reach our real business data, or are they working from a disconnected slice of it? That separates Level 1 from Levels 2 and up.

Can they take action inside our workflows, or only answer questions about them? That separates the “better search box” levels from Level 3 and up, where AI starts doing work rather than describing it.

Do our systems share a consistent understanding of what our data means, or does each tool interpret raw data on its own? That’s the Level 3 to Level 4 line, and it’s the one most organizations overestimate, because shared business context is hard and easy to assume you already have.

LEVEL 1LEVEL 2LEVEL 3LEVEL 4LEVEL 5Q1Can our AI systems actually reachour real business data, or adisconnected slice of it?separates Level 1 from Levels 2 and upQ2Can they take action inside ourworkflows, or only answerquestions about them?separates the search-box levels from Level 3Q3Do our systems share a consistentunderstanding of what our datameans?the Level 3 to Level 4 line · overestimatedThree honest answers locate you more accurately than any vendor assessment.Three questions, each one a gate on a specific boundary. Answer them honestly and your position on the curve falls out.

Three honest answers will locate you more accurately than any vendor assessment, largely because the vendor assessment is designed to locate you one level below whatever they’re selling.

Why this is the highest-value hour you’ll spend

The work of placing yourself on this curve costs nothing but the willingness to be honest about the starting point, and it changes every decision downstream. What to buy, what to build, what to fund next, what to promise the board: all of it gets easier once the organization actually agrees on where it’s standing. The alternative, which is what most companies are doing, is funding AI ambition without a shared map, and then wondering why the results don’t match the investment.

Get the leadership team in a room, put the curve on the screen, and make everyone commit to a level out loud. The disagreements that surface in that hour are the most useful thing you’ll learn about your AI program all quarter.

What comes next: the second dial

There’s a second question that sits on top of this one, and it’s the one that trips up the organizations who’ve done the maturity work and think they’re finished: not how deeply AI is integrated into your data and architecture, but how much decision-making authority you’ve actually handed it. Those turn out to be two different dials, and confusing them is expensive. That’s where we’ll go next.

L1L2L3L4L5Maturityhow deeply AI is integratedAssistAdviseActOwnAutonomyhow much authority you’ve handed itTwo different dials. Confusing them is expensive.Integration depth and delegated authority move independently. A Level 4 architecture can still be set to “advise,” and a Level 2 one can be wired to act.