Dear CIO,

In recent weeks, two highly anticipated reports on the state of artificial intelligence, both covered extensively by news outlets, have painted completely different pictures of where we stand with AI adoption in 2025. On one side, the MIT NANDA “State of AI in Business 2025” report shows that, despite billions of dollars in investment, most enterprise AI projects are failing to provide real value. On the other hand, the Google DORA “State of AI-Assisted Software Development 2025” report reads like a success story, highlighting significant productivity gains, rapid adoption, and tangible improvements in how software gets built.

If you are feeling confused, you are not alone. The mixed messages these two reports send are less about contradiction and more about perspective, and understanding that difference is key to navigating AI’s next chapter.

Best Regards,
John, Your Enterprise AI Advisor

Dear CIO

The Paradox of AI Reports

Why Two Major Reports Tell Very Different Stories About the Future of AI

MIT: Billions Spent, But Few Real Results

The MIT NANDA report paints a bleak picture of the progress in enterprise AI. Despite an estimated $30–40 billion invested in generative AI projects, a staggering 95% of organizations report no measurable financial return.

The report introduces the concept of the “GenAI Divide”, a growing gap between a small group of companies that extract millions in value and the vast majority, who see little to no impact. The reasons are not what you might expect. It is not model quality or regulatory hurdles holding companies back, but a failure to integrate AI into real workflows.

Key findings include:

  • Only 5% of custom AI projects ever reach production.

  • Seven of nine major industries show “little to no structural change” despite significant experimentation.

  • Tools like ChatGPT are widely used, but primarily for individual productivity, rather than enterprise transformation.

The report also highlights a growing “shadow AI economy,” where employees utilize personal AI tools outside official channels to accomplish real work, often with greater success than sanctioned enterprise initiatives. The takeaway from MIT is clear: AI is not yet delivering on its transformational promise.

DORA: AI Is Already Changing the Game

In contrast, the DORA “State of AI-Assisted Software Development 2025” report is full of optimism. Based on data from thousands of software teams worldwide, DORA finds that AI is already reshaping how software is built and delivering real results.

Some standout findings:

  • 95% of developers now use AI tools, many daily.

  • 80% report significant productivity gains.

  • 71% use AI for writing new code, and 59% say it improves code quality.

  • Teams that adopt AI exhibit faster delivery cycles and higher throughput.

DORA does note that challenges remain, including code trust, delivery instability, and limited “reflexive use”, but the overall narrative is straightforward: AI is a daily reality that is driving measurable progress.

Why the Stories Seem So Different

At first glance, these two narratives could not be more different. One says AI is failing. The other says it’s thriving. But the truth is more nuanced. They are actually both correct, just speaking to different levels of the AI story.

MIT Report

DORA Report

Focus: Enterprise-wide outcomes

Focus: Team-level engineering outcomes

Success metric: ROI, transformation, structural change

Success metric: Productivity, code quality, delivery speed

Tone: Skeptical, cautionary

Tone: Optimistic, pragmatic

Message: AI is overhyped and underdelivering

Message: AI is delivering real value today

The tension between them reflects an important reality that AI is maturing unevenly. At the micro level, among developers and technical teams, it is producing measurable benefits. But at the macro level, across industries and balance sheets, those gains often fail to scale into transformative business results.

What This Means for Business Leaders

The “mixed message” is a warning and an opportunity. If you are a business leader, the MIT report should be a wake-up call. Investing in AI without rethinking workflows, data strategy, and organizational design is a recipe for disappointment. However, the DORA report offers hope that when implemented effectively, AI does work. The challenge now is to bridge the gap between local success and enterprise-wide impact.

That means:

  • Treating AI as a systems transformation, not just a tool adoption.

  • Building infrastructure and governance that allow AI-driven improvements to scale.

  • Measuring success not just by output, but by outcomes that move the business forward.

Bottom Line: AI Works Only If We Do

The seemingly conflicting stories from MIT and DORA are two sides of the same coin. AI is succeeding in pockets but failing at scale. It is revolutionizing how developers write code, but it is still struggling to transform how companies operate. AI’s potential is real, but unlocking it requires more than pilots, demos, or hype. It requires the hard work of integration, iteration, and organizational change. Until that happens, you can expect the headlines to keep sending mixed signals.

References:

How did we do with this edition of the AI CIO?

Login or Subscribe to participate

Deep Learning
  • Ravie Laskshmanan dives into research identifying MalTerminal as the earliest known malware embedding LLM capabilities.

  • Researchers from Radware expose a zero-click exploit in ChatGPT's Deep Research agent that uses hidden email prompts to exfiltrate Gmail data via OpenAI’s servers.

  • Eric Geller highlights a report revealing that only 31% of IT leaders feel confident defending against AI-powered cyberattacks.

  • I define AI observability as a three-layer stack: prompt management, system observability, and evaluations.

  • The Artificially Intelligent Enterprise covers how to use AI agents to complete complex projects.

  • AI Tangle exmaines the expansion of project Stargate, Google revealing two agentic models for robots, and Alibaba’s debut of Qwen3-Max.

Regards,

John Willis

Your Enterprise IT Whisperer

Follow me on X

Follow me on Linkedin

Dear CIO is part of the AIE Network. A network of over 250,000 business professionals who are learning and thriving with Generative AI, our network extends beyond the AI CIO to Artificially Intelligence Enterprise for AI and business strategy, AI Tangle, for a twice-a-week update on AI news, The AI Marketing Advantage, and The AIOS for busy professionals who are looking to learn how AI works.

Keep Reading

No posts found