Jun 30, 2025

Beyond Time Saved: How to Calculate AI ROI That Actually Matters (Nicole Castillo)

Beyond Time Saved: How to Calculate AI ROI That Actually Matters

Why "saving time" isn't enough—and how to map AI investments to real business outcomes

"This AI tool will save us 2 hours per week!"

If that's how you're calculating AI ROI, you're doing it wrong. Nicole Castillo, VP of Strategic Products at News Corp, has seen countless AI projects justified with vague time savings that never translate to actual business value.

Her approach? Map every AI investment directly to fundamental business metrics that actually drive company value. Here's how to calculate AI ROI that connects to real business outcomes.

The Problem with "Time Saved" ROI

Most AI ROI calculations look like this:

  • Current process takes 5 hours
  • AI reduces it to 3 hours
  • 2 hours saved × hourly rate = ROI

Nicole's problem with this approach? "Without that intention, it's just sort of like a crystal ball. And you're like, well, I think... I hope the subscribers will come. I hope the cost savings will come. And I think that's unfortunately... not the smartest way to do business."

The reality: saved time doesn't automatically translate to business value. If those 2 hours don't result in more revenue, lower costs, or reduced risk, you haven't created real ROI.

Nicole's ROI Mapping Framework

Nicole's methodology requires mapping AI investments to one of three business outcomes:

1. Revenue-Generating Solutions

Map directly to business drivers and "show the math" connecting AI to increased revenue.

Example: AI content personalization for subscription business

  • Business Driver: Subscription growth
  • AI Solution: Personalized content recommendations
  • Measurement: Engagement metrics → subscriber retention → revenue impact
  • ROI Calculation: Increased subscription revenue minus AI implementation costs

2. Cost-Saving Solutions

Understand "the people and the processes behind that to a really specific degree"—calculate exact current costs, then measure precise savings.

Example: AI for quarterly compliance reviews

  • Current Process: Lawyers manually scan regulatory documents
  • AI Solution: Automated initial review with recommendations
  • Measurement: Lawyer hours saved × hourly rate
  • ROI Calculation: Personnel cost savings minus AI tool costs

3. Risk-Reducing Solutions

Calculate the cost of the problems you're preventing.

Example: AI fraud detection

  • Current Risk: Average fraud losses per quarter
  • AI Solution: Early fraud detection and prevention
  • Measurement: Fraud losses prevented
  • ROI Calculation: Fraud prevention value minus AI system costs

The Deep Dive ROI Process

Nicole's approach requires intensive, specific analysis: "You need to sit with the teams and get your little calculator out or get your spreadsheet out and say, okay, I've got this amount of people who are analyzing this amount of content... and they cost X amount to have that. And then to understand with the solutions how you can bring that cost down."

Step 1: Baseline Analysis

Before implementing any AI solution:

  • Time current processes (not how long you think they take)
  • Calculate true costs including employee time, error correction, and opportunity cost
  • Identify bottlenecks and inefficiencies
  • Document current quality metrics

Step 2: Business Driver Mapping

Connect to fundamental business metrics:

  • Revenue generation (sales, subscriptions, customer lifetime value)
  • Cost reduction (operational efficiency, error reduction, resource optimization)
  • Risk mitigation (compliance, security, quality control)

Step 3: Specific Success Metrics

Set measurable outcomes before testing:

  • Quantifiable improvements (X% increase in conversion, Y% reduction in processing time)
  • Quality metrics (error rates, accuracy improvements)
  • Business impact (revenue increase, cost savings, risk reduction)

Nicole's Real-World Example: Quarterly Compliance Reviews

Nicole shared one concrete example that perfectly illustrates her ROI methodology: using AI for quarterly compliance reviews.

The Process:"You have to scan all these really dense compliance documentation" and provide recommendations to ensure company compliance. Instead of having lawyers manually review every document, AI handles the initial review and provides recommendations for human review.

Why This Works as an ROI Example:

  • Clear Input: Dense regulatory documents + lawyer time
  • Clear Output: Compliance recommendations
  • Clear Savings: Reduced lawyer hours on initial document scanning
  • Measurable Impact: Time savings can be directly calculated in personnel costs

Nicole's Key Insight: This works because you can measure the exact current cost (lawyer hours × hourly rate) and compare it to the new cost (AI tool cost + reduced lawyer hours for final review).

The beauty of this example is its simplicity and measurability—exactly what Nicole demands from any AI ROI calculation.

The Hidden Costs to Include

Nicole warns about planning for the full lifecycle: "AI solutions are still very expensive to implement... How much is it gonna cost you to build it? How much is it going to cost you to maintain it? How often do you need to update the model?"

Include These Costs:

  • Initial implementation and setup
  • Ongoing subscription or usage fees
  • Model training and updates
  • Integration maintenance
  • User training and change management
  • Vendor relationship management
  • Potential migration costs

Nicole's Key Questions:

  • How much will it cost to build initially?
  • What are the ongoing maintenance costs?
  • How often do you need to update the model?
  • How easily can you update or replace the model?
  • Can you migrate to lower-cost alternatives without losing quality?
  • What happens if the vendor relationship changes?

How to Apply Nicole's ROI Framework

Step 1: Map to Business Drivers

For subscription businesses (like News Corp): "Understanding what drives subscription growth and then... you can map a solution directly to those business drivers."

For any business: Identify whether your AI solution primarily:

  • Generates revenue (drives sales, subscriptions, customer value)
  • Saves costs (reduces operational expenses, personnel time)
  • Reduces risk (prevents compliance issues, security breaches, quality problems)

Step 2: Do the Deep Dive Analysis

Nicole's approach: "You need to sit with the teams and get your little calculator out or get your spreadsheet out and say, okay, I've got this amount of people who are analyzing this amount of content... and they cost X amount to have that. And then to understand with the solutions how you can bring that cost down."

Practical steps:

  • Calculate current process costs including all personnel time
  • Identify bottlenecks and inefficiencies
  • Document current quality metrics and error rates
  • Map exactly how the AI solution changes each step

Step 3: Avoid the "Crystal Ball" Trap

"Without that intention, it's just sort of like a crystal ball. And you're like, well, I think... I hope the subscribers will come. I hope the cost savings will come. And I think that's unfortunately... not the smartest way to do business."

Nicole's requirement: Be able to "show the math essentially" connecting the AI solution to business outcomes. If you can't draw a direct line from the AI implementation to measurable business impact, reconsider the investment.

Common ROI Mistakes to Avoid

1. The "Crystal Ball" Trap

Don't project vague benefits. Nicole insists on specific, measurable outcomes connected to actual business drivers.

2. Ignoring Opportunity Cost

Calculate what else you could do with the time and resources instead of implementing AI.

3. Underestimating Total Cost

Include all lifecycle costs, not just initial implementation.

4. Overestimating Time Savings Value

Saved time only creates value if it's redirected to revenue-generating or cost-saving activities.

The Business Understanding Foundation

Nicole's most important insight: "Deeply understanding how your business makes money and measures money... measures value is really important."

Before calculating any AI ROI:

  • Understand your primary revenue drivers
  • Identify your biggest cost centers
  • Know your key performance indicators
  • Map how different activities connect to business outcomes

The Bottom Line

Stop justifying AI investments with vague time savings. Instead, map every AI solution to specific business outcomes: more revenue, lower costs, or reduced risk. Calculate the full lifecycle costs. Measure the actual business impact.

As Nicole puts it: without connecting AI to fundamental business drivers, "it's just sort of like a crystal ball" hoping for results that may never come.

Real ROI requires real business understanding. Get the math right, and AI investments become strategic business decisions rather than expensive experiments.

Want more practical AI strategy insights? This playbook is part of our series on real-world AI implementation lessons from enterprise leaders.

Stuart Willson
Ratings
stuart-willson

Founder @ Just Curious

Los Angeles, CA

Founder of Just Curious, a platform dedicated to helping SMB leaders practically adopt AI to enhance growth, margins, and efficiency.

No items found.
No items found.
Just Curious AI – Ask Us Anything