Part II: Discovery and Design
Chapter 5.4

Identifying Leverage Points

Not all improvements are created equal. Some changes cascade through your product and organization, creating multiplicative benefits. Others drain resources with minimal impact. The difference is leverage. Understanding where to apply effort is as important as the effort itself.

High-Frequency vs High-Impact Tasks

Two dimensions define improvement opportunity: frequency and impact. Frequency is how often a task occurs. Impact is how much difference the task makes to outcomes. The most valuable improvements combine both.

The Frequency-Impact Matrix
                    HIGH IMPACT              LOW IMPACT
                ┌─────────────────────┬─────────────────────┐
HIGH FREQ       │                     │                     │
                │  STRATEGIC PRIORITY │   OPTIMIZE IF       │
                │  These tasks are    │  resources allow     │
                │  worth significant  │                     │
                │  investment         │                     │
                ├─────────────────────┼─────────────────────┤
LOW FREQ        │                     │                     │
                │   BIG BET           │   DEPRIORITIZE      │
                │   Could be          │   Fill in when      │
                │   transformative     │   nothing better   │
                │   but rare          │   to do            │
                │                     │                     │
                └─────────────────────┴─────────────────────┘
            

Applying the Matrix

The Frequency-Impact Matrix guides investment decisions based on where tasks fall across the two dimensions. High frequency combined with high impact indicates tasks where you should invest heavily, as these are the core of your AI strategy and will generate the most value. High frequency combined with low impact suggests tasks to optimize for efficiency, as these may be candidates for automation where volume compensates for individual low impact. Low frequency combined with high impact means you should design carefully for when these important but rare events occur, ensuring they are handled well despite their infrequency. Low frequency combined with low impact suggests you should minimize investment, as these tasks are not worth much attention.

QuickShip: Frequency-Impact Analysis

QuickShip: Prioritizing AI Initiatives by Leverage
TASK ANALYSIS FOR QUICKSHIP OPERATIONS:

┌─────────────────────────────────────────────────────────┐
│ TASK                │ FREQ    │ IMPACT  │ PRIORITY      │
├─────────────────────────────────────────────────────────┤
│ Exception handling   │ High    │ High    │ STRATEGIC     │
│ Route optimization   │ High    │ High    │ STRATEGIC     │
│ Customer status      │ Very    │ Low     │ OPTIMIZE       │
│ inquiries            │ High    │         │               │
│ Driver performance   │ Medium  │ Medium  │ SECONDARY     │
│ review               │         │         │               │
│ Weekend volume       │ Low     │ High    │ BIG BET       │
│ prediction           │         │         │               │
│ Weather impact       │ Low     │ High    │ BIG BET       │
│ planning             │         │         │               │
│ New driver training  │ Low     │ Low     │ DEPRIORITIZE  │
└─────────────────────────────────────────────────────────┘

PRIORITIZED AI PORTFOLIO:
1. Exception handling AI (strategic - highest leverage)
2. Route optimization AI (strategic - core to value prop)
3. Predictive volume modeling (big bet - could transform planning)
            

Bottleneck Analysis

Bottlenecks are constraints that limit the throughput of the entire system. Unlike local inefficiencies that affect only one step, bottlenecks constrain overall capacity. Fixing a bottleneck improves the entire system.

Identifying Bottlenecks

Look for these signs of bottlenecks in your workflows. Work piling up, where inventory or backlog builds before a particular step, indicates that step cannot keep pace with upstream flow. Downstream starvation occurs when resources sit idle because upstream cannot deliver work fast enough, showing that the bottleneck is earlier in the process. The longest cycle time identifies a step that takes significantly longer than others, which often constrains overall throughput. Dependency chains reveal steps that cannot run in parallel and must proceed sequentially, creating inherent limitations. Single points of failure occur when one person or system has responsibility that everything depends on, creating vulnerability and constraint.

The Theory of Constraints

Based on Eli Goldratt's Theory of Constraints, improvement efforts should follow a systematic five-step approach. First, identify the system bottleneck by finding the constraint that limits overall throughput. Second, exploit the bottleneck by making maximum use of its capacity, ensuring it is not starved or interrupted. Third, subordinate all other work to support the bottleneck, aligning everything else to keep the constraint running at full efficiency. Fourth, if the bottleneck constraint remains insufficient after exploitation and subordination, elevate by adding capacity to it directly. Fifth, repeat the process when one bottleneck is resolved, as fixing one constraint often reveals the next one in the system.

HealthMetrics: Bottleneck Analysis for Patient Flow
PATIENT FLOW BOTTLENECK ANALYSIS:

System throughput: Patients processed per day

Bottleneck Identification:
├─ ER arrivals: 120 patients/day
├─ Triage: 125 patients/day capacity
├─ Bed assignment: 80 patients/day capacity ← BOTTLECK
├─ Treatment: 110 patients/day capacity
└─ Discharge: 90 patients/day capacity

Bottleneck: Bed assignment (80 patients/day)
Constraint: Limited by nurse availability for intake

EXPLOIT STRATEGIES:
1. Pre-populate bed assignment forms during triage
2. Use AI to predict bed availability 2 hours ahead
3. Flag potential bottlenecks proactively to administration

SUBORDINATE STRATEGIES:
1. Release beds earlier when discharge is predicted
2. Stagger ER arrivals when predictable surge expected
3. Move stable patients to "pending discharge" status

ELEVATE STRATEGIES:
1. Cross-train nurses from other departments
2. Implement floating nurse pool for bottleneck coverage
            

Quick Wins vs Strategic Investments

A balanced AI portfolio includes both quick wins and strategic investments. Quick wins build momentum and prove value. Strategic investments create transformative but longer-term capabilities.

Characteristics of Quick Wins

Quick wins share several distinct characteristics that make them valuable portfolio additions. They have narrow scope, being limited to a specific, well-defined task rather than sprawling across multiple workflows. They have clear success metrics that make it easy to measure whether the initiative worked. They carry low technical risk because they use proven AI approaches with established track records. They provide fast feedback with results visible within days or weeks rather than months. They have limited dependencies, meaning they can be built and deployed independently without waiting for other initiatives or coordinated cross-team efforts.

Characteristics of Strategic Investments

Strategic investments differ from quick wins in several fundamental ways. They have broad scope that affects multiple workflows or user types rather than targeting a single task. Their success is multi-dimensional, with value that is complex and long-term rather than easily measurable in the short term. They carry higher technical risk because they require new capabilities or approaches that have not been proven in your context. They have long feedback cycles, potentially taking months to see full value rather than weeks. They have cross-cutting dependencies that require coordination across teams, making them more complex to manage and deploy.

The 70-20-10 Portfolio Rule

Consider allocating AI investment across a balanced portfolio that combines near-term delivery with long-term capability building. Allocate approximately 70 percent to quick wins that use high-frequency, high-impact, proven approaches, delivering reliable value quickly. Commit roughly 20 percent to strategic bets that represent medium-term investments in high-potential areas that could create significant advantage. Reserve about 10 percent for explorations that are long-term bets on transformative but uncertain ideas. This balance ensures steady delivery of value while building for the future and maintaining the ability to pursue breakthrough opportunities.

Eval-First in Practice

Before allocating portfolio resources, define how you will measure portfolio health. A micro-eval for AI portfolios tracks: ROI per initiative, failure rate by initiative type, time-to-value by approach, and user adoption rates by task type. HealthMetrics' eval-first insight: their 70-20-10 rule looked balanced on paper but their eval revealed that 80% of "quick wins" were actually eroding trust because they had not been measured for interference with each other. After establishing cross-initiative eval, they restructured to 60-25-15 and saw 40% improvement in overall portfolio outcomes.

HealthMetrics: Building a Balanced Portfolio

HealthMetrics: Prioritization Decision
EVALUATING TWO AI INITIATIVES:

INITIATIVE A: AI-Powered Discharge Prediction
├─ Scope: Predict which patients will be ready for 
│         discharge in next 24 hours
├─ Frequency: Daily for every patient
├─ Impact: High (frees beds, reduces wait times)
├─ Technical Risk: Medium (requires new model)
├─ Time to Value: 3-4 months
└─ Classification: STRATEGIC INVESTMENT

INITIATIVE B: AI-Assisted Exception Note Writing
├─ Scope: Help nurses draft exception notes
├─ Frequency: 20-30 times per day
├─ Impact: Low (saves 2-3 minutes per note)
├─ Technical Risk: Low (standard text generation)
├─ Time to Value: 4-6 weeks
└─ Classification: QUICK WIN

DECISION:
- Pursue BOTH in parallel
- Quick win (B) builds AI culture and proves value
- Strategic investment (A) creates major competitive advantage
- Different timelines, different teams, different metrics

PORTFOLIO BALANCE:
- 60% of AI resources to strategic (A)
- 30% to quick wins (B and similar)
- 10% to exploration
            

Calculating ROI for AI Initiatives

Before committing to AI initiatives, estimate return on investment. AI investments have costs that are often underestimated and value that is often overestimated.

Cost Categories

AI initiatives incur costs across four distinct categories that must all be factored into ROI calculations. Development costs include engineering time, data preparation, and infrastructure setup required to build the system. Operational costs cover model serving, API calls, and ongoing maintenance that keep the system running in production. Governance costs encompass compliance requirements, monitoring systems, and error handling processes that ensure the AI operates responsibly. Failure costs account for errors the AI may make, system downtime that disrupts operations, and reputation damage that results from AI failures.

Value Categories

AI initiatives generate value across four distinct categories that together determine true return on investment. Labor savings represent the time saved by automation or augmentation, reducing the human effort required to accomplish tasks. Error reduction captures the value of avoiding mistakes that would otherwise require correction or cause downstream problems. Revenue impact includes increased sales, improved customer retention, or better conversion rates that directly affect business revenue. Strategic value encompasses capabilities that create future advantage, positioning the organization for long-term success even if short-term ROI is harder to quantify.

Quick ROI Calculation Framework
NET VALUE = (Labor Savings + Error Reduction + Revenue Impact) 
            - (Development + Operations + Governance + Failure Costs)

PAYBACK PERIOD = Development Costs / Monthly Net Value

Example:
├─ Development: $200,000
├─ Annual Operations: $50,000
├─ Annual Labor Savings: $180,000
├─ Annual Error Reduction: $30,000
├─ Annual Net Value: $180,000 + $30,000 - $50,000 = $160,000
└─ Payback Period: $200,000 / $160,000 = 15 months
            

Cross-References to Strategy and UX

Leverage point analysis connects directly to product strategy and user experience design:

Connecting to Chapter 6: AI Product Strategy

Leverage points should align with your overall product strategy. If your strategy focuses on operational efficiency, prioritize high-frequency, high-impact tasks. If your strategy focuses on premium differentiation, consider strategic investments that create unique capabilities.

See Chapter 6: AI Product Strategy and Portfolio Thinking for frameworks on aligning AI initiatives with strategic objectives.

Connecting to Chapter 8: Designing AI UX

Where AI intervenes in workflows has major UX implications. High-frequency tasks require efficient, low-friction AI interactions. Strategic investments may warrant more sophisticated but higher-value interactions.

See Chapter 8: Designing AI User Experiences for patterns on matching AI interaction design to task characteristics.

Key Takeaways

High-frequency combined with high-impact tasks are strategic priorities worth significant investment because they combine ubiquity with importance. Bottlenecks constrain entire systems, and fixing them improves overall throughput rather than just local efficiency. Quick wins build momentum and prove value while strategic investments create transformative capabilities that drive long-term advantage. A balanced portfolio allocates resources across quick wins, strategic bets, and explorations to balance near-term delivery with long-term capability building. ROI analysis should include all cost and value categories, ensuring that both investments and returns are fully captured. Leverage point selection should align with product strategy and UX requirements, ensuring that AI initiatives support broader organizational objectives.

Exercise: Analyzing Your AI Opportunity Portfolio

Create your own leverage point analysis by working through these steps. First, list all potential AI initiatives in your product or organization, casting a wide net to capture the full scope of possibilities. Second, classify each initiative on frequency and impact dimensions, determining where it falls in the matrix. Third, identify your strategic priorities and quick wins based on this classification, distinguishing between initiatives that deserve major investment and those that can deliver quick value. Fourth, apply the 70-20-10 rule to allocate resources across quick wins, strategic bets, and explorations, ensuring portfolio balance. Fifth, calculate rough ROI for your top three priorities, considering all cost and value categories. Sixth, identify any bottlenecks that, if fixed, would improve everything across the system.

What's Next

In Section 5.5, we explore When Not to Use AI, examining cost-quality trade-offs, regulatory constraints, trust requirements, and cases where simpler solutions win.