Monthly Newsletter - American Institute of Healthcare Compliance

April 2026 Monthly Newsletter -Measure What Matters

In This Monthly Issue

Compliance in the Age of AI and Accountability
Measuring Quality in the AI Era
AUC-ROC
Auditing is Critical
Measure Workforce Well-Being
Equity-Centric Data

The April topic is "Measuring What Matters," which provides the necessary focus on accountability and human-centered leadership that is critical for success in 2026. April is a great time to shift from simply collecting data to actionable, value-based outcomes, especially in a resource-constrained environment. The information in this Newsletter is for educational purposes only. Please consult with a certified professional to determine appropriate action steps for your organization.

Compliance in the Age of AI and Accountability

Healthcare compliance programs can no longer rely on activity-based metrics alone. Regulators, including the Office for Civil Rights and The Joint Commission, are increasingly focused on whether organizations can demonstrate measurable impact on patient safety, access, and data integrity.

For example, HIPAA Right of Access compliance is now evaluated through timeliness, consistency, and complaint trends, not just policy presence.

Similarly, Joint Commission expectations emphasize leadership accountability for staffing, quality, and patient safety outcomes. At the same time, the rise of Artificial Intelligence (AI) used to document clinical information introduces new compliance risks and challenges for providers, auditors and compliance officers. Organizations must monitor accuracy of AI-assisted documentation, alignment with coded data, and oversight of automated decision-making.

Key Takeaway - In 2026, measuring what matters means aligning compliance metrics with regulatory expectations, AI accountability, and patient-centered outcomes, not just internal activity tracking.

Measuring Quality in the AI Era

How to use technology to move beyond compliance to true care improvement

In the era of Artificial Intelligence, measuring quality for healthcare providers shifts from tracking manual processes to evaluating real-time outcomes and system performance. Several areas to consider as described below.

Clinical & Model Performance Metrics

Traditional metrics are being replaced by diagnostic indicators that emphasize clinical safety and reliability.

Sensitivity (Recall) vs. Specificity: High sensitivity is prioritized for screenings to avoid missed diagnoses (false negatives), while high specificity is critical for high-risk interventions to avoid false alarms (alert fatigue).
AUC-ROC: Evaluates how well an AI can distinguish between sick and healthy patients across different thresholds, providing operational flexibility during high-volume periods.
- More information is provided below in the next topic.
Groundedness & Hallucination Rate: What is Groundedness? It is the process of connecting Large Language Model (LLM) responses to verified, trusted data sources (e.g., internal documents, databases) to prevent them from relying solely on training data that may be outdated or incorrect.
- Groundedness in generative AI ensures model outputs are anchored to verified data, reducing the hallucination rate (false, confident, or fabricated content).
- While general AI chatbots exhibit high hallucination rates of 10-20%, or up to 58-82% in specialized fields like law, grounding techniques such as RAG (Retrieval-Augmented Generation) reduce these rates to 1–3% by providing accurate context, as described in studies from Stanford University - Human Centered Artificial Intelligence (HAI)
- For generative AI (like medical scribes), quality is measured by the percentage of claims supported by source clinical notes.

Operational Efficiency & Relationship Metrics

A key promise of AI is returning time to providers for direct patient care, such as:

Time Saved & ROI: Tracking hours saved by off-loading call handling or administrative tasks to AI, often ranging extensive hours per day for some providers. A cost-benefit analysis can determine whether AI implementation is a good return on investment (ROI).
Relationship-Centered Metrics: Measuring the reduction in provider screen time during encounters and the gain in minutes for face-to-face patient interaction. By increasing provider efficiency, it can result in more quality time with patients, which also results in higher provider satisfaction.
Automated Resolution Rate (ARR): For patient-facing chatbots, this measures the fraction of queries fully resolved without human intervention.

Providers must move beyond simple accuracy to a multi-dimensional framework that balances clinical safety, operational efficiency, and the patient experience.

AUC-ROC

Measuring AI Model’s Abilities

AUC-ROC (Area Under the Receiver Operating Characteristic Curve) Evaluates how well an AI can distinguish between sick and healthy patients across all classification thresholds. It plots sensitivity against the false positive rate, with a score of 1.0 being perfect, 0.5 indicating random guessing, and higher values indicating better diagnostic performance. It is especially useful because it looks at the balance between Sensitivity (catching all the sick people) and Specificity (not bothering the healthy people) across all possible confidence levels

Performance Metric - AUC-ROC provides a single summary score for diagnostic accuracy. A model with a higher AUC has a higher probability of correctly identifying a patient with a condition compared to one without. It assists in setting the optimal diagnostic threshold to balance sensitivity (catching the sick) and specificity (ruling out the healthy), which is crucial for determining clinical intervention risks.

Interpretation of Scores:

0.9–1.0: Excellent
0.8–0.9: Good - generally considered good for medical diagnostics
0.7–0.8: Poor/Fair
0.5–0.6: Failed
0.5: No better than random guessing. The AI is essentially guessing, like a coin flip

Limitation: While robust, AUC-ROC can sometimes be misleading with heavily imbalanced data (e.g., very rare diseases), where a high score might hide poor performance in detecting the few actual positive cases.

Auditing is Critical

Measure Coding, Billing and Documentation Compliance

Internal auditing and ongoing monitoring are critical for measuring coding, billing, and documentation accuracy. Effective compliance programs can use audit results to ensure that clinical records justify submitted claims, reducing financial risk, and preventing regulatory penalties. It validates the precision of both procedure and diagnosis codes by ensuring there is supporting medical record documentation, which directly impacts revenue integrity and compliance.

Take the Proactive Approach - Auditing bridges the gap between what was performed and what was ultimately billed to the payer. Documentation is the "legal evidence" of a medical encounter; if it is not documented, it is considered not to have happened. Auditing acts as a proactive firewall that identifies systemic errors, such as unbundling, upcoding, or under coding, before they result in severe financial or legal penalties.

How Auditing Ensures Accuracy - Common methods include retrospective audits (post-bill review) to catch errors before payment, and prospective audits (pre-bill review) to correct claims prior to filing claims. Both approaches are needed for different reasons. First, retrospective audits can detect potential errors made by the providers, coders and how the system prepares the claim for filing.

The results of retrospective audits help not only to know where training or system corrections are needed, but data can be used to determine where to hold claims for prospective audits. Additional considerations are:

Documentation and Coding Alignment: Audits verify that medical records (documentation) fully support the codes billed, preventing both under coding (lost revenue) and over coding (compliance risk).
Regulatory Compliance: Regular audits check for adherence to payer requirements and CMS guidelines for appropriate documentation and authentication, reducing the risk of fraud penalties.
Revenue Optimization: By identifying missed billable services or incorrect bundling, audits can help detect potential lost revenue. It can also identify where filing appeals may be needed as well.
- Audits require conducting Root Cause Analysis (RCA) to determine best methods to correct coding errors.
- Identifying inappropriate denials enables targeted staff training and education, reducing future errors.

Whether audits are conducted by qualified internal experts or contracting external auditors, the results offer insights into operational efficiencies and how to improve patient care by ensuring accurate records for quality care and reduced risk.

Measure Workforce Well-Being

A Leading Indicator of Compliance Risk

Burnout is no longer just a workforce concern it is a compliance and patient safety risk. When staff are fatigued or overextended, the likelihood of documentation errors, missed care steps, and regulatory gaps increases. Recognizing this, leading organizations are beginning to treat workforce well-being as a measurable compliance indicator, not solely a Human Resource metric. Key indicators include:

Turnover and vacancy rates in high-risk roles
Overtime and extended shift patterns
Documentation error trends
Employee engagement and psychological safety

These metrics provide early warning signs of systemic risk, allowing organizations to intervene before issues escalate into audit findings or adverse events.

Shift Data to Integrated Priorities

Measuring what matters in healthcare requires a shift from tracking separate silos of data to integrating patient-centered outcomes with workforce wellbeing as dual strategic priorities. True alignment is achieved when your mission, vision, and values are reflected in daily operations and measured through a unified framework of Key Performance Indicators (KPIs). Consider the following to guide your process:

Integrated Strategic Pillars - A robust alignment framework often uses "Strategic Pillars" to organize goals and measurements across the following foundational areas:

Quality & Safety: Clinical outcomes, medical errors, and adherence to evidence-based protocols.
Patient Experience: Metrics that reflect the patient's voice and perceived quality of care.
Workforce Wellbeing: Indicators of staff engagement, burnout, and mental health.
Finance & Growth: Operational efficiency and long-term sustainability.
Community Impact: Alignment with regional health needs and equity.

Key Metrics for Patient Experience - Beyond standard satisfaction scores, measure the factors that drive deep trust and loyalty:

Net Promoter Score (NPS): Likelihood of patients recommending your services.
Customer Effort Score (CES): How easy it is for patients to navigate care (e.g., scheduling, billing).
What Matters to Your Patients? Gather qualitative data from asking patients directly about their priorities, then tracking how often these needs are met.
Real-time Feedback: Transition from retrospective surveys to immediate digital feedback tools.

Key Metrics for Workforce Wellbeing - Wellbeing is a lead indicator of patient safety and satisfaction. Critical measures include:

Burnout & Stress Indices: Validated tools like the Maslach Burnout Inventory (MBI) or Well-Being Index (WBI) to detect meaningful changes over time.
Workforce Stability: Turnover and retention rates, particularly among mid-level and frontline staff.
Psychological Safety: Measuring how comfortable staff feel reporting "near-misses" or voicing concerns.

Measuring Results – Correlation between Staff and Patient Data - Collect data to determine if your strategy and approach is actually aligning these areas. Track the correlation between staff and patient data:

Alignment Assessment: Use surveys to measure "goal clarity" and "goal commitment" among frontline staff—ensuring they understand how their daily work supports the patient experience.
Joint Impact Reporting: Report wellness data (e.g., fatigue levels) alongside safety metrics (e.g., adverse events) to demonstrate how staff health directly impacts patient results.
Value-Based Care Pathways: Track adherence to clinical protocols as a measure of both operational efficiency and quality of care.

Measurement Implementation Steps

Conduct a Strategic Assessment: Identify your top business goals (e.g., growth, retention) and audit current wellness initiatives for connection to those goals.
Establish SMART Goals: Establishing SMART goals (Specific, Measurable, Attainable, Relevant, Time-bound) to improve workforce wellbeing and patient care involves setting clear, data-driven targets, such as reducing burnout scores or raising patient satisfaction ratings by a specific, measurable amount through enhanced staff training and support programs.
Define specific, measurable objectives that tie each wellness goal to a business KPI (e.g., "Reduce turnover by 8% through mental health support and reasonable work hours").
Deploy a Centralized Dashboard: Consolidate disparate data into a single visual system to guide decision-making at every level.
- Deploying a centralized, real-time dashboard improves workforce well-being and patient care by integrating staffing, operational, and clinical data into one interface.
- These dashboards reduce burnout through streamlined workflows, optimized scheduling, and automated documentation, while enhancing patient care via predictive staffing and real-time clinical monitoring.
Engage Leaders as Champions: Ensure leadership at all levels (clinical and administrative) is actively modeling and communicating these priorities.

Key Takeaway - Workforce data is compliance data. Organizations that monitor staff well-being are better positioned to prevent risk, improve quality, and demonstrate a culture of accountability.

Equity-Centric Data

Measuring not just overall health, but reducing care inequities and disparities

Measuring equity-centric data requires moving beyond average performance metrics to stratify outcomes by race, ethnicity, language, socioeconomic status, and disability status, identifying disparities between groups.

Key strategies include benchmarking against best-performing subgroups and tracking social determinants of health (SDOH), ultimately identifying meaningful differences to drive targeted interventions.

Core Strategies for Equity Data Measurement

Stratify Existing Metrics: Disaggregate clinical performance measures (e.g., diabetes care, readmission rates, mortality) by demographic variables to reveal disparities.
Identify "Best-Performing" Benchmarks: Compare population subgroups against the best-performing group (highest/lowest rate) to highlight gaps, rather than just the average.
Include Social Factors: Gather data on socioeconomic status, health-related social needs, ZIP codes, and insurance status to capture upstream drivers of inequality.
Include Intersectionality: Examine how multiple variables (e.g., race and gender) intersect to create specific inequities, rather than analyzing factors in isolation.

Key Data Categories for Tracking

Patient demographics: Race, ethnicity, language, sexual orientation, gender identity, religion, and disability status.
Health-related social needs: Housing instability, transportation barriers, food insecurity, and utility needs.
Access to care: Appointment wait times, telemedicine usage, and language service utilization.
Community-facing data: Data that looks beyond the hospital walls to reflect the immediate community’s health context.

Implementing Measurement for Action

Set Clear Goals: Focus on specific disparities rather than just broad health goals.
Use Standardized Tools: Leverage consistent, evidence-based metrics to track progress over time and for benchmarking.
Engage Stakeholders: Collaborate with patients and community members to identify priority disparities and ensure community relevance.
Evaluate Improvements: Use historical data to monitor whether interventions actually reduce gaps over time.

Standardized SDOH Screening Tools

PRAPARE (Protocol for Responding to and Assessing Patients’ Assets, Risks, and Experiences): A widely used, nationally recognized tool with 15 core questions (and optional supplements) designed for community health centers and EHR integration.
CMS Accountable Health Communities (AHC) Tool: A 10-question tool focusing on 5 key domains: housing, food, transportation, utilities, and safety.
AAFP Social Needs Screening Tool: Provided by the American Academy of Family Physicians, this tool includes short and long forms in multiple languages, focusing on core social needs.
Health Leads Screening Toolkit: A comprehensive set of tools for identifying and addressing social needs.
WE CARE (Well-child Care, Accountable Care, Referral and Education): A tool primarily used in pediatric settings to identify social needs.
Hunger Vital Sign: A validated 2-question screening tool specifically for identifying food insecurity.