Around JPM 2026, our conversations surfaced a practical shift: some healthcare AI uses already face existing legal duties, while newer AI-specific obligations are enacted or approaching. This is a retrospective on those conversations, not a survey of conference attendees or a claim that every AI use is regulated the same way.
In our January conversations, the questions moved beyond “are you using AI?” toward “what evidence supports the way this system is supervised?” and “when a patient asks how an AI system shaped a decision, what can you explain and document?” Signed records can support that inquiry; they do not prove that an AI system is safe.
That pattern framed the meetings we had. Other organizations may be at different stages.
What’s ahead on AI regulation
Here is where things stand:
- Colorado: The state reset its AI law. SB 24-205 was repealed and replaced by SB 26-189 (“Automated Decision-Making Technology”), signed May 14, 2026, with substantive compliance commencing January 1, 2027. It now turns on covered automated decision-making technology (ADMT) used to materially influence a consequential decision, including some healthcare access, cost, and coverage decisions.
- European Union: The AI Omnibus entered into force on July 27, 2026. Relevant high-risk obligations apply from December 2, 2027 for Annex III systems and August 2, 2028 for Annex I product-embedded systems.
- All year: State-level AI requirements and enforcement theories keep expanding, which makes jurisdiction-by-jurisdiction tracking part of the job.
And that’s just regulation. Litigation pressure is mounting too. The Sharp HealthCare lawsuit over ambient AI scribes is a reminder that consent and recording theories are active, and California’s wiretapping statute carries statutory damages that can scale quickly when plaintiffs plead per-encounter violations.
The question governance committees are asking
A recurring diligence question — presented here as a synthesis, not a named-customer quote or survey result — is what a health system could reconstruct if an approved AI vendor’s product hallucinated in a clinical workflow. SOC 2 reports and attestation letters remain useful, but they may not answer that event-level question.
Governance committees can ask for operating evidence alongside vendor claims: a signed record of what a configured guardrail reported for a covered event, plus routing, testing, and coverage evidence. The signature makes covered fields and attribution checkable; it does not independently establish source truth, effectiveness, safety, or compliance.
That’s the gap. And it’s why we’ve been heads-down building resources to help.
What we’ve built
Over the past few months, we’ve put together a library of practical guides to what’s ahead.
Healthcare AI Compliance Briefing
Our pre-read for JPM: state laws, consent litigation, HIPAA gaps, and what governance committees are asking.
RegulationColorado AI Act Compliance Guide
SB 26-189 (ADMT) requirements, timeline, and implementation checklist. What healthcare AI vendors need before January 1, 2027.
TrackerUS State AI Laws Tracker
Which states are regulating AI, and what their requirements mean for healthcare.
Risk AlertAmbient AI Scribe Privacy Guide
CIPA liability, consent requirements, and lessons from the Sharp HealthCare lawsuit.
InternationalEU AI Act Compliance Guide
Complete guide to the EU’s AI regulation. Risk classifications, timelines, and implementation.
Plus deep-dives on HIPAA-compliant AI, NIST AI RMF implementation, ISO 42001 certification, and role-specific guides for CISOs, CMIOs, and General Counsel.
After JPM
We were in San Francisco January 12–15. If you’re working through the same AI compliance questions now, as a health system vetting vendors or as a vendor trying to satisfy enterprise security reviews, the conversation is still open.
Healthcare AI buyers are moving from “trust us” to “prove it.” Organizations that answer early will face these questions under less pressure than the ones that wait.
It’s been a consequential year for healthcare AI so far.
Let’s continue the JPM conversation
If you missed us at JPM, we can pick up the same AI compliance conversation now.
Talk to us
