Issue #7: Before AI Touches Patient Information

Artificial intelligence is already becoming part of everyday healthcare workflows.

It is appearing inside documentation tools, patient portals, scheduling platforms, communications systems, administrative applications, and products healthcare organizations may already use. Sometimes leadership deliberately selects an AI-enabled service. Other times, new capabilities arrive through a vendor update or begin appearing in staff workflows before the organization has decided how they should be governed.

That makes AI less of a future planning issue and more of a current operational one.

For smaller healthcare organizations, the first step does not need to be a large AI governance program. It needs to be visibility.

Before an AI-enabled tool interacts with patient information or becomes part of a healthcare workflow, leadership should be able to answer four basic questions:

What information enters the tool?
Who receives that information?
Who checks what the tool produces?
Who remains responsible after the tool is approved?

These questions fit naturally within the privacy, security, vendor-management, and risk-management practices healthcare organizations should already have in place.

Question 1 — What Patient Information Enters the Tool?

AI governance begins with understanding the workflow.

Before approving an AI-enabled application, leadership should know what information the tool will receive and why that information is necessary.

That may be obvious when a product is used for clinical documentation or patient communication. It can be less obvious when AI functionality is embedded inside an existing platform or when employees begin using general-purpose tools to assist with routine work.

Patient information may include clinical notes, appointment details, messages, billing information, uploaded documents, recordings, summaries, or other data connected to an individual.

Leadership should be able to determine:

  • what information is being provided

  • whether PHI or ePHI is involved

  • which employees or departments are using the tool

  • whether that use has been approved

  • where the information goes as part of the workflow

If those questions cannot be answered, the organization may not yet have enough visibility to make an informed risk decision.

The goal is not to slow useful technology unnecessarily. It is to prevent patient information from entering new workflows faster than the organization can understand and govern them.

Question 2 — Who Receives the Information, and What Happens to It?

Understanding what enters the tool is only half of the picture.

Leadership also needs to understand what happens once information reaches the service provider.

The application visible to the user may represent only one part of the underlying service. Information may be processed, maintained, supported, or accessed through systems and parties that are not immediately apparent from the interface.

Healthcare organizations should understand the vendor’s role, whether PHI is involved, what contractual protections apply, what access the vendor has, and whether additional parties participate in delivering the service.

HHS has identified a third-party AI chatbot handling PHI through a healthcare provider’s patient portal as an example of a business associate. The broader lesson is straightforward: using AI does not place an existing healthcare workflow outside HIPAA responsibilities.

When a business associate relationship exists, a Business Associate Agreement is important, but it should not be treated as the entire review.

Leadership may still need to ask:

  • whether information is retained after processing

  • whether subcontractors or additional service providers are involved

  • who can access patient information

  • how security incidents are communicated

  • what happens to information when the relationship ends

These are familiar vendor-governance questions applied to less familiar technology.

Healthcare organizations do not need an entirely new risk-management philosophy for AI. They need to apply existing disciplines carefully to a new type of service.

Question 3 — Who Checks What the AI Produces?

Responsible AI use is not only about what goes into the system. Healthcare organizations also need to consider what comes out.

AI-enabled tools may draft documentation, summarize information, generate suggested language, prepare patient communications, or support other clinical and administrative activities.

Those capabilities can improve efficiency. They can also introduce risk if generated information moves directly into a workflow without appropriate review.

The level of oversight should reflect how the output will be used.

An AI tool supporting an internal administrative task presents a different risk than one generating information that may enter the medical record, be communicated directly to a patient, or influence a clinical or operational decision.

For each significant AI-enabled workflow, leadership should be able to answer one question:

Who is expected to review the output before someone relies on it?

If AI-generated information is inaccurate, incomplete, inappropriate, or inconsistent with its intended use, staff should know who can correct it and when the issue should be escalated.

Automation may assist the work.

Accountability still belongs to people.

Question 4 — Who Owns the Tool After It Is Approved?

Approval is not the end of governance.

AI-enabled services can change. Vendors may introduce new functionality, add integrations, modify workflows, or expand how information is handled. Employees may also begin using an approved tool for purposes that were not part of the original review.

That makes ongoing ownership important.

For a smaller healthcare organization, ownership does not require a dedicated AI department or complex governance committee. It may simply mean identifying the person or function responsible for monitoring the service and recognizing when a meaningful change deserves another look.

That owner should know when to ask:

  • Has the purpose of the tool changed?

  • Is different patient information now entering the service?

  • Has the vendor materially changed how the service operates?

  • Has the tool been connected to another system?

  • Are staff using it in ways that were not originally considered?

These questions matter because HIPAA risk analysis should account for the ePHI an organization creates, receives, maintains, or transmits and the risks present in that environment.

The objective is not to reassess every minor product update. It is to recognize when the use of the technology has changed enough that the organization should revisit the original decision.

A Practical AI Governance Check

Healthcare organizations do not need to begin with a lengthy AI policy manual. For each significant AI-enabled tool, leadership should be able to document six basic facts:

Purpose — What is the organization using the tool to accomplish?

Information — What patient or organizational information enters the service?

Vendor — Who provides the service, and what role does that party play?

Review — Who checks the output when accuracy or appropriateness matters?

Ownership — Who is responsible for the tool after implementation?

Change — What kind of change would trigger another privacy, security, vendor, or risk review?

If those answers are unclear, that is a useful finding. It indicates that governance may not yet have caught up with adoption.

How SecureHealth Can Help

  • AI Workflow & Data-Flow Review – Identify AI-enabled workflows that interact with PHI or ePHI and document how patient information moves through those services

  • Vendor & Risk Governance Review – Evaluate business associate considerations, vendor responsibilities, safeguards, operational dependencies, and risk-analysis implications

  • AI Administrative Governance Support – Develop practical approval, acceptable-use, accountability, review, and change-management practices appropriate to the organization’s size and operations

A 30-Day Starting Point

Healthcare leadership does not need to launch a broad AI initiative to begin improving oversight.

1. Find out what is already being used. Talk with clinical, administrative, operational, and IT personnel. Include AI capabilities embedded inside existing platforms, not only stand-alone tools.

2. Review the highest-impact workflows. Prioritize tools that receive patient information, connect to clinical systems, communicate with patients, create documentation, or materially affect healthcare operations.

3. Establish ownership. Determine who approves use, monitors the vendor relationship, evaluates meaningful changes, and ensures appropriate review continues after implementation.

The goal is simple: make AI use visible enough to govern.

Final Thought

Healthcare organizations do not need to predict where artificial intelligence will be five years from now to make responsible decisions about it today.

They need to understand what is already happening inside their own environment.

AI introduces new capabilities, but the underlying leadership responsibilities are familiar: understand where patient information goes, evaluate third parties, define accountability, and revisit risk when technology or workflows change.

The objective is not to build an elaborate AI compliance program simply because AI is receiving attention. It is to ensure that new technology enters the organization through the same disciplined processes used to protect patient information, manage vendos, understand operational risk, and document responsible decisions.

For healthcare leadership, strong AI governance can begin there.

Next
Next

Issue #6: Health Privacy Changed in 2026 — What Providers Need to Know About Part 2