Evidence and uncertainty: a clinician’s generative AI reading habit

Treat citations as leads, not proof

Verify that each source exists, is current, matches the population and question, and supports the claim made. Models can produce plausible but incorrect bibliographic details.

For clinical decisions, use trusted evidence systems and organizational resources rather than relying on a conversational answer.

Preserve what is unknown

Ask the draft to separate known facts, assumptions, missing information, and questions for a qualified reviewer. Then verify that separation yourself.

A useful tool should make uncertainty easier to see, not bury it beneath confident prose.

Compliance is a workflow, not a label

A product name, model name, or marketing page cannot make a healthcare workflow compliant by itself. The organization using the tool still has to determine whether HIPAA applies, understand what information enters the system, document permitted uses, configure access, train its workforce, and manage risk.

For a cloud service that creates, receives, maintains, or transmits electronic protected health information on behalf of a covered entity or business associate, HHS guidance centers the business associate agreement and the regulated organization’s own risk analysis. Those are operational responsibilities, not badges that can be inferred from a homepage.

• Identify the data before selecting the tool
• Confirm the contract and covered services
• Document access, retention, review, and incident handling

Keep the human decision visible

Generative output can be fluent and still be incomplete, outdated, or wrong. A useful implementation names who reviews the output, what they compare it against, which changes they must make, and where the approved final record lives.

Human review should be proportionate to the consequence of error. A draft staff announcement and a patient-specific clinical recommendation do not belong in the same review lane. High-consequence decisions require qualified professional judgment and authoritative sources.

A review table for the team