Ambient AI Scribes: What It Means When Your Doctor Records the Visit

Your doctor walks in, sets a phone on the counter and asks, “Do you mind if I use an AI assistant to take notes today?” It is a question millions of patients are now hearing. Most say yes without thinking twice. Others feel uneasy: is the visit being recorded, who hears it, and what if the computer gets something wrong?

Those are fair questions. Ambient AI scribes can give your doctor more time to look at you instead of a screen, but you should know what you are agreeing to. This guide explains how the tools work, what the evidence says about accuracy and burnout, how your data is handled and the 6 questions worth asking before you agree.

This is general information, not medical or legal advice.

What an ambient AI scribe actually does

An ambient AI scribe is software that listens to the conversation between you and your clinician and turns it into a draft clinical note. “Ambient” means it runs in the background. Your doctor does not dictate to it; it just listens.

The typical flow has 4 steps:

1. Capture. The clinician starts the tool on a smartphone app, computer or room microphone, usually after asking your permission.
2. Transcribe. Speech recognition converts the audio into text.
3. Summarize. A large language model, the same kind of technology behind chatbots, organizes the transcript into the format doctors use, such as history, exam, assessment and plan. If you want the background, see what a large language model is.
4. Review and sign. The draft appears in the electronic health record (EHR). Your clinician edits it, corrects errors and signs it. The note does not become part of your record until they do.

Some tools also draft after-visit summaries, referral letters or billing codes. Those drafts should be reviewed by a person, too.

Why so many doctors are adopting it

Documentation is one of the biggest drivers of physician burnout. Many clinicians spend hours each evening finishing notes, sometimes called “pajama time.”

The largest published rollout so far comes from The Permanente Medical Group, Kaiser Permanente’s physician group in Northern California. In a 63-week evaluation published in NEJM Catalyst, as summarized by the American Medical Association:

• 7,260 physicians used ambient AI scribes across more than 2.5 million patient encounters.
• The group estimated about 15,791 hours of documentation time saved, roughly 1,794 eight-hour workdays.
• In patient surveys, 47% said their doctor spent less time looking at the computer, and 56% reported a positive effect on visit quality.

Those results come from the health system that deployed the tool, and the authors called for more research by specialty and population. Still, they explain why many clinics are moving quickly. For the wider trend, see AI in healthcare in 2026.

Consent: do you have to say yes?

No. You can decline, and a good practice will respect that without affecting your care.

Consent matters for 2 reasons:

• Recording laws. Federal law allows recording with one party’s consent, but about a dozen states, including California, Florida, Illinois, Pennsylvania and Washington, generally require consent from everyone in a private conversation. Health systems usually ask every patient to avoid problems, especially with telehealth visits that cross state lines.
• Trust. Even where the law does not require it, most health systems have policies to ask first, and many record your verbal consent in the note.

Ask to pause the scribe if you want to talk about something sensitive, such as mental health, substance use, reproductive health or a family situation. Clinicians can usually stop and restart recording during the visit.

Key takeaway: You can say no to an AI scribe, or ask your doctor to pause it for part of the visit. Your clinician, not the software, is responsible for what ends up in your medical record.

How accurate are AI scribe notes?

Generally useful, but not perfect, which is why clinician review is essential. The early Permanente pilot described the output as high-quality documentation for physicians to edit, and noted that ongoing work was needed on accuracy and relevance. Common error types include:

• Omissions. A symptom you mentioned in passing does not make it into the note.
• Hallucinations. The model adds a detail nobody said, such as an exam finding or a medication dose. Our explainer on AI hallucinations covers why this happens.
• Speaker mix-ups. A family member’s comment gets attributed to you, or your question is recorded as your doctor’s statement.
• Mis-hearing terms. Similar-sounding drug names or numbers get transcribed wrongly.

You can protect yourself by reading the after-visit summary and the full visit note in your patient portal. If something is wrong, message the office and ask for a correction. Under HIPAA, you have a right to request an amendment to your record.

What happens to the recording and your data

This is where patients should ask the most questions, because practices differ.

The vendor is a HIPAA business associate. When a clinic uses an outside company to process patient information, HIPAA requires a business associate agreement (BAA) that limits how the vendor can use and must protect that data. If you work on the technology side, our guide to HIPAA compliance for software explains the obligations.

Audio retention varies. Some products delete the audio once the note is generated or signed. Others keep audio or transcripts for a period for quality review, troubleshooting or model improvement. Ask how long the recording is kept and whether a person at the vendor can listen to it.

Model training is a key question. Some vendors use de-identified data to improve their products, which HIPAA allows under specific rules. Others commit to not using patient data for training. You can ask which applies.

State laws add layers. Some states have health or consumer privacy laws on top of HIPAA, and California’s AB 3030, effective January 1, 2025, requires certain disclosures when generative AI writes clinical communications to patients, unless a licensed provider reviews them first. Our US state data privacy laws guide explains the broader picture. This is not legal advice.

6 questions to ask before you agree

You do not need to interrogate your doctor, but these questions are reasonable and most clinicians are used to them:

1. Is the visit recorded, or only transcribed in real time?
2. How long is the audio or transcript kept, and who can access it?
3. Is the vendor under a business associate agreement with the practice?
4. Is my data used to train the AI?
5. Will you review and edit the note before it goes into my record?
6. Can I see the note, and how do I ask for a correction?

If you are a caregiver attending a visit for a parent or child, the same questions apply. Let the clinician know who is in the room so the note does not confuse speakers.

For clinics: how to introduce an AI scribe the right way

If you run a practice, patients will trust the tool more if you set it up carefully. A simple rollout checklist:

1. Sign a BAA and review the vendor’s security documentation, data retention and training policies.
2. Write a consent script that staff use every time, and document consent in the note.
3. Offer an easy opt-out and a way to pause recording mid-visit.
4. Check state recording laws for every state where you see patients, including by telehealth.
5. Train clinicians to review every note, with extra care on medications, doses, allergies and plans.
6. Audit a sample of notes regularly for omissions and invented details.
7. Update your notice of privacy practices and patient-facing materials to describe the tool.

Clinics weighing broader AI use can also see our guide on whether it is safe to put company data into AI.

Conclusion

Ambient AI scribes are spreading fast because they give clinicians back time and attention, and early results from large health systems are positive for both doctors and patients. The trade-off is that a recording of a private conversation now passes through software and a vendor. You have the right to say no, to ask for a pause and to review and correct your note. Ask a few clear questions, read your visit notes in the portal, and you can get the benefits of an AI scribe with your eyes open.

Sources

• American Medical Association: AI scribes save 15,000 hours and restore the human side of medicine — Permanente Medical Group 63-week results
• Kaiser Permanente Division of Research: Ambient AI scribes to alleviate the burden of clinical documentation — pilot study with 3,442 physicians
• HHS: Business Associates under HIPAA — when vendors need a business associate agreement
• HHS: Your Medical Records — patient rights to access records and request amendments