Three Rooms Where This Works

Conversational AI Watch

Conversational AI Watch

The news that moves policy, portfolios, and patient safety.

By Jess Jessop  |  August 23, 2026  |  Issue #135

▶ WATCH🎧 QUICK LISTEN🎧 DEEP DIVE
Jess's Take editorial cartoon on today's lead

CONVERSATIONAL AI WATCH

Jess Jessop

Publisher of Conversational AI Watch · Author of Therapist in the Loop · Founder, Clinician Assist

Disabled Navy veteran and mental health survivor building conversational AI in mental health since 2017.

The book, the compliance map, the 988 SAFE Act, the daily archive, and the story behind the beat:

Visit JessJessop.info →

Infographic: three American programs designed so a licensed or accountable human stays on the hook for what a conversational AI says: Tufts embodied conversational agents delivering patient-reported outcomes in cancer care, the Colorado Attorney General's detailed Chatbot Safety Act rules published August 11, and Nationwide Children's DAPHNE chatbot routing social-care needs from caregivers back to the pediatric primary-care team.

LISTEN & WATCH ANYWHERE

Three shows, everyday.

Pick the format that fits your commute, your workout, or your desk.

DEEP DIVE20 MIN PODCAST

Spotify  ·  Apple  ·  Amazon  ·  RSS

QUICK LISTEN4 MIN BRIEFING

Spotify  ·  Apple  ·  Amazon  ·  RSS

VIDEO6 MIN CINEMATIC

Spotify  ·  Apple  ·  YouTube  ·  RSS

ALSO ON  Substack  ·  Full archive  ·  X

Jess's Sunday Reflection

Three Rooms Where This Works

A cancer-care internist at Tufts, an elected AG in Denver, and a pediatric researcher at Nationwide Children's, each showing what a human-in-the-loop chatbot looks like when meant.

Everyday this newsletter tracks a wire that will not stop breaking.

. . .

Sunday is different.

. . .

Sunday is when we put down the dockets and the headlines and go find the people who built the answer years before the news finally went viral.

The three people on this page have almost nothing in common. One is a Boston internist with more than a decade of work on health literacy through embodied conversational agents. One is Colorado’s elected Attorney General. One is a researcher at a children’s hospital in Columbus, Ohio. I do not think any of them have met.

Each of them landed on the same small, hard idea. A licensed human answers when the machine speaks.

. . .

A Boston physician who has spent over a decade teaching machines to read the questionnaire to the patient who cannot navigate a paper form, and who has never let the machine deliver the answer without a doctor between it and the diagnosis.

. . .

A state attorney general who watched the Federal Trade Commission threaten to preempt state chatbot laws, and then filed detailed proposed rules five weeks later anyway.

. . .

A pediatric researcher whose new chatbot recruits caregivers, not children, and hands every social-care need it finds to the child’s primary care team.

. . .

Legislators and staffers, notice what none of these three left to chance. Every one of them wrote down, in advance, the moment the machine has to stop and go get a person, and then named the person.

That is harder to design than a prohibition. All three designed it.

. . .

A physician-researcher. A state attorney general. A children’s hospital investigator.

Here they are.

Reader Pulse

Three Americans keeping a human in the loop.

🔥  How it should work
✏️  New name to me
💪  Show me at scale
🤔  Where is the audit
💬  I know a fourth

Forward to a colleague →  ·  Join the discussion →

. . .

PAASCHE-ORLOW’S EMBODIED CONVERSATIONAL AGENT FOR CANCER PATIENTS. A patient in cancer treatment picks up her phone and an animated figure asks, out loud, how her pain has been this week. It makes eye contact, gestures, waits for her answer, in English or in Spanish. That figure is an embodied conversational agent, and Doctor Michael Paasche-Orlow has spent years building the version that reports the answer back to her oncologist.

Doctor Michael Paasche-Orlow, Vice Chair for Research in the Department of Medicine at Tufts Medical Center, contact PI on the NIH R01 building an embodied conversational agent for cancer patient-reported outcomes
Photo: Tufts University

Doctor Michael Paasche-Orlow is Vice Chair for Research in the Department of Medicine at Tufts Medical Center and a Professor of Medicine at Tufts University School of Medicine, in Boston. He is a nationally known health literacy researcher, the field that asks a plainer question than most of medicine bothers to ask: can the patient understand and use the information her care depends on.

The grant is titled “Improving PRO Interpretation at the Individual Level for Patients with Cancer using Conversational Agents and Data Visualization.” NIH project number 5R01CA271145-05. Paasche-Orlow is the contact PI at Tufts Medical Center.

His co-PI and technology lead is Timothy W. Bickmore, PhD, of Northeastern University’s College of Computer Science, who has spent over a decade developing embodied conversational agents for patients with limited health literacy, elderly patients, and patients with cancer.

The system they are building is called ECA-PRO. It is a framework for administering patient-reported outcomes, the surveys that ask how a patient is doing, over time, through an embodied conversational agent on the patient’s own smartphone. It runs in English and Spanish.

The agent is not a chat window. It is an animated character that simulates a face-to-face conversation: voice, hand gestures, gaze cues, the nonverbal signals a text box cannot carry.

Bickmore’s group has already shown that these agents work as valid alternatives to paper-based screening surveys, and that an ECA displaying empathy keeps patients engaged over time, where a form on a screen loses them.

Two clinical scenarios anchor this R01. One: longitudinal monitoring of symptoms and quality of life for patients undergoing cancer treatment, tracked visit over visit instead of caught only at the appointment. Two: monitoring medication adherence for patients on long-term oral anti-cancer drugs, the pills taken alone at home with no one watching.

The results come back through new interfaces built to show patients and clinicians clear visualizations, not raw survey data.

The agent asks the questions and reads them aloud to a patient who might otherwise struggle with the form. It does not diagnose, does not prescribe, does not decide. It hands the picture to the oncologist, who does.

For Clinicians: ECA-PRO is not deployed software; it is an active five-year R01 building the framework, currently in year five of five. What it demonstrates is the design discipline worth demanding elsewhere: the agent’s job ends at collecting and visualizing the patient-reported data, and the oncologist’s job begins at interpreting it. No step in between where the machine decides.

For Legislators: A federal grant is funding, in real time, what a health-literacy-focused conversational agent looks like when it is built for patients who cannot navigate a standard survey: two languages, empathy shown to sustain engagement, and results that terminate in a clinician’s hands, never a diagnosis of their own. That handoff point is the design bar a statute can name.

Source: NIH RePORTER, 5R01CA271145-05, https://reporter.nih.gov/search/5R01CA271145-05/project-details

Comment on this story →  ·  Forward this →

. . .

WEISER’S FIRST DETAILED CHATBOT SAFETY ACT RULES. A teenager in Colorado opens a companion chatbot for company on a slow afternoon. Under a rule the state’s Attorney General just proposed, the app has to guess her age first, then tell her, plainly, that she is talking to a machine.

Phil Weiser, elected Attorney General of Colorado, whose office filed detailed proposed rules under a state Chatbot Safety Act on August 11, 2026
Photo: Colorado Attorney General's Office

Phil Weiser is the elected Attorney General of Colorado, first elected in 2018 and re-elected in 2022. He was Dean of the University of Colorado Law School before he ran for office, and he is also a candidate for Colorado Governor in the 2026 cycle. That campaign is background here. The story is the rules his office filed, not the race.

On August 11, the Colorado Department of Law, under Weiser’s authority, filed proposed rules for two statutes at once: Senate Bill 26-189, the Automated Decision-Making Technology Act, and House Bill 26-1263, Colorado’s Chatbot Safety Act, formally the Conversational Artificial Intelligence Services Act. Both take effect January 1, 2027. The rules are proposed, not final. They were published for public comment on the same day they were filed.

. . .

Read what the Chatbot Safety Act rules ask of an operator. Estimate the age of the user. Disclose that the user is talking to AI, not a person.

Protect minors specifically against sexually explicit content and against what the rules name directly: simulated emotional dependence. Build privacy and account-management tools sized for a minor user, not an adult’s settings menu. Establish a suicide and self-harm response protocol, not a general safety statement but a protocol.

File an annual report with the Office of the Attorney General, with metrics on how the safeguards and the response protocols performed. And do not let the chatbot’s output be represented as equivalent to a licensed professional service.

Six duties, in a proposed rule, tied to a statute that carries an enforcement office behind it once it takes effect.

. . .

The comment window runs from August 11 to October 26, 2026, at 11:59 p.m. Mountain Standard Time, extended to the last day of the hearing if the hearing itself runs long. A formal rulemaking hearing has been scheduled around that same October date. Nothing in the Chatbot Safety Act rules is locked yet. The record is still open.

The timing carries its own context. Five weeks earlier, on July 7, 2026, the Federal Trade Commission signaled it may move to preempt state chatbot laws, a story Conversational AI Watch covered in issue #134. Weiser’s office filed anyway. Whatever the outcome of that federal question, Colorado put a detailed rule on the table rather than waiting to find out whether it would be allowed to.

The same August 11 filing carries the Automated Decision-Making Technology Act rules alongside the chatbot rules, covering the separate world of AI used in consequential decisions like housing, employment, credit, and insurance: disclosure duties, reporting requirements, and consumer rights for developers and deployers of that technology. It is a second, adjacent proposal riding in the same filing.

For Legislators: This is one of the first detailed state regulatory implementations of a chatbot safety statute in the country. Other states have reached for outright bans on companion chatbots for minors or prohibitions on chatbots posing as therapists.

For Operators: The six items are not aspirational. Age estimation. AI disclosure. Protection against sexually explicit content and simulated emotional dependence for minors. Privacy and account tools sized for minors. A suicide and self-harm response protocol. An annual report to the Attorney General with performance metrics.

Source: Colorado Department of Law, AI rulemaking docket, https://coag.gov/ai/

Comment on this story →  ·  Forward this →

. . .

SEZGIN’S DAPHNE CHATBOT FOR PEDIATRIC CAREGIVERS. A caregiver of a pediatric primary-care patient at Nationwide Children’s Hospital opens a chatbot on her phone. Its name is DAPHNE. She is the one it talks to, not her child. What she tells it about usability, burden, and unmet social needs routes back to the child’s own primary care team, never to the child directly.

Doctor Emre Sezgin, Principal Investigator at the Center for Biobehavioral Health at Nationwide Children’s Hospital, PI and lead sponsor of the DAPHNE pediatric-primary-care caregiver chatbot trial
Photo: Nationwide Children's Hospital

Emre Sezgin, PhD, is Principal Investigator at the Center for Biobehavioral Health at Nationwide Children’s Hospital and Assistant Professor of Pediatrics at The Ohio State University College of Medicine. He leads the Intelligent Futures Research Lab, based in Columbus, Ohio, where his stated focus is building connected digital health tools that improve remote care and promote digital equity for patients and families.

On the DAPHNE trial, Sezgin holds an unusual dual role. He is both the Principal Investigator and the lead sponsor, listed on ClinicalTrials.gov as Emre Sezgin, not as a corporate entity or the hospital itself. That means personal responsibility for the trial’s conduct sits with the researcher, not behind an institutional or commercial sponsor.

DAPHNE is a pilot randomized clinical trial. Its subjects are caregivers of pediatric patients at the Nationwide Children’s Hospital Primary Care Center, not the children themselves. Enrolled caregivers are split between a DAPHNE intervention arm and a standard-of-care control arm over a six-month engagement window. Caregivers complete usability and burden surveys plus brief qualitative interviews. Primary care providers, separately, assess how the chatbot’s outputs fit their own workflow.

The trial asks two questions: is DAPHNE usable, acceptable, and low-burden for caregivers over six months, and can it be integrated into a primary care provider’s workflow without friction.

The outcome measures are the System Usability Scale, the Web Evaluation Questionnaire, the Feasibility of Intervention Measure, retention rate, and social determinants of health. The trial began recruiting April 24, 2026, with primary completion projected for August 2028. No outcome data exists yet.

The architectural choice is the news. DAPHNE does not speak to the child in the exam chair. It speaks to the adult who holds legal and practical responsibility for that child, and it hands what it learns, particularly unmet social-care needs, to the licensed pediatric primary care team. The vulnerable person in this design is never the one talking to the machine.

For Clinicians: The pediatric primary care team stays in the loop by design, not by policy overlay. DAPHNE is a pilot with a six-month engagement arm and no outcome data yet; the trial itself, not a vendor claim, is what will tell you whether it works.

For Legislators: Statutory language about “AI in pediatric settings” tends to assume the AI is talking to the pediatric patient. DAPHNE is a working counterexample: a chatbot built to serve a pediatric patient population entirely through the adult caregiver, with outputs routed to a licensed clinician.

Source: ClinicalTrials.gov, “AI-Based Personalized Health and Self-Care,” NCT07168382, https://clinicaltrials.gov/study/NCT07168382; Nationwide Children’s Hospital, Emre Sezgin profile, https://www.nationwidechildrens.org/find-a-doctor/profiles/emre-sezgin

Comment on this story →  ·  Forward this →

Disclosure

Conversational AI Watch is published by Jess Jessop and sponsored by Clinician Assist Inc. The author has no commercial relationship with Doctor Michael Paasche-Orlow, Attorney General Phil Weiser, or Doctor Emre Sezgin. None of them was compensated, consulted, or shown this issue before publication.

Clinician Assist builds software that keeps a licensed clinician in charge of an AI tool. Every project in this issue leans the same way, toward bounded machines with humans close by, and readers should weigh that interest.

The reporting draws on the federal grant database, the trial registry, the Colorado Department of Law’s rulemaking docket, and each program’s own public statements. This newsletter is produced with artificial intelligence models under human editorial supervision.

Three rooms. Three people. One idea: a licensed human answers when the machine speaks.

Back to the dockets tomorrow.

Today's Question

When a chatbot sits between you and your care, what makes it worth trusting?

Clinician-designed for this population
State rules the regulator can enforce
It never speaks to the vulnerable person
Published track record of results

One tap. Results on the other side.

The Book • Out Now

Therapist in the Loop book cover: a therapist and a client in armchairs joined by a glowing loop of light

Therapist in the Loop

by Jess Jessop

One billion people live with a mental health disorder. Most will never see a therapist. Into that gap has rushed a generation of chatbots that talk like clinicians and answer to no one.

The book lays out the architecture this newsletter tests against every statute and docket: client, therapist, and machine, governed by Six Laws offered as an open safety standard.

The machine can help. It cannot be left in charge.

Get the Book on Amazon →

Kindle, hardcover, and paperback

More On Our Radar

UK opens age-restriction consultation naming AI chatbots The Department for Science, Innovation and Technology opened a national consultation on Aug 19 that names AI chatbots inside a wider age-restriction regime for online services aimed at minors. It is the first UK regulator document to put chatbots inside an age-gating frame, and the consultation window closes in the fall. Source

Nobody can independently check the chatbot usage reports MIT Technology Review published a piece by Anka Reuel of Stanford saying Anthropic and OpenAI 'only release the data they want us to see' and that 'there is no independent source to corroborate' the adoption numbers a legislator or a VC quotes on any given day. Source

Brush Your Brain - The jingle

that started a movement

Watch on YouTube

This Issue

Three names to notice before Monday.

Adding all three
Forwarding it on
Not a champion
Who pays for it
I have a fourth

If you or someone you know is in crisis, call or text 988 (Suicide and Crisis Lifeline).

Jess Jessop is the Founder and CEO/CTO of Clinician Assist Inc. (BetterMind.Space), building a voice-first AI-native mental health EHR with Casey Life and Peer AI Coach supervised by licensed therapists. A disabled veteran and 25-year AI/software engineering veteran, Jess brings lived experience as a mental health client to the mission of making daily mental health care as integrated as oral care.

ClinicianAssist.ai  |  BetterMind.Space  |  JessJessop.info

Subscribe  |  Archive  |  Unsubscribe