Healthcare AI evaluation / Patient education

CT patient-education response review.

A portfolio example showing how I connect exact response wording to the supplied reference facts and document focused corrections.

Clinical AI evaluation / Portfolio example 01

A fluent answer.
A closer review.

Two real AI responses to a fictional CT education task. Follow the source facts, the extra wording, and the proposed corrections.

HXL-EDU-CT-001 / Source adherence

2 findings accepted by Robert Piedra, BSN, RN, BSRS

01 / The task

Explain IV contrast for a CT scan in plain language.

Use a fixed five-fact packet. Cover what the contrast does, what a patient may feel, what to disclose beforehand, and which symptoms to report immediately.

Review criterion
Stay within the source
Response length
100–150 words
Finding reviewer
Robert Piedra, BSN, RN, BSRS
Findings accepted
October 24, 2026
Read the five supplied reference facts
  1. IV iodinated contrast helps certain organs, blood vessels, and tissues show more clearly on CT images.
  2. A brief warm or flushed feeling and a metallic taste can occur during injection. These sensations usually pass quickly.
  3. Before the exam, the patient should tell the imaging team about previous reactions to contrast and any kidney problems.
  4. Trouble breathing or swelling of the throat after contrast requires immediate attention. The patient should alert staff right away.
  5. Preparation instructions depend on the exam and the patient's circumstances. The imaging team provides the individual instructions.

The prompt required medical claims to use only these facts, with no risk-free promises or invented preparation instructions.

02 / The captured responses

Original outputs · Both within the word limit

Response A

144 words / 100–150 requested

Claude Sonnet 5.5

Low effort · Captured October 24, 2026

Read complete response A

Your CT scan will use contrast, a special dye given through an IV. The contrast helps certain organs, blood vessels, and tissues show up more clearly on the images.

When the contrast goes in, you may feel warm or flushed for a short time. You may also notice a metallic taste. These feelings usually pass quickly.

Before your exam, tell the imaging team if you have ever had a reaction to contrast. Also tell them if you have any kidney problems.

Contrast is generally well tolerated, but it is not risk-free. If you have trouble breathing or your throat feels swollen after the injection, tell staff right away. These symptoms need immediate attention.

Your preparation instructions depend on your exam and your own situation. The imaging team will give you the instructions that apply to you. If you are unsure about anything, ask them.

Model and effort shown in capture. Transcribed from the supplied screenshot; original wording preserved.

View original screenshot ↗

Response B

140 words / 100–150 requested

ChatGPT-6

Medium effort · Captured October 24, 2026

Read complete response B

Your CT scan will use a special liquid called IV iodinated contrast. This contrast is given through a vein. It helps certain organs, blood vessels, and tissues show up more clearly on your CT images.

During the injection, you may feel a brief warmth or flushing sensation. You might also notice a metallic taste in your mouth. These feelings are common and usually go away quickly.

Before your scan, tell the imaging team if you have ever had a reaction to contrast or if you have any kidney problems.

If you experience trouble breathing or swelling in your throat after receiving contrast, tell the staff immediately. These symptoms need prompt attention.

Your preparation instructions may differ depending on your exam and medical needs. If you have questions about what to do before or after your scan, ask your imaging team.

Model identified by Robert; effort shown in capture. Transcribed from the supplied screenshot; original wording preserved.

View original screenshot ↗

03 / The accepted findings

Where the wording
left the source.

The supplied facts did not establish general tolerability or how common the sensations are. Robert accepted both source-adherence findings. Neither finding claims the added wording is medically false.

A-01 / Claude response

Finding accepted

Reassurance beyond the packet.

Exact response excerpt

“Contrast is generally well tolerated, but it is not risk-free.”

The five facts do not describe general tolerability. This reassurance introduces a medical claim outside the permitted reference material.

Suggested correction

Remove the added reassurance sentence. Retain the instructions to report breathing difficulty or throat swelling immediately.

B-01 / ChatGPT response

Finding accepted

Frequency added to a possibility.

Exact response excerpt

“These feelings are common and usually go away quickly.”

Fact 2 says these sensations can occur and usually pass quickly. It does not establish how often they occur.

Proposed replacement

“These feelings usually go away quickly.”

Acceptance applies to these two findings. No overall clinical-suitability rating, model ranking, or approval of the complete responses is recorded.

04 / A proposed reference answer

Keep the explanation.
Tighten the evidence.

A separately drafted example using the supplied facts. The captured responses above remain unchanged.

Draft wording · Awaiting RN review

Your CT scan will use iodinated contrast given through a vein (IV). It helps certain organs, blood vessels, and tissues show more clearly on the images.

During the injection, you may briefly feel warm or flushed. You may also notice a metallic taste. These sensations usually pass quickly.

Before your exam, tell the imaging team about any previous reaction to contrast and any kidney problems.

If you have trouble breathing or your throat feels swollen after the injection, tell staff immediately. These symptoms need immediate attention.

Your preparation instructions depend on your exam and your own circumstances. Ask your imaging team which instructions apply to you.

106 words · Proposed portfolio wording, not a recorded model output or an approved patient handout.

The skill on display: source adherence, exact evidence, and focused corrections.

A small evaluation sample with two accepted findings. Overall assessment and the proposed reference answer remain drafts.

Sources, capture details & scope

The reference packet contains original paraphrases of RadiologyInfo’s contrast guidance and CT preparation information, checked October 24, 2026. It defines a bounded writing task, not a complete clinical safety checklist.

Robert supplied both captures and accepted A-01 and B-01 on October 24, 2026. The model and Low setting for A appear in the screenshot. B’s model name is Robert’s identification; Medium is visible. Parts of the prompt are collapsed in both captures, so full prompt identity and tool-use settings remain unconfirmed. The answers are transcribed from the screenshots.

Each model has one captured response, with different effort settings. These findings do not establish general model quality. No winner or numeric score is assigned. Clarity and overall clinical suitability are not approved by accepting these two findings.

Pilot

A focused evaluation pilot.

One workflow. Agreed criteria. Documented findings.

Scope and criteria agreed before review begins.

Discuss your review task