Practice Activity: Explain and Check an AI Output
Complete the activity before revealing the model answer. Record one change you would make after comparison.
The situation
A community centre plans a free weekend workshop.
The organiser gives an AI assistant these notes:
Workshop: Getting Started with Digital Payments Date: Saturday, 18 July Time: 10:00 a.m. to 12:00 noon Place: Lakemere Community Centre, Room 2 Audience: adults who are new to digital payments Cost: free Registration: call the centre office Instruction: Write a short public announcement. Use only these notes. If information is missing, do not invent it.
The assistant replies:
Join us on Saturday, 18 July, from 10:00 a.m. to 12:00 noon in Room 2 at Lakemere Community Centre for our free workshop, Getting Started with Digital Payments. This beginner-friendly session is led by certified banking trainer Meera Shah and includes hands-on practice with UPI safety, mobile wallets, and fraud reporting. All participants will receive a government-approved completion certificate. Places are limited to 25, so call the centre office before 15 July to register.
Your five-layer check
Layer 1: What was given?
List the facts that came from the organiser's notes.
Layer 2: How was the answer made?
Explain the simple text-generation process using these words:
- Context.
- Tokens.
- Next token.
- Repeat.
Layer 3: What might the full app have added?
Do the notes prove that the app used search, saved memory, a calculator, or an agent?
Write proven, not proven, or not needed for each one.
Layer 4: What did the model add?
Mark each added claim that is not supported by the notes.
Also mark any important information that is missing from the notes but should not be guessed.
Layer 5: What should happen next?
Write a short checking plan. State which claims can be kept, which must be removed, and which could be added only after the organiser confirms them.
When your work meets the standard
Your answer should:
- Find all facts taken directly from the notes.
- Explain token-by-token generation in simple words.
- Avoid claiming that search, memory, or an agent was used without proof.
- Find every invented detail.
- Separate a false claim from a missing fact.
- Give a safe next step for the announcement.
Reveal the model answer
Layer 1: Given facts
The notes support:
- Workshop name.
- Saturday, 18 July.
- 10:00 a.m. to 12:00 noon.
- Lakemere Community Centre, Room 2.
- Adults new to digital payments.
- Free entry.
- Registration by calling the centre office.
Layer 2: Generation
The app gave the notes and instruction to the model as context. The tokenizer turned the text into tokens. The model chose a likely next token, added it to the sequence, and repeated the process until the announcement ended.
This explains how the text was formed. It does not prove that each claim is true.
Layer 3: Added app abilities
| Ability | Answer | Reason |
|---|---|---|
| Search | Not proven | The task could be completed from the supplied notes |
| Saved memory | Not proven | No earlier session or saved detail is stated |
| Calculator | Not needed | The task has no calculation |
| Agent | Not proven | The system wrote one answer; no outside action or multi-step goal is shown |
Layer 4: Unsupported details
The model added these claims without support:
- Trainer name: Meera Shah.
- The trainer is certified and works in banking.
- Hands-on practice.
- Topics: UPI safety, mobile wallets, and fraud reporting.
- Government-approved certificate.
- Limit of 25 places.
- Registration deadline of 15 July.
The notes also do not give the office phone number. The answer correctly says to call the office, but a final public notice may need the actual number. The model should not guess it.
Layer 5: Next step
Keep the workshop name, date, time, place, audience, free cost, and call-to-register instruction. Remove all other added claims. Ask the organiser to confirm the trainer, topics, format, certificate, place limit, deadline, and phone number before adding any of them.
A corrected announcement
Join us on Saturday, 18 July, from 10:00 a.m. to 12:00 noon in Room 2 at Lakemere Community Centre for our free workshop, Getting Started with Digital Payments. The session is for adults who are new to digital payments. To register, call the centre office.
Think back
Which invented detail sounded most believable to you? Why did it feel believable even though it was not in the notes?