How do we…
How do we run phishing simulations that teach rather than punish?
Add to board memoOpen the memo
The short answer
- Recommendation
- Judge practice emails on reporting, never on catching people out. Get the programme approved before the first send, keep the forbidden lures out, show a teaching page on every click, publish no results, and meet repeat clicking with support, never a sanction.
- Reasoning
- A practice email exists to build one habit: reporting a suspicious email at once. Run badly, a programme teaches people to distrust the security team, damages trust in real messages and can breach employment and data protection law. That is why the approvals come first (rule AW-09) and why some rules protect the people simulated and admit no exception: the forbidden lures, the teaching page and no published results, the minimum data, and support before sanction.
- Considerations
- Where national law or a collective agreement requires it, staff representatives are consulted or agree before the programme starts. Legal confirms which applies.
- A public authority cannot rely on legitimate interests. Its Data Protection Officer records the basis its own law gives it.
- The figures are the pack's defaults: one practice email about every two months, the 30-day exclusions, the 20% reporting and 15% click thresholds, groups of at least 10 and named results kept for 12 months.
- A small organisation can use one send group and one campaign a quarter. Keep the checklist, the teaching page, the support stages and the 10-person minimum.
The decision, step by step
Select any step for the reasoning behind it and where the pack covers it.
- Start
- Step
- Decision
- Outcome
- Loop back
Keyboard: Tab to a step, arrow keys move along the flow, Enter pins its explanation, + and − zoom, 0 fits the diagram, Esc closes. The text version below has the same content.
Where a step quotes a number, it is the default in the CISO Times pack. Your own standard may set a different one.
Read as text
The same flow written out: each step, its reasoning and where the pack covers it. 18 steps.
Start
You want practice emails that build the habit of reporting
A practice email exists to build one habit: reporting a suspicious email at once. It is judged on reporting, never on catching people out. Run badly, a programme teaches people to distrust the security team, damages trust in real messages, and can breach employment and data protection law.
In the pack
- P16-A05 Phishing Simulation Programme MethodPurpose
- P16-A05 Phishing Simulation Programme MethodPrinciples
Decision
Is the programme signed off by all four approvers, and in date?
The Head of Information Security, HR, the Data Protection Officer and Legal sign the programme before the first practice email. By the pack's default it is renewed every 12 months, and whenever the method changes: a new grade, a new kind of simulation, new fields recorded or a new platform. While any item fails, no practice email runs.
- Yes: Set the grade the progression rule gives the group
- No, lapsed, or not known: Get the sign-offs, staff representatives first where required
In the pack
- P16-A05 Phishing Simulation Programme MethodApproval and ethics (rule AW-09)
- P16-A08 Phishing Simulation Ethics & Approval ChecklistSummary
Step
Get the sign-offs, staff representatives first where required
Legal confirms the national rules on monitoring at work and whether staff representatives must be informed, consulted or agree; where they must, that comes first. The Data Protection Officer records the lawful basis; a public authority uses the basis its law gives it, not legitimate interests. Set the platform to keep only four facts and to show managers groups only. Tell staff what is recorded, who sees it and how support works, without saying when. No practice email is sent until every item passes.
In the pack
- P16-A08 Phishing Simulation Ethics & Approval ChecklistInstructions
- P16-A08 Phishing Simulation Ethics & Approval ChecklistProgramme Approval
- P16-A05 Phishing Simulation Programme MethodData protection
Step
Set the grade the progression rule gives the group
Grades run from 1 (five or more cues) to 4 (one cue, tailored to a role), set by counting the lure's cues. Everyone starts at Grade 1. A grading group moves up one grade when its last two campaigns at the current grade, taken together, reached at least 20% reporting and at most 15% clicks, the pack's defaults. It never moves down as a penalty; if clicks double at a new grade, the next campaign goes back one.
In the pack
- P16-A05 Phishing Simulation Programme MethodDifficulty grades (rule AW-11)
- P16-A05 Phishing Simulation Programme MethodMoving between grades
Decision
Is it a Grade 4 campaign, tailored to one role?
The progression rule stops at Grade 3. Grade 4 is used only for a role at higher risk graded on its own, such as payment staff or privileged users, and each campaign is a decision of its own.
- Yes: Head of Information Security approves it in writing
- No: Write the lure on the month's theme, and count its cues
In the pack
- P16-A05 Phishing Simulation Programme MethodGrading by group
- P16-A05 Phishing Simulation Programme MethodMoving between grades
Step
Head of Information Security approves it in writing
Approval is campaign by campaign, in writing, before the send. Without it the campaign is not cleared to send.
In the pack
- P16-A05 Phishing Simulation Programme MethodThe steps of a campaign
- P16-A08 Phishing Simulation Ethics & Approval ChecklistCampaign Checks
Step
Write the lure on the month's theme, and count its cues
The lure follows the month's theme where it can, so that the teaching page repeats what the month taught. The lure brief gives the story in one line, each cue, the send group and the teaching page. Use fictional names and look-alike organisations.
In the pack
- P16-A05 Phishing Simulation Programme MethodWriting and checking a lure
Decision
Does the lure touch a forbidden topic, or name anyone real?
HR checks every lure before it is used. Never use pay, bonuses, benefits or gifts; health; redundancy, restructuring, reviews or discipline; real emergencies, disasters or appeals; the reporting route or the security team's own warnings; or a real colleague, supplier, customer or partner. No exception can set these aside. Where the awareness lead and HR disagree about a lure, it is not used.
- Yes, or HR and the lead disagree: Replace the lure; never adjust it until it passes
- No: Build the send list, leaving out those who must not receive it
In the pack
- P16-A05 Phishing Simulation Programme MethodLures that are never used (rule AW-10)
- P16-A05 Phishing Simulation Programme MethodCalibrating the people who grade and check lures
- P16-A08 Phishing Simulation Ethics & Approval ChecklistLure Screening
Step
Replace the lure; never adjust it until it passes
A rejected lure is replaced with a new one, never argued through or edited until it scrapes past. The check is on the topic, not on whether the lure would work: a bonus statement would be effective, which is why it is forbidden.
- Then: Write the lure on the month's theme, and count its cues (back to an earlier step)
In the pack
- P16-A05 Phishing Simulation Programme MethodExample 2: the bonus lure
- P16-A08 Phishing Simulation Ethics & Approval ChecklistLure Screening
Step
Build the send list, leaving out those who must not receive it
Leave out joiners in their first 30 days, people on a long absence, anyone sent a practice email in the last 30 days, and anyone HR has asked to leave out for personal circumstances, without recording the reason with the results. Avoid payroll day, the busiest trading days and any period of redundancy consultation.
In the pack
- P16-A05 Phishing Simulation Programme MethodHow often, and who is left out
- P16-A08 Phishing Simulation Ethics & Approval ChecklistCampaign Checks
Decision
Is a Severity 1 or 2 incident open on the day before or of sending?
A real attack needs everyone's attention, and the reporting route needs to be free. Check the incident log on the day before sending and again on the day. If you cannot tell, hold.
- Yes, or not known: Hold the send until the incident closes
- No: Brief the service desk, and ready the teaching page
In the pack
- P16-A05 Phishing Simulation Programme MethodHow often, and who is left out
- P16-A05 Phishing Simulation Programme MethodExample 3: keeping clear of open incidents
Outcome
Hold the send until the incident closes
Send once the incident has closed and the other checks still pass. In the pack's example, one send went out 2 working days after a Severity 1 incident closed.
- Then: Is a Severity 1 or 2 incident open on the day before or of sending? (back to an earlier step)
In the pack
- P16-A05 Phishing Simulation Programme MethodExample 3: keeping clear of open incidents
Step
Brief the service desk, and ready the teaching page
The service desk and the incident manager know the campaign is running, so a report is thanked and not escalated. The teaching page is ready for this lure; test it on a phone and on a floor terminal. The sending route passes mail filtering for this campaign only, and the domain cannot receive replies.
In the pack
- P16-A08 Phishing Simulation Ethics & Approval ChecklistCampaign Checks
- P16-A05 Phishing Simulation Programme MethodThe teaching page
Step
Send across the day; keep it open for 5 working days
Spread the send over the working day, so that one report does not warn the whole group at once. A click shows the teaching page at once: this was a practice email, nobody else will see that you clicked, the cues you could have spotted, and how to report next time. No score, no test and no warning. A report after a click counts as a report.
In the pack
- P16-A05 Phishing Simulation Programme MethodThe steps of a campaign
- P16-A05 Phishing Simulation Programme MethodThe teaching page (rule AW-12)
- P16-A05 Phishing Simulation Programme MethodMeasuring a campaign
Step
Close: count reporting first, and publish no results
Count the reporting rate and time to first report for each group, with its grade; clicks and credentials entered are context. Send the group a note within 3 working days with the cues and a thank-you, and no figure. Line managers see their team's result only where the team has at least 10 people. Results are never published, ranked or announced.
In the pack
- P16-A05 Phishing Simulation Programme MethodMeasuring a campaign (rule AW-15)
- P16-A04 Awareness Campaign Communications KitCampaign close note
- P16-A05 Phishing Simulation Programme MethodWho sees what (rule AW-13)
Decision
Has anyone now clicked twice within 12 months?
The awareness lead counts from the platform's own results, which only the lead sees by name. A second click within 12 months starts the support stages. It never starts a sanction.
- Yes: Offer private coaching within 10 working days of closing
- No: Next month: the other send group, under the same checks
In the pack
- P16-A05 Phishing Simulation Programme MethodSupport for repeat clickers (rule AW-14)
Step
Offer private coaching within 10 working days of closing
The awareness lead offers a short private session about the person's own inbox; taking it up is voluntary. A third click brings a support conversation and stronger protection for the account.
In the pack
- P16-A05 Phishing Simulation Programme MethodSupport for repeat clickers
Outcome
Next month: the other send group, under the same checks
Two send groups take turns, so each person receives one practice email about every two months. Compare results only at the same grade, report group figures monthly, and reduce named results to group figures after 12 months, on the platform and in any export.
In the pack
- P16-A05 Phishing Simulation Programme MethodHow often, and who is left out
- P16-A05 Phishing Simulation Programme MethodComparing results
- P16-A05 Phishing Simulation Programme MethodThe steps of a campaign
Practical checklist
- Get the programme signed by the Head of Information Security, HR, the Data Protection Officer and Legal, and tell staff what is recorded and who sees it.
- Set each group's grade by the progression rule, and have every Grade 4 campaign approved in writing.
- Write the lure on the month's theme, count its cues, and have HR check it against the forbidden topics and for real names.
- Build the send list without joiners, long absences, recent recipients and anyone HR asks to leave out.
- Check for an open Severity 1 or 2 incident the day before and the day of sending, and hold if there is one.
- Tell the service desk and the incident manager, test the teaching page, and spread the send across the day.
- Close after the campaign window, count reporting first, and share group results only.
- Offer private coaching within 10 working days to anyone who has clicked twice within 12 months.
Evidence to have ready
- The signed ethics and approval checklist, with its four signers, the consultation where required and its renewal date.
- The lawful basis, and the legitimate interests assessment where that is the basis.
- The announcement staff received, with its date.
- For each campaign: the lure brief, HR's check, the exclusions, the grade and how the rule gave it, and the group results.
- The support offered to repeat clickers as counts, and proof that named results older than 12 months were reduced.
Assumptions
- There is one reporting route for suspicious emails, and the service desk and the incident manager can be told when a campaign is running.
- Your simulation platform can be set to record only sent, clicked, credential entered and reported, and to show managers groups of at least 10 people only.
- The figures shown (one practice email about every two months, the 30-day exclusions, the 20% and 15% thresholds, a campaign open for 5 working days, groups of at least 10, 12 months) are the CISO Times awareness pack's defaults. Your own method may set others.
Not covered here
- Support for one person who keeps clicking. That is “If the same person keeps clicking simulated phishing emails, then what do we do?”.
- Which measures show whether the programme works. That is “When do we know whether awareness is working, and what do we measure?”.
- Choosing the month's theme that the lure follows. That is “How do we plan a year of awareness from our own incidents and risks?”.
- Handling a reported email that turns out to be real phishing. That is “How do we decide whether something is an incident or just an event?”.
Related questions
- How do we decide whether something is an incident or just an event?
- How do we roll out phishing-resistant MFA, and in what order?
- If the same person keeps clicking simulated phishing emails, then what do we do?
- When do we know whether awareness is working, and what do we measure?
- How do we plan a year of awareness from our own incidents and risks?