How do we…
How do we rate a control deficiency and set its deadline?
Add to board memoOpen the memo
The short answer
- Recommendation
- Rate the deficiency on the day the reviewer signs. Low if the control ran and only its record fell short; High if a key control failed, or a risk outside appetite or an unmet obligation is left without its control, with nothing tested behind it; otherwise Medium. Deadlines run from that day.
- Reasoning
- The severity tracks what is left exposed (rule CA-12). A control that ran every time with a weak record leaves little exposed. A failed key control with no tested compensating control leaves the risk open. A compensating control counts only once it has itself been tested effective for the same period. The risk owner is told at once, because a risk that relied on the control may need reassessing, and a deficiency closes only when a retest by someone other than its owner passes (rule CA-14).
- Considerations
- The deadlines are the pack's defaults: a plan within 10 working days, and a fix within 90 days for High, 180 for Medium and 365 for Low, counted in calendar days. Your own method may set others.
- A deficiency that cannot be fixed in time is deferred only as a security exception requested before the due date, approved by the approver its band sets. Never by changing the date in the tracker.
- A High deficiency goes to the approver in the next report: the board or a board risk committee it has delegated to, the management board in a two-tier structure, or executive management where there is no board.
- If you are not sure the control ran, or whether it is key, take the more severe branch.
The decision, step by step
Select any step for the reasoning behind it and where the pack covers it.
- Start
- Step
- Decision
- Outcome
Keyboard: Tab to a step, arrow keys move along the flow, Enter pins its explanation, + and − zoom, 0 fits the diagram, Esc closes. The text version below has the same content.
Where a step quotes a number, it is the default in the CISO Times pack. Your own standard may set a different one.
Read as text
The same flow written out: each step, its reasoning and where the pack covers it. 20 steps.
Start
A reviewer has signed a workpaper that found a problem
The control assurance lead rates each deficiency when the reviewer signs the workpaper. The date the reviewer signs is the day the deficiency is confirmed, and every deadline counts from it.
In the pack
- P20-A05 Control Test Execution ProcedureStage 8: Review and sign the workpaper (rules CA-11, CA-13)
- P20-A02 Control Testing MethodologyRating a deficiency (rule CA-12)
Decision
Was the design Deficient, or the operating test Not effective?
Every design deficiency and every Not effective result is a deficiency. An exception found on a test that was still concluded Effective, after the sample was extended, is not one.
- Yes: Log it the day the reviewer signs, with what was found
- No, Effective with an exception: Not a deficiency: note the exception and keep testing on cycle
In the pack
- P20-A08 Control Deficiency & Remediation TrackerInstructions (rule CA-12)
Outcome
Not a deficiency: note the exception and keep testing on cycle
Record the exception in your tracker's list of exceptions noted, with the control that caught it if one did. It needs no plan or deadline of its own.
In the pack
- P20-A08 Control Deficiency & Remediation TrackerExceptions Noted
- P20-A08 Control Deficiency & Remediation TrackerInstructions (rule CA-12)
Step
Log it the day the reviewer signs, with what was found
Enter the control, the workpaper, whether the deficiency is in design or operation, and the finding in one or two sentences. Enter the date the reviewer confirmed it: the plan-by and due dates count from it.
In the pack
- P20-A05 Control Test Execution ProcedureStage 9: Log the deficiency, rate it and agree the plan (rule CA-12)
- P20-A08 Control Deficiency & Remediation TrackerTracker
Decision
Did it run every time, with only its record short of the standard?
This is checked first. A control that ran, with a record short of the evidence standard, such as approvals with no date, is Low whatever else applies. A control that did not run is never Low. If you are not sure it ran, take the cautious branch.
- Yes: Rate it Low: fixed within 365 days
- No, or not known: Is it a key control?
In the pack
- P20-A08 Control Deficiency & Remediation TrackerSeverity and Deadlines (rule CA-12)
Step
Rate it Low: fixed within 365 days
The control ran, but its record falls short of the evidence standard. In the pack's default a Low deficiency is fixed within 365 days of the day the reviewer signed.
In the pack
- P20-A08 Control Deficiency & Remediation TrackerSeverity and Deadlines (rules CA-12, CA-13)
Decision
Is it a key control?
A control is key when its failure alone would let a risk on the register happen or go unnoticed, or when the organisation names it as its evidence for an obligation. Your control inventory should say so. If it does not, take the cautious branch.
- Yes, or not known: Was a control keeping the same risk in check tested Effective?
- No: Does a risk outside appetite or an unmet obligation rely on it?
In the pack
- P20-A02 Control Testing MethodologyWhat a control is and what makes it testable
- P20-A03 Control Inventory & Ownership RegisterRisk rating guide
Decision
Does a risk outside appetite or an unmet obligation rely on it?
A control that is not key can still matter: if its failure leaves a risk outside appetite, or an obligation you have recorded as not met, without its control, it is rated as a key control would be. If you do not know, take the cautious branch.
- Yes, or not known: Was a control keeping the same risk in check tested Effective?
- No: Rate it Medium: fixed within 180 days
In the pack
- P20-A08 Control Deficiency & Remediation TrackerSeverity and Deadlines (rule CA-12)
Decision
Was a control keeping the same risk in check tested Effective?
A compensating control keeps the same risk in check when this one fails, such as a monthly account reconciliation behind a leaver control. It counts only once it has itself been tested and found effective for the same period. One that is believed to work but has not been tested does not count. Name it on the deficiency with the workpaper that tested it.
- Yes: Rate it Medium: fixed within 180 days
- No, or not known: Rate it High: fixed within 90 days
In the pack
- P20-A02 Control Testing MethodologyRating a deficiency (rule CA-12)
- P20-A02 Control Testing MethodologyA failure another control caught (rules CA-08, CA-12)
Step
Rate it High: fixed within 90 days
A key control failed with nothing tested behind it, or the failure leaves a risk outside appetite or a recorded unmet obligation without its control. In the pack's default a High deficiency is fixed within 90 days of the day the reviewer signed.
In the pack
- P20-A05 Control Test Execution ProcedureStage 9: Log the deficiency, rate it and agree the plan (rules CA-12, CA-13)
Step
Rate it Medium: fixed within 180 days
A compensating control was tested effective behind a key control, or behind a control that a risk outside appetite or a recorded unmet obligation rests on. Or a control that is not key failed and neither rests on it. In the pack's default a Medium deficiency is fixed within 180 days of the day the reviewer signed.
In the pack
- P20-A05 Control Test Execution ProcedureStage 9: Log the deficiency, rate it and agree the plan (rules CA-12, CA-13)
- P20-A08 Control Deficiency & Remediation TrackerSeverity and Deadlines (rule CA-12)
Step
Tell the risk owner now; agree a plan within 10 working days
Deadlines are calendar days. The risk owner of every risk that relies on the control is told the same day, and decides whether the risk needs reassessing. The control owner agrees what will change, who does it, by when, and the record that will show the fix; the Head of Information Security agrees it for a security control. Where planned work will fix it, link that work, due no later than the deficiency. Rate the control Higher until a retest passes. If no plan is agreed in time, the lead takes it to the assurance sponsor.
- Then: Is it rated High?
In the pack
- P20-A05 Control Test Execution ProcedureStage 9: Log the deficiency, rate it and agree the plan (rules CA-13, CA-15)
- P20-A02 Control Testing MethodologyDeadlines (rule CA-13)
- P20-A08 Control Deficiency & Remediation TrackerEscalation (rule CA-13)
Decision
Is it rated High?
A High deficiency goes higher than the control owner. Medium and Low deficiencies are reported in the quarterly counts, and named if they pass their due date.
- Yes: Report it to the sponsor and the approver in the next report
- No: Will the fix be in place by the due date?
In the pack
- P20-A08 Control Deficiency & Remediation TrackerEscalation (rules CA-13, CA-19)
Step
Report it to the sponsor and the approver in the next report
The approver is the one your governance sets: the board, or a board risk committee it has delegated to; the management board in a two-tier structure; executive management where there is no board. The approver accepts any risk left while the deficiency stays open.
In the pack
- P20-A05 Control Test Execution ProcedureStage 9: Log the deficiency, rate it and agree the plan (rule CA-13)
- P20-A02 Control Testing MethodologyWho is involved
Decision
Will the fix be in place by the due date?
A deficiency is fixed by its due date or deferred. It is never deferred by changing the due date in the tracker. If the owner cannot say the fix will be ready in time, take the cautious branch while there is still time to ask.
- Yes: Once fixed, wait until the control has run at least twice
- No, or not known: Request a security exception before the due date passes
In the pack
- P20-A05 Control Test Execution ProcedureDeficiencies past their due date (rule CA-13)
Outcome
Request a security exception before the due date passes
The owner asks for an exception naming the deficiency, why the fix is late, what keeps the risk in check meanwhile, and the new date. The approver its band sets decides, never the assurance lead or the owner alone. Without an approved exception the deficiency is overdue, named in the next report, and the assurance sponsor decides on a High one.
In the pack
- P20-A08 Control Deficiency & Remediation TrackerEscalation (rule CA-13)
- P02-A04 Security Exception Request & Approval FormSteps
Step
Once fixed, wait until the control has run at least twice
The owner's statement that it is fixed starts the retest; it never closes the deficiency. The retest waits until the fixed control has run at least twice, or once for an annual or automated control, in the pack's default. A design deficiency is retested with a new walkthrough first. A deficiency fixed by its due date and waiting for its retest is still open, but it is not past due.
In the pack
- P20-A02 Control Testing MethodologyRetest and closure (rule CA-14)
- P20-A05 Control Test Execution ProcedureStage 10: Retest and close (rule CA-14)
- P20-A08 Control Deficiency & Remediation TrackerSummary (rules CAM-04, CAM-05)
Decision
Did a retest by someone other than the owner pass?
The retest is an operating test on its own workpaper, over a period that starts after the fix, with the same sample table and a reviewer's signature.
- Yes: Close it with the retest workpaper and the reviewer's date
- No: Keep it open with its original due date and agree a new plan
In the pack
- P20-A05 Control Test Execution ProcedureStage 10: Retest and close (rule CA-14)
Outcome
Close it with the retest workpaper and the reviewer's date
The control's rating returns to what its risk and key status set. A closed deficiency means a retest passed. It is not an audit finding closed, and not evidence of compliance.
In the pack
- P20-A05 Control Test Execution ProcedureStage 10: Retest and close (rules CA-14, CA-15)
- P20-A08 Control Deficiency & Remediation TrackerInstructions (rule CA-18)
Outcome
Keep it open with its original due date and agree a new plan
A failed retest keeps the deficiency open, and the next report shows it. Agree a new plan and tell the risk owner again. The due date stays unless an approved security exception moves it. If that date has passed with no approved exception, the deficiency is past due and named in the next report.
In the pack
- P20-A05 Control Test Execution ProcedureStage 10: Retest and close (rules CA-13, CA-14)
- P20-A02 Control Testing MethodologyRetest and closure (rule CA-14)
- P20-A08 Control Deficiency & Remediation TrackerSummary (rule CAM-05)
Practical checklist
- Log the deficiency the day the reviewer signs, with the control, the workpaper and what was found.
- Rate it Low if the control ran every time and only its record fell short.
- Otherwise check whether it is key, and whether a risk outside appetite or an unmet obligation relies on it.
- Check for a compensating control tested effective for the same period, and name its workpaper.
- Tell the risk owner the same day, and have the control owner agree a plan within 10 working days.
- Report a High deficiency in the next report to the approver.
- Request a security exception before the due date if the fix will be late.
- Retest once the fixed control has run at least twice, and close only when the retest passes.
Evidence to have ready
- The tracker entry: the date confirmed, the severity, the reason for it and the due date.
- The workpaper of any compensating control relied on.
- The remediation plan, agreed within the window, and the note to the risk owner.
- The retest workpaper and the reviewer's date that closed it, or the approved exception that deferred it.
Assumptions
- You know which of your controls are key: those whose failure alone would let a risk on the register happen or go unnoticed, or that you name as your evidence for an obligation.
- Your risk register records your risk appetite and the risk owner for each risk, and you run a security exception process with approval bands.
- Ten working days, 90, 180 and 365 days, and two runs before a retest are the pack's defaults. Your own method may set others.
Not covered here
- Whether an exception in the sample means the control failed at all. That is “If a control test finds an exception, has the control failed?”.
- How to score the security exception that defers a deficiency, and how long it may last. That is “How do we score an exception and set how long it lasts?”.
- Whether a risk is outside appetite in the first place. That is “When is a risk outside appetite, and what has to happen then?”.
- What happens when the exception expires and the gap is still there. That is “If an exception expires and the gap is still there, then what?”.