Independent thinking. Informed defence.

CISO Times

Intelligence for the people behind the defence.

The CISO Decision Brief

How do we…

How do we tell whether our security programme is mature, and which gaps matter?

4 decision pointsThe pack behind this answer: Security Maturity & Internal Assessment

Add to board memo

The short answer

Recommendation
Rate each practice on four levels in words (Not in place, Informal, Defined, Managed) from evidence, against targets approved before scoring. Treat as pressing first the practices on which a risk outside appetite, or an obligation recorded as not met, rests.
Reasoning
Maturity is how reliably each practice is done, so what people say should happen is not enough: an interview alone supports Informal at most (rule MA-02). A domain is only as mature as its weakest practice, and there is no overall score, percentage or weighting, because a single figure hides the weak practice the assessment exists to find (rules MA-06 and MA-07). A target set after the results tends to settle at the level found, which hides the gap. Pressing gaps come from your registers, not from the assessor's opinion.
Considerations
  • A maturity result is not an internal audit, a certification or a statement of compliance. It describes how practices work, not how exposed you are, so read it beside the risk register.
  • The 12-month evidence window, the sample of 3 and the 5 priority actions per cycle are the pack's defaults. You may change them before the first assessment; a later change is a break in series.
  • No one rates a practice they own or run. Where nobody independent is available, the result is marked self-assessed and capped at Defined.
  • The approver depends on how you are governed: the board, or a board risk committee it has delegated to; the management board in a two-tier structure; executive management where there is no board.

The decision, step by step

Select any step for the reasoning behind it and where the pack covers it.

  • Start
  • Step
  • Decision
  • Outcome

Keyboard: Tab to a step, arrow keys move along the flow, Enter pins its explanation, + and − zoom, 0 fits the diagram, Esc closes. The text version below has the same content.

Where a step quotes a number, it is the default in the CISO Times pack. Your own standard may set a different one.

Read as text

The same flow written out: each step, its reasoning and where the pack covers it. 18 steps.
  1. Start

    We want to know how mature our security programme really is

    Maturity is how reliably each security practice is done: whether it happens at all, whether it depends on particular people, whether it is written down and leaves a record, and whether it is measured, checked and improved. It describes how the practice works, not how exposed you are today, so read the result beside the risk register. A maturity result is not an internal audit, a certification or a statement of compliance. It can feed the management review, the internal audit programme and the risk register.

    In the pack

  2. Step

    Use one four-level scale, in words, for every practice

    Not in place: the practice does not exist, or happens only by chance. Informal: it happens, but depends on particular people and is not written down or not done consistently. Defined: it is written down, agreed and done routinely, and leaves a record. Managed: as Defined, and also measured, checked by someone else and improved. The levels are words. They are not numbers to add, average or weight.

    In the pack

  3. Step

    Split the programme into domains and practices

    Assess practices, not technology. The pack's model has 14 domains, from governance to recovery, each made of two or three practices. Every practice is a question with the evidence Defined needs and what Managed adds, so the assessor knows what to look for before the interviews start.

    In the pack

  4. Decision

    Does every practice apply to you?

    A practice may be left out only for a reason the sponsor approves and the report states, such as a notification duty you are outside or a service you do not run. A weak practice never counts as not applicable: it is Not in place or Informal, and the result says so.

    In the pack

  5. Step

    Record the sponsor-approved reason for each one left out

    Write the reason in the assessment plan and the report. A domain whose practices all do not apply is left out of the result, and the report says why. A practice that does apply stays in, however weak it is.

    In the pack

  6. Step

    Approve a target for every domain before scoring

    The sponsor approves a target level for each domain, in writing and dated, before any evidence is scored, with a reason: an obligation that rests on it, a risk outside appetite, or a business need. Defined is the default. Managed is a target only where one of those reasons needs measurement and independent checking. A target set after the results tends to settle at the level found, which hides the gap.

    In the pack

  7. Decision

    Can someone who does not run each practice rate it?

    No one rates a practice they own, do, manage day to day, or wrote the procedure for. A colleague from another function, such as a finance controls manager, a risk manager or internal audit, is usually the best choice. If you are not sure that an assessor is independent of a practice, treat them as not independent.

    In the pack

  8. Step

    Mark those results self-assessed, capped at Defined

    A self-assessed result is still useful: it is marked so the reader knows how far to rely on it, and it cannot be above Defined until someone independent checks the evidence. Count them. If more than a third of the results would be self-assessed, the pack's procedure asks the sponsor to decide on an independent assessment.

    In the pack

  9. Step

    Rate each practice on evidence, not on description

    An interview alone supports Informal at most, and so does a written procedure with no records of it being done. Defined needs the practice's Defined evidence seen by the assessor; Managed needs Tested, a sample the assessor chose and checked. Only records in the evidence window count: by default the 12 months up to the last day of fieldwork. The assessor chooses any sample, not the practice owner, and every sampled record must pass. Each result states how it was evidenced: Told, Seen or Tested.

    In the pack

  10. Step

    Set each domain at the level of its weakest practice

    A domain's level is the lowest of its practices that apply, with no average and no rounding. Two Defined practices and one Informal make an Informal domain, because the domain depends on the weak practice. Managed beside Not in place is Not in place, never something in between.

    In the pack

  11. Step

    Show each domain's level, target and gap in words

    The gap is the target minus the level, counted in levels. There is no overall score, percentage or weighting: a number out of 100, a traffic-light total or a radar chart joining the domains are all scores, and each hides the weak practice that matters. A count such as "2 of 14 domains at target" describes the result without scoring it.

    In the pack

  12. Decision

    Is any domain below its target?

    A domain at or above its target has no gap. The sponsor may then spend less effort on it. Every practice below its domain's target gets an action, so this answer decides whether there is an improvement plan to make.

    In the pack

  13. Outcome

    At target: keep the cycle and re-assess within 12 months

    Report the result to the approver and keep the full assessment cycle; by the pack's default it runs at least every 12 months. Re-assess a domain sooner after a significant incident, a major change to systems or the organisation, or a new obligation that rests on it.

    In the pack

  14. Decision

    Is a recorded risk or unmet obligation resting on the practice?

    A practice is pressing when a risk recorded as outside appetite in the risk register, or an obligation recorded as not met by the body that owns it, rests on it. A practice the assessor merely thinks is important is not pressing, and neither is one the registers say nothing about. If you believe a risk is outside appetite but it is not recorded, raise it with the risk owner through your own risk process.

    In the pack

  15. Step

    Put its action first, the lower level first among them

    Pressing practices come before all others. Among them, the practice at the lower level goes first. In the pack's example four practices were pressing: the policy set, because the board had recorded a NIS2 measure as outstanding until its policy was approved; supplier assessment, because a payment fraud risk was outside appetite; and backups and recovery testing, because a ransomware risk was outside appetite.

    In the pack

  16. Step

    Order the rest: lower level, then larger gap

    After the pressing practices, take the practice at the lower level first, then the domain with the larger gap, then domain and practice order. A practice already at Defined that sits in a domain with a Managed target comes late, because it moves only to meet the higher target.

    In the pack

  17. Step

    Plan one level per action, a few priority actions per cycle

    Each action moves one practice up one level. A practice at Not in place with a target of Defined needs two actions, so the plan shows whether the first took hold. Managed can be claimed only after at least 6 months at Defined, with records. By the pack's default up to 5 actions take priority in one cycle.

    In the pack

  18. Outcome

    Take the targets, gaps and plan to the approver

    The top approver depends on how you are governed: the board, or a board risk committee it has delegated to; the management board in a two-tier structure; executive management where there is no board. Ask for three decisions: the targets, the plan, and the investment it needs. Then pass the results to the management review, the internal audit programme and the risk register.

Practical checklist

  1. Use one written model with four levels in words and the evidence each level needs for every practice.
  2. Record a sponsor-approved reason for any practice left out as not applicable.
  3. Have the sponsor approve a target for every domain, with a reason, before any evidence is scored.
  4. Assign each practice to someone who does not own or run it, and mark any result that is self-assessed.
  5. Rate each practice on records in the evidence window, stating whether it was Told, Seen or Tested.
  6. Set each domain at its weakest practice, and show its level, target and gap in words.
  7. Order the actions: pressing practices first, then the lower level, then the larger gap.
  8. Take the targets, gaps and plan to the approver, and feed the result to the management review, internal audit and the risk register.

Evidence to have ready

  • The sponsor's dated approval of the targets, with the reason for each, signed before fieldwork.
  • For each practice: its level, how it was evidenced, the records seen or sampled, and who assessed it.
  • The report showing each domain's level, target and gap in words, the count of self-assessed results and any practices left out with reasons.
  • The approver's decision on the targets, the improvement plan and the investment it needs.

Assumptions

  • You assess against a written model that says, for each practice, what evidence each level needs. The pack's model has 14 domains and 32 practices; a model of your own works if it has the same rules.
  • A member of management can act as sponsor: commission the assessment, approve the targets before scoring and take the result to the approver.
  • You keep a risk register with an approved risk appetite, and a record of the obligations that apply. Without them, no gap can be shown to be pressing.
  • The evidence window, sample size and number of priority actions shown are the pack's defaults. Your own method may set different ones.

Not covered here