Independent thinking. Informed defence.

CISO Times

Intelligence for the people behind the defence.

The CISO Decision Brief

How do we…

How do I record my starting position so I can show progress at the end of the first year?

5 decision pointsThe pack behind this answer: CISO Transition, Handover & First 90 Days

Add to board memo

The short answer

Recommendation
Record the starting position once, as at one date, in counts and in levels in words, using fixed measures whose definitions you do not change. Mark how you know each value, record gaps as Unknown, and repeat the same measures in month 12 so the comparison is ready at the first anniversary.
Reasoning
Without a record of where you started, nobody can show in a year what changed. A comparison only holds where the definition and the scope are the same, so the measures must stay fixed. A value you were told is a statement, not a finding, and an honest Unknown is more useful next year than a guess. A single score hides all of this, so the result is counts and words (rule BL-01).
Considerations
  • The 60 days, the 12 measures and the 14 domains are the pack's defaults. Your own standard or your regulator may ask for more or set a different period.
  • If you are past the 60 days, record the baseline now with its true as-at date. Never date it earlier than the day you took it.
  • The baseline is a first view. A formal maturity assessment sets levels from a sample of records and may change yours. It is not an audit, a certification or a statement of compliance with NIS2 or any standard.

The decision, step by step

Select any step for the reasoning behind it and where the pack covers it.

  • Start
  • Step
  • Decision
  • Outcome

Keyboard: Tab to a step, arrow keys move along the flow, Enter pins its explanation, + and − zoom, 0 fits the diagram, Esc closes. The text version below has the same content.

Where a step quotes a number, it is the default in the CISO Times pack. Your own standard may set a different one.

Read as text

The same flow written out: each step, its reasoning and where the pack covers it. 19 steps.
  1. Start

    In a year you will need to show what changed

    Without a record of where you started, nobody can show in a year what changed. The pack asks for a snapshot in counts and levels in words, taken once. The result is a baseline and a plan. It is never one score.

    In the pack

  2. Step

    Write down the scope, then take the 12 measures as defined

    Say which entities, sites and systems the baseline covers. Then take the pack's 12 measures and the 14 maturity domains as they stand. Each measure keeps the definition the catalogue of measures gives it, because a changed definition cannot be compared next year. Judgement: the pack fixes the set, so add a measure of your own only after it has a catalogue definition.

    In the pack

  3. Decision

    Are you within 60 days of your start date?

    The pack's default is to record the baseline within 60 days of day 1 of the role, which falls in week 6 of its weekly plan. The date is a house default, so use your own if you have one. If you are not sure of your start date, take the later branch.

    In the pack

  4. Step

    Record it now, with the true as-at date

    Judgement: the pack does not say what to do after day 60. A late baseline with its real date is more useful than none, and a baseline dated earlier than the day you took it is not honest. Note the days since your start, and tell your sponsor that it is late.

    In the pack

  5. Decision

    For each value, how do you know it?

    Take the values one at a time. Seen means a document, record or system view that you looked at. Tested means you took a sample and checked each record against the practice. Told means someone described it and showed nothing. Ask for the record before you accept Told, and leave alone anything you have only been told until you have checked it.

    In the pack

  6. Step

    Record the count or level, marked Seen or Tested

    A count is a whole number, or n of m where you counted against a whole, such as 5 of 8 Tier 1 suppliers assessed. A level is one of four words: Not in place, Informal, Defined or Managed. Enter the evidence word beside each value.

    In the pack

  7. Step

    Record it as Told, and note which record would show it

    A value you were told is a statement, not a finding. Count it and mark it Told, and say so when you report it. Told supports a level no higher than Informal. Put the request for the record into your plan, so the value can move to Seen.

  8. Step

    Record Unknown, with a reason and a plan item

    Leave the value blank and do not estimate. Choose one reason: Not measured here, Data not available, Not yet asked or Owner disputes the data. Name the plan item that will find it out. An honest Unknown is more useful next year than a guess, and it is never counted as good or bad.

    In the pack

  9. Decision

    Does the evidence support the level you gave?

    Answer yes where the value is a count with no level. For a level, Told supports up to Informal, Seen up to Defined, and Managed needs Tested. If you cannot say what the evidence is, take the cautious branch.

    In the pack

  10. Step

    Lower the level to what the evidence supports

    Your level is a first view from what you saw. A formal maturity assessment sets levels by its own rules, from a sample of records, and may change yours. Record the lower level now. Do not edit it later. When you have the evidence, enter the new level beside it in the later columns, with its own date.

    In the pack

  11. Step

    Date every value and keep the first copy unchanged

    The baseline is a snapshot as at a date. Do not update it as you learn more. Later values go beside it in new columns, with their own evidence and date. Save the first copy where nobody edits it, for the records period your organisation uses.

    In the pack

  12. Decision

    Is anyone asking for one number?

    Management often wants a single figure. The pack gives none: no total, score, share, weighting or colour total. A radar chart joined into one shape counts as a score. Answer yes, or not known, if you expect the request.

    In the pack

  13. Step

    Offer counts, levels in words and the unknowns

    Give the counts the baseline sheet gives, such as 9 of 12 measures recorded, 3 Unknown, and 6 of 14 domains given a level, 8 Unknown. Show levels by word, evidence by word, and the unknowns with their reasons. Count the Told values in the briefing and say so. Measures and domains are never added together.

  14. Step

    Sign it, and show it to your executive sponsor

    You record it and the sponsor sees it, so nobody signs off what they own. It is a starting position as at one date. It is not an audit, a certification or a statement of compliance with NIS2 or any standard, and the page says so. Use the baseline line in your first executive briefing.

    In the pack

  15. Step

    Put each Unknown into your plan, and book the repeat

    Each Unknown needs a plan item that will find it out, so the gaps shrink and are not forgotten. Book the repeat in your own calendar for the end of month 12, ready for the first anniversary. The pack's first-year calendar lists it as an annual item.

    In the pack

  16. Step

    At month 12, repeat the same measures and scope

    Enter later values beside the baseline, with their evidence and date. Use the same measures, the same definitions and the same scope. Do not overwrite the first copy. Where a value was Unknown, say whether you can now give it.

    In the pack

  17. Decision

    Are the definition and the scope unchanged for this value?

    A change to a definition, a scope, an out-of count or the evidence criteria breaks the series. If you cannot show that nothing changed, take the cautious branch, because a comparison across a break misleads.

    In the pack

  18. Outcome

    Compare it, and report the change in words

    Say whether each measure moved the way it should, and whether each level went up, down or stayed. Report counts beside counts. A level that falls with no break in series is a finding, so ask what changed. Judgement: report the Told values you moved to Seen as progress in evidence, because the pack asks only that evidence is recorded, not how to report it.

    In the pack

  19. Outcome

    Mark a break in series and draw no trend across it

    Show both values with the reason the definition or scope changed, and do not say better or worse. Judgement: where you can restate the earlier value on the new basis, do so and say so. Where you cannot, start a new series from this value.

    In the pack

Practical checklist

  1. Write down which entities, sites and systems the baseline covers.
  2. Take each measure with its catalogue definition unchanged, and give a level in words to each domain you can judge.
  3. Mark each value Told, Seen or Tested, and lower any level the evidence does not support: above Informal needs Seen, and Managed needs Tested (rule BL-02).
  4. Record anything you do not know as Unknown, with one reason and the plan item that will find it out.
  5. Date every value, sign the baseline, and show it to your executive sponsor.
  6. Keep the first copy unchanged, and book the repeat for month 12.
  7. At month 12, enter later values beside the baseline and compare only where the definition and the scope have not changed.

Evidence to have ready

  • The signed baseline as at its date, with the scope, every value, its evidence word and the date it was taken.
  • Each Unknown value with its reason and the plan item that will find it out.
  • The executive sponsor's record of having seen the baseline.
  • At the first anniversary, the later values beside the unchanged first copy, with each break in series marked and its reason.

Assumptions

  • You are new in the role, or about to take it, and the security programme existed before you.
  • You can ask data owners for records or system views, and an executive sponsor will see the result.
  • The 60 days, the 12 measures and the 14 domains are the defaults in the CISO Times pack. Your own standard, or your regulator, may ask for more or set a different period.
  • Your own scope is clear: which entities, sites and systems the baseline describes.

Not covered here