Independent thinking. Informed defence.

CISO Times

Intelligence for the people behind the defence.

The CISO Decision Brief

How do we…

How do I find out what an inherited security programme really does, as opposed to what it claims?

6 decision pointsThe pack behind this answer: CISO Transition, Handover & First 90 Days

Add to board memo

The short answer

Recommendation
Treat everything you are told as a claim. For each of the ten discovery areas, ask for a record, a test result or a system view by a date, and give each item one of four words: Evidenced, Described only, Not found or Contradicted.
Reasoning
Some of a programme is real, some is written down and not done, and some is a hope. A policy or a description shows what is meant to happen; a record, a test or a system view shows that it does (rule TR-02). A date turns silence into a finding. Counting findings in words, never a score, keeps the picture honest for the first executive briefing.
Considerations
  • Discovery is no reason to leave harm running. A contradiction that is a live exposure, such as a leaver's account still active, goes to its owner now (rule TR-01).
  • The ten areas, the four words and the close at the end of week 7 are the pack's defaults. Your own method may differ.
  • Where a supplier runs a control, ask for the supplier's own evidence. A statement from its account manager is Described only.
  • Ask Legal before you record a finding that touches a duty to notify a regulator. Counsel confirms what the finding means for that duty.

The decision, step by step

Select any step for the reasoning behind it and where the pack covers it.

  • Start
  • Step
  • Decision
  • Outcome
  • Loop back

Keyboard: Tab to a step, arrow keys move along the flow, Enter pins its explanation, + and − zoom, 0 fits the diagram, Esc closes. The text version below has the same content.

Where a step quotes a number, it is the default in the CISO Times pack. Your own standard may set a different one.

Read as text

The same flow written out: each step, its reasoning and where the pack covers it. 19 steps.
  1. Start

    You inherit a programme that others describe to you

    Every description of an inherited programme is a claim until you have seen something that backs it. Some of it is real, some is written down and not done, and some is a hope. Your first job is to tell these apart before you build on any of it or promise anything.

    In the pack

  2. Step

    Read and listen for three weeks and change nothing

    Meet people and read what exists: the last board report, the risk register, the exception register and the last audit report. Change no policy, tool, structure or priority until discovery ends at the close of week 7. The only exceptions are stopping harm, acting on a legal duty and no-regret actions. The default rule is TR-01.

    In the pack

  3. Decision

    Did the outgoing leader leave a handover document?

    A handover document is what the outgoing leader believed, so it is a source of claims and not a record of the facts. Where there is none, you build the picture from records and write down what is missing. That route has its own flow.

    In the pack

  4. Step

    Build the list of claims from records and mark the gaps

    Take the risk and exception registers, the incident log, correspondence with customers, auditors and regulators, the supplier register and the account lists. Each states something the programme is said to do. Write down what you cannot find, and who you asked for it.

    In the pack

  5. Step

    Read the handover as a list of claims, not as facts

    Mark every statement in it that you can check: a role, an approval, a test, a supplier assessment. Treat each as something to look at, not something to rely on. Do not criticise the author in front of others. Record what you find, not who is to blame (NE-7).

    In the pack

  6. Step

    Work through the ten discovery areas, two items each

    The areas are governance, risk, policy, access, vulnerabilities, incidents, suppliers, resilience, awareness and assurance. Each has two items to find out and a published document to read first. Start with the areas your interviews raised. Without a team, take the lightest proof for each: one test is worth more than three statements.

  7. Step

    For one item, ask for the proof, not for an answer

    Proof is a record, a test result or a system view. For access, that is an extract of active accounts compared with the HR leaver list. For backups, it is a restore you watch. Ask for it by a date you set. An assurance from the person who runs the control is not proof. Where a supplier runs the control, ask for the supplier's own evidence.

  8. Decision

    Was proof shown or found by the date you set?

    A date turns silence into a finding. If nothing was produced and you can find nothing yourself, that is a result worth recording. If you find the proof yourself, answer Yes. The pack sets no default length for the wait, so choose a date that fits the item and tell the owner what it is. Judgement: keep it short enough to finish discovery by week 7.

  9. Decision

    Did it show the work is done, not only that it is claimed?

    A policy, a plan or a description shows what is meant to happen. It does not show that it happens. A record, a test result or a system view does. In the evidence words of the maturity pack, a statement alone is Told, and something shown that says what the practice needs is Seen. If you cannot tell, take the cautious answer.

    In the pack

  10. Decision

    Does what you saw match what you were told?

    Compare the proof with the claim. A matching record is Evidenced. A difference of any size is Contradicted, such as eleven leaver accounts still active where the claim was that leavers are removed in the window. That figure comes from the pack's worked example and is not a benchmark.

  11. Step

    Record it as Not found

    You asked, by a date, and nothing was produced and nothing could be found. This is a finding about the programme. It is no judgement of the person you asked. Name the follow-up: an action, or an item for the 100-day plan. A plan item must trace to a finding, an interview or a handover gap (TR-14).

  12. Step

    Record it as Described only, and keep asking

    Described only means you were told, or a document claims it, and you have seen nothing that shows it is done. It is not a finding of failure, and it is not yet a finding of success. It is checked again after six months by default, or on a material change (TR-02). Never promise anything that rests on it.

    In the pack

  13. Step

    Record it as Evidenced, with what you saw

    Write what you saw and the date you looked, so that someone else can find it again. Evidenced describes one item. It is not a maturity level, which is set by the maturity method from a sample of records. Do not add the findings into a score.

    In the pack

  14. Step

    Record it as Contradicted, with both versions

    State what you were told and what you saw side by side, without blame. Counsel confirms what a finding means for any duty to notify a regulator, so ask Legal before you write one that touches such a duty. Keep the evidence with the finding.

  15. Decision

    Is it a live risk, such as a leaver's account still active?

    Discovery does not stop harm from continuing. A contradiction that is a live exposure goes to its owner now, which TR-01 allows. Anything else waits for the findings and the plan. Judgement: if you cannot tell whether it is live, treat it as live.

    In the pack

  16. Step

    Send it to the owner today and ask for the fix

    Name the system, the account or the record, give the owner the evidence and ask for a date. Taking a no-regret action early does not break the rule of learning first. Agree who decides first if the owner is unclear, using the decision-rights arrangement.

    In the pack

  17. Step

    Enter the finding, what you saw and the date you looked

    Every finding states what was seen. Leave an item blank until you have looked: a blank means Not yet looked at, which is not a finding. For Not found and Contradicted, name the follow-up in the same row.

  18. Decision

    Are items left to look at, and is it before the end of week 7?

    Discovery closes at the end of week 7. Items you cannot look at by then stay Not yet looked at, with a reason, and you say so when you record the baseline. Unknown is a result.

    In the pack

  19. Outcome

    Close discovery and count the findings in four words

    Count items in each of the four words and list the contradictions and the items not looked at. A count looks like 14 of 20 items looked at: 6 Evidenced, 5 Described only, 2 Not found, 1 Contradicted. Do not add it into a score. Take the counts to the first executive briefing and let the plan follow them.

Practical checklist

  1. Listen and read for the first three weeks, and change nothing except to stop harm, act on a legal duty or take a no-regret action.
  2. Read the handover as a list of claims, or build the list from the registers, the incident log, correspondence and account lists.
  3. Work through the ten areas, starting with those the interviews raised, and ask for one kind of proof for each item by a date you set.
  4. Record Not found where nothing was produced by the date, and Described only where you were told but saw nothing that shows it is done.
  5. Compare what you saw with the claim, and record Evidenced, or Contradicted with both versions and without blame.
  6. Send any live exposure to its owner the same day with the evidence, and ask for a date.
  7. Write what you saw and the date you looked for every finding, and name the follow-up for each Not found and Contradicted item.
  8. Close discovery at the end of week 7, count the findings in the four words, and take the counts to the first executive briefing.

Evidence to have ready

  • For each item: the finding word, what was seen and the date it was looked at.
  • The proof kept with each finding: the record, the test result or the system view.
  • The follow-up named for each Not found and Contradicted item, and the fix date asked of the owner for each live exposure.
  • The counts in the four words, with the items not yet looked at and the reason for each.

Assumptions

  • You have just taken, or are about to take, the head of security or CISO role, and you may have a small team or none.
  • You can ask the owners of IT, HR, legal, finance and audit for records and extracts. If you cannot, say so in your first briefing.
  • The ten areas, the four finding words and the week 7 close are the defaults in the CISO Times pack. Your own method may differ.

Not covered here