Independent thinking. Informed defence.

CISO Times

Intelligence for the people behind the defence.

The CISO Decision Brief

How do we…

How do we decide what the executive committee sees each month, and what goes to the board?

6 decision pointsThe pack behind this answer: Cybersecurity Metrics & Reporting Programme

Add to board memo

The short answer

Recommendation
Give each audience only the metrics it decides on. Every metric you use goes to the operational dashboard, the executive committee sees only those it takes decisions on, and the board sees only the board measures it has agreed, quarterly, built from the same checked figures.
Reasoning
Each reporting level has a different job. The security and IT leadership team runs the controls, the executive committee decides, and the board governs. A metric that informs no decision at a level only takes attention from those that do. The committee's report centres on what needs a decision: the position against appetite, risk indicators outside green, performance indicators short of target, and the decisions it must take. A metric shown to two audiences uses the same value and the same definition at both, so the board and the committee never see different numbers.
Considerations
  • The cadences (operational and executive committee monthly, the board quarterly) and the 5 working days for an out-of-cycle report are the defaults in the CISO Times packs. Your own calendar and procedure may set different ones.
  • A metric without an approved definition card and a target or thresholds reaches no audience until it has them.
  • A risk past tolerance or a major incident goes out of cycle to the chair of the top body: the board or a risk committee it delegates to, the management board in a two-tier structure, or executive management where there is no board.
  • The board decides appetite, priority, money above management's authority, and acceptance of risk above tolerance. Do not ask the board to decide what the committee should.

The decision, step by step

Select any step for the reasoning behind it and where the pack covers it.

  • Start
  • Step
  • Decision
  • Outcome

Keyboard: Tab to a step, arrow keys move along the flow, Enter pins its explanation, + and − zoom, 0 fits the diagram, Esc closes. The text version below has the same content.

Where a step quotes a number, it is the default in the CISO Times pack. Your own standard may set a different one.

Read as text

The same flow written out: each step, its reasoning and where the pack covers it. 17 steps.
  1. Start

    A metric could go to the committee, the board, or both

    The pack runs three reporting levels. The security and IT leadership team runs the controls, monthly. The executive committee decides, monthly. The board governs, quarterly, through the board report. Each level gets the metrics it takes decisions on, and a metric that informs no decision is not collected.

    In the pack

  2. Decision

    Does it have an approved card and a target or thresholds?

    Every metric needs an approved definition card before its first value is reported, and every performance indicator a target, every risk indicator green, amber and red thresholds. A metric with no target set does not reach any audience until one is set. If you are not sure the card is approved, treat it as not approved.

    In the pack

  3. Outcome

    Hold it back until the card and target are approved

    A number with no agreed target cannot be judged good or bad, so it moves the discussion to the measure instead of the risk. Finish the card first. For a risk indicator, the owner of the linked risk approves the thresholds, set from that risk's appetite and tolerance.

    In the pack

  4. Step

    Put it on the monthly operational dashboard

    Every metric the organisation uses goes to the operational level, with trend, zone or status, and owner commentary. This is where the controls are run, by the security and IT leadership team, monthly.

    In the pack

  5. Decision

    Does the executive committee take a decision on it?

    A metric reaches the executive committee only if the committee decides on it. Write the decision as something a named person does: fund, reassess, escalate, change a plan, accept. The catalogue's Audience column shows the pack's starting view of which metrics are executive; adjust it to your committee.

    In the pack

  6. Outcome

    Keep it at the operational level

    It stays on the dashboard for the people who run the control. If no audience at all takes a decision on it, the pack's rule is that it is not collected. The yearly metric review retires metrics that informed no decision.

    In the pack

  7. Step

    Report it to the committee every month, same value and card

    A metric shown to two audiences uses the same value and the same card at both; only the detail and commentary differ. Show each value with its target or thresholds, its direction since last period and its status in words. Never colour alone, never a combined index, never a score out of 100. A metric its owning pack defines over a quarter goes in the last month of each quarter only. In the pack's example, the committee's report gives its position against appetite in one sentence.

    In the pack

  8. Decision

    Is it a risk indicator outside green, or short of target?

    The committee level exists to decide, so its report centres on what needs a decision: the position against appetite, risk indicators outside green, performance indicators short of target, and the decisions the committee must take. Metrics on target or in green need no discussion.

  9. Step

    Give it a line of its own, with the plan and date

    For a risk indicator: its value, thresholds, direction, linked risk, the escalation made and its result. For a performance indicator short of target but within tolerance: the owner's commentary, the plan and the date; outside tolerance, an ask with options follows. Show every risk indicator outside green together, so the committee can see several warnings on one service at once.

  10. Step

    Keep it brief in the body; show its full figures

    Metrics on target or in green need no discussion, so keep them short in the body of the report. Every value the committee receives is still shown with its target or thresholds, direction and status in words, so the committee can check any of them. Where that detail sits, such as an appendix, is your choice.

  11. Decision

    Is a risk now past tolerance, or has a major incident happened?

    These two cannot wait for the next board report. A move outside appetite but within tolerance waits for the next report. If a reassessment result is not yet clear, take the cautious branch.

    In the pack

  12. Outcome

    Tell the board or its equivalent out of cycle

    In the pack's default, a short note to the chair within 5 working days, agreed first with the executive sponsor. Who that is depends on how you are governed: the board, or a board risk committee it has delegated to; the management board in a two-tier structure; executive management where there is no board. The news then opens the next full report.

    In the pack

  13. Decision

    Does it feed one of the board measures you agreed?

    A measure reaches the board only if it answers a question the board asks and has a stated target or tolerance. The pack's board catalogue proposes eight board measures, and the board or its committee agrees the selection. The metrics catalogue shows which metric feeds which board measure; it feeds them and never copies them.

    In the pack

  14. Step

    Send it to the board quarterly, through its measure

    In the last month of each quarter the same checked figures feed the board report, so the board and the committee see the same numbers. The board report follows Position, Direction, Exposure, Ask, with technical detail in an appendix. Whether the committee sees the board papers first is for your calendar to set; each ask says who has agreed it before the meeting.

    In the pack

  15. Decision

    Does it need a decision only the board can take?

    The board decides appetite, priority, money above management's authority, and acceptance of risk above tolerance. Choosing a product, a supplier or a project plan is management's decision. Do not ask the board to decide what the committee should.

    In the pack

  16. Outcome

    Put it to the board as an ask with options

    State the decision, why now, at least two real options with cost, a recommendation, the risk of not deciding, and who has agreed the ask before the meeting. Things the board only notes are kept separate, after the decisions.

    In the pack

  17. Outcome

    The committee decides; the board sees only its measures

    The decision is taken at the executive committee, written as something a named person does, with a date. Follow it up at later meetings until it is closed, in your committee's own action list. The board sees the result through its agreed measures.

    In the pack

Practical checklist

  1. Confirm the metric has an approved definition card and a target or thresholds. If not, hold it back.
  2. Put every metric you use on the monthly operational dashboard, and send it to the executive committee only if the committee takes a decision on it.
  3. Show each value with its target or thresholds, its direction and its status in words.
  4. Give every risk indicator outside green and every performance indicator short of target its own line, with the plan and date. Keep the rest brief.
  5. Send a risk past tolerance or a major incident to the chair out of cycle, agreed first with the executive sponsor.
  6. Feed the board measures you agreed into the quarterly board report from the same checked figures.
  7. Put only decisions that are the board's own to the board, as an ask with options.
  8. Record the committee's decisions with a date, and follow them up until closed.

Evidence to have ready

  • The approved definition card for each metric reported.
  • The monthly operational dashboard and executive committee reports, and the quarterly board reports, showing the same values for the same metrics.
  • The board's agreed selection of board measures, with targets and tolerances.
  • The executive committee's decisions and their follow-up, and any out-of-cycle notes to the chair.

Assumptions

  • You have chosen your metrics from a catalogue, each with a definition card, and the board or its delegated committee has agreed a set of board measures with targets and tolerances.
  • The cadences shown (operational and executive committee monthly, the board quarterly) and the 5 working days for an out-of-cycle report are the CISO Times packs' defaults. Your own calendar and procedure may set different ones.
  • The top body depends on how you are governed: the board, or a board risk committee it has delegated to; the management board in a two-tier structure; executive management where there is no board.

Not covered here