Independent thinking. Informed defence.

CISO Times

Intelligence for the people behind the defence.

The CISO Decision Brief

Generative AI Deployment Configuration Checklist

Verifies tenant settings, data retention, access scopes and logging before an AI service goes live.

Available soon

Format
Excel
Size
81 KB
Length
10 sheets
Version
1.0
Updated

What's inside

What changed

  1. 1.0

    Published.

Changes across this pack

Preview

The workbook's sheets as you will receive them, with its example rows and the values its formulas calculate. Highlighted [[text]] is for you to replace; rows marked EXAMPLE are for you to delete. Wide sheets scroll sideways. The cover, document control and changelog sheets are in the file.

Instructions

How to use this workbook

StepWhat to do
1Complete one copy of the Checklist sheet for each feature, with the application developer and the head of it (LLM Application Security Review Procedure, stage RP-3). To make a copy, right-click the tab, choose Move or Copy, tick Create a copy, and name the copy. Each copy calculates on its own.
2Read the Checks Explained sheet once. It groups the checks by area, names the requirement and the threats behind each, and says what kinds of evidence are enough.
3Answer the three questions under "This feature". They say whether the feature reads stored company content, has tools or connectors, and is hosted or built by you. The Applies? column then marks each check Yes or No. Do not mark a check Not applicable because it is hard or slow to verify.
4For each check that applies, look at the setting, the contract term or the test result yourself. Choose the Status: Verified, Not verified, Failed or Not applicable. The Definitions sheet says what each means. Verified needs evidence and a date.
5Write the evidence you hold in the Evidence kept column, the date you saw it and who looked. A provider's page or statement counts as evidence if you say so and date it.
6Write a note for any check that is Not verified, Failed or Not applicable. For a Failed check, rate it, enter it in the AI Security Findings & Exceptions Register and write its number in the Finding column. The Check column tells you what is still missing on each row.
7Read the counts at the top. They show how many applicable checks are verified, failed and not verified, area by area, and name each one. They also list the checks that hold the release and say what that means for the release decision.
8Give the result to the people who decide the release (LLM Application Security Review Procedure, stage RP-6). The checklist is one item of the evidence (E-4). It does not decide anything by itself.
9Repeat the checks after any change of model, model version, system prompt, tool, retrieval source or filter setting (GS-18), and at the review interval of the feature's depth. A feature has two review dates: the one this review sets from its depth, and the one in its P24 inventory entry. The earlier of the two applies. Keep each completed copy.
10Add checks of your own on the yellow rows at the foot of the table. They are counted on their own line and do not change the pack's counts or the release line.
11To clear the EXAMPLE, delete the EXAMPLE Checklist sheet. The Checklist sheet is already blank. The checks stay: they are the pack's list.

Legend

Yellow cells are inputs. Everything else is calculated or fixed — do not overwrite formulas.

EXAMPLERows marked EXAMPLE in the first column show how a completed row looks. Delete them before approval.

GS-18: A change of model, model version, system prompt, tool, retrieval source or filter setting is a change: it goes through the change control that applies to the system, the attack classes it could affect are tested again at the feature's review depth, and the change is recorded. A provider's change of model is a trigger for review within [[10]] working days of the notice (P24 ST-7; AG-10).

GS-29: The owner keeps for each feature the data flow, the threat selection, the standard check, the configuration checklist, the test results, the findings and exceptions, and the approval, while the feature runs and for [[3]] years after it ends, or longer where law or a contract asks.

RG-2: No configuration check that blocks release has failed or is unverified.

Why a checklist. An LLM application puts instructions and data in one channel. The model reads the organisation's instructions and an attacker's words as the same kind of thing, so the checks that work for ordinary input, such as matching a field against a pattern, cannot tell them apart. The national cyber centres and OWASP both say the defence lies in the system around the model, because the model will sometimes be fooled. Everything the organisation already does for access, logging, secure development, patching and supplier assurance still applies and is not repeated here. This pack adds what is specific: what the model may read, what its output may reach, what it may do, who approves what it does, and how the organisation tests all of this before release and watches it afterwards. The result is counts of features reviewed, checks verified and findings open. It is never one score.

The rules on which AI may be used, with which data, who approves a use and how a use is recorded are P24's (AG-01 to AG-22). This pack does not change them. It sets what a generative AI feature has to do to be secure once a use is approved, and what the organisation checks before the feature goes live and while it runs.

This document helps you secure the generative AI your organisation builds, configures or buys. It is not legal advice, and following it is not a statement that you comply with the EU AI Act, the GDPR or any standard. A test that finds no problem does not show that a feature is secure. Whether the Act binds you, in which role, and which of its duties apply to each system depends on the facts: confirm it with counsel.

EXAMPLE: a wholesale distributor with about 900 staff, three warehouses and an online ordering service that takes 60% of its orders, as at 30 Sep 2026. The EXAMPLE Checklist sheet shows its checklist for the draft and summarise with the office-suite assistant (LF-1). Its settings, evidence and dates are the pack's other documents' for it.

Adapting this template.

Small organisation: most of your features are a supplier's, so most checks you can see are in the tenant settings. Keep every check. Where the tenant cannot show a setting, ask the provider in writing, mark the check Not verified until the answer arrives, and keep the answer as evidence.

Regulated organisation: your regulator or your customers may ask for more settings, or for the evidence for longer. Add your own checks on the yellow rows, and keep the completed copies for the period your records policy sets (GS-29).

IT run by a service provider or outsourced: the provider can supply the evidence, and your own staff check it. The checks and the release decision stay yours. Ask for a snapshot of the settings as found before the provider changes any of them.

Larger group: copy the sheet for each feature and each environment that differs. Keep the count for each copy apart, and never add the counts of different features into one total.

This workbook is your own record. Keep it with the feature's review evidence.

Checklist

Configuration checks: [[feature name]]

One copy of this sheet for each feature. Yellow cells are yours. Applies?, Status now, every count, the release line and the Check column calculate. Counts only, never a score.

This feature

Feature[[Name of the feature]]
AI inventory entry (P24)[[AI-nnn]]
Does the feature read stored company content (documents, a search index, a knowledge store)?Your answers decide which checks apply (Checks Explained sheet).
Does the feature have tools or connectors (it can read other systems or act)?
Do you host or build the feature and hold its keys and network settings?
Date the checklist was started[[YYYY-MM-DD]]
Completed with (Head of IT)[[Head of IT: name]]

Where the checks stand

Checks verified (of those that apply)Fill your profile first
Checks failed
Checks not verified
Checks that hold the release and are not verified or failed (RG-2)
What this does to the release decision
Your own checks (counted on their own)None added

By area

AreaChecksApply to this featureVerifiedNot verifiedFailedNot applicableVerified of those that apply
Tenant and identity400000None apply
Data and retention500000None apply
Access scopes500000None apply
Logging400000None apply
Network and keys300000None apply
Content filters300000None apply
Rate limits300000None apply
Model and change200000None apply
Stop100000None apply
All 30 checks of the pack3000000None apply
Your own checks000000None apply

Counts of checks, never a share. A check of your own is in the last row only, and in no area above.

The checks, DC-01 to DC-30

IDAreaCheckHolds the release?Applies?StatusStatus nowDate verifiedChecked byEvidence keptNote: what is missing or what failedFinding (AF-nnn)CheckApplies whenRequirementReference
DC-01Tenant and identityStaff reach the feature only with their work account through single sign-on. Personal and guest accounts cannot.YesFill your profileFill your profileFill your profileEvery featureGS-23P24 BC-1; P13 JML-12
DC-02Tenant and identityAdministrator roles for the AI service are held by named people with phishing-resistant sign-in, and are reviewed.YesFill your profileFill your profileFill your profileEvery featureGS-23P14 PA-05, PA-16
DC-03Tenant and identitySharing of prompts, chats, files and custom assistants outside the organisation is off, or limited to a listed set.NoFill your profileFill your profileFill your profileEvery featureGS-08
DC-04Tenant and identityThe setting or contract term that bars the provider from training on the organisation's data is on and evidenced.YesFill your profileFill your profileFill your profileEvery featureGS-17P24 BC-2, ST-1
DC-05Data and retentionRetention of prompts, outputs and uploaded files is set to the period the owner recorded, and users can delete their history as the owner decided.NoFill your profileFill your profileFill your profileEvery featureGS-08GDPR Article 25(2)
DC-06Data and retentionThe data location is the one the contract names, and the provider's own page agrees.NoFill your profileFill your profileFill your profileEvery featureGS-17P24 ST-4; P06 clause CL-05
DC-07Data and retentionThe feature takes no data above the level it is approved for, and sensitivity labels are respected where the provider supports them.YesFill your profileFill your profileFill your profileEvery featureGS-08P24 A07 (the data permission check)
DC-08Data and retentionEvery source the feature can read has an owner and a data level, and the feature reads only what the signed-in person may read.YesFill your profileFill your profileFill your profileThe feature reads stored company contentGS-09
DC-09Data and retentionA document removed from a source disappears from the feature's index within the time the owner set.NoFill your profileFill your profileFill your profileThe feature reads stored company contentGS-12
DC-10Access scopesConnectors, plug-ins and extensions are on an approved list, and all others are off by default.YesFill your profileFill your profileFill your profileThe feature has tools or connectorsGS-22
DC-11Access scopesEach connector holds the least scope its job needs, read-only where the job only reads.YesFill your profileFill your profileFill your profileThe feature has tools or connectorsGS-23
DC-12Access scopesEach key or service account serves one feature in one environment, sits in a secrets store, and appears in no code, prompt or tool description.YesFill your profileFill your profileFill your profileYou host or build the feature and hold its keysGS-10P14 PA-10
DC-13Access scopesWeb browsing, code execution and file creation inside the feature are off unless the approval lists them.NoFill your profileFill your profileFill your profileEvery featureGS-22
DC-14Access scopesTools run as the signed-in person or under a named service identity with the least access, and the identity is on the privileged and service account inventory.YesFill your profileFill your profileFill your profileThe feature has tools or connectorsGS-23P14 PA-11
DC-15LoggingAudit logs of prompts, outputs and administrator actions are on and reach the log store, or the provider's export is scheduled.YesFill your profileFill your profileFill your profileEvery featureGS-19
DC-16LoggingEvery tool call is logged with its arguments and result.YesFill your profileFill your profileFill your profileThe feature has tools or connectorsGS-19
DC-17LoggingAccess to the logs is limited to named roles, and secrets are removed before logs are stored.NoFill your profileFill your profileFill your profileEvery featureGS-19
DC-18LoggingAlerts for the signals AS-01 to AS-12 that the feature can raise are set and go to a named person.NoFill your profileFill your profileFill your profileEvery featureGS-20
DC-19Network and keysThe runtime and any sandbox reach only the addresses on an allow list, and no internal network by default.YesFill your profileFill your profileFill your profileYou host or build the feature and hold its keysGS-22
DC-20Network and keysInbound access to the feature's endpoint is limited to the application or a listed network.NoFill your profileFill your profileFill your profileYou host or build the feature and hold its keysGS-23
DC-21Network and keysThe rotation date of each key is recorded, and revoking a key was tested.NoFill your profileFill your profileFill your profileYou host or build the feature and hold its keysGS-10
DC-22Content filtersThe provider's content and safety filters are on at the level the owner chose, and only named administrators can change them.NoFill your profileFill your profileFill your profileEvery featureGS-04
DC-23Content filtersInput filtering (hidden characters, size, type) and output checks (schema, encoding, addresses) are in application code.YesFill your profileFill your profileFill your profileYou host or build the feature and hold its keysGS-06
DC-24Content filtersThe screen or message that shows output does not fetch addresses the output names, where the organisation controls this.NoFill your profileFill your profileFill your profileEvery featureGS-07
DC-25Rate limitsLimits per person and per feature on requests and tokens are set.NoFill your profileFill your profileFill your profileEvery featureGS-21
DC-26Rate limitsA hard spending cap stops use when it is reached.NoFill your profileFill your profileFill your profileYou host or build the feature and hold its keysGS-21
DC-27Rate limitsA cap on steps and tool calls in one task is set.NoFill your profileFill your profileFill your profileThe feature has tools or connectorsGS-21
DC-28Model and changeThe model and version in use are recorded, and the provider's route for notice of changes is known.NoFill your profileFill your profileFill your profileEvery featureGS-18P24 ST-7
DC-29Model and changeThe system prompt and tool descriptions are under version control with an owner.NoFill your profileFill your profileFill your profileYou host or build the feature and hold its keysGS-18
DC-30StopA feature that can act (send, change records, run commands or spend) has a switch-off that works in one step, revokes keys and tool access, and was tested. Where no tool can act, enter that as the evidence.YesFill your profileFill your profileFill your profileThe feature has tools or connectorsGS-26

Sign-off

RoleNameDateSignature or reference
Completed by (Application developer)[[Name]][[YYYY-MM-DD]][[Reference]]
Accountable (Head of IT)[[Name]][[YYYY-MM-DD]][[Reference]]
Reviewed (Head of Information Security)[[Name]][[YYYY-MM-DD]][[Reference]]
Next check due[[After any change of model, prompt, tool, source or filter (GS-18), and by the earlier of the date the feature's depth sets and the review date in its P24 entry]][[YYYY-MM-DD]][[Reference]]

EXAMPLE Checklist

EXAMPLE: Draft and summarise with the office-suite assistant (LF-1)

a wholesale distributor with about 900 staff, three warehouses and an online ordering service that takes 60% of its orders, as at 30 Sep 2026. Yellow cells are the checker's. Applies?, Status now, the counts, the release line and the Check column calculate.

This feature

FeatureDraft and summarise with the office-suite assistant
AI inventory entry (P24)AI-001
Does the feature read stored company content (documents, a search index, a knowledge store)?YesYour answers decide which checks apply (Checks Explained sheet).
Does the feature have tools or connectors (it can read other systems or act)?No
Do you host or build the feature and hold its keys and network settings?No
Date the checklist was started16 Sep 2026
Completed with (Head of IT)Head of IT

Where the checks stand

Checks verified (of those that apply)14 of 17 applicable checks verified; 0 failed, 3 not verified
Checks failedNone
Checks not verifiedDC-06, DC-09, DC-18
Checks that hold the release and are not verified or failed (RG-2)None
What this does to the release decisionRelease with conditions: some checks are not yet verified (RG-2)
Your own checks (counted on their own)None added

By area

AreaChecksApply to this featureVerifiedNot verifiedFailedNot applicableVerified of those that apply
Tenant and identity4440004 of 4
Data and retention5532003 of 5
Access scopes5110041 of 1
Logging4321012 of 3
Network and keys300003None apply
Content filters3220012 of 2
Rate limits3110021 of 1
Model and change2110011 of 1
Stop100001None apply
All 30 checks of the pack301714301314 of 17
Your own checks000000None apply

Counts of checks, never a share. A check of your own is in the last row only, and in no area above.

The checks, DC-01 to DC-30

IDAreaCheckHolds the release?Applies?StatusStatus nowDate verifiedChecked byEvidence keptNote: what is missing or what failedFinding (AF-nnn)CheckApplies whenRequirementReference
DC-01Tenant and identityStaff reach the feature only with their work account through single sign-on. Personal and guest accounts cannot.YesYesVerifiedVerified16 Sep 2026Head of ITSign-in policy exportRow completeEvery featureGS-23P24 BC-1; P13 JML-12
DC-02Tenant and identityAdministrator roles for the AI service are held by named people with phishing-resistant sign-in, and are reviewed.YesYesVerifiedVerified16 Sep 2026Head of ITAdmin role list and sign-in methodRow completeEvery featureGS-23P14 PA-05, PA-16
DC-03Tenant and identitySharing of prompts, chats, files and custom assistants outside the organisation is off, or limited to a listed set.NoYesVerifiedVerified16 Sep 2026Head of ITTenant sharing setting screenshotRow completeEvery featureGS-08
DC-04Tenant and identityThe setting or contract term that bars the provider from training on the organisation's data is on and evidenced.YesYesVerifiedVerified16 Sep 2026Head of ITProvider's statement of 5 Aug 2026 and tenant settingRow completeEvery featureGS-17P24 BC-2, ST-1
DC-05Data and retentionRetention of prompts, outputs and uploaded files is set to the period the owner recorded, and users can delete their history as the owner decided.NoYesVerifiedVerified16 Sep 2026Head of ITRetention policy screenshotRow completeEvery featureGS-08GDPR Article 25(2)
DC-06Data and retentionThe data location is the one the contract names, and the provider's own page agrees.NoYesNot verifiedNot verifiedThe provider's page names a region; the contract schedule is awaited.Row completeEvery featureGS-17P24 ST-4; P06 clause CL-05
DC-07Data and retentionThe feature takes no data above the level it is approved for, and sensitivity labels are respected where the provider supports them.YesYesVerifiedVerified16 Sep 2026Head of ITT-01 approval conditionsRow completeEvery featureGS-08P24 A07 (the data permission check)
DC-08Data and retentionEvery source the feature can read has an owner and a data level, and the feature reads only what the signed-in person may read.YesYesVerifiedVerified17 Sep 2026Head of ITTest with two accounts: each saw only its own filesRow completeThe feature reads stored company contentGS-09
DC-09Data and retentionA document removed from a source disappears from the feature's index within the time the owner set.NoYesNot verifiedNot verifiedThe time to remove a deleted document from the index is not stated by the provider.Row completeThe feature reads stored company contentGS-12
DC-10Access scopesConnectors, plug-ins and extensions are on an approved list, and all others are off by default.YesNoNot applicableNot for this featureThe feature has tools or connectorsGS-22
DC-11Access scopesEach connector holds the least scope its job needs, read-only where the job only reads.YesNoNot applicableNot for this featureThe feature has tools or connectorsGS-23
DC-12Access scopesEach key or service account serves one feature in one environment, sits in a secrets store, and appears in no code, prompt or tool description.YesNoNot applicableNot for this featureYou host or build the feature and hold its keysGS-10P14 PA-10
DC-13Access scopesWeb browsing, code execution and file creation inside the feature are off unless the approval lists them.NoYesVerifiedVerified16 Sep 2026Head of ITFeature switches screenshotRow completeEvery featureGS-22
DC-14Access scopesTools run as the signed-in person or under a named service identity with the least access, and the identity is on the privileged and service account inventory.YesNoNot applicableNot for this featureThe feature has tools or connectorsGS-23P14 PA-11
DC-15LoggingAudit logs of prompts, outputs and administrator actions are on and reach the log store, or the provider's export is scheduled.YesYesVerifiedVerified16 Sep 2026Head of ITAudit log export scheduleRow completeEvery featureGS-19
DC-16LoggingEvery tool call is logged with its arguments and result.YesNoNot applicableNot for this featureThe feature has tools or connectorsGS-19
DC-17LoggingAccess to the logs is limited to named roles, and secrets are removed before logs are stored.NoYesVerifiedVerified16 Sep 2026Head of ITLog access listRow completeEvery featureGS-19
DC-18LoggingAlerts for the signals AS-01 to AS-12 that the feature can raise are set and go to a named person.NoYesNot verifiedNot verifiedAlert rules for AS-01 to AS-12 are being written.Row completeEvery featureGS-20
DC-19Network and keysThe runtime and any sandbox reach only the addresses on an allow list, and no internal network by default.YesNoNot applicableNot for this featureYou host or build the feature and hold its keysGS-22
DC-20Network and keysInbound access to the feature's endpoint is limited to the application or a listed network.NoNoNot applicableNot for this featureYou host or build the feature and hold its keysGS-23
DC-21Network and keysThe rotation date of each key is recorded, and revoking a key was tested.NoNoNot applicableNot for this featureYou host or build the feature and hold its keysGS-10
DC-22Content filtersThe provider's content and safety filters are on at the level the owner chose, and only named administrators can change them.NoYesVerifiedVerified16 Sep 2026Head of ITFilter settingRow completeEvery featureGS-04
DC-23Content filtersInput filtering (hidden characters, size, type) and output checks (schema, encoding, addresses) are in application code.YesNoNot applicableNot for this featureYou host or build the feature and hold its keysGS-06
DC-24Content filtersThe screen or message that shows output does not fetch addresses the output names, where the organisation controls this.NoYesVerifiedVerified17 Sep 2026Head of ITTest: no link preview fetchedRow completeEvery featureGS-07
DC-25Rate limitsLimits per person and per feature on requests and tokens are set.NoYesVerifiedVerified16 Sep 2026Head of ITLicence limitsRow completeEvery featureGS-21
DC-26Rate limitsA hard spending cap stops use when it is reached.NoNoNot applicableNot for this featureYou host or build the feature and hold its keysGS-21
DC-27Rate limitsA cap on steps and tool calls in one task is set.NoNoNot applicableNot for this featureThe feature has tools or connectorsGS-21
DC-28Model and changeThe model and version in use are recorded, and the provider's route for notice of changes is known.NoYesVerifiedVerified16 Sep 2026Head of ITModel version note and notice routeRow completeEvery featureGS-18P24 ST-7
DC-29Model and changeThe system prompt and tool descriptions are under version control with an owner.NoNoNot applicableNot for this featureYou host or build the feature and hold its keysGS-18
DC-30StopA feature that can act (send, change records, run commands or spend) has a switch-off that works in one step, revokes keys and tool access, and was tested. Where no tool can act, enter that as the evidence.YesNoNot applicableNot for this featureThe feature has tools or connectorsGS-26

Sign-off

RoleNameDateSignature or reference
Completed by (Application developer)[[Name]][[YYYY-MM-DD]][[Reference]]
Accountable (Head of IT)Head of IT[[YYYY-MM-DD]][[Reference]]
Reviewed (Head of Information Security)Head of Information Security[[YYYY-MM-DD]][[Reference]]
Next check due[[After any change of model, prompt, tool, source or filter (GS-18), and by the earlier of the date the feature's depth sets and the review date in its P24 entry]][[YYYY-MM-DD]][[Reference]]

What the check found. 14 of 17 applicable checks verified; 0 failed, 3 not verified. The 3 not verified are DC-06, DC-09, DC-18. None of them holds the release, so the checklist leaves the release decision with conditions (RG-2). The decision on 25 Sep 2026 was Release with conditions: the conditions are these checks and the open finding AF-001, which has an approved exception (AI Security Findings & Exceptions Register).

The same checks on the image generator (LF-2) give 13 of 15 applicable checks verified; 0 failed, 2 not verified. The two not verified are DC-05 and DC-06: both wait for the provider. Across the two live features, 27 of 32 applicable checks are verified. That is the measure GM-02.

The chatbot (LF-3) is held under P24, so its checklist is not started. Its profile (tools, no stored company content, hosted by the provider) makes 21 checks apply. Until they are run, the sheet would read 0 of 21 applicable checks verified; 0 failed, 21 not verified.

A verified check is a setting you have seen. It is not a test of the feature. The review procedure and the red team plan test the feature. This checklist makes sure the settings that test relies on are the settings the feature runs with.

Checks Explained

What each area is for, what stands behind it and what to keep

Each row is one area of the checks. The Generative AI Security Standard gives the text of each requirement, and the LLM Application Threat Catalogue describes each threat. The documents listed here help with the work. Using one does not by itself show that a requirement is met.

The 9 areas

AreaChecks and requirementsApplies whenThreats the checks help withHold the release
Tenant and identityDC-01 to DC-04
Requirements: GS-23, GS-08, GS-17
Every featureLT-03 Sensitive information disclosure
LT-04 Excessive agency
LT-05 AI supply chain compromise
LT-06 Data and model poisoning
LT-10 Vector and embedding weaknesses
DC-01, DC-02, DC-04
Data and retentionDC-05 to DC-09
Requirements: GS-08, GS-17, GS-09, GS-12
Every feature
The feature reads stored company content
LT-03 Sensitive information disclosure
LT-05 AI supply chain compromise
LT-06 Data and model poisoning
LT-10 Vector and embedding weaknesses
DC-07, DC-08
Access scopesDC-10 to DC-14
Requirements: GS-22, GS-23, GS-10
The feature has tools or connectors
You host or build the feature and hold its keys
Every feature
LT-03 Sensitive information disclosure
LT-04 Excessive agency
LT-09 Hidden context exposure (system prompt leakage)
LT-10 Vector and embedding weaknesses
LT-11 Improper output handling
LT-12 Poisoned memory and tool descriptions
DC-10, DC-11, DC-12, DC-14
LoggingDC-15 to DC-18
Requirements: GS-19, GS-20
Every feature
The feature has tools or connectors
LT-01 Direct prompt injection
LT-02 Indirect prompt injection
LT-03 Sensitive information disclosure
LT-04 Excessive agency
LT-06 Data and model poisoning
LT-07 Unbounded consumption
LT-08 Misinformation
LT-09 Hidden context exposure (system prompt leakage)
LT-10 Vector and embedding weaknesses
LT-11 Improper output handling
LT-12 Poisoned memory and tool descriptions
DC-15, DC-16
Network and keysDC-19 to DC-21
Requirements: GS-22, GS-23, GS-10
You host or build the feature and hold its keysLT-03 Sensitive information disclosure
LT-04 Excessive agency
LT-09 Hidden context exposure (system prompt leakage)
LT-10 Vector and embedding weaknesses
LT-11 Improper output handling
LT-12 Poisoned memory and tool descriptions
DC-19
Content filtersDC-22 to DC-24
Requirements: GS-04, GS-06, GS-07
Every feature
You host or build the feature and hold its keys
LT-01 Direct prompt injection
LT-02 Indirect prompt injection
LT-03 Sensitive information disclosure
LT-04 Excessive agency
LT-11 Improper output handling
DC-23
Rate limitsDC-25 to DC-27
Requirements: GS-21
Every feature
You host or build the feature and hold its keys
The feature has tools or connectors
LT-04 Excessive agency
LT-07 Unbounded consumption
None
Model and changeDC-28 to DC-29
Requirements: GS-18
Every feature
You host or build the feature and hold its keys
LT-01 Direct prompt injection
LT-02 Indirect prompt injection
LT-05 AI supply chain compromise
LT-08 Misinformation
LT-09 Hidden context exposure (system prompt leakage)
None
StopDC-30 to DC-30
Requirements: GS-26
The feature has tools or connectorsLT-04 Excessive agency
LT-07 Unbounded consumption
LT-12 Poisoned memory and tool descriptions
DC-30

What counts as evidence

KindWhen it is enough
A screenshot or export of the settingThe best evidence. It shows the setting as it stands. Put the date and the account it was taken from on it.
The contract term or the provider's written statementUse this where the tenant cannot show the setting. Say which you hold. A provider's web page can change without notice, so date what you saw.
A test you ranFor example, sign in with two accounts and check that each sees only its own files. Write down what you did and what happened.
A log or report extractFor example the schedule of the audit log export, or an alert rule with a test alert. Date it.

The release gate

RG-2: No configuration check that blocks release has failed or is unverified. A check that holds the release and is failed or not verified holds the release. Any other check that is failed or not verified leaves the release with conditions. The decision is the approvers', recorded under P24 and the LLM Application Security Review Procedure (stage RP-6).

Where another pack owns the content

TopicWhat to know
Which AI may be usedWhich tools are approved, with what data, who approves a use and how it is recorded are P24's. This checklist checks the settings that make an approval true. It never grants one.
Accounts and sign-inSingle sign-on is P13's (JML-12). The inventory of privileged and service accounts is P14's (PA-10, PA-11). DC-01, DC-02, DC-12 and DC-14 check that the AI service follows them.
Contract termsThe AI terms (ST-1 to ST-8) and the P06 clauses are the contract's. DC-04 and DC-06 check that the setting matches the term. The provider's own answers are in the questionnaire.
What a verified check showsA verified check shows a setting. It does not show that the feature resists attack. The review procedure and the red team plan test that.
A setting found changed or a leakTake a snapshot of the settings as found before you change anything (EP-08), then report it through the incident route. P09 decides whether it is an incident.

Report an event at once through the incident route (P09 IM-01). Nobody is blamed for a report made in good faith. P09 decides whether it is an incident and whether anything must be reported, and P18's clocks apply. P09 IM-07 sets the order of containing and preserving. Where harm can still spread, such as an agent that can still act (AS-03, AS-07, AS-08) or data still leaving, contain first by switching the feature's access off, and capture what you can in the same step. Otherwise preserve the evidence first, then switch the feature off. What to keep when a signal is confirmed: A snapshot of the configuration checklist (A05) settings as found, taken before anything is changed or, where harm is still spreading, in the same step as the switch-off.

Lists

CheckStatusYesNoCheckArea
VerifiedYesTenant and identity
Not verifiedNoData and retention
FailedAccess scopes
Not applicableLogging

Network and keys

Content filters

Rate limits

Model and change

Stop

Definitions

Definitions

TermMeaning in this workbook
FeatureOne LLM capability the organisation uses, builds or has switched on, for one purpose, with one owner. A feature is the technical view of a P24 use.
LLM applicationSoftware that sends text, files or other content to an LLM and uses what comes back. A chat assistant, a summariser built into an office suite, a customer chatbot and an agent are all LLM applications. The inventory (P24) lists them as uses; this pack calls the part that uses the model a feature.
Tool and connectorA function the model can ask the application to run: search, read a file, send an email, run a query, run code. Also called a plugin, extension, skill or connector. A connector gives access to another system.
RetrievalFetching stored content, such as company documents, and adding it to the prompt so the model can use it. Often called retrieval-augmented generation.
Knowledge storeWhere retrieved content and memory are kept: a search index, a vector store, a semantic cache or an agent's memory. An embedding is the numerical form of a piece of content that a vector store uses to find similar content.
GuardrailA filter, rule or check placed around the model, on its input or output. It lowers the chance of a bad outcome. It is not a security boundary, because a determined attacker can often get round it.
Model providerThe organisation that supplies the model or the service built on it. It can be the same as the tool supplier or different (the tool supplier may use another party's model).
System promptThe instructions the application sends to the model before the user's words. Also called hidden context, together with tool descriptions and policy text retrieved for the model. It is hidden from the user's screen and can still be read by the model, and so by a determined user.
CheckOne setting to verify, DC-01 to DC-30. Each has an area, a condition for applying, a requirement it serves and a mark for whether it holds the release.
Applies?Worked out from your three answers about the feature. A check that does not apply reads Not applicable and leaves the count.
Holds the releaseA check marked Yes that is failed or not verified holds the release (RG-2). Other checks that are failed or not verified leave the release with conditions.
VerifiedYou have seen the setting, the contract term or the test result yourself, you hold the evidence, and you have dated it. A check marked Verified without evidence and a date counts as Not verified.
Not verifiedNo result yet, or the result lacks its evidence or its date. Say in the note what is missing. A check that holds the release and is in this state holds it.
FailedYou looked, and the setting is not as the check asks. Say in the note what you found. A failed check is a finding: rate it and enter it in the register, then write its number in the Finding column. A failed check that holds the release holds it.
Not applicableThe sheet works this out from the feature's profile. You may also choose it for a check that the profile says applies, if you write the reason in the note. It then leaves the count. A check marked this way without a reason counts as Not verified.
Status nowWhat the sheet counts. It is Not applicable where the profile says so, Verified only with evidence and a date, Failed as chosen, and Not verified otherwise.
DC-nnOne of DC-01 to DC-30: a check on this checklist.
GS-nnA requirement in the Generative AI Security Standard. The Requirement column names the one each check serves.
Head of ITConnects approved tools to single sign-on, applies the tool's settings and keeps the technical list of what is installed.
Application developerBuilds or configures the feature to this standard, completes the configuration checks with the IT owner, fixes findings and takes part in the review. Does not test the feature at Depth 3, and at Depth 2 is not the tester unless the review says why.
EXAMPLEAn illustration: a wholesale distributor with about 900 staff, three warehouses and an online ordering service that takes 60% of its orders, as at 30 Sep 2026, with the values the pack's other documents hold for it.

Framework References

Framework references

These references indicate relevance only and do not reproduce the text of any standard.

FrameworkReferenceSupported by
ISO/IEC 27001:2022Annex A 8.9 — Configuration managementThe whole checklist: the configuration of the AI service is defined, recorded, checked and reviewed
NIST CSF 2.0PR.PS-01 — “Configuration management practices are established and applied”The whole checklist: configuration management practices applied to the AI service
ISO/IEC 42001:2023Annex A 4.2 — Resource documentationEvidence kept and Date verified columns: the resources and settings of the AI system are documented
ISO/IEC 42001:2023Annex A 9.4 — Intended use of the AI systemDC-07 and DC-13: the feature takes only the data, and has only the functions, its approval lists
EU AI Act — Regulation (EU) 2024/1689Article 15(5) — high-risk systems “shall be resilient against attempts by unauthorised third parties to alter their use, outputs or performance by exploiting system vulnerabilities”; the technical solutions for AI-specific vulnerabilities “shall include, where appropriate, measures to prevent, detect, respond to, resolve and control for attacks trying to manipulate the training data set (data poisoning), or pre-trained components used in training (model poisoning), inputs designed to cause the AI model to make a mistake (adversarial examples or model evasion), confidentiality attacks or model flaws”Content Filters, Access Scopes and Network and Keys checks: the settings that resist attempts to alter outputs or reach data. The Act states this benchmark for high-risk systems and does not bind a deployer to it
EU AI Act — Regulation (EU) 2024/1689Article 26(6) — deployers keep the logs automatically generated by the high-risk system, to the extent the logs are under their control, “for a period appropriate to the intended purpose of the high-risk AI system, of at least six months, unless provided otherwise in applicable Union or national law, in particular in Union law on the protection of personal data”Logging checks DC-15 to DC-18: logs kept where they are under the deployer's control
EU AI Act — Regulation (EU) 2024/1689Article 113, as amended — the Regulation applies from 2 August 2026, except that Chapters I and II (including Articles 4 and 5) apply from 2 February 2025, with Article 5(1) points (ba) and (bb) and Article 5(1a) and (1b) applying from 2 December 2026; Chapter III Section 4, Chapter V (general-purpose AI models), Chapter VII and Chapter XII and Article 78 apply from 2 August 2025, except Article 101; and Chapter III Sections 1, 2 and 3, except Article 6(5), apply from 2 December 2027 as regards systems classified as high-risk under Article 6(2) and Annex III, and from 2 August 2028 as regards those under Article 6(1) and Annex I. Article 50 is not listed in an exception and so applies from 2 August 2026The dates the Act applies, as amended; cited with the Act
EU AI Act — Regulation (EU) 2026/1744 (Digital Omnibus on AI)Regulation (EU) 2026/1744 of 8 July 2026 amending Regulations (EU) 2024/1689, (EU) 2018/1139 and (EU) 2023/1230 as regards the simplification of the implementation of harmonised rules on artificial intelligence (Official Journal, 24 July 2026); in force on the third day after publication (its Article 4), 27 July 2026. Its Article 1 amends Regulation (EU) 2024/1689The amendment to the Act, cited with the Act
GDPR — Regulation (EU) 2016/679Article 25(2) — the controller implements measures so that, “by default, only personal data which are necessary for each specific purpose of the processing are processed”; this covers the amount collected, the extent of processing, the period of storage and accessibility, and by default personal data are not made accessible “without the individual’s intervention to an indefinite number of natural persons”DC-05 and DC-08: by default only the personal data the purpose needs is processed, kept and made accessible
GDPR — Regulation (EU) 2016/679Article 32(1) — appropriate technical and organisational measures to ensure a level of security appropriate to the risk, taking into account the likelihood and severity of risk to people's rights and freedomsTenant and identity, access scope and logging checks: technical and organisational measures that suit the risk
GDPR — Regulation (EU) 2016/679Article 32(2) — in assessing the appropriate level of security, account is taken of the risks presented by processingAccess scope and logging checks: risks of unauthorised disclosure of or access to personal data
NIS2 — Directive (EU) 2022/2555Article 21(2)(i) — “human resources security, access control policies and asset management”Tenant and identity and access scope checks: access control policies
OWASP Top 10 for LLM Applications 2026LLM02:2026 Sensitive Information Disclosure — “exposes confidential, regulated, privileged, or proprietary data through a channel the data subject, controller, or system owner did not authorize”. The channel is not only the final answer: tool-call arguments, reasoning traces, retrieved chunks, logs, telemetry and embeddings are disclosure surfacesData and retention and logging checks: the places data can leak (logs, caches, retrieved content)
OWASP Top 10 for LLM Applications 2026LLM06:2026 Unbounded Consumption — “allows excessive and uncontrolled inferences, enabling attackers to disrupt service availability, inflict unsustainable financial costs, or steal intellectual property through model cloning”; the entry says request-rate limits alone are not enough and asks for token-aware limits and hard spending capsRate limits checks DC-25 to DC-27: limits, spending caps and caps on steps
OWASP Top 10 for LLM Applications 2026LLM08:2026 Hidden Context Exposure (named System Prompt Leakage in the 2025 edition) — “unauthorized extraction, inference, or reconstruction of hidden, non-user-facing system instructions or operational context placed in a model’s context”; practitioners “should design under the assumption that hidden context is discoverable”, keep credentials out of it and not rely on it as a security boundaryDC-12 and DC-29: keys kept out of prompts and tool descriptions, and the system prompt under version control
OWASP Top 10 for LLM Applications 2026LLM09:2026 Vector and Embedding Weaknesses — risks in any application that converts content into numerical representations and “uses similarity search to decide what the model sees”, including retrieval-augmented generation, agent memory and semantic caches; its controls start with permission and access control on the indexDC-08 and DC-09: access control and removal at the index
Guidelines for secure AI system development (NCSC, CISA and partners)Secure operation and maintenance, “Monitor your system’s inputs” — “you monitor and log inputs to your system (such as inference requests, queries or prompts) to enable compliance obligations, audit, investigation and remediation in the case of compromise or misuse”, in line with privacy and data protection requirementsDC-15 and DC-18: inputs and outputs logged, and alerts set
NIST AI RMF 1.0MANAGE 2.4 — “Mechanisms are in place and applied, and responsibilities are assigned and understood, to supersede, disengage, or deactivate AI systems that demonstrate performance or outcomes inconsistent with intended use.”DC-30: a switch-off that works and was tested
NIST AI RMF 1.0MANAGE 4.1 — “Post-deployment AI system monitoring plans are implemented, including mechanisms for capturing and evaluating input from users and other relevant AI actors, appeal and override, decommissioning, incident response, recovery, and change management.”DC-15, DC-18 and DC-28: monitoring after release and change management

Editions referenced: Regulation (EU) 2024/1689 (the EU AI Act) as amended by Regulation (EU) 2026/1744; Regulation (EU) 2016/679 (GDPR); OWASP Top 10 for LLM Applications, 2026 edition; MITRE ATLAS 2026.09; NIST AI 600-1; NIST AI RMF 1.0; NIST CSF 2.0; ISO/IEC 27001:2022 incl. Amd 1:2024; ISO/IEC 42001:2023 (by number and title only); as published and read on 8 October 2026

Regulation (EU) 2024/1689 binds the operators of its Article 2(1). Article 15 sets requirements for high-risk AI systems, and the provider of such a system answers for them. An organisation that uses another party’s AI system under its own authority is a deployer (Article 3(4)), and its duties are those of Article 26 and the other articles that name deployers. This pack cites Article 15 as the Act’s own statement of what security a high-risk system needs, and cites no system as high-risk. Counsel confirms the role and the category of each system.

Regulation (EU) 2016/679 binds controllers and processors. Article 25 asks the controller for data protection by design and by default, and Article 32 for security of processing that is appropriate to the risk. Both apply to an LLM application that processes personal data. Whether an organisation is a controller or a processor for a given application depends on the facts, and counsel confirms it.

OWASP, MITRE ATLAS, NIST AI 600-1, NIST SP 800-218A, the NCSC blog, the NCSC and CISA guidelines and the joint agency guidance on agents are voluntary guidance. They are not law, and none of them says what the AI Act or the GDPR requires. This pack cites them as their publishers state them.

The OWASP lists are community lists of the risks the project judges most important. A threat that is not on a list is not therefore safe, and a threat on a list is not therefore present in every application.

This pack does not say which OWASP, MITRE ATLAS, NIST or ISO/IEC 42001 items meet a requirement of the EU AI Act or the GDPR. Each reference says what its source asks for and which CISO Times document helps with that work. Using a document does not by itself show that a requirement is met.

ISO/IEC 27001 and ISO/IEC 42001 references name the clause or control this document relates to, by number and title only. ISO/IEC 42001 is a paid standard whose text was not read for this document. A reference does not say that meeting a clause or control meets any requirement of the EU AI Act or the GDPR.

These references show where this document supports an external framework. They indicate relevance only and do not reproduce the text of any standard.

Prepared by Zero One Cybersecurity · Published by CISO Times

CISO Times Resource Licence — Internal Use