Generative AI Security Standard
Specifies requirements for LLM applications covering input handling, output validation, data exposure, logging and agent permissions.
Available soon
- Format
- Word
- Size
- 76 KB
- Length
- 26 pages
- Version
- 1.0
- Updated
What's inside
- Purpose
- Scope
- How this standard works
- Threats this standard answers
- Requirements
- Signals to watch and evidence to keep
- Roles and responsibilities
- Findings and exceptions
- Review and change
- Related documents
- Definitions
- Document control
- Worked example: the first three weeks
- Adapting this template
- Framework references
What changed
- 1.0
Published.
Preview
The document from section 1, as you will receive it. Highlighted [[text]] is for you to replace; shaded guidance boxes are for you to delete before approval. The cover and document control pages are in the file.
Purpose
An LLM application puts instructions and data in one channel. The model reads the organisation's instructions and an attacker's words as the same kind of thing, so the checks that work for ordinary input, such as matching a field against a pattern, cannot tell them apart. The national cyber centres and OWASP both say the defence lies in the system around the model, because the model will sometimes be fooled. Everything the organisation already does for access, logging, secure development, patching and supplier assurance still applies and is not repeated here. This pack adds what is specific: what the model may read, what its output may reach, what it may do, who approves what it does, and how the organisation tests all of this before release and watches it afterwards. The result is counts of features reviewed, checks verified and findings open. It is never one score.
This standard commits [[Organisation Name]] to the same approach. It sets 31 requirements, GS-01 to GS-31, for every generative AI feature the organisation builds, configures or switches on. Each requirement names the threats it answers (LT-01 to LT-12) and the evidence a reviewer looks at. Every other document in the Generative AI Security pack cites the requirements by number.
The other documents in the pack put the standard into practice. The LLM Application Security Review Procedure reviews each feature, and the LLM Application Threat Catalogue, Generative AI Deployment Configuration Checklist, AI Vendor & Model Provider Security Questionnaire, AI Red Team Test Plan Template, AI Security Findings & Exceptions Register and AI Agent Permission & Tool-Access Review Checklist support the review.
What this standard leaves to P24. The rules on which AI may be used, with which data, who approves a use and how a use is recorded are P24's (AG-01 to AG-22). This pack does not change them. It sets what a generative AI feature has to do to be secure once a use is approved, and what the organisation checks before the feature goes live and while it runs.
Legal note. This document helps you secure the generative AI your organisation builds, configures or buys. It is not legal advice, and following it is not a statement that you comply with the EU AI Act, the GDPR or any standard. A test that finds no problem does not show that a feature is secure. Whether the Act binds you, in which role, and which of its duties apply to each system depends on the facts: confirm it with counsel.
Guidance — delete before approval
This is a Standard-tier document in the Security Policy Management pack: approved by the Head of Information Security, with the document owner consulted, and reviewed at least every 12 months. A standard states what must be true. How a review is done is in the procedure (A03).
Scope
This standard applies to:
- Features: every large language model (LLM) feature the organisation builds, configures or switches on, for staff or for customers: chat assistants, summarisers built into other software, customer chatbots, search over company documents, coding assistants and agents. It covers the model, the instructions sent to it, its tools and connectors, its stores of retrieved content and memory, and its logs (GS-01).
- Features that suppliers add: an LLM feature that arrives in software already in use is in scope from the day it is switched on. A supplier can add one in a release (GS-01).
- People: everyone who builds, configures, approves, tests or runs such a feature, and the suppliers whose models and services the feature uses.
- Other AI: AI that is not generative, such as a forecasting model or an anomaly filter, stays under the AI governance rules of the AI Security Governance & Acceptable Use pack and is not covered here.
Excluded: [[anything deliberately left out, and where it is covered instead, e.g. an AI feature inside a product the organisation sells, which a separate product security process covers; or "None"]].
Everything the organisation already does for access, logging, secure development, patching and supplier assurance still applies and is not repeated here: access under the Joiner-Mover-Leaver & Access Provisioning and Privileged Access Management packs, vulnerabilities and patches under the Vulnerability & Exposure Management and Patch Management packs, classification under the Information Classification & Handling pack, incidents under the Security Incident Management pack and suppliers under the Third-Party Security Risk Management pack.
Guidance — delete before approval
A bought feature is a feature. Most organisations will meet this standard as a customer: a requirement about code in the application (GS-04, GS-06) then becomes a question to the supplier and a setting to check (A05, A06). Where a requirement does not apply, the review says so and gives the reason.
The Act calls an organisation that uses another party's AI system under its own authority a deployer. Building an application or feature on a supplier's model API, whether for staff or for customers, counts as building, and a supplier's finished product used as supplied does not. If you build a feature that way, or brand or supply an AI system, AI Security Governance & Acceptable Use rule AG-17 sends the decision on your role to Legal before anything starts. This standard still applies to the feature. A new feature built that way is reviewed at Depth 3 until Legal records the role. If Legal records the deployer role, the depth follows the tier set again from the answers; if Legal records the provider role or another role, the feature stays Tier 3 and at Depth 3. A feature already running carries the hold as a condition with a date. You may need more than this standard.
How this standard works
Every feature answers five questions: what may the model read; where may its output go; what may it do; who approves what it does; how is it tested and watched. The requirements are the detail.
Design on the assumption that the model will be fooled (GS-02). The national cyber centres and OWASP both say the defence lies in the system around the model. Filters and instructions in the prompt lower the chance of an attack working. They are not a barrier. The remaining requirements limit what a successful attack can reach.
The review depth
Each feature is reviewed at a depth. The depth follows the P24 tier of the use and rises with the features that raise the risk: retrieval over company content above the Public level, tools, memory between sessions and the rule of two below (GS-09, GS-14, GS-22, GS-24). The Head of Information Security sets it in the LLM Application Security Review Procedure. The approvers, the decision time and the approval's review interval follow the higher of the P24 tier and the depth; where the two review dates differ, the earlier applies. The depth routes the review and says nothing about how the Act classifies the feature. Values in [[brackets]] are the pack's defaults.
Depth | Who reviews | What the review holds | Decision within | Approval reviewed every |
|---|---|---|---|---|
basic Depth 1 | The owner, the developer and the IT owner | Data flow, standard check and configuration checklist. No separate test of the attack classes beyond the checks the checklist holds, and no tester is required. Where an outside provider supplies the model, its published security statement is read instead of the questionnaire. Depth 1 follows the P24 tier unless a property of the feature moves it up. | [[5]] working days | [[12]] months |
standard Depth 2 | The team, with the Head of Information Security reviewing | Depth 1, the threat selection, and tests of the selected classes by the team. A tester who did not build the feature is expected, and the review states who tested. The provider questionnaire, required when an outside provider supplies the model. The agent permission review where there are tools. | [[15]] working days | [[6]] months |
full Depth 3 | An independent tester | Depth 2, with an independent red team test of every selected class under a written plan (A07), and the agent permission review for any tools. A new feature built on a supplier's model API is Tier 3 under P24 until Legal records the role, so it starts at Depth 3. When Legal records the deployer role, the depth is worked out again from the new tier and the feature's properties. When Legal records the provider role or another role, the feature stays Tier 3 and stays at Depth 3. A feature already running when the standard starts carries the P24 hold as a condition with a date, and its depth follows its tier and properties. | [[30]] working days | [[6]] months |
The rule of two (GS-24). Count three properties of the feature. With all three, a person approves every action. With two, the review records the residual risk.
Property | What it means | |
|---|---|---|
A | Reads untrusted content | Customers' messages, supplier documents, inbound email, web pages, tickets, or output of a tool that fetches them. A feature that customers or the public deal with counts. |
B | Can reach sensitive data | Data above the Public level, or any personal data. |
C | Can change state or communicate outside | Has a tool that writes, sends anything outside the organisation, or acts without a person reading its output first. |
Where the standard comes from
EU AI Act. Regulation (EU) 2024/1689 binds the operators of its Article 2(1). Article 15 sets requirements for high-risk AI systems, and the provider of such a system answers for them. An organisation that uses another party’s AI system under its own authority is a deployer (Article 3(4)), and its duties are those of Article 26 and the other articles that name deployers. This pack cites Article 15 as the Act’s own statement of what security a high-risk system needs, and cites no system as high-risk. Counsel confirms the role and the category of each system.
GDPR. Regulation (EU) 2016/679 binds controllers and processors. Article 25 asks the controller for data protection by design and by default, and Article 32 for security of processing that is appropriate to the risk. Both apply to an LLM application that processes personal data. Whether an organisation is a controller or a processor for a given application depends on the facts, and counsel confirms it.
Threats this standard answers
The twelve threats are those of the LLM Application Threat Catalogue. Each of the ten classes of the OWASP Top 10 for LLM Applications, 2026 edition, has a threat. Prompt injection is split into direct (LT-01) and indirect (LT-02), and LT-12 adds attacks on memory and tool descriptions, for which OWASP points to its agentic list. OWASP and MITRE ATLAS are community sources. They are cited as the sources state them, not as law.
Threat | Name | OWASP entry | Requirements that answer it |
|---|---|---|---|
LT-01 | Direct prompt injection | LLM01 Prompt Injection | GS-01, GS-02, GS-03, GS-04, GS-05, GS-06, GS-18, GS-19, GS-20, GS-24, GS-28, GS-29, GS-30, GS-31 |
LT-02 | Indirect prompt injection | LLM01 Prompt Injection | GS-01, GS-02, GS-03, GS-04, GS-07, GS-13, GS-14, GS-18, GS-19, GS-20, GS-24, GS-25, GS-27, GS-28, GS-29, GS-30, GS-31 |
LT-03 | Sensitive information disclosure | LLM02 Sensitive Information Disclosure | GS-01, GS-03, GS-07, GS-08, GS-09, GS-10, GS-12, GS-15, GS-17, GS-19, GS-20, GS-28, GS-29, GS-30, GS-31 |
LT-04 | Excessive agency | LLM03 Excessive Agency | GS-01, GS-06, GS-10, GS-19, GS-20, GS-21, GS-22, GS-23, GS-24, GS-25, GS-26, GS-27, GS-28, GS-29, GS-30, GS-31 |
LT-05 | AI supply chain compromise | LLM04 Supply Chain | GS-01, GS-15, GS-16, GS-17, GS-18, GS-28, GS-29, GS-30, GS-31 |
LT-06 | Data and model poisoning | LLM05 Data and Model Poisoning | GS-01, GS-12, GS-13, GS-14, GS-15, GS-17, GS-19, GS-28, GS-29, GS-30, GS-31 |
LT-07 | Unbounded consumption | LLM06 Unbounded Consumption | GS-01, GS-05, GS-20, GS-21, GS-26, GS-28, GS-29, GS-30, GS-31 |
LT-08 | Misinformation | LLM07 Misinformation | GS-01, GS-18, GS-20, GS-25, GS-27, GS-28, GS-29, GS-30, GS-31 |
LT-09 | Hidden context exposure (system prompt leakage) | LLM08 Hidden Context Exposure | GS-01, GS-02, GS-10, GS-11, GS-18, GS-20, GS-28, GS-29, GS-30, GS-31 |
LT-10 | Vector and embedding weaknesses | LLM09 Vector and Embedding Weaknesses | GS-01, GS-03, GS-08, GS-09, GS-12, GS-13, GS-19, GS-20, GS-23, GS-28, GS-29, GS-30, GS-31 |
LT-11 | Improper output handling | LLM10 Improper Output Handling | GS-01, GS-03, GS-06, GS-07, GS-19, GS-20, GS-22, GS-28, GS-29, GS-30, GS-31 |
LT-12 | Poisoned memory and tool descriptions | LLM01 Prompt Injection, and ASI06 in the agentic list | GS-01, GS-14, GS-16, GS-19, GS-20, GS-22, GS-26, GS-28, GS-29, GS-30, GS-31 |
Guidance — delete before approval
The order of the OWASP list changes between editions, and a threat that is not on a list is not therefore safe. Use the catalogue (A04) to select the threats that apply to a feature and record the reason for each one left out.
Requirements
The requirements keep the IDs GS-01 to GS-31 that every document in the Generative AI Security pack cites. Values in [[brackets]] are the pack's defaults; set your own before approval. Under each requirement, the threats it answers and the evidence a reviewer looks at.
Scope
GS-01 Every LLM feature the organisation builds, configures or switches on is on the AI inventory (P24 A05) with a named owner before it goes live, and this standard applies to it. That includes a feature a supplier adds to software already in use. A feature the organisation builds on a supplier's model API (prompts, retrieval, tools or code around a model it calls) answers Yes to P24's building question, for staff as for customers (AG-17): a new feature is Tier 3 and held until Legal records the role, and it is reviewed at Depth 3 until then. If Legal records the deployer role, the tier is set again from the answers and the depth follows it; if Legal records the provider role or another role, the hold clears but the feature stays Tier 3 and stays at Depth 3. A feature already running carries the hold as a condition with a date and is reviewed at the depth its tier and properties give. A supplier's finished product used as supplied is not building. Which AI may be used and who approves it are P24's rules (AG-09).
Answers: all twelve threats (LT-01 to LT-12). Evidence: the inventory entry (P24 A05) with owner and a date before go-live; supplier-added features found at the last inventory review.
Design
GS-02 Design on the assumption that the model will be fooled. The security of the feature rests on what the system around the model allows, never on instructions in the prompt. A control that is only a sentence in a prompt is not a control.
Answers: LT-01 direct prompt injection; LT-02 indirect prompt injection; LT-09 hidden context exposure (system prompt leakage). Evidence: the review record showing which controls sit in code, permissions and approvals; a test showing the feature holds when its prompt rules are ignored.
GS-03 Draw a data flow for each feature that shows every source the model reads (user input, files, web pages, email, tool results, retrieved text, memory) and every place its output goes (screens, files, databases, links, tools, other systems). Mark each source trusted or untrusted. Content from outside the organisation, and content from anyone who can submit text, is untrusted, whichever system holds it.
Answers: LT-01, LT-02, LT-03, LT-10, LT-11. Evidence: the data flow (E-1), with every source and destination marked trusted or untrusted.
Input handling
GS-04 Keep untrusted content apart from instructions: send it in a separate, labelled part of the request, and never build instructions by joining text from untrusted sources. Strip hidden characters (tag characters, zero-width characters and variation selectors) when content comes in and when output is shown. Filter every kind of input the feature takes, not only text. These steps lower the chance of success. They are not a barrier.
Answers: LT-01 direct prompt injection; LT-02 indirect prompt injection. Evidence: the request-building code or settings showing untrusted content in its own labelled part, and the hidden-character filter; results for AC-01 and AC-02.
GS-05 Limit the size, number and type of inputs, files and tool results the model receives, and reject the rest.
Answers: LT-01 direct prompt injection; LT-07 unbounded consumption. Evidence: the configured limits on size, number and type of input; a test that an oversized or wrong-type input is rejected.
Output handling
GS-06 Treat the model's output as untrusted input to whatever receives it. Check it against a schema in application code, encode it for where it goes (page, query, shell, link, terminal), and never pass it to an interpreter, query or template without that.
Answers: LT-11 improper output handling; LT-01 direct prompt injection; LT-04 excessive agency. Evidence: the output schema and encoding in the receiving code; results for AC-11.
GS-07 A screen or message that shows model output does not fetch addresses the output names (images, link previews, frames) unless they are on an allow list, and shows the full address of any link.
Answers: LT-03 sensitive information disclosure; LT-11 improper output handling; LT-02 indirect prompt injection. Evidence: the address allow list; a test that no address named in output loads by itself (DC-24).
Data exposure
GS-08 Send the model only what the task needs, at the lowest data level that works, and apply P24's data permissions at the point of sending (the data permission check of the approved tool list, P24 A07; P15 levels). Personal data goes in only as GDPR Article 25 asks: by design and by default, with the amount, the extent of processing, the storage period and the access limited to the purpose.
Answers: LT-03 sensitive information disclosure; LT-10 vector and embedding weaknesses. Evidence: the data flow with the data level of each item sent; the tool's entry on the approved list (P24 A07); the privacy review where personal data is involved.
GS-09 Retrieval and search tools return only what the signed-in person may already read. The check is made in the index query or the source system, with the person's identity. Asking the model to hold something back is not a check.
Answers: LT-10 vector and embedding weaknesses; LT-03 sensitive information disclosure. Evidence: the identity check in the index or source system; a test with two accounts of different rights (DC-08); results for AC-10.
Secrets
GS-10 No secret, password, key or token goes into a prompt, a system prompt, a tool description or a knowledge store. The application or a secrets store holds keys, one per feature and environment, rotated and recovered as P14 sets (PA-10). A key that appears in output or a log is revoked at once.
Answers: LT-09 hidden context exposure (system prompt leakage); LT-03 sensitive information disclosure; LT-04 excessive agency. Evidence: secrets store entries per feature and environment; scans of prompts, tool descriptions and stores; rotation dates; any key revoked after it appeared in output or a log (DC-12, DC-21).
GS-11 Treat the system prompt, the tool descriptions and any policy text retrieved for the model as readable by users. Nothing in them may give an attacker more access than they already have, and nothing in them is relied on as a security boundary.
Answers: LT-09 hidden context exposure (system prompt leakage). Evidence: the reviewed system prompt and tool descriptions; results for AC-09 showing that revealing them gives an attacker no extra access.
Knowledge stores
GS-12 Every knowledge store (index, vector store, cache, memory) has an owner, a list of its sources, a data level, access control that matches its sources, and a way to remove a document and everything derived from it.
Answers: LT-10 vector and embedding weaknesses; LT-06 data and model poisoning; LT-03 sensitive information disclosure. Evidence: the store's entry: owner, sources, data level, access list and removal route; a removal test (DC-09).
GS-13 Content enters a knowledge store only from named sources, added by named people or processes, with a record of who added it and when. Content from untrusted sources is kept apart from trusted content and checked before it is trusted.
Answers: LT-06 data and model poisoning; LT-10 vector and embedding weaknesses; LT-02 indirect prompt injection. Evidence: the list of named sources and of who may add to them; the log of additions; untrusted content kept apart; results for AC-06.
GS-14 Where a feature keeps memory between sessions, writes to memory are logged with their cause, are limited to what the task needs, and are kept per person. The person and the owner can view and clear them. Text that reads as an instruction is not stored as memory without approval.
Answers: LT-12 poisoned memory and tool descriptions; LT-06 data and model poisoning; LT-02 indirect prompt injection. Evidence: the memory design; the log of memory writes with cause; the view-and-clear function; results for AC-12.
Model and provider
GS-15 Choose a model and its provider through P24's tool approval (A07) and the supplier assessment of P06, and record the model name and version each feature uses. The provider answers the questionnaire (A06). A model or adapter taken from a public source is used only after its publisher, source and file hash are checked and it is loaded in a form that does not run code when loaded.
Answers: LT-05 AI supply chain compromise; LT-06 data and model poisoning; LT-03 sensitive information disclosure. Evidence: the record of model name and version; publisher, source and hash checks; the P06 supplier decision; the questionnaire answers (A06).
GS-16 Keep a list of the models, adapters, datasets, libraries, tools and connectors each feature uses, with versions, and manage them as the vulnerability and patch packs manage other software (P01, P17). Tool and connector servers are pinned to a version and approved before use.
Answers: LT-05 AI supply chain compromise; LT-12 poisoned memory and tool descriptions. Evidence: the list of models, adapters, datasets, libraries, tools and connectors with versions; pinned versions; approval of each connector server.
GS-17 The contract carries the AI terms ST-1 to ST-8 (P24) and the clauses P06 clause CL-04, P06 clause CL-05, P06 clause CL-06, P06 clause CL-07, P06 clause CL-13 and P06 clause CL-20, and the provider's answers to A06 are on file.
Answers: LT-03 sensitive information disclosure; LT-05 AI supply chain compromise; LT-06 data and model poisoning. Evidence: the contract showing ST-1 to ST-8 and the named clauses; the questionnaire (A06) on file.
Change control
GS-18 A change of model, model version, system prompt, tool, retrieval source or filter setting is a change: it goes through the change control that applies to the system, the attack classes it could affect are tested again at the feature's review depth, and the change is recorded. A provider's change of model is a trigger for review within [[10]] working days of the notice (P24 ST-7; AG-10).
Answers: LT-01, LT-02, LT-05, LT-08, LT-09. Evidence: the change record for each change; retest results; the date each review started after a provider's notice.
Logging
GS-19 Log, for each request: who asked and when; the feature, model and version; the system prompt version; the sources retrieved; every tool call with its arguments and result; the output; and the verdict of each filter. Write the log to a store that the feature's administrators cannot change. Keep it for the period the owner records for the purpose, at least [[6]] months, and for a high-risk system at least 6 months where the Act applies (Article 26(6)). Limit who can read prompt logs and keep secrets out of them.
Answers: LT-01, LT-02, LT-03, LT-04, LT-06, LT-10, LT-11, LT-12. Evidence: the log settings: fields captured, protected store, retention and access list (DC-15 to DC-17).
Monitoring
GS-20 Monitor use for the signals AS-01 to AS-12. Alerts go to a named person, who looks at each within [[2]] working days. An event goes to the incident route (P09 IM-01).
Answers: LT-01, LT-02, LT-03, LT-04, LT-07, LT-08, LT-09, LT-10, LT-11, LT-12. Evidence: the alert rules (DC-18); the alert log with date seen and by whom; events passed to the incident route.
Resource limits
GS-21 Set limits per person and per feature on requests, tokens and the number of steps and tool calls in one task, and a hard spending cap per key and per feature that stops use when it is reached. A cap that only sends a warning is not a cap.
Answers: LT-07 unbounded consumption; LT-04 excessive agency. Evidence: the limits and spending cap; results for AC-07 showing the cap stops use (DC-25 to DC-27).
Agents and tools
GS-22 Give the model only the tools the task needs. Each tool does one job and takes a strict input. Do not offer an open-ended tool (run any command, fetch any address) unless it runs in a sandbox with no network access to internal systems and no secrets.
Answers: LT-04 excessive agency; LT-12 poisoned memory and tool descriptions; LT-11 improper output handling. Evidence: the tool list with each tool's one job and input rules; for an open-ended tool, the sandbox settings (DC-10, DC-13, DC-19).
GS-23 A tool acts as the signed-in person, or under a named service identity with the least access its job needs (P14 PA-11; P13 JML-12). Credentials are held by the application, never the model, and the person's permission is checked on every call by code, not by the model.
Answers: LT-04 excessive agency; LT-10 vector and embedding weaknesses. Evidence: the identity and scopes of each tool; a test that a call for data the person may not read is refused (DC-11, DC-14).
GS-24 Count three properties of a feature: it reads untrusted content (A), it can reach sensitive data (B), and it can change state or communicate outside the organisation (C). With all three it needs a person to approve every action. With two the review records the residual risk. The review procedure (A03) counts them.
Answers: LT-04 excessive agency; LT-02 indirect prompt injection; LT-01 direct prompt injection. Evidence: the rule of two result in the review; for all three, the per-action approval setting; for two, the recorded residual risk.
Human approval
GS-25 A person approves, seeing the exact action and not a summary of it, before any action that is irreversible, leaves the organisation, changes access, runs code outside a sandbox or affects a person. The agent permission checklist (A09) gives the answer for each kind of action. Spending is controlled through the cap on spend in the agent permission review (AP-13) and the hard spending cap (GS-21), and payments through the payment rule (GS-27), not through this approval. A decision about a person is made by a named person (P24 AG-06).
Answers: LT-04 excessive agency; LT-02 indirect prompt injection; LT-08 misinformation. Evidence: the list of actions with the approval each needs (A09); the approval screens showing the exact action; a sample of recorded approvals.
GS-26 A feature that can act (send, change records, run commands or spend) has a switch-off that one named person can use in one step. It stops the feature, revokes its keys and tool access, and is tested before release and after any change to the feature (NIST AI RMF MANAGE 2.4).
Answers: LT-04 excessive agency; LT-12 poisoned memory and tool descriptions; LT-07 unbounded consumption. Evidence: the switch-off procedure, the named person and the date of its last test (DC-30).
GS-27 No feature releases a payment or changes supplier bank details, by any tool or path (P24 AG-16). A feature may draft a payment request that a named person then makes through the normal approval. This requirement takes no exception (GS-30).
Answers: LT-04 excessive agency; LT-02 indirect prompt injection; LT-08 misinformation. Evidence: a test that no tool and no path releases a payment or changes bank details (A09 AP-10); results for AC-04.
Testing
GS-28 Test each feature before release against the attack classes AC-01 to AC-12 at the depth the review procedure (A03) sets. At Depth 3 someone other than the builder tests (P20 CA-10). At Depth 2 the team tests, the review states who tested, and a tester who did not build the feature is expected. At Depth 1 no separate test is required. A feature already running when this standard is adopted is reviewed within [[90]] calendar days of adoption. Tests are repeated after a change that could affect an attack class.
Answers: all twelve threats (LT-01 to LT-12). Evidence: the depth and its reasons; results for each selected attack class; who tested (at Depth 3 the independent tester's report); for an existing feature, its review date against the adoption date.
Evidence
GS-29 The owner keeps for each feature the data flow, the threat selection, the standard check, the configuration checklist, the test results, the findings and exceptions, and the approval, while the feature runs and for [[3]] years after it ends, or longer where law or a contract asks.
Answers: all twelve threats (LT-01 to LT-12). Evidence: the evidence set E-1 to E-9 that the depth needs, held by the owner.
Findings
GS-30 A finding is rated on P05's impact and likelihood scales, has an owner and a due date set by its severity, and is tracked in the register (A08). A departure from this standard is a P02 exception approved by the approver its band sets, and a Critical one goes to the board or its equivalent. A breach of P24's AG-03 or AG-05, and a feature that releases a payment (GS-27), take no exception.
Answers: all twelve threats (LT-01 to LT-12). Evidence: the register entries (A08) with rating, owner and due date; each exception with approver and expiry; none against GS-27, AG-03 or AG-05.
Review
GS-31 This standard is reviewed at least every [[12]] months (P04 Standard tier), and when a new edition of the OWASP list or the MITRE ATLAS matrix is published, when an incident shows a gap, or when the law changes.
Answers: all twelve threats (LT-01 to LT-12). Evidence: the document control table; the record of the last review and the triggers considered.
Guidance — delete before approval
Keep the requirement IDs. If you remove one, keep its number and mark it "Withdrawn in version x.y", so records that cite it still point to the right text. GS-27 takes no exception, and neither do AG-05 and AG-03 of the AI Security Governance & Acceptable Use pack.
Set the bracketed values once, here: ten working days for a review after a change, 2 working days to look at an alert, and the log and evidence periods. Use the same values in the procedure, the checklist and the register.
Signals to watch and evidence to keep
GS-20 asks for monitoring of twelve signals. Each is a sign that an attack may be under way or that a control has failed. When a person confirms one, the P24 incident trigger in the last column applies. P09 decides whether an event is an incident. Regulatory Notification Operating Procedure and its clocks stay with the Regulatory Incident Notification & Reporting pack, and this standard restates none of them.
Signal | What to watch for | P24 trigger |
|---|---|---|
AS-01 | Output that quotes the system prompt or tool list, or many near-identical requests asking the model to repeat its instructions. | AT-6 |
AS-02 | A spike in refusals or filter hits from one account, or one account sending many variations of the same request. | AT-6 |
AS-03 | Output or a tool call that follows content the feature has just read, and that the person did not ask for. | AT-6 |
AS-04 | Output that contains addresses, images or encoded text that are not in the source and not asked for. | AT-6 |
AS-05 | Data of a level or kind the person does not normally see appears in output, or in a log, trace or cache. | AT-2 |
AS-06 | Personal data or Confidential data found in a tool that is not approved for it, or leaving through an outbound request. | AT-1 |
AS-07 | A tool call outside the feature's normal pattern: a new recipient, a new system, a bulk read, a delete, or a call that follows a refusal. | AT-6 |
AS-08 | An action taken without the approval the standard requires, or an approval that shows a different action from the one done. | AT-6 |
AS-09 | A new model version, tool, connector or tool description, or a changed file hash, that nobody approved. | AT-4 |
AS-10 | New documents from an unusual author in a knowledge store, a sudden change in what ranks first, or a fixed question set whose answers drift. | AT-6 |
AS-11 | Tokens or cost per person or per hour well above the feature's pattern, or repeated maximum-length requests. | AT-6 |
AS-12 | A user or reviewer reports an invented fact, source, name or package that was relied on. | AT-5 |
Report an event at once through the incident route (P09 IM-01). Nobody is blamed for a report made in good faith. P09 decides whether it is an incident and whether anything must be reported, and P18's clocks apply. P09 IM-07 sets the order of containing and preserving. Where harm can still spread, such as an agent that can still act (AS-03, AS-07, AS-08) or data still leaving, contain first by switching the feature's access off, and capture what you can in the same step. Otherwise preserve the evidence first, then switch the feature off.
Keep the evidence as P09 IM-07 asks: preserve it before anything is changed, unless waiting would let the harm spread. If it would, contain first and capture what you can in the same step. Keep (EP-01 to EP-10): the prompts and outputs of the affected sessions, with times and the person or account; the system prompt, tool descriptions and filter settings in force at the time, with their versions; the model name and version, and the provider's request identifiers; every tool call in the sessions, with arguments, results, identity and any approval; the passages and documents retrieved, with their source and the index version; the content of the document, page, email or ticket that carried the injection, kept as received; the contents of memory before and after, and the log of memory writes; a snapshot of the configuration checklist settings as found, taken before anything is changed or, where harm is still spreading, in the same step as the switch-off; access, sign-in and key-use logs for the feature's identities and keys; the cost and usage records for the period.
Roles and responsibilities
Every feature has one AI use owner, recorded by role in the inventory. The owner answers for the feature and for what it produces. The head of Information Security owns this standard. One person may hold several roles in a small organisation, with two limits: nobody approves a feature they own, and nobody tests at Depth 3 a feature they built or own. The P24 rules on who approves a use stay as the AI Security Governance & Acceptable Use pack sets them.
Role | Responsibilities under this standard |
|---|---|
AI governance lead [[e.g. Head of Risk]] | Owns the approved list and the inventory (P24), convenes the release decision and collects the signatures of the approvers (RG-6), may suspend a running feature pending review, and reports the measures. |
AI use owner [[the manager accountable for the business activity the AI supports]] | Owns the feature, answers for its output, has the data flow drawn, agrees fixes for findings and keeps the evidence. Never approves a feature it owns. |
Application developer [[the engineer or configurer who builds or sets up the feature]] | Builds or configures the feature to this standard, completes the configuration checks with the IT owner, fixes findings and takes part in the review. Does not test the feature at Depth 3, and at Depth 2 is not the tester unless the review says why. |
Head of Information Security [[e.g. Head of Information Security]] | Owns this standard, selects the threats and sets the review depth, reviews the evidence, rates each finding, signs the release decision from Depth 2 (RG-6), and approves exceptions in the Medium and High bands. |
Independent tester [[a security analyst or external tester who did not build the feature]] | Tests the feature against the attack classes and writes the report. Required at Depth 3, where the tester does not own or build the feature (P20 CA-10; NIST AI RMF MEASURE 1.3), and expected at Depth 2. |
Data Protection Officer [[or the privacy lead where no DPO is appointed]] | Advises on personal data in any use, decides with the use owner whether a data protection impact assessment is needed, and is consulted on every use of personal data. |
Legal [[in-house or external counsel]] | Confirms the AI Act role and category of each system, reads supplier terms, and decides whether the organisation could be a provider. |
Procurement [[e.g. Procurement Manager]] | Makes sure no AI tool or AI feature is bought or switched on without an intake decision, and puts the AI terms into the contract (ST-1 to ST-8). |
Head of IT [[e.g. Head of IT]] | Connects approved tools to single sign-on, applies the tool's settings and keeps the technical list of what is installed. |
Executive decision-maker [[e.g. Executive Committee, or the management body]] | Decides Tier 3 uses: executive management by default, or the board where the governance structure puts it. Signs as well for a High risk outside appetite (P05). Does not accept a Critical risk as executive management: it goes to the board or its equivalent (P05 RM-04). |
The matrix sets out who is responsible (R), accountable (A), consulted (C) and informed (I) for each of 14 activities. Columns, in order: Lead for AI governance lead; Owner for AI use owner; Dev for application developer; Sec for head of Information Security; Test for independent tester; DPO for data Protection Officer; Legal for legal; Buy for procurement; IT for head of IT; Exec for executive decision-maker.
Activity | Lead | Owner | Dev | Sec | Test | DPO | Legal | Buy | IT | Exec |
|---|---|---|---|---|---|---|---|---|---|---|
LR-01 Keep this standard up to date | C | I | C | A | C | C | C | I | C | I |
LR-02 Describe the feature and draw its data flow | I | A | R | C | C | |||||
LR-03 Select the threats and set the review depth | I | C | C | A | ||||||
LR-04 Complete the configuration checklist | C | R | C | A | ||||||
LR-05 Assess the provider with the questionnaire and put the AI terms in the contract | C | R | R | C | R | A | ||||
LR-06 Test the feature before release | I | C | A | R | ||||||
LR-07 Plan and run a red team test at Depth 3 | I | C | C | A | R | C | I | |||
LR-08 Review an agent's permissions and tool access | C | R | A | C | C | |||||
LR-09 Agree the fix for each finding, which the Head of Information Security has rated | I | A | R | R | ||||||
LR-10 Approve an exception to this standard (the approver its band sets under P02 EX-05) | C | C | A | C | ||||||
LR-11 Convene the release decision after the review; the approvers of RG-6 sign (the executive decision-maker at Depth 3, as in P24 RS-07) | A | C | I | R | C | R | ||||
LR-12 Watch the signals and hand an event to the incident route | I | C | R | A | C | C | R | |||
LR-13 Keep the evidence for each feature | A | R | C | |||||||
LR-14 Switch a feature off when it misbehaves | A | C | R | C | R |
Guidance — delete before approval
Name an owner by role, never a team. The owner is the manager accountable for the business activity the feature supports, not the engineer who switched it on. In a small organisation the same person is often the lead, the owner and the Head of IT. Where that happens, ask someone outside the feature to test it and to read the findings.
Findings and exceptions
A finding is a confirmed gap between a feature and this standard, found in a review, a configuration check, a test or an incident (GS-30). The Head of Information Security rates it on the impact and likelihood scales of the Information Security Risk Management pack, each from 1 to 4, and the band of impact times likelihood is its severity. Each finding has an owner, who agrees the fix, and a due date, and is tracked in the register (AI Security Findings & Exceptions Register). The due date runs from the day the reviewer confirms the finding.
Exceptions. A departure from this standard is requested, rated and approved under the Security Exception & Waiver Standard (P02-A02, Security Exception, Waiver & Segregation of Duties pack), using the Security Exception Request & Approval Form, before the departure begins (GS-30). The approver is the one the finding's band sets. An exception names the requirement, the feature, the reason, the compensating measures and an expiry date, and is recorded in the Security Exception Register. Agreement by email, in a meeting or by a manager is not an exception.
Severity | Impact times likelihood | Finding due within | Exception approved by | Longest exception | Decision within | Renewals the approvers may grant |
|---|---|---|---|---|---|---|
Low | 1–3 | 365 days | Control owner | 365 days | 5 working days | 2 |
Medium | 4–6 | 180 days | Head of Information Security | 180 days | 10 working days | 2 |
High | 8–9 | 90 days | Head of Information Security and Accountable executive | 90 days | 10 working days | 1 |
Critical | 12–16 | 30 days | Board or its equivalent | 30 days | 5 working days | 1 |
The renewals a band shows are the renewals its approvers may grant. A renewal beyond the band's limit goes to the next approval level up (EX-08). A renewal is a new decision.
A Critical exception goes to the board or its equivalent: the board, or a board risk committee it has delegated this to; in a two-tier structure, the management board; where there is no board, such as in an owner-managed company, executive management. The finding's owner is never among the approvers. The decision time is counted in working days from a complete request. Due dates are calendar days.
Release. A release does not go ahead while a Critical finding is open without an exception from the board or its equivalent, or while a High finding is open without an exception from the Head of Information Security and the accountable executive. The LLM Application Security Review Procedure holds the release gates.
No exception. GS-27, AG-05, AG-03 take no exception: a feature never releases a payment or changes a supplier's bank details, and the rules of the AI Security Governance & Acceptable Use pack on special category data and on the practices Article 5 of the EU AI Act prohibits stand. An exception never changes a legal duty. Personal data is protected under data protection law, and an incident is reported, exception or not.
Guidance — delete before approval
EXAMPLE: finding AF-001, rated Medium (impact 2 times likelihood 2), was confirmed on 18 Sep 2026 and due by 17 Mar 2027. Exception AX-001 was requested on 21 Sep 2026, approved on 25 Sep 2026 by the head of Information Security and expires on 29 Jan 2027, inside the 180 days a Medium exception may run.
Review and change
Changing a feature
A change of model, model version, system prompt, tool, retrieval source or filter setting is a change: it goes through the change control that applies to the system, the attack classes it could affect are tested again at the feature's review depth, and the change is recorded. A provider's change of model is a trigger for review within [[10]] working days of the notice (P24 ST-7; AG-10). A model can change under a feature without anyone in the organisation asking for it, so the contract asks for notice (GS-17) and the checklist records how the notice will arrive (DC-28).
A feature already running when this standard is adopted is reviewed within [[90]] calendar days of adoption (GS-28). The depth follows the same rules as for a new feature.
Reviewing the standard
This standard is reviewed at least every [[12]] months (Security Policy Management pack, Standard tier), and sooner when a new edition of the OWASP list or the MITRE ATLAS matrix is published, when an incident shows a gap, or when the law changes (GS-31). The Security Policy Management pack also names these triggers: a major incident, or an incident the document should have prevented; a material change to the organisation's activities, systems or suppliers; a change in law, regulation or a contract the document supports; an audit or assessment finding against the document; a significant change in the threats the document addresses. The review is recorded in the document control table.
Changing the standard. The head of Information Security proposes a change and consults the lead, the owners of live features and Legal. The approver of the standard tier approves it. A change that adds or tightens a requirement says by when features that are already live must meet it. Unless the change says otherwise, a feature already live has [[90]] calendar days from the day the change is approved.
Measures
The AI governance lead reports five measures each period. Each is a count with the gaps named. None is combined into a score or a share.
Measure | What it counts | Target |
|---|---|---|
GM-01 Generative AI features reviewed at their depth | Features on the AI inventory (live or held) that have a completed review at the depth the review procedure gives and a release decision, out of all such features. | All |
GM-02 Configuration checks verified on live features | Applicable configuration checks marked Verified with evidence and a date on features that are live, out of all applicable checks on them. | All |
GM-03 Open High or Critical AI security findings | Findings with a severity of High or Critical that are not Closed and have no approved exception. | Zero |
GM-04 AI security findings past their due date | Findings not Closed and not under a live exception whose due date has passed at the period end. | Zero |
GM-05 Providers with an answered security questionnaire | Outside providers of in-scope features at Depth 2 or 3, who must return the questionnaire (A06), that have returned it, out of all such providers. At Depth 1 the questionnaire is not required. Questions still open on a returned questionnaire are counted separately. | All |
Guidance — delete before approval
EXAMPLE, as at 30 Sep 2026: 2 of 3 generative AI features have a completed review; 27 of 32 configuration checks on live features are verified; 0 High or Critical findings are open without an exception; 0 findings are past their date; 1 of 2 providers have returned the security questionnaire, with 7 questions still open.
Related documents
Document | Relationship |
|---|---|
LLM Application Security Review Procedure | Reviews each feature: the stages, the depth, the evidence and the release gates |
LLM Application Threat Catalogue | The twelve threats, with examples, tests and signals |
Generative AI Deployment Configuration Checklist | The settings to check for a feature, each tied to a requirement |
AI Vendor & Model Provider Security Questionnaire | The questions to put to the provider of the model or the service (GS-15, GS-17) |
AI Red Team Test Plan Template | Plans and records an independent test of the attack classes (GS-28) |
AI Security Findings & Exceptions Register | Records findings and exceptions, with severity and due dates (GS-30) |
AI Agent Permission & Tool-Access Review Checklist | Reviews the tools, permissions and approvals of an agent (GS-22 to GS-27) |
AI Acceptable Use & Security Policy; AI Use Case Intake & Approval Procedure | Which AI may be used, the intake that gives each use its tier, and the rules on who approves; AI Security Governance & Acceptable Use pack |
AI System & Use Case Inventory; AI Tool Approval & Data Permission Matrix | The inventory of AI uses and the approved tools with the data each may take (GS-01, GS-08, GS-15) |
Risk Assessment Methodology & Scoring Model | The impact and likelihood scales and the bands that rate a finding; Information Security Risk Management pack |
Security Exception & Waiver Standard; Security Exception Register | The route for every exception to this standard (GS-30); Security Exception, Waiver & Segregation of Duties pack |
Third-Party Security Policy; Supplier Contract Security Clause Library | Assessing an AI supplier and the contract clauses (GS-17); Third-Party Security Risk Management pack |
Security Incident Management Policy | Reporting an event, deciding whether it is an incident and preserving evidence (GS-20); Security Incident Management pack |
Regulatory Notification Operating Procedure | The reporting duties and clocks the incident pack applies; Regulatory Incident Notification & Reporting pack |
Control Testing Methodology | Independence of the tester and the days to remedy a deficiency (GS-28, GS-30); Security Control Assurance pack |
[[Information Security Policy; secure development and change management standards; privacy policy]] | [[Parent policy; change control that applies to the system (GS-18); whether processing personal data is lawful]] |
Definitions
Term | Meaning in this standard |
|---|---|
AI system | A machine-based system that infers from the input it receives how to generate outputs such as predictions, content, recommendations or decisions (EU AI Act Article 3(1)). A chat assistant, an image generator, a forecasting feature and a spam filter that learns are all AI systems. A fixed formula is not. |
Deployer | An organisation that uses an AI system under its own authority for its business (EU AI Act Article 3(4)). Most organisations are deployers of the AI they use. |
Feature | One LLM capability the organisation uses, builds or has switched on, for one purpose, with one owner. A feature is the technical view of a P24 use. |
Untrusted content | Any content the feature reads that came from outside the organisation or from a person who can submit text: customers' messages, supplier documents, inbound email, web pages, tickets, public files, and the output of a tool that fetches such things. |
Prompt injection | Content that changes what the model does, in a way its builder did not intend. It is direct when the user types it and indirect when the model reads it in a document, web page, email, tool result or retrieved passage. |
Agent | A feature in which the model chooses which tools to call and in what order, with tool results fed back to it. An agent can act, so P24 treats a system that acts as Tier 3 until assessed (AG-16). |
Exception | A recorded, time-limited approval to depart from a requirement, made under P02 and approved by the approver the finding's band sets. |
Document control
Approval record
Version | Approved by | Date | Evidence of approval | Next review by |
|---|---|---|---|---|
[[1.0]] | [[Head of Information Security]] | [[YYYY-MM-DD]] | [[e.g. signed approval record, reference]] | [[YYYY-MM-DD]] |
Review. See Review and change. This standard is reviewed at least every 12 months (GS-31).
Guidance — delete before approval
This is a Standard-tier document: approved by the Head of Information Security. Nobody approves a document they own or wrote: if the owner is the Head of Information Security, executive management approves it (Security Policy Management pack, PF-03).
Worked example: the first three weeks
EXAMPLE, not part of the standard. The organisation is the one used throughout the pack: a wholesale distributor with about 900 staff, three warehouses and an online ordering service that takes 60% of its orders, an important entity under NIS2 in its Member State. Replace it with your own, or delete this section before approval.
The standard was approved on 8 Sep 2026 by the Executive Committee. The Head of Information Security owns the standard, and nobody approves a document they own or wrote (P04 PF-03), so the Executive Committee approves it. The three generative uses on the P24 inventory: AI-001, AI-003 and AI-004. AI-002 (forecasting) and AI-006 (anomaly detection) are not generative. AI-005 was stopped and AI-007 declined under P24. Features already running have until 7 Dec 2026 for their first review.
Feature | Depth | Configuration checks | Release decision |
|---|---|---|---|
LF-1 Draft and summarise with the office-suite assistant AI-001, live | Depth 2 | 14 of 17 applicable checks verified; 0 failed, 3 not verified | Release with conditions |
LF-2 Image generator in the design tool AI-004, live | Depth 1 | 13 of 15 applicable checks verified; 0 failed, 2 not verified | Release with conditions |
LF-3 Customer-service chatbot proposed by the contact centre AI-003, held | Depth 3 | 0 of 21 applicable checks verified; 0 failed, 21 not verified | Hold Held by RG-1 and RG-2 and RG-5 and RG-6 |
The position for the leadership team: 2 of 3 generative AI features have a completed review; 27 of 32 configuration checks on live features are verified; 0 High or Critical findings are open without an exception; 0 findings are past their date; 1 of 2 providers have returned the security questionnaire, with 7 questions still open.
Guidance — delete before approval
LF-1 reads documents that suppliers send, so the review treats that content as untrusted, and the finding AF-001 came from a planted line in a test copy. LF-3 is held under P24, so its review waits for the questionnaire and a red team test. Its 4 gates hold the release until the evidence is on file.
Adapting this template
Small organisation
Guidance — delete before approval
Keep all 31 requirements. Most small organisations buy LLM features and do not build them, so begin with the configuration checklist (A05) and the provider questionnaire (A06), and treat each requirement about code as a question to the supplier. Begin with the features already in use: ask every team what they use, on any account.
One person may be the AI governance lead, the owner and the Head of IT. Keep a short written record of each release decision, and ask a colleague who does not own the feature to run the Depth 3 tests.
Regulated entity (NIS2, DORA, GDPR, EU AI Act)
Guidance — delete before approval
An essential or important entity under NIS2 and a financial entity under DORA keep the same requirements and check with counsel whether their own sector rules ask for more about AI, third-party arrangements and incident reporting. The incident pack and the regulatory reporting pack hold the reporting duties and clocks. This standard restates none of them.
Under the GDPR, a feature that puts personal data into a model needs data protection by design and by default (GS-08). Involve the Data Protection Officer at Depth 2 and above. If any feature may fall in an area of Annex III of the EU AI Act, ask counsel to read the review before the feature starts: the deployer duties of Article 26 start from 2 December 2027 for those systems, and a feature bought now will still be in use then.
IT and services run by suppliers
Guidance — delete before approval
Your managed IT provider, cloud providers and any other outsourced service provider may already use LLM features on your data. Ask each for the features it uses, the model and version, and notice before it changes either (P24 ST-7). The AI governance lead stays accountable. Send the questionnaire (A06) to each provider and put the AI terms ST-1 to ST-8 into the contract with the clauses of the Supplier Contract Security Clause Library.
Delete this section before approval.
Framework references
These references show where this document supports an external framework. They indicate relevance only and do not reproduce the text of any standard. Editions referenced: Regulation (EU) 2024/1689 (the EU AI Act) as amended by Regulation (EU) 2026/1744; Regulation (EU) 2016/679 (GDPR); OWASP Top 10 for LLM Applications, 2026 edition; MITRE ATLAS 2026.09; NIST AI 600-1; NIST AI RMF 1.0; NIST CSF 2.0; ISO/IEC 27001:2022 incl. Amd 1:2024; ISO/IEC 42001:2023 (by number and title only); as published and read on 8 October 2026.
Framework | Reference | Supported by |
|---|---|---|
ISO/IEC 27001:2022 | Annex A 8.26 — Application security requirements | Requirements and Data exposure: application security requirements for an LLM feature |
ISO/IEC 27001:2022 | Annex A 8.25 — Secure development life cycle | Testing and Change control: a secure development life cycle applied to the feature |
ISO/IEC 42001:2023 | Annex A 2.3 — Alignment with other organizational policies | Scope and Related documents: how this standard sits with the AI governance rules and the security policies |
ISO/IEC 42001:2023 | Annex A 9.2 — Processes for responsible use of AI systems | How this standard works and Testing: the processes for the use of an AI system, including review before release |
ISO/IEC 42001:2023 | Annex A 9.4 — Intended use of the AI system | Scope and Requirements: the intended use of a feature is recorded and its limits are set (GS-01, GS-03) |
NIST CSF 2.0 | PR.PS-06 — “Secure software development practices are integrated, and their performance is monitored throughout the software development life cycle” | The whole standard: secure development practices applied to an LLM feature through its life cycle |
EU AI Act — Regulation (EU) 2024/1689 | Article 15(1) — high-risk AI systems “shall be designed and developed in such a way that they achieve an appropriate level of accuracy, robustness, and cybersecurity, and that they perform consistently in those respects throughout their lifecycle”. The Article is a requirement on high-risk systems, which providers meet; it applies to Annex III systems from 2 December 2027 (Article 113 as amended) | Purpose and Exceptions: the Act's own statement of the security a high-risk system needs, used here as a benchmark. It binds providers, not this organisation |
EU AI Act — Regulation (EU) 2024/1689 | Article 15(5) — high-risk systems “shall be resilient against attempts by unauthorised third parties to alter their use, outputs or performance by exploiting system vulnerabilities”; the technical solutions for AI-specific vulnerabilities “shall include, where appropriate, measures to prevent, detect, respond to, resolve and control for attacks trying to manipulate the training data set (data poisoning), or pre-trained components used in training (model poisoning), inputs designed to cause the AI model to make a mistake (adversarial examples or model evasion), confidentiality attacks or model flaws” | Threats and Testing: the kinds of attack the Act names for AI systems, such as data poisoning and confidentiality attacks (GS-13, GS-28) |
EU AI Act — Regulation (EU) 2024/1689 | Article 26(1) — deployers of high-risk AI systems “shall take appropriate technical and organisational measures to ensure they use such systems in accordance with the instructions for use accompanying the systems”. The obligations of Article 26 applies from 2 December 2027 to systems classified as high-risk under Article 6(2) and Annex III, and from 2 August 2028 to those under Article 6(1) and Annex I (Article 113, third paragraph, point (c), as amended by Regulation (EU) 2026/1744) | Scope: a deployer of a high-risk system uses it as its instructions say, from 2 December 2027 for Annex III systems (GS-01) |
EU AI Act — Regulation (EU) 2024/1689 | Article 26(5) — deployers monitor the operation of the high-risk system on the basis of the instructions for use; where they have reason to consider that use may present a risk within the meaning of Article 79(1) they inform the provider or distributor and the market surveillance authority “without undue delay” and suspend use; where they identify a serious incident they “immediately inform first the provider, and then the importer or distributor and the relevant market surveillance authorities” | Monitoring: a deployer monitors the operation of a high-risk system and acts on a risk or an incident (GS-20) |
EU AI Act — Regulation (EU) 2024/1689 | Article 26(6) — deployers keep the logs automatically generated by the high-risk system, to the extent the logs are under their control, “for a period appropriate to the intended purpose of the high-risk AI system, of at least six months, unless provided otherwise in applicable Union or national law, in particular in Union law on the protection of personal data” | Logging: a deployer keeps the logs it controls for at least six months (GS-19) |
EU AI Act — Regulation (EU) 2024/1689 | Article 50(1) — providers ensure that AI systems intended to interact directly with natural persons are designed so that the persons are informed that they are interacting with an AI system, “unless this is obvious from the point of view of a natural person who is reasonably well-informed, observant and circumspect” | Scope: providers of a system meant to interact with people design it so the people are told they are dealing with AI; P24 holds the disclosure rule (AG-08) |
EU AI Act — Regulation (EU) 2024/1689 | Article 113, as amended — the Regulation applies from 2 August 2026, except that Chapters I and II (including Articles 4 and 5) apply from 2 February 2025, with Article 5(1) points (ba) and (bb) and Article 5(1a) and (1b) applying from 2 December 2026; Chapter III Section 4, Chapter V (general-purpose AI models), Chapter VII and Chapter XII and Article 78 apply from 2 August 2025, except Article 101; and Chapter III Sections 1, 2 and 3, except Article 6(5), apply from 2 December 2027 as regards systems classified as high-risk under Article 6(2) and Annex III, and from 2 August 2028 as regards those under Article 6(1) and Annex I. Article 50 is not listed in an exception and so applies from 2 August 2026 | Scope: the dates from which the Act applies, as amended |
EU AI Act — Regulation (EU) 2026/1744 (Digital Omnibus on AI) | Regulation (EU) 2026/1744 of 8 July 2026 amending Regulations (EU) 2024/1689, (EU) 2018/1139 and (EU) 2023/1230 as regards the simplification of the implementation of harmonised rules on artificial intelligence (Official Journal, 24 July 2026); in force on the third day after publication (its Article 4), 27 July 2026. Its Article 1 amends Regulation (EU) 2024/1689 | Scope: the amending Regulation (EU) 2026/1744, which changes some of those dates |
GDPR — Regulation (EU) 2016/679 | Article 25(1) — the controller, “both at the time of the determination of the means for processing and at the time of the processing itself”, implements appropriate technical and organisational measures, such as pseudonymisation, “designed to implement data-protection principles, such as data minimisation, in an effective manner”, taking into account the state of the art, the cost, the nature, scope, context and purposes of processing and the risks to people | Data exposure: data protection by design when the means of processing are chosen (GS-08) |
GDPR — Regulation (EU) 2016/679 | Article 25(2) — the controller implements measures so that, “by default, only personal data which are necessary for each specific purpose of the processing are processed”; this covers the amount collected, the extent of processing, the period of storage and accessibility, and by default personal data are not made accessible “without the individual’s intervention to an indefinite number of natural persons” | Data exposure: only the personal data needed for each purpose, by default (GS-08) |
GDPR — Regulation (EU) 2016/679 | Article 32(1) — appropriate technical and organisational measures to ensure a level of security appropriate to the risk, taking into account the likelihood and severity of risk to people's rights and freedoms | Requirements: security of processing that suits the risk, for any feature that handles personal data (GS-02 to GS-27) |
GDPR — Regulation (EU) 2016/679 | Article 32(2) — in assessing the appropriate level of security, account is taken of the risks presented by processing | Findings: the risks that processing presents are taken into account when the level of security is judged (GS-30) |
GDPR — Regulation (EU) 2016/679 | Article 5(1)(c) — personal data shall be “adequate, relevant and limited to what is necessary in relation to the purposes for which they are processed (‘data minimisation’)” | Data exposure: personal data limited to what is necessary (GS-08) |
GDPR — Regulation (EU) 2016/679 | Article 5(1)(f) — personal data shall be “processed in a manner that ensures appropriate security of the personal data, including protection against unauthorised or unlawful processing and against accidental loss, destruction or damage, using appropriate technical or organisational measures (‘integrity and confidentiality’)” | Logging and Secrets: personal data processed with appropriate security (GS-10, GS-19) |
NIS2 — Directive (EU) 2022/2555 | Article 21(2)(e) — “security in network and information systems acquisition, development and maintenance, including vulnerability handling and disclosure” | Testing and Change control: security in the development and maintenance of systems, including handling of vulnerabilities (GS-18, GS-28) |
NIS2 — Directive (EU) 2022/2555 | Article 21(2)(i) — “human resources security, access control policies and asset management” | Agents and tools: access control policies and asset management (GS-22, GS-23) |
NCSC blog (8 December 2025) | NCSC, “Prompt injection is not SQL injection (it may be worse)”, Dave Chismon, 8 December 2025: “As there is no inherent distinction between ‘data’ and ‘instruction’, it’s very possible that prompt injection attacks may never be totally mitigated in the way that SQL injection attacks can be.” It suggests viewing prompt injection as an exploitation of an “inherently confusable deputy” and says “If the system’s security cannot tolerate the remaining risk, it may not be a good use case for LLMs.” | How this standard works and GS-02: prompt injection may never be fully removed, so the design limits what a success can do |
Guidelines for secure AI system development (NCSC, CISA and partners) | Secure operation and maintenance, “Monitor your system’s inputs” — “you monitor and log inputs to your system (such as inference requests, queries or prompts) to enable compliance obligations, audit, investigation and remediation in the case of compromise or misuse”, in line with privacy and data protection requirements | Logging and Monitoring: monitor and log inputs so that audit, investigation and remediation are possible (GS-19, GS-20) |
NIST SP 800-218A | NIST SP 800-218A, Secure Software Development Practices for Generative AI and Dual-Use Foundation Models: An SSDF Community Profile, final, 26 July 2024: it extends the Secure Software Development Framework with “practices, tasks, recommendations, considerations, notes, and informative references that are specific to AI model development throughout the software development life cycle”, for AI model producers, AI system developers who use those models, and acquirers of AI systems. Cited by number, title and abstract | Requirements: secure software development practices for generative AI, cited by number and title only |
NIST AI RMF 1.0 | MEASURE 2.7 — “AI system security and resilience – as identified in the MAP function – are evaluated and documented.” | Testing: AI system security and resilience are evaluated and documented (GS-28) |
NIST AI RMF 1.0 | MANAGE 4.1 — “Post-deployment AI system monitoring plans are implemented, including mechanisms for capturing and evaluating input from users and other relevant AI actors, appeal and override, decommissioning, incident response, recovery, and change management.” | Monitoring and Review and change: monitoring plans after deployment, with change management (GS-18, GS-20) |
OWASP Top 10 for LLM Applications 2026 | OWASP GenAI Security Project, OWASP Top 10 for Large Language Model Applications, version 2026, published August 2026: LLM01 Prompt Injection, LLM02 Sensitive Information Disclosure, LLM03 Excessive Agency, LLM04 Supply Chain, LLM05 Data and Model Poisoning, LLM06 Unbounded Consumption, LLM07 Misinformation, LLM08 Hidden Context Exposure, LLM09 Vector and Embedding Weaknesses, LLM10 Improper Output Handling. A community awareness document, weighted about three-quarters on a community vote and one-quarter on incident data, that states its own limits; it replaces the 2025 edition | Threats: the ten classes of the 2026 edition, each answered by a threat LT-01 to LT-12 (see Threats this standard answers) |
ISO/IEC 27001 and ISO/IEC 42001 references name the clause or control this document relates to, by number and title only. ISO/IEC 42001 is a paid standard whose text was not read for this document. A reference does not say that meeting a clause or control meets any requirement of the EU AI Act or the GDPR.
This pack does not say which OWASP, MITRE ATLAS, NIST or ISO/IEC 42001 items meet a requirement of the EU AI Act or the GDPR. Each reference says what its source asks for and which CISO Times document helps with that work. Using a document does not by itself show that a requirement is met.