Before an agent touches your systems.
An AI agent is only as safe as the access it is given and the checks around it. Before connecting one to email, files, a CRM, or a finance system, settle twenty questions about permissions, data flows, prompt injection, provider terms, actions, logging, and who responds when something goes wrong. Here they are, grouped in six areas, with what a good answer looks like.
Access and permissions
- Does the agent have its own identity? A dedicated service account per system, never a person’s login, so access can be scoped, logged, and revoked on its own.
- Is every permission the least it needs? Read, propose, and write are separate grants. A folder, not the drive. A mailbox label, not the mailbox.
- Which writes wait for a person? Send, file, pay, delete, and changes to customer data sit behind an approval gate unless the action is reversible and the owner agreed otherwise in writing.
- How is access revoked? A written step to remove credentials and integrations when the pilot ends, a person leaves, or the scope changes.
Data flow and retention
- What reaches the model provider? List the fields and documents sent with each request. Redact what the task does not need.
- Is the data used for training? Check the provider’s business or API terms and the account setting, record the answer, and re-check when plans or providers change.
- Where is it processed and how long is it kept? Provider, hosting, integration platform, logs, and backups each have a location and a retention period. Write them down.
- Who can see the logs? Traces often contain the same data as the request. Restrict them like the source.
Prompt injection and untrusted content
Prompt injection is when content the agent reads (an email, a web page, a PDF) contains instructions that try to override its rules. OWASP ranks it first in its Top 10 for LLM applications. It is not exotic; it is any document written by someone who is not you.
- Is retrieved content treated as data, never as instructions? The agent’s rules come from its system prompt and configuration, not from whatever it reads.
- Are tools allow-listed per task? A triage agent does not need a tool that sends money. Fewer tools, fewer ways to be redirected.
- Does the agent confirm before acting on instructions found in content? “The invoice says to update the bank details” is a stop rule, not an action.
- Have you tested with injected inputs? Put hostile documents in the test set: hidden text, contradictory instructions, requests to reveal other records.
Actions and money
- Are actions idempotent? A retry after a timeout must not create a second record, email, or payment.
- Are there thresholds and rate limits? Amounts, counts per hour, and recipients outside the organization each have a ceiling that routes to a person.
- Is there a dry-run mode? The workflow can run end to end and show what it would do without doing it. Use it for every change.
- Is there a kill switch? One documented step stops the workflow, and the owner knows where it is.
Logging and audit
- Does every result record who asked, which sources were used, what was proposed, and who approved? That record is the audit trail and the raw material for the next test set.
- Can you reproduce a decision? Model, prompt version, source versions, and tool calls are recorded so a disputed result can be replayed.
Operations and incidents
- Who is on the launch checklist? Named people monitor failures, receive alerts, investigate incidents, maintain dependencies, and approve changes. Support coverage is written into the agreement.
- What happens when the provider changes? Model deprecations, price changes, and term updates are routine. A rerun of the test set and a review of the data terms are the standing response.
None of these questions requires a certification to answer. They require a written scope, which is what the security and data page describes and what we agree before access is shared.
Sources
External references used in this guide. Figures are quoted with their original baseline; none is a measurement of our own work.