Skip to content

Commit ef0c6ba

Browse files
cemini23cursoragent
andcommitted
Ingest agentic red-team security audit (2606.24496) + brief reference check.
Adds kill-chain concept for offensive LLM agents and agent-phishing eval; K116 addendum on Tier-2 architecture. Brief audit: 37/38 wiki refs resolve on disk. Co-authored-by: Cursor <cursoragent@cursor.com>
1 parent f240e72 commit ef0c6ba

17 files changed

Lines changed: 443 additions & 9 deletions

wiki/concepts/agent-runtime-guardrails.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -83,9 +83,11 @@ related:
8383
- concepts/lingering-authority-revocable-capabilities.md
8484
- sources/arxiv-2606-22916-intent-governed-tool-authorization-igac.md
8585
- concepts/intent-governed-tool-authorization.md
86+
- sources/arxiv-2606-24496-red-teaming-the-agentic-red-team.md
87+
- concepts/agentic-offensive-security-kill-chain.md
8688
maturity: draft
8789
created: 2026-06-01
88-
updated: 2026-06-24
90+
updated: 2026-06-25
8991
---
9092

9193
# Agent runtime guardrails — attack surfaces + enforcement paradigms
@@ -158,6 +160,8 @@ Tool-using agents (MCP, shell, APIs, email) shift the security problem from **re
158160
| **Lingering authority** | Subgoal-closed capability still visible in planner manifest | PORTICO 2606.22504 |
159161
| **Intent-scope mismatch** | Static credential authorizes tool call unjustified by current user request | IGAC 2606.22916 |
160162
| **Runtime implementation flaws** | Parser/dispatcher/memory-writer bugs in local agent source | CLAWAUDIT 2606.21071 |
163+
| **Agent-phishing (offensive agent)** | Trojanized target artifact → download+execute without prompt injection | 2606.24496 |
164+
| **Worker→orchestrator escalation** | Compromised worker reaches orchestrator secrets/APIs | 2606.24496 |
161165
| **Semantic decoupling** | Natural-language intent hides unsafe tool args from LLM-as-Judge guards | ePCA motivation |
162166

163167
These are **not jailbreaks** in the classic sense — the model may comply with user intent while attacker-controlled context steers authorized access off-scope. [CONFIRMED] across AIRGuard + sleeper paper framing.

wiki/concepts/agent-vm-sandboxing.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -16,9 +16,11 @@ related:
1616
- concepts/agent-execution-provenance.md
1717
- sources/arxiv-2606-04990-agent-traces-evidence-provenance.md
1818
- entities/tools/defending-code-reference-harness.md
19+
- sources/arxiv-2606-24496-red-teaming-the-agentic-red-team.md
20+
- concepts/agentic-offensive-security-kill-chain.md
1921
maturity: validated
2022
created: 2026-05-13
21-
updated: 2026-06-07
23+
updated: 2026-06-25
2224
---
2325

2426
## Relations
Lines changed: 97 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,97 @@
1+
---
2+
title: Agentic offensive-security kill chain
3+
type: concept
4+
tags: [concept, agent-security, red-team, llm-pentest, kill-chain, agent-phishing, sandbox]
5+
keywords: [agentic red team, agent-phishing, worker orchestrator separation, 2606.24496, offensive security agents]
6+
related:
7+
- sources/arxiv-2606-24496-red-teaming-the-agentic-red-team.md
8+
- concepts/llm-pentest-automation.md
9+
- concepts/agent-runtime-guardrails.md
10+
- concepts/red-team-operations.md
11+
- concepts/agent-vm-sandboxing.md
12+
- concepts/docker-agent-sandbox-allowlist-proxy.md
13+
- concepts/ai-for-cybersecurity.md
14+
- entities/tools/airecon.md
15+
- entities/tools/pentest-ai-agents.md
16+
- entities/tools/pentest-ai.md
17+
- entities/tools/iron-proxy.md
18+
- sources/arxiv-zero-apt-llm-pentest-2606.05567-2026-06-05.md
19+
- concepts/mcp-security-posture.md
20+
21+
maturity: draft
22+
created: 2026-06-25
23+
updated: 2026-06-25
24+
---
25+
26+
## Relations
27+
28+
- @sources/arxiv-2606-24496-red-teaming-the-agentic-red-team.md — primary audit (2606.24496)
29+
- @concepts/llm-pentest-automation.md — Tier-2 deployment methodology
30+
- @concepts/agent-vm-sandboxing.md — substrate isolation complement
31+
32+
## Raw Concept
33+
34+
Ingest 2026-06-25: arXiv:2606.24496 — security model for **agentic offensive-security tools** when the engagement target is adversarial (honeypot / active defender).
35+
36+
## Narrative
37+
38+
### Architecture abstraction
39+
40+
```
41+
Orchestrator (secrets, memory, skills, UI, high-privilege APIs)
42+
↔ Agent harness / guardrails
43+
Worker (bash runtime, tool execution) ← treat as UNTRUSTED after any target contact
44+
Target T (adversary-controlled during pentest)
45+
```
46+
47+
### Kill chain stages
48+
49+
| Stage | Objective |
50+
|-------|-----------|
51+
| **LLM manipulation** | Agent-phishing: staged artifact on `T` → download + execute gates |
52+
| **Worker RCE** | Trojanized binary/config (cfgunpack, db-restore, pwcrypt patterns) |
53+
| **Lateral movement** | Worker → orchestrator (shared API keys, host-network, docker.sock) |
54+
| **Secrets exfil** | LLM API keys, Cobalt Strike tokens, cross-session findings |
55+
| **Persistence** | Skill injection via unauthenticated internal APIs (RedAmon-class) |
56+
| **Guardrail bypass** | CAI/xalgorix guardrails fail under active adversary model |
57+
| **Sandbox escape** | Privileged Docker, `--network=host`, orchestrator exec from worker message |
58+
59+
### Agent-phishing (prompt-injection-free)
60+
61+
1. Craft payload with hidden malicious functionality (plausible offensive artifact)
62+
2. Stage on honeypot as **critical artifact** for operation progress
63+
3. Agent downloads + executes after inspection → RCE
64+
65+
**97.8%** success across 8 agents × 6 frontier LLMs (2606.24496 Table 3). Relies on **download gate** + **execute gate**, not injected prompts.
66+
67+
### Landscape audit (Table 1 summary)
68+
69+
10/12 tools: deterministic worker RCE + secrets exfil + host compromise path. Failures: **STRIX** (no reliable chain), **Artemis** (limited). **METATRON / nebula / xalgorix**: no OS sandbox — host compromise immediate.
70+
71+
### Secure design principles (§9 steal-from)
72+
73+
| Principle | Implementation |
74+
|-----------|----------------|
75+
| **Malicious worker model** | Assume worker compromise after target engagement |
76+
| **No secrets in worker** | API keys on orchestrator; proxy tool calls |
77+
| **Least-privilege Docker** | No docker.sock, no `--network=host`, no privileged unless scoped |
78+
| **Worker↔orchestrator isolation** | No shared blanket API keys; per-user authZ on internal APIs |
79+
| **Orchestrator-enforced guardrails** | Deny lists ineffective if only worker-side |
80+
| **Egress proxy + human gate** | High-impact actions require orchestrator approval |
81+
82+
Pairs with @concepts/llm-pentest-automation.md Tier-2 scope gates — **scope ≠ sandbox security**.
83+
84+
See `briefs/2026-06-25_agentic-red-team-secure-architecture-handoff.md` and `briefs/2026-06-25_agent-phishing-tier2-eval-checklist.md`.
85+
86+
`[TENTATIVE]` — audit covers default configs of 12 OSS tools; hardened deployments not measured.
87+
88+
## Snippets
89+
90+
| Agent | Notable misconfig (2606.24496) |
91+
|-------|-------------------------------|
92+
| AIRecon | `--network=host` → orchestrator API abuse |
93+
| CAI / PentAGI | docker.sock mount |
94+
| RedAmon | Shared internal API key, no per-user checks |
95+
| PentestGPT | `python_session` runs on host orchestrator |
96+
97+
[Source: arxiv-2606.24496]

wiki/concepts/ai-for-cybersecurity.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -77,9 +77,11 @@ related:
7777
- concepts/intent-governed-tool-authorization.md
7878
- sources/arxiv-2606-21377-arena-autonomous-defense-transferability.md
7979
- concepts/autonomous-defense-agent-transferability.md
80+
- sources/arxiv-2606-24496-red-teaming-the-agentic-red-team.md
81+
- concepts/agentic-offensive-security-kill-chain.md
8082
maturity: draft
8183
created: 2026-05-12
82-
updated: 2026-06-24
84+
updated: 2026-06-25
8385
---
8486

8587
## Relations

wiki/concepts/docker-agent-sandbox-allowlist-proxy.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -12,6 +12,8 @@ related:
1212
- concepts/agent-runtime-guardrails.md
1313
- concepts/exploit-development.md
1414
- concepts/agent-skill-injection.md
15+
- concepts/agentic-offensive-security-kill-chain.md
16+
1517
maturity: draft
1618
created: 2026-06-06
1719
updated: 2026-06-06

wiki/concepts/llm-pentest-automation.md

Lines changed: 9 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -38,9 +38,13 @@ related:
3838
- sources/arxiv-zero-apt-llm-pentest-2606.05567-2026-06-05.md
3939
- sources/arxiv-2606-07158-synthetic-apts-ttp-attribution-collapse.md
4040
- concepts/mcp-security-posture.md
41+
- sources/arxiv-2606-24496-red-teaming-the-agentic-red-team.md
42+
- concepts/agentic-offensive-security-kill-chain.md
43+
- entities/tools/airecon.md
44+
4145
maturity: validated
4246
created: 2026-05-13
43-
updated: 2026-06-09
47+
updated: 2026-06-25
4448
---
4549

4650
## Relations
@@ -89,6 +93,10 @@ The split is the safety contract: Tier 1 is "LLM as research assistant" — usef
8993

9094
@sources/arxiv-zero-apt-llm-pentest-2606.05567-2026-06-05.md argues Tier-2 benchmarks must include a **live Defender** (Sysmon + ELK + configurable LLM monitor), not static VMs. ZERO-APT's Attacker–Defender–Judge loop reports **79% ASR** vs Aurora **22%** and PentestGPT **39%** on Windows post-exploit scenarios — high causal-consistency scores alone do not survive adaptive defense. Steal for lab design: mechanical action preconditions + judge-audited CTI reports alongside scope gates. See also @concepts/mcp-security-posture.md for MCP-side trust layers.
9195

96+
### Agentic red-team security (2606.24496 — K116)
97+
98+
Offensive agents face **reverse red-team** when targets are adversarial: **agent-phishing** achieves **97.8%** worker compromise without prompt injection (staged cfgunpack/db-restore/pwcrypt honeypots). **10/12** audited OSS pentest agents allow secrets exfil + host escape via docker.sock, `--network=host`, shared orchestrator keys. Tier-2 methodology must add **malicious-worker architecture** (secrets on orchestrator, proxied tools, least-privilege Docker) — scope gates alone insufficient. See @concepts/agentic-offensive-security-kill-chain.md and `briefs/2026-06-25_agentic-red-team-secure-architecture-handoff.md`.
99+
92100
### Scope-enforcement model
93101

94102
Tier 2 agents declare a `requires_scope: true` flag in their YAML. The runtime (Claude Code, in the reference implementation) prompts for explicit scope before invocation. The agent's allowed-targets parameter is templated against the engagement scope: `allowed_targets: ["{{ engagement.scope_cidrs }}"]`. [CONFIRMED]

wiki/concepts/mcp-security-posture.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -60,9 +60,11 @@ related:
6060
- sources/arxiv-2606-21071-clawaudit-local-agent-runtime-audit.md
6161
- concepts/local-agent-runtime-audit.md
6262
- entities/tools/clawaudit.md
63+
- sources/arxiv-2606-24496-red-teaming-the-agentic-red-team.md
64+
- concepts/agentic-offensive-security-kill-chain.md
6365
maturity: validated
6466
created: 2026-06-05
65-
updated: 2026-06-24
67+
updated: 2026-06-25
6668
---
6769

6870
## Relations
@@ -171,3 +173,5 @@ Attestation blocks **unauthorized tools** before `tools/call`. DCI asks whether
171173
**IGAC (2606.22916)** — server-side intent certificates + manifest narrowing; static OpenPort still allowed **85.71%** of high-risk requests. Sits above admission, before planner. **Reference**. See @concepts/intent-governed-tool-authorization.md and `briefs/2026-06-24_igac-intent-governed-tool-auth-handoff.md`.
172174

173175
**Local runtime audit (2606.21071)** — CLAWAUDIT Semgrep/CodeQL on OpenClaw source (**66.8% / 75.1%** recall vs baselines); complements scanner-only posture. Phase-0 **CONDITIONAL-GO** (`SRestLabUB/ClawAudit`, no LICENSE file). See @concepts/local-agent-runtime-audit.md and `briefs/2026-06-24_clawaudit-openclaw-runtime-audit-checklist.md`.
176+
177+
**Agentic red-team reverse-audit (2606.24496)** — 10/12 OSS pentest agents compromised via **agent-phishing** (97.8% honeypot success, no prompt injection). Worker-as-malicious architecture required: secrets on orchestrator, no docker.sock/`--network=host`. See @concepts/agentic-offensive-security-kill-chain.md and `briefs/2026-06-25_agentic-red-team-secure-architecture-handoff.md`.

wiki/concepts/red-team-operations.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -80,9 +80,11 @@ related:
8080
- entities/tools/osmedeus.md
8181
- entities/tools/offensive-claude.md
8282
- sources/arxiv-zero-apt-llm-pentest-2606.05567-2026-06-05.md
83+
- sources/arxiv-2606-24496-red-teaming-the-agentic-red-team.md
84+
- concepts/agentic-offensive-security-kill-chain.md
8385
maturity: validated
8486
created: 2026-05-12
85-
updated: 2026-05-31
87+
updated: 2026-06-25
8688
---
8789

8890
## Relations

wiki/entities/tools/airecon.md

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,9 +7,13 @@ related:
77
- "@osint-wiki/entities/tools/airecon.md"
88
- "@osint-wiki/sources/evaluating-project-links-systems-2-2026-05-12.md"
99
- concepts/llm-vulnerability-discovery.md
10+
- sources/arxiv-2606-24496-red-teaming-the-agentic-red-team.md
11+
- concepts/agentic-offensive-security-kill-chain.md
12+
- concepts/llm-pentest-automation.md
1013
maturity: draft
1114
created: 2026-05-12
12-
updated: 2026-05-12
15+
updated: 2026-06-25
16+
phase_0_verdict: "CONDITIONAL-GO 2026-06-25 — 2606.24496 flags --network=host worker + orchestrator API abuse; re-audit before Tier-2 adoption"
1317
osint_eval_origin: doc2-url-6 (cross-routed from OSINT eval as cybersec-primary)
1418
---
1519

@@ -29,6 +33,8 @@ osint_eval_origin: doc2-url-6 (cross-routed from OSINT eval as cybersec-primary)
2933

3034
Autonomous pentest agent — LLM orchestrates recon + scan + exploit + post-exploit phases with a persistent state machine tracking discoveries. The **pentest-state pattern** is the methodologically interesting bit: explicit state transitions gate next-action selection, preventing the random-step LLM behavior common in early autonomous-agent attempts.
3135

36+
**2606.24496 audit:** AIRecon worker granted `--network=host` among other caps — sandbox escape via orchestrator API (`/api/chat` + host-executed `python_session` pattern). See @concepts/agentic-offensive-security-kill-chain.md before Tier-2 deployment.
37+
3238
### Phase-0 audit pending
3339

3440
Verify maturity (stars, commits, recency), supported recon targets, integration with existing scanner toolchain. File deeper eval after Phase-0.

wiki/entities/tools/iron-proxy.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -14,6 +14,8 @@ related:
1414
- concepts/agent-runtime-guardrails.md
1515
- concepts/docker-agent-sandbox-allowlist-proxy.md
1616
- entities/tools/defending-code-reference-harness.md
17+
- concepts/agentic-offensive-security-kill-chain.md
18+
1719
maturity: draft
1820
created: 2026-05-26
1921
updated: 2026-06-01

0 commit comments

Comments
 (0)