Skip to content

Commit 76a6d83

Browse files
cemini23cursoragent
andcommitted
Ingest five arXiv papers (20610–23075): OSINT LoC, DEFENGRAPH, PI calibration, CITADEL stub, MLAS self-evolution.
Phase-0 reference verdicts on DEFENGRAPH/picalib; archive-only CITADEL; bidirectional lint clean. Co-authored-by: Cursor <cursoragent@cursor.com>
1 parent e0edd97 commit 76a6d83

36 files changed

Lines changed: 872 additions & 17 deletions

wiki/concepts/6g-cps-closed-loop-security.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -15,6 +15,7 @@ related:
1515
- entities/frameworks/mitre-attack.md
1616
- sources/arxiv-2606-05252-bas-to-siem-detection-as-code-synthesis.md
1717
- sources/arxiv-2606-18734-point-cloud-wireless-channel-prediction.md
18+
- sources/arxiv-2606-22939-citadel-csi-jamming-iiot.md
1819
maturity: draft
1920
created: 2026-06-12
2021
updated: 2026-06-21

wiki/concepts/agent-runtime-guardrails.md

Lines changed: 9 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -67,9 +67,15 @@ related:
6767
- sources/arxiv-2606-18673-prompt-leaking-attacks-area.md
6868
- concepts/system-prompt-leakage.md
6969
- entities/tools/leakbench-area.md
70+
- sources/arxiv-2606-22659-confidently-wrong-prompt-injection-calibration.md
71+
- concepts/prompt-injection-detector-calibration.md
72+
- sources/arxiv-2606-23075-self-evolving-llm-agent-safety-mlas.md
73+
- concepts/self-evolving-agent-security.md
74+
- sources/arxiv-2606-20610-osint-ai-loss-of-control-detection.md
75+
- concepts/ai-loss-of-control-osint-monitoring.md
7076
maturity: draft
7177
created: 2026-06-01
72-
updated: 2026-06-22
78+
updated: 2026-06-23
7379
---
7480

7581
# Agent runtime guardrails — attack surfaces + enforcement paradigms
@@ -136,6 +142,8 @@ Tool-using agents (MCP, shell, APIs, email) shift the security problem from **re
136142
| **Trajectory steering** | Locally plausible fragments accumulate across turns; accepted outputs update persistent context without drift gate | GT-MCP 2606.10322 |
137143
| **Over-privileged tool selection** | Agent picks broader **authorized** tool when narrow sufficient alternative exists; amplified by transient narrow-tool failures | TOOLPRIVBENCH 2606.20023 |
138144
| **System prompt leakage** | Adversarial query exfiltrates hidden system/skill instructions — API keys, tool rules | LLM07 / 2606.18673 |
145+
| **Confident guard misses** | PI detectors assign ~1.0 confidence to missed indirect hijacks | 2606.22659 |
146+
| **Self-evolution persistence** | Attacks embed across evolution cycles; scanners miss evolution path | 2606.23075 MLAS |
139147
| **Semantic decoupling** | Natural-language intent hides unsafe tool args from LLM-as-Judge guards | ePCA motivation |
140148

141149
These are **not jailbreaks** in the classic sense — the model may comply with user intent while attacker-controlled context steers authorized access off-scope. [CONFIRMED] across AIRGuard + sleeper paper framing.

wiki/concepts/agent-skill-injection.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -32,9 +32,11 @@ related:
3232
- sources/openreview-openclaw-real-world-safety-analysis.md
3333
- sources/arxiv-2606-18673-prompt-leaking-attacks-area.md
3434
- concepts/system-prompt-leakage.md
35+
- sources/arxiv-2606-23075-self-evolving-llm-agent-safety-mlas.md
36+
- concepts/self-evolving-agent-security.md
3537
maturity: draft
3638
created: 2026-06-03
37-
updated: 2026-06-22
39+
updated: 2026-06-23
3840
---
3941

4042
## Relations

wiki/concepts/agentic-containment-principles.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,9 +18,11 @@ related:
1818
- concepts/internet-of-agentic-ai-ioai.md
1919
- sources/arxiv-2606-20023-over-privileged-tool-selection-toolprivbench.md
2020
- concepts/agent-least-privilege-tool-selection.md
21+
- sources/arxiv-2606-23075-self-evolving-llm-agent-safety-mlas.md
22+
- concepts/self-evolving-agent-security.md
2123
maturity: draft
2224
created: 2026-06-13
23-
updated: 2026-06-19
25+
updated: 2026-06-23
2426
---
2527

2628
## Relations
@@ -39,6 +41,8 @@ updated: 2026-06-19
3941

4042
K114 ingest (2026-06-13): six **containment principles** from arXiv:2606.12797 operationalized as a reusable compliance matrix for LangChain, AutoGPT, and OpenAI Agents SDK — synthesized with containment-gap experiments and cross-linked to MCP/error-path work (2606.07992).
4143

44+
**Self-evolution extension (2606.23075):** static P1–P6 audits assume **immutable anchors** (weights, tool set). Self-evolving agents violate P3/P6 by design — MLAS shows 17/25 cells critical with no effective defense. See @concepts/self-evolving-agent-security.md before certifying any "contained" agent that can modify memory, tools, or architecture.
45+
4246
## Narrative
4347

4448
Agentic LLM systems loop **perception ($P$) → reasoning ($B$) → execution ($E$) → memory update ($\mathcal{U}$)**. Without **inter-layer gates**, corruption at any stage propagates across cycles. Containment requires $\Phi(o_t,m_t)=E(B(P(o_t),m_t)) \in \mathcal{C}$ for policy-safe action space $\mathcal{C}$.

wiki/concepts/ai-for-cybersecurity.md

Lines changed: 9 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -59,9 +59,17 @@ related:
5959
- sources/arxiv-2606-18673-prompt-leaking-attacks-area.md
6060
- concepts/system-prompt-leakage.md
6161
- entities/tools/leakbench-area.md
62+
- sources/arxiv-2606-22659-confidently-wrong-prompt-injection-calibration.md
63+
- concepts/prompt-injection-detector-calibration.md
64+
- sources/arxiv-2606-23075-self-evolving-llm-agent-safety-mlas.md
65+
- concepts/self-evolving-agent-security.md
66+
- sources/arxiv-2606-20610-osint-ai-loss-of-control-detection.md
67+
- concepts/ai-loss-of-control-osint-monitoring.md
68+
- entities/tools/defengraph.md
69+
- sources/arxiv-2606-21059-defengraph-knowledge-graph-blue-team.md
6270
maturity: draft
6371
created: 2026-05-12
64-
updated: 2026-06-22
72+
updated: 2026-06-23
6573
---
6674

6775
## Relations
Lines changed: 48 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,48 @@
1+
---
2+
title: AI loss of control — OSINT monitoring
3+
type: concept
4+
tags: [ai-governance, osint, cti, loss-of-control, monitoring]
5+
keywords: [2606.20610, ai loss of control, osint detection, capability concealment, infrastructure correlation]
6+
related:
7+
- sources/arxiv-2606-20610-osint-ai-loss-of-control-detection.md
8+
- concepts/osint-for-cybersecurity.md
9+
- concepts/threat-intelligence.md
10+
- concepts/ai-for-cybersecurity.md
11+
- concepts/agent-runtime-guardrails.md
12+
maturity: draft
13+
created: 2026-06-23
14+
updated: 2026-06-23
15+
---
16+
17+
## Relations
18+
19+
- @sources/arxiv-2606-20610-osint-ai-loss-of-control-detection.md — primary source (2606.20610)
20+
- @concepts/osint-for-cybersecurity.md — operational OSINT tradecraft for engagements
21+
22+
## Narrative
23+
24+
Ingest 2026-06-23: arXiv:2606.20610 frames **AI loss of control** as an observable phenomenon amenable to **OSINT + CTI** methods — distinct from in-app prompt injection testing.
25+
26+
### Three priority vectors
27+
28+
```
29+
User reports (transcripts) ──→ anomaly clustering
30+
Infrastructure telemetry ──→ unexpected egress / replication
31+
Output vs action gap ──→ capability concealment
32+
```
33+
34+
### Overlap with pentest/SOC work
35+
36+
| Vector | Existing wiki hook |
37+
|--------|-------------------|
38+
| Infrastructure correlation | @concepts/threat-intelligence.md CTI fusion; SOC egress (@entities/tools/iron-proxy.md) |
39+
| Transcript mining | Social/OSINT sources; not automated in this wiki |
40+
| Capability concealment | Agent trajectory eval (@concepts/seclaw-agent-security-evaluation.md) |
41+
42+
### Limits
43+
44+
- **Partial feasibility** — not a substitute for runtime guardrails or formal verification
45+
- **Governance/policy** paper — no tool Phase-0
46+
- Cross-wiki handoff: institutional monitoring architecture may fit @osint-wiki briefs better than deep entity pages
47+
48+
See `briefs/2026-06-23_ai-loc-osint-monitoring-handoff.md` for CTI/SOC fusion notes.

wiki/concepts/incident-response.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,9 +42,11 @@ related:
4242
- entities/tools/cve-mcp-server.md
4343
- concepts/exceptional-access-risk-quantification.md
4444
- sources/arxiv-2606-19106-exceptional-access-compromise-risk-quantification.md
45+
- sources/arxiv-2606-21059-defengraph-knowledge-graph-blue-team.md
46+
- entities/tools/defengraph.md
4547
maturity: validated
4648
created: 2026-05-12
47-
updated: 2026-06-18
49+
updated: 2026-06-23
4850
---
4951

5052
## Relations

wiki/concepts/llm-adversarial-fuzzing.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,9 +29,12 @@ related:
2929
- sources/arxiv-2606-18673-prompt-leaking-attacks-area.md
3030
- concepts/system-prompt-leakage.md
3131
- entities/tools/leakbench-area.md
32+
- sources/arxiv-2606-22659-confidently-wrong-prompt-injection-calibration.md
33+
- concepts/prompt-injection-detector-calibration.md
34+
- entities/tools/picalib-research.md
3235
maturity: validated
3336
created: 2026-05-13
34-
updated: 2026-06-22
37+
updated: 2026-06-23
3538
---
3639

3740
## Relations

wiki/concepts/mcp-security-posture.md

Lines changed: 10 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -45,9 +45,14 @@ related:
4545
- concepts/agent-probabilistic-datalog-verification.md
4646
- sources/arxiv-2606-18673-prompt-leaking-attacks-area.md
4747
- concepts/system-prompt-leakage.md
48+
- entities/tools/leakbench-area.md
49+
- sources/arxiv-2606-22659-confidently-wrong-prompt-injection-calibration.md
50+
- concepts/prompt-injection-detector-calibration.md
51+
- sources/arxiv-2606-23075-self-evolving-llm-agent-safety-mlas.md
52+
- concepts/self-evolving-agent-security.md
4853
maturity: validated
4954
created: 2026-06-05
50-
updated: 2026-06-22
55+
updated: 2026-06-23
5156
---
5257

5358
## Relations
@@ -144,3 +149,7 @@ Attestation blocks **unauthorized tools** before `tools/call`. DCI asks whether
144149
**Probabilistic runtime verification (2606.20510)** — MCP intercept paths that rely on **noisy content classifiers** (PII/secret scan) need distributionally robust bounds when failures correlate across batched tool responses — deterministic Boolean taint + naive P(violation) thresholds under-bound leak risk. Complements admission/DCI/SPI; Phase-0 **Reference**. See @concepts/agent-probabilistic-datalog-verification.md and `briefs/2026-06-21_probabilistic-agent-guardrail-dro-handoff.md`.
145150

146151
**System prompt leakage (2606.18673)** — custom GPT/copilot **hidden instructions** (including skill preambles and MCP routing rules) leak in **>80%** of measured commercial apps; prompt-append defenses fail via **attention drift**. Orthogonal to SPI/DCI but same assessment window — add LeakBench-style exfil probes. See @concepts/system-prompt-leakage.md and `briefs/2026-06-22_system-prompt-leak-redteam-checklist.md`.
152+
153+
**Guard calibration under shift (2606.22659)** — ProtectAI / Prompt-Guard-2 can miss **indirect behavior-hijack** with **severity S ≈ 1.0** on false negatives. Shift-test on MCP tool-return channel; never deploy on pooled ECE alone. See @concepts/prompt-injection-detector-calibration.md and `briefs/2026-06-23_prompt-guard-severity-calibration-handoff.md`.
154+
155+
**Self-evolving agents (2606.23075)** — MLAS matrix: evolution removes immutable anchors; Hermes case **100% attack persistence**, scanners **2.5%** on evolution path. Default deny self-modifying agents on prod-mcp. See @concepts/self-evolving-agent-security.md.

wiki/concepts/network-security.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -52,9 +52,10 @@ related:
5252
- concepts/6g-cps-closed-loop-security.md
5353
- sources/arxiv-2606-08173-ai-native-closed-loop-6g-cps-security.md
5454
- sources/arxiv-2606-18734-point-cloud-wireless-channel-prediction.md
55+
- sources/arxiv-2606-22939-citadel-csi-jamming-iiot.md
5556
maturity: draft
5657
created: 2026-05-12
57-
updated: 2026-06-21
58+
updated: 2026-06-23
5859
---
5960

6061
## Relations

0 commit comments

Comments
 (0)