Benchmark Radar Day 78: Separate Injection Reach from Compliance

1 minute read

Published:

Day 78 of Benchmark Radar. The scan fetched 997 items, published 449, and marked 223 as recommended.

Author: Koutian Wu; GitHub: ktwu01

Benchmark Radar is live. Open the dashboard, star the repository, or read the paper. The Hugging Face dataset provides the data.

MultiAgentInject contains 4,050 trials that vary task, agent-network topology, attack class, stealth, and propagation depth. It records whether an injected instruction reaches another agent separately from whether that agent complies. Those events point to different defenses: communication boundaries and behavior after exposure. MultiAgentInject dataset, injection templates, and analysis scripts.

SimGlot supplies eight integrity checks and 21 injected fault variants across seven defect classes for an agent benchmark’s task generator and reward function. Its records bind results to frozen software revisions. The scoring machinery becomes something that can be tested against known faults. SimGlot: Oracle-Integrity Auditing and Configuration-Dependent Measurement in an LLM Agent Benchmark.

Why this matters

Keep intermediate events visible. A single success flag cannot locate either an attack-defense failure or a defect in the benchmark itself.

Scan coverage

This is a keyword-filtered discovery feed, not a representative survey of AI research. The archived briefing used 124 of 449 captured evidence records. These findings summarize its cited releases; discovery dates do not necessarily equal original publication dates.

Data and briefing: 2026-10-12 archived snapshot.