Skip to content

Commit c39651a

Browse files
authored
Merge pull request #63 from x-zheng16/add-embodied-ai-safety-survey
2 parents b59385a + e8d5c9e commit c39651a

1 file changed

Lines changed: 5 additions & 2 deletions

File tree

README.md

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -45,6 +45,8 @@ https://raw.githubusercontent.com/wuyoscar/ISC-Bench/main/AGENT_README.md
4545
4646
🧩 To reliably trigger and study this phenomenon, we built the **TVD** (Task + Validator + Data) framework — an engineered architecture that presents AI agents with **incomplete professional workflows** containing sensitive data fields. The agent must fill in the missing data to satisfy tool validation and complete the task.
4747

48+
> 📖 ISC extends naturally into the embodied AI domain, where agents interact with physical-world tools and sensors. For a comprehensive survey of safety risks across perception, cognition, planning, interaction, and agentic systems, see [**Awesome-Embodied-AI-Safety**](https://github.com/x-zheng16/Awesome-Embodied-AI-Safety) (400+ papers). We welcome contributions of embodied AI ISC cases!
49+
4850
<details>
4951
<summary><b>📋 Evaluation Settings</b></summary>
5052

@@ -93,7 +95,7 @@ https://raw.githubusercontent.com/wuyoscar/ISC-Bench/main/AGENT_README.md
9395
| | Date | Note |
9496
|:-:|:-----|:-----|
9597
|| 2026-03-29 | **700+ stars**; terminology updated from "Jailbroken" to "Triggered" |
96-
| 📄 | 2026-03-27 | Related work: [**Safety in Embodied AI**](https://github.com/x-zheng16/Embodied-AI-Safety) · [**UltraBreak**](https://github.com/kaiyuanCui/UltraBreak) (ICLR 2026) |
98+
| 📄 | 2026-03-27 | Related work: [**Awesome-Embodied-AI-Safety**](https://github.com/x-zheng16/Awesome-Embodied-AI-Safety) — 400+ papers on embodied AI safety · [**UltraBreak**](https://github.com/kaiyuanCui/UltraBreak) (ICLR 2026) |
9799
| 🚀 | 2026-03-25 | ISC-Bench repository and [**paper**](https://arxiv.org/abs/2603.23509) released |
98100

99101
<sub>[Full changelog →](CHANGELOG.md)</sub>
@@ -569,6 +571,7 @@ Traditional jailbreaks require dedicated effort (adaptive attacks, white-box acc
569571
- [**Past Tense**](https://arxiv.org/abs/2407.11969) — Simply reformulating a harmful question in past tense ("How did people make...") causes the model to answer what it would normally refuse. A form of self-jailbreak through rephrasing.
570572
- [**Self-Jailbreak**](https://arxiv.org/abs/2510.20956) — After benign reasoning training, models spontaneously fabricate justifications in their own Chain of Thought to engage with harmful requests. The model convinces itself to comply.
571573
- [**Role Confusion**](https://arxiv.org/abs/2603.12277) — A prompt injection technique that exploits CoT reasoning by fabricating internal deliberation, making the model attack itself through its own reasoning process.
574+
- [**Awesome-Embodied-AI-Safety**](https://github.com/x-zheng16/Awesome-Embodied-AI-Safety) — A survey of 400+ papers on safety in embodied AI (robots, autonomous vehicles, physical agents), covering attacks and defenses across perception, cognition, planning, interaction, and agentic system layers.
572575

573576

574577

@@ -628,7 +631,7 @@ For questions, collaborations, or responsible disclosure: **wuy⁷¹¹⁷ ⓐ
628631

629632
## Related Projects
630633

631-
- [Safety in Embodied AI](https://github.com/x-zheng16/Embodied-AI-Safety) -- Risks, Attacks, and Defenses across the full embodied AI pipeline (480+ papers)
634+
- [Awesome-Embodied-AI-Safety](https://github.com/x-zheng16/Awesome-Embodied-AI-Safety) -- Safety in Embodied AI: Risks, Attacks, and Defenses (400+ papers)
632635
- [Awesome-Large-Model-Safety](https://github.com/xingjunm/Awesome-Large-Model-Safety) -- Safety at Scale: A Comprehensive Survey of Large Model and Agent Safety
633636
- [AI Safety Report](https://github.com/XSafeAI/AI-safety-report) -- A broad evaluation suite and report for frontier model safety across language, vision-language, and image generation
634637

0 commit comments

Comments
 (0)