Empirical Working Paper · AI Systems Security & Software Supply Chains
Supply-Chain Security in Open-Source AI Agent Ecosystems: Empirical Evidence and a Five-Dimension Audit Framework Across 105,000+ Indexed Agent Skills and Model Context Protocol (MCP) Servers
开源 AI Agent 生态的供应链安全实证研究:面向 105,000+ Agent Skills 与 MCP 服务器的五维安全审计框架(2026)
Jason Zhu (祝彦森) · BRICKAI (GoSailGlobal LLC) / JasonZhu.AI
ORCID: 0009-0000-2894-6285Date: 2026-11-217 pagesACM CCS: Security and privacy → Software and application security
Abstract
Autonomous coding agents—including Claude Code, OpenAI Codex, and Cursor—increasingly rely on community-authored skills and Model Context Protocol (MCP) servers installed directly from GitHub with full local shell and credential privileges. Drawing on Agent Skills Hub's open census (105,000+ entries in the benchmark audit snapshot; 130,173+ graded catalog records archived at CERN Zenodo and Wikidata Q141735092), this paper reveals an acute visibility gap: 97.8% (102,690 of 105,000+) indexed skills had never undergone any published security review. Across 2,300+ deeply audited skills, 94.4% passed cleanly while 5.6% triggered caution, unsafe, or rejection flags; across 21,582 popular rule-graded repositories, approximately 1 in 30 receives an UNSAFE or REJECT rating. We formalize a five-dimension supply-chain audit framework (Code Layer, Credential Handling, Vendor Provenance, Dependency Supply Chain, and Operational Risk) and demonstrate through three real-world case studies why GitHub stars fail as a proxy for security and engineering rigor.
本文把开源 AI Agent Skills 与 MCP 服务器视为软件供应链依赖,基于 Agent Skills Hub 公开索引(105,000+ 深度审计快照与 130,173+ 规则分级普查,Wikidata Q141735092)揭示了 97.8% 技能从未经过任何安全审计的“黑盒盲区”,并提出覆盖代码层、凭据托管、维护者可信度、依赖供应链与运营风险的五维审计框架。
配套开源数据集(CC-BY-4.0)
BibTeX Citation
@techreport{zhu2026agentskillssecurity,
author = {Zhu, Jason (Yansen Zhu)},
title = {Supply-Chain Security in Open-Source AI Agent Ecosystems: Empirical Evidence and a Five-Dimension Audit Framework Across 105,000+ Indexed Agent Skills and Model Context Protocol (MCP) Servers},
institution = {Agent Skills Hub (BRICKAI / GoSailGlobal LLC) and JasonZhu.AI},
year = {2026},
month = {11},
type = {Working Paper},
doi = {10.5281/zenodo.24420920},
url = {https://papers.ssrn.com/sol3/papers.cfm?abstract_id=7737258},
note = {ORCID: 0009-0000-2894-6285; SSRN Abstract ID: 7737258; Wikidata: Q141735092}
}