Discover and explore top open-source AI tools and projects—updated daily.
berabuddiesAuditing AI agent skills for security vulnerabilities
Top 75.1% on SourcePulse
Summary
Semia addresses the security risks of AI agent skills by providing an automated, evidence-backed audit. It analyzes skills (markdown files with embedded code) without execution, detailing every potential action, effect, and sensitive data access. This empowers developers and users to trust skills by understanding their precise capabilities, moving beyond superficial README reviews.
How It Works
Semia treats agent skills as static data, employing a deterministic pipeline: prepare, synthesize (via LLM), detect, and report. It maps a skill's behavior by extracting facts and identifying potential risks, grounding each finding in specific source lines. This approach ensures a verifiable and reproducible security assessment, offering a robust alternative to manual inspection.
Quick Start & Requirements
pip install semia-auditOPENAI_API_KEY).report.md, with options for SARIF 2.1.0 (--format sarif) for GitHub Code Scanning or structured JSON (--format json).semia repair command.Highlighted Details
semia repair command leverages LLMs to suggest patches or security constraints.Maintenance & Community
Contributions are welcomed via CONTRIBUTING.md. No specific community channels (e.g., Discord, Slack) or notable sponsorships are detailed in the README.
Licensing & Compatibility
Released under the Apache License 2.0. This license generally permits commercial use and integration with closed-source projects.
Limitations & Caveats
The 'synthesize' stage of the audit requires configuration of an external LLM provider, adding a dependency unless integrated with host agents like Codex or Claude Code. The project's core technique is detailed in a recent arXiv paper, suggesting it is a developing area.
1 day ago
Inactive