Tencent/AI-Infra-Guard

▲ 1,806 stars today★ 6,338⑂ 586

A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

6,338Star
586Fork
0Watch
0Issue
PythonLanguage
-License
Created · last push · repository size 0 KB · default branch -

README

https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/A.I.G

📖 Documentation  |  🌐 🇨🇳 中文 · 🇯🇵 日本語 · 🇪🇸 Español · 🇩🇪 Deutsch · 🇫🇷 Français · 🇰🇷 한국어 · 🇧🇷 Português · 🇷🇺 Русский

https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/GitHub stars https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/GitHub downloads https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/docker pulls https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/Release https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/Ask DeepWiki

https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/EdgeOne ClawScan https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/EdgeOne Skill Scanner https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/AIG Scanner

https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/OpenClaw Recommended

https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/Tencent%2FAI-Infra-Guard | Trendshift  https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/Tencent%2FAI-Infra-Guard | blackhat  https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/Tencent%2FAI-Infra-Guard | awesome-deepseek-integration


🚀 AI Red Teaming Platform by Tencent Zhuque Lab

A.I.G (AI-Infra-Guard) integrates capabilities such as ClawScan(OpenClaw Security Scan), Agent Scan,AI infra vulnerability scan, MCP Server & Agent Skills scan, and Jailbreak Evaluation, aiming to provide users with the most comprehensive, intelligent, and user-friendly solution for AI security risk self-examination.

We are committed to making A.I.G(AI-Infra-Guard) the industry-leading AI red teaming platform. More stars help this project reach a wider audience, attracting more developers to contribute, which accelerates iteration and improvement. Your star is crucial to us!

https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/Give us a Star


📋 User Feedback Survey

Help us improve A.I.G! Please take 3-5 minutes to fill out our User Feedback Survey. Users who provide high-quality feedback and leave a valid email address will receive an exclusive Tencent souvenir gift.


🚀 What's New

👉 Earlier releases · 🛒 AI Security Skill Market · 🔍 skill-scan CLI · 🔍 mcp-scan CLI · 🔍 agent-scan CLI · 📊 SkillTrustBench

Table of Contents



🚀 Quick Start

🐳 Deploy A.I.G with Docker

| Docker | RAM | Disk Space | |:-------|:----|:----------| | 20.10 or higher | 4GB+ | 10GB+ |

# This method pulls pre-built images from Docker Hub for a faster start
git clone https://github.com/Tencent/AI-Infra-Guard.git
cd AI-Infra-Guard

For Docker Compose V2+, replace 'docker-compose' with 'docker compose'

docker-compose -f docker-compose.images.yml up -d

Once the service is running, you can access the A.I.G web interface at: http://localhost:8088

Use from OpenClaw

You can also call A.I.G directly from OpenClaw chat via the aig-scanner skill.

clawhub install aig-scanner

Then configure AIG_BASE_URL to point to your running A.I.G service.

For more details, see the aig-scanner README.

More installation options

Other Installation Methods

Method 2: One-Click Install Script (Recommended)

# This method will automatically install Docker and launch A.I.G with one command
curl https://raw.githubusercontent.com/Tencent/AI-Infra-Guard/refs/heads/main/docker.sh | bash

Method 3: Build and run from source

git clone https://github.com/Tencent/AI-Infra-Guard.git
cd AI-Infra-Guard

This method builds a Docker image from local source code and starts the service

(For Docker Compose V2+, replace 'docker-compose' with 'docker compose')

docker-compose up -d

Note: The AI-Infra-Guard project is positioned as an AI red teaming platform for internal use by enterprises or individuals. It currently lacks an authentication mechanism and should not be deployed on public networks.

For more information, see: https://tencent.github.io/AI-Infra-Guard/?menu=getting-started

⚡ Install aig-skill-scan with a Single Command

Agent Skill security audit tool, easily integrated into enterprise CI/CD pipelines. Vulnerability classification aligns with SkillTrustBench T01–T09 taxonomy. Learn more →

pip install aig-skill-scan

Set API key via environment variable

export LLM_API_KEY="your-api-key"

Scan a local Skill project directory

aig-skill-scan --repo /path/to/your/skill \ -m deepseek-v4-flash \ --language en \ -o result.json

Model and API Relay Checker

The checker frontend is deployed separately. Docker deployment keeps the checker APIs available at GET /api/v1/relay/models and POST /api/v1/relay/check/stream; API documentation is available at http://127.0.0.1:8088/api-checker/docs. To run the checker and unified CLI from source:

python3 -m venv services/api_checker/.venv
services/api_checker/.venv/bin/pip install -r services/api_checker/requirements.txt
go build -o ai-infra-guard ./cmd/cli/main.go

export AIG_API_CHECKER_PYTHON="$PWD/services/api_checker/.venv/bin/python" ./ai-infra-guard api-checker list ./ai-infra-guard api-checker audit

See the API Checker integration guide for the Agent-embedded runtime architecture, HTTP API, configuration, and security boundaries.

🌟 Try the Online Pro Version

Experience the Pro version with advanced features and improved performance. The Pro version requires an invitation code and is prioritized for contributors who have submitted issues, pull requests, or discussions, or actively help grow the community. Visit: https://aigsec.ai/.

✨ Features

🔍 aig-skill-scan Performance & Coverage

Performance on SkillTrustBench with different LLMs:

| # | Model | F1 | Precision | Recall | FPR | |:--|:------|:---|:----------|:-------|:----| | 1 | Claude Opus 4.6 | 0.9848 | 0.9725 | 0.9974 | 0.0663 | | 2 | GLM 5.1 | 0.9836 | 0.9701 | 0.9974 | 0.0723 | | 3 | Gemini 3.5 Flash | 0.9792 | 0.9947 | 0.9641 | 0.0120 | | 4 | Kimi 2.6 | 0.9780 | 0.9895 | 0.9667 | 0.0241 | | 5 | DeepSeek v4 Flash | 0.9740 | 0.9868 | 0.9615 | 0.0301 |

Covers 9 categories of Skill security risks (SkillTrustBench T01–T09):

| Layer | Risks | |:------|:--------| | A · Instruction & Memory | T01 Skill Instruction Hijacking, T02 Memory Poisoning | | B · Code Execution | T03 Remote Payload Download & Execution, T04 Embedded Malicious Code | | C · System Privilege | T05 Privilege Escalation & Unauthorized Access, T06 System Persistence | | D · Toolchain & Dependencies | T07 Tool Hijacking & Spoofing, T08 Insecure Dependencies | | E · Skill Code Quality | T09 Insecure Coding Practices |

For full leaderboard and details, visit SkillTrustBench.

🔬 Security Scanning & Evaluation

| Feature | More Info | |:--------|:------------| | ClawScan(OpenClaw Security Scan) | Supports one-click evaluation of OpenClaw security risks. It detects insecure configurations, Skill risks, CVE vulnerabilities, and privacy leakage. | | Agent Scan | This is an independent, multi-agent automated scanning framework. It is designed to evaluate the security of AI agent workflows. It seamlessly supports agents running across various platforms, including Dify and Coze. | | MCP Server & Agent Skills scan | It thoroughly detects 14 major categories of security risks. The detection applies to both MCP Servers and Agent Skills. It flexibly supports scanning from both source code and remote URLs. | | AI infra vulnerability scan | This scanner precisely identifies over 100 AI framework components. It covers more than 2000 known CVE vulnerabilities. Supported frameworks include Ollama, ComfyUI, vLLM, n8n, Triton Inference Server and more. | | Jailbreak Evaluation | It assesses prompt security risks using carefully curated datasets. The evaluation applies multiple attack methods to test robustness. It also provides detailed cross-model comparison capabilities. | | Model and API Relay Checker | Model fingerprinting, Claude Signature verification, relay black-box auditing, PAMELA, and Ventor QTest. |

💎 Additional Benefits
  • 🖥️ Modern Web Interface: User-friendly UI with one-click scanning and real-time progress tracking
  • 🔌 Complete API: Full interface documentation and Swagger specifications for easy integration
  • 🤖 Agent-Ready: Plug-and-play agent skills on ClawHub — EdgeOne ClawScan, EdgeOne Skill Scanner, and AIG Scanner — seamlessly embed security scanning into any AI agent workflow
  • 🌐 Multi-Language: Chinese and English interfaces with localized documentation
  • 🐳 Cross-Platform: Linux, macOS, and Windows support with Docker-based deployment
  • 🆓 Free & Open Source: Completely free under the Apache 2.0 license


🖼️ Showcase

A.I.G Main Interface

A.I.G Main Page

Plugin Management

Plugin Management


🗺️ Quick Usage Guide

After deployment, open http://localhost:8088 in your browser.

AI Infrastructure Vulnerability Scan

What to enter as the target URL / IP?

The target is the network address of a running AI service you want to scan - not a GitHub URL or source code path. A.I.G connects to the live service and fingerprints it for known CVE vulnerabilities.

| Scenario | Example target | |:---------|:--------------| | A locally running vLLM instance | http://127.0.0.1:8000 | | An Ollama server on your LAN | http://192.168.1.100:11434 | | A ComfyUI instance exposed internally | http://10.0.0.5:8188 | | Multiple hosts (one per line) | 192.168.1.0/24 (CIDR), 10.0.0.1-10.0.0.20 (range) |

Step-by-step: Scan a local vLLM instance

1. Start vLLM normally (e.g. python -m vllm.entrypoints.api_server --model meta-llama/...) 2. In the A.I.G web UI, click "AI基础设施安全扫描 / AI Infra Scan" 3. Enter http://127.0.0.1:8000 (or the IP/port where vLLM is listening) 4. Click Start Scan - A.I.G will fingerprint the service and match it against 2000+ known CVEs 5. View the report: component version, matched vulnerabilities, severity, and remediation links

💡 Tip: To scan the nightly build of vLLM specifically, just run that nightly build and point A.I.G at its address. The scanner detects the version automatically.

MCP Server & Agent Skills Scan

Enter either a remote URL (e.g. https://github.com/user/mcp-server) or upload a local source archive - no running instance required.

Jailbreak Evaluation

Configure the target LLM's API endpoint (base URL + API key) in Settings → Model Config, then select a dataset and start the evaluation.

---

📖 User Guide

Visit our online documentation: https://tencent.github.io/AI-Infra-Guard/

For more detailed FAQs and troubleshooting guides, visit our documentation.

🔧 API Documentation

A.I.G provides a comprehensive set of task creation APIs that support AI infra scan, MCP Server Scan, and Jailbreak Evaluation capabilities.

After the project is running, visit http://localhost:8088/docs/index.html to view the complete API documentation.

For detailed API usage instructions, parameter descriptions, and complete example code, please refer to the Complete API Documentation.

📝 Contribution Guide

The extensible plugin framework​​ serves as A.I.G's architectural cornerstone, inviting community innovation through Plugin and Feature contributions.​

Plugin Contribution Rules

1. Fingerprint Rules: Add new YAML fingerprint files to the data/fingerprints/ directory. 2. Vulnerability Rules: Add new vulnerability scan rules to the data/vuln/ directory. 3. MCP Plugins: Add new MCP security scan rules to the data/mcp/ directory. 4. Jailbreak Evaluation Datasets: Add new Jailbreak evaluation datasets to the data/eval directory.

Please refer to the existing rule formats, create new files, and submit them via a Pull Request.

Other Ways to Contribute



🛡️ About the Team

This project is led and developed by Tencent Zhuque Lab, part of the Tencent Security Platform Department. Founded in 2019, Tencent Zhuque Lab is a top-tier security research lab focused on real-world offensive and defensive research and frontier technology in the AI security space, covering large model security, AI agent security, AI-empowered security, and AI-generated content detection.

The team has helped major vendors such as NVIDIA, Google, and Microsoft, as well as open-source communities like OpenClaw, Linux, and Hugging Face, fix a large number of high-risk vulnerabilities, and has been publicly acknowledged by them.

We have released open-source AI security products including the AI Red Team Security Testing Platform A.I.G (AI-Infra-Guard) and the Zhuque AI Detection Assistant. Our research has been widely published at top international security and AI conferences such as Black Hat, DEF CON, ICLR, CVPR, NeurIPS, and ACL, and we have authored the book "AI Security: Technology and Practice".

👥 Core Members & Contributions

| Role | Member | Contribution | | --- | --- | --- | | Head of Tencent Security Platform Department | Yong Yang | Initiated A.I.G and proposed automated assessment of AI agent loss-of-control risks, guiding the platform's expansion from AI infrastructure vulnerability scanning to agent execution risk, tool misuse, and permission-boundary evaluation. | | Head of Tencent Zhuque Lab | Xing Zheng | Proposed the automated vulnerability-update and benchmark-alignment mechanism, helping AI Infra fingerprints, CVE/GHSA rules, and benchmarks iterate continuously. | | Project Lead | Nicky | Frontier security research, product planning, technical-route decisions, internal and external collaboration, and communications. | | Technical Lead | Python | Overall architecture design, core module development, and version iteration. | | Core Contributor | Zona | Frontend interaction, product experience, community operations, and user-feedback loop. | | Core Contributor | Fyoung | AI Infra vulnerability component fingerprint updates and Benchmark system construction. | | Core Contributor | Xiangfan | Security capability development for Skill risks and agent loss-of-control scenarios. | | Core Contributor | Elwood | Enhancing Agent security scanning capabilities and updating technical reports. | | Core Contributor | Robert | LLM safety assessment and jailbreak-evaluation strategy operations. | | Core Contributor | Zoe | LLM safety assessment, jailbreak evaluation, and model-integration module development. | | Contributor | Ronin | Participated in AI agent security scanning development. | | Contributor | Rsin | Participated in community operations and campaign communications. |


🙏 Acknowledgements

🎓 Academic Collaborations

We thank our academic partners for their research contributions and technical support.

https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/
Prof. hui Li
https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/
Bin Wang
https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/
Zexin Liu
https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/
Hao Yu
https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/
Ao Yang
https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/
Zhengxi Lin

https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/
Prof. Zhemin Yang
https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/
Kangwei Zhong
https://github.com/Tencent/AI-Infra-Guard/blob/HEAD/

More Today's Trending projects

Git Homed · data from GitHub Trending and GitHub topic pages · updated daily · about sitemap · robots