EE Solutions AI Operator's Index EE Solutions

Category

Quality & Security

Quality & Security covers 32 resources across 5 subcategories in the AI Operator's Index. It's one of 9 top-level categories EE Solutions tracks for people operating with Claude and other frontier models.

Evals & Testing
12 resources
AgentX Evaluations
Agent evaluation product for versioned test sets, regression checks, multi-step analysis and suggested fixes.
Arize Phoenix
Open-source tracing and evaluation.
Link
Braintrust
Evals, traces and production quality workflows.
Link
DeepEval
Code-first evaluation framework.
Link
Eugene Yan: Cybersecurity Evals
Concrete patterns for evaluating cybersecurity agents using sandboxes, tasks, tools and graders.
Hamel Husain: Evals Skills for Coding Agents
Reusable eval skills built from Hamel Husain's work with production AI teams.
Hamel Husain: It's Hard to Eval Is a Product Smell
Product-oriented argument for making AI outputs inherently easy to verify before layering on evaluation tooling.
Langfuse
Open-source LLM observability and evals.
Link
Latitude Evals
Evaluation and telemetry platform that turns observed failure modes into continuously running evals.
Promptfoo
Open-source LLM eval and red-team framework.
Link
Ragas
RAG-focused evaluation framework.
Link
W&B Weave
Tracing and evaluation from Weights & Biases.
Link
Governance & Risk
1 resources
NIST AI Risk Management Framework
Canonical AI risk framework.
Link
Observability & Tracing
2 resources
LangSmith
Tracing and observability platform for agent and LLM applications.
Link
Pydantic Logfire Claude Plugin
Add and work with Logfire observability in Python applications.
Plugin123 stars
Security & Red Teaming
12 resources
Security Awareness Skill
Guidance for recognizing phishing, credential theft and social engineering during agent operation.
Skill489 stars
Security Threat Model Skill
Repository-grounded threat modeling with trust boundaries and abuse paths.
Skill489 stars
42Crunch API Security Testing
Audit OpenAPI specs and API security risks from Claude Code.
Plugin1 stars
Aikido Claude Plugin
SAST, secret and IaC scanning through Aikido's Claude plugin.
Plugin13 stars
Anthropic Security Guidance
Anthropic plugin with edit warnings and diff review for common vulnerability classes.
Plugin33.7k stars
garak Website
Project site for garak, the LLM vulnerability scanner.
Link
MITRE ATLAS
Adversarial threat knowledge base for AI.
Link
NVIDIA garak
LLM vulnerability scanner.
Repo8.9k stars
OWASP GenAI / LLM Top 10 — 2026
Current OWASP 2026 risk list for GenAI and LLM applications.
Link
OWASP GenAI Security Project
Core security guidance for GenAI systems.
Link
OWASP Top 10 for LLM Applications
High-value LLM risk checklist.
Link
Semgrep Claude Plugin
Security scanning and code guidance from Semgrep inside Claude Code.
Plugin10 stars
Security Skills
5 resources
Supabase Postgres Best Practices
Postgres performance, schema, security and RLS guidance maintained by Supabase.
Skill2.5k stars
Awesome Claude Skills
Claude-specific visual skill directory. Use for discovery, not as a security or quality guarantee.
Link
Trail of Bits Claude Code Config
Opinionated Claude Code config and workflows.
Repo2.1k stars
Trail of Bits Curated Skills
Reviewed external Claude plugins and skills.
Repo489 stars
Trail of Bits Skills
Security-focused Claude Code skills from a respected security firm.
Skill6.7k stars

Looking for hands-on help in Quality & Security? EE Solutions can help. EE Solutions is a senior technology team for private capital firms and their portfolio companies.

Talk to EE Solutions ↗