AgentProbe

Agent

Drop-in pytest plugin for regression-testing AI agents — snapshot baselines, semantic comparison, mock LLMs

Copy the install, test the workflow, then decide if it earns a permanent slot.

Why nowArchived

Strong idea surface, weaker maintenance signal. Steal the pattern before you commit.

DecisionKeep on the radar

Copy the install, test the workflow, then decide if it earns a permanent slot.

Trial costMedium lift

Reasonable to try, but it will take more than a quick skim to get real signal.

Risk98/100

GitHub health unknown. no security policy. Archived repo plus maintenance drag means copy patterns, not the whole tool.

What You Are Adopting

AI Agent

Universal

Model

Multiple

Build Time

Instant

One command inClean rollbackLow commitment

SandboxedInstalls to ~/.claude — isolated from your projects. One command to remove.

Fastest way to find out if AgentProbe belongs in your setup.

Copy the install command, run a real test, and back it out cleanly if it slows you down.

Try now

git clone https://github.com/he-yufeng/AgentProbe ~/.claude/agents/agentprobe

Run this first. You will know quickly if the workflow earns a permanent slot.

Back out

rm -rf ~/.claude/agents/agentprobe

No messy cleanup loop. If it misses, remove it and keep moving.

Install Location

~/  └─ .claude/      ├─ commands/      ├─ agents/      │   └─ agentprobe/ ← installs here      └─ settings.json

Drop-in pytest plugin for regression-testing AI agents — snapshot baselines, semantic comparison, mock LLMs

Submitted May 10, 2026