# openjudge

If you're building LLM evaluation pipelines, this wraps the OpenJudge framework into something Claude can use directly. You get pre-built graders for correctness, hallucination, and relevance, plus the ability to define custom scoring functions or use other LLMs as judges. The GradingRunner handles batch evaluation with configurable concurrency, and you can...

## Decision Card

- Recommendation score: 31/100 (Review first)
- Fit score: 48/100
- Trust tier: Needs review
- Install readiness: Source guide
- Trial status: not_recorded
- Claim status: Unclaimed
- Verified level: Unverified
- Primary risk: No community evaluation
- Next action: manual_review

## Fit & Capabilities

- Role: Coding & Development
- Protocols: manual review
- Capabilities: Multi-agent orchestration, Coding assistance, Reusable skill package, Design assistance

## Evidence

- Source: https://claudemarketplaces.com/skills/agentscope-ai/openjudge/openjudge
- Source activity: 657 stars
- Community reviews: 0
- External reputation signals: 0
- Known gaps: community review, third-party review/discussion signal, sandbox trial result

## Risk & Safety

- Security verdict: Evidence is thin. Read source, license, and requirements before trial.
- Required checks: Verify install source, Confirm license, Review permissions, Collect user evaluation

## Installation

- Readiness: Source guide
- Primary method: Source guide
- Install JSON: https://agentstaffer.com/skills/claudemarketplaces-openjudge/install.json

## Trial Plan

- Task: Run a small code review trial
- Expected output: A concise review with reproducible findings, changed-file scope, and test suggestions.
- Trial JSON: https://agentstaffer.com/skills/claudemarketplaces-openjudge/trial.json

## Profile Data Package

- profile.json: https://agentstaffer.com/skills/claudemarketplaces-openjudge/profile.json
- score.json: https://agentstaffer.com/skills/claudemarketplaces-openjudge/score.json
- evidence.json: https://agentstaffer.com/skills/claudemarketplaces-openjudge/evidence.json
- trust.json: https://agentstaffer.com/skills/claudemarketplaces-openjudge/trust.json
- trial.json: https://agentstaffer.com/skills/claudemarketplaces-openjudge/trial.json
- install.json: https://agentstaffer.com/skills/claudemarketplaces-openjudge/install.json
- history.json: https://agentstaffer.com/skills/claudemarketplaces-openjudge/history.json
- similar.json: https://agentstaffer.com/skills/claudemarketplaces-openjudge/similar.json
- dossier.md: https://agentstaffer.com/skills/claudemarketplaces-openjudge/dossier.md
- summary.md: https://agentstaffer.com/skills/claudemarketplaces-openjudge/summary.md
- visibility-report.json: https://agentstaffer.com/vendors/claudemarketplaces-openjudge/visibility-report.json
- claim.json: https://agentstaffer.com/claim.json
- Vendor visibility report: https://agentstaffer.com/vendors/claudemarketplaces-openjudge/visibility-report
- Agent index: https://agentstaffer.com/agents.json