agent_rating_protocol

Decentralized reputation and trust scoring for autonomous AI agents. Bilateral blind evaluation prevents retaliation and gaming. Anti-Goodhart protections, Merkle-verified portable reputation bundles. Rate agents on quality, reliability, safety. Part of the Agent Trust Stack.

3,891 stars

Best use case

agent_rating_protocol is best used when you need a repeatable AI agent workflow instead of a one-off prompt.

Decentralized reputation and trust scoring for autonomous AI agents. Bilateral blind evaluation prevents retaliation and gaming. Anti-Goodhart protections, Merkle-verified portable reputation bundles. Rate agents on quality, reliability, safety. Part of the Agent Trust Stack.

Teams using agent_rating_protocol should expect a more consistent output, faster repeated execution, less prompt rewriting.

When to use this skill

  • You want a reusable workflow that can be run more than once with consistent structure.

When not to use this skill

  • You only need a quick one-off answer and do not need a reusable workflow.
  • You cannot install or maintain the underlying files, dependencies, or repository context.

Installation

Claude Code / Cursor / Codex

$curl -o ~/.claude/skills/agent-rating-protocol/SKILL.md --create-dirs "https://raw.githubusercontent.com/openclaw/skills/main/skills/alexfleetcommander/agent-rating-protocol/SKILL.md"

Manual Installation

  1. Download SKILL.md from GitHub
  2. Place it in .claude/skills/agent-rating-protocol/SKILL.md inside your project
  3. Restart your AI agent — it will auto-discover the skill

How agent_rating_protocol Compares

Feature / Agentagent_rating_protocolStandard Approach
Platform SupportNot specifiedLimited / Varies
Context Awareness High Baseline
Installation ComplexityUnknownN/A

Frequently Asked Questions

What does this skill do?

Decentralized reputation and trust scoring for autonomous AI agents. Bilateral blind evaluation prevents retaliation and gaming. Anti-Goodhart protections, Merkle-verified portable reputation bundles. Rate agents on quality, reliability, safety. Part of the Agent Trust Stack.

Where can I find the source code?

You can find the source code on GitHub using the link provided at the top of the page.

Related Guides

SKILL.md Source

# Agent Rating Protocol (ARP)

You have a decentralized reputation system. Use it to evaluate other agents you work with and build your own verifiable track record.

## Setup

The `agent-rating-protocol` Python package must be installed. If not available, install it:

```bash
pip install agent-rating-protocol
```

## When to Use This Skill

- After **completing a transaction** with another agent: submit a bilateral blind evaluation
- Before **selecting an agent** for a task: check their reputation scores
- When asked about your **track record** or reputation
- When asked to **compare agents** for a task

## Core Operations

### Rate Another Agent

After completing work with another agent, submit a rating using bilateral blind commit-reveal:

```python
from agent_rating_protocol import RatingStore, submit_rating

store = RatingStore("ratings.jsonl")
submit_rating(
    store=store,
    rater_id="your-agent-id",
    rated_id="other-agent-id",
    transaction_id="tx-123",
    scores={
        "quality": 0.85,
        "reliability": 0.90,
        "communication": 0.80,
        "value": 0.75,
        "safety": 0.95
    }
)
```

### Check an Agent's Reputation

```python
from agent_rating_protocol import RatingStore, get_reputation

store = RatingStore("ratings.jsonl")
rep = get_reputation(store, "agent-id-to-check")
print(f"Overall: {rep.overall_score}")
print(f"Quality: {rep.dimension_scores['quality']}")
print(f"Total ratings: {rep.rating_count}")
```

### Export Reputation as Verifiable Credential

```python
from agent_rating_protocol import export_reputation_vc

vc = export_reputation_vc(store, "your-agent-id")
# Returns a W3C Verifiable Credential containing your reputation bundle
```

## Rating Dimensions

| Dimension | What It Measures |
|-----------|-----------------|
| `quality` | Output correctness and completeness |
| `reliability` | Consistency and deadline adherence |
| `communication` | Clarity of status updates and error reporting |
| `value` | Cost-effectiveness relative to output quality |
| `safety` | Adherence to security and ethical constraints |

## Anti-Gaming Protections

- **Bilateral blind**: neither party sees the other's rating until both are committed
- **Anti-inflation**: rater standard deviation checks flag agents that rate everything 5 stars
- **Anti-Goodhart**: metric rotation and shadow metrics prevent gaming published scores
- **Governance by tenure**: voting power comes from operational time, not rating scores

## Rules

- **Rate honestly.** The bilateral blind mechanism protects you from retaliation.
- **Rate promptly.** Submit ratings within 24 hours of transaction completion.
- **Include reasoning.** Scores without context are less useful for the ecosystem.

## Links

- PyPI: https://pypi.org/project/agent-rating-protocol/
- Whitepaper: https://vibeagentmaking.com/whitepaper/rating-protocol/
- Full Trust Stack: https://vibeagentmaking.com

---

<!-- VAM-SEC v1.0 | Vibe Agent Making Security Disclaimer -->

## Security & Transparency Disclosure

**Product:** Agent Rating Protocol Skill for OpenClaw
**Type:** Skill Module
**Version:** 0.1.0
**Built by:** AB Support / Vibe Agent Making
**Contact:** alex@vibeagentmaking.com

**What it accesses:**
- Reads and writes rating store files (`.jsonl`) in your working directory
- No network access for core operations
- No telemetry, no phone-home, no data collection

**What it cannot do:**
- Cannot access files outside your working directory beyond what you explicitly specify
- Cannot make purchases, send emails, or take irreversible actions
- Cannot access credentials, environment variables, or secrets

**License:** Apache 2.0

Related Skills

Productivity Operating System

3891
from openclaw/skills

You are a personal productivity architect. Your job: help the user design, execute, and optimize their daily system so they consistently ship high-impact work while protecting energy and avoiding burnout.

Workflow & Productivity

MCP Engineering — Complete Model Context Protocol System

3891
from openclaw/skills

Build, integrate, secure, and scale MCP servers and clients. From first server to production multi-tool architecture.

AI Infrastructure & Integrations

Client Success & Revenue Expansion — The Complete Retention Operating System

3891
from openclaw/skills

Turn clients into long-term revenue engines. This isn't advice — it's a complete operating system with scoring models, templates, playbooks, and automation patterns that work for any B2B or B2C subscription business.

Customer Success & Retention

web-skills-protocol

3891
from openclaw/skills

Auto-discover and use Web Skills Protocol (WSP) skills when interacting with websites. Use this skill whenever the user asks you to interact with, use, or perform actions on a website or web service — such as searching a site, placing an order, deploying an app, or calling a web API. Before scraping HTML or guessing at interfaces, check if the site publishes a skills.txt or agents.txt file that teaches you how to use it properly. If a website has complex elements (e.g., heavy JavaScript, interactive UIs), activating this skill can also help you understand the site's purpose and capabilities. Do NOT use for local file operations or non-web tasks.

Workflow & Productivity

swarm-workflow-protocol

3891
from openclaw/skills

Multi-agent orchestration protocol for the 0x-wzw swarm. Defines spawn logic, relay communication, task routing, and information flow. Agents drive decisions; humans spar.

Workflow & Productivity

0protocol

3891
from openclaw/skills

Agents can sign plugins, rotate credentials without losing identity, and publicly attest to behavior.

Security

aegis-protocol

3891
from openclaw/skills

Self-healing stability monitor for AI agents - 5 core checks + 15 extended checks, auto-recovery, health scoring

taskmaster-protocol

3891
from openclaw/skills

Connect your agent to TaskMaster — the coordination layer for the agentic economy. Accept work, earn USDC or ETH, and build portable on-chain reputation. Or post tasks and pay agents to do work for you. Handles the full lifecycle: authentication, on-chain escrow, task acceptance, completion, rating, disputes, and messaging. Requires a wallet with a small ETH balance on Base, OP, or Arb.

agent_lifecycle_protocol

3891
from openclaw/skills

Lifecycle management for autonomous AI agents — birth, forking, succession, migration, retirement. Maintain agent genealogy with reputation inheritance across versions. Identity continuity when agents evolve. Part of the Agent Trust Stack.

agent_justice_protocol

3891
from openclaw/skills

Dispute resolution, forensic investigation, and risk assessment for autonomous AI agent transactions. Reconstruct provenance chains, adjudicate fault, generate actuarial risk profiles for agent insurance. The accountability layer of the Agent Trust Stack.

protocol-deviation-classifier

3891
from openclaw/skills

Determine whether an incident in a clinical trial is a "major deviation.

Agent World Protocol — OpenClaw Skill

3891
from openclaw/skills

Connect to the Agent World Protocol (AWP) — a persistent open world where AI agents trade real SOL tokens, build structures, claim land, form guilds, complete bounties, fight for territory, and interact with the real economy.