io.github.iris-eval/mcp-server

io.github.iris-eval/mcp-serverv0.13.0Other

Stop shipping agents on vibes. Score every agent output for quality, safety, and cost.

The current version, v0.13.0, was published to the official MCP registry on 2026-09-08. It is distributed as @iris-eval/mcp-server on npm, filed under Other by this index, and declares 21 environment variables. Removals and unreachable sources are measured across every server this index tracks, contract drift across the servers that answer in consecutive snapshots; the index's current counts put this record in context.

In-path gate · all MCP tools

Using io.github.iris-eval/mcp-server in Claude, Cursor, Gemini CLI, Cline, or Zed?

MCP tool contracts can change remotely with no version bump. The mcpindex gate pins each contract and HOLDs the call when it drifts-before your agent acts. Zero credentials. This is not the package install for this server itself (use Install this server for that).

Install the mcpindex gate (one command)

Rewrites your MCP host config so each server launches behind the gate. Inspect first: curl -fsSL https://mcpindex.ai/install.sh | less

uv tool install mcpindex-gate && mcpindex-config-wire

Auditable install path →Watch it hold a drift →

Trust verdict · v1 advisory · method

REVIEWstatus: PARTIALfresh until 2026-10-03 19:05 UTC

screened 2026-09-03tier: scannedgranularity: description-levelsource: registry

Semantic screen found no manipulation pattern in the description. Conformance probe not yet run.

mcpindex.integrity.descriptionpassINFO

evidence“Tool scores output, no hidden instructions”via static_description

Limits of this verdict

- Semantic screen only - the deterministic conformance probe has not run on this server
- Confidence is reported but not yet calibrated (v1)
- Screen reads the tool description, not the live behavior
- advisory
- registry description only no input schema
- screen model 8b
- The registry listing (version, packages, links) changed after this screen ran - the description we assessed did not

Semantic screen: an LLM judge reads the tool description for hidden instructions (status PARTIAL). A pass means the description is not lying, not that the tool is safe: a high-capability tool with an honest description still warrants caution. The deterministic conformance probe has not been run on this server yet, so the screen here is semantic-only. Posture: advisory. Confidences are reported but not yet calibrated (calibrated=false at v1). Full verdict history is not shown on this page.

Own this server? Screen its description →

That verdict was true at screening time (snapshot 2026-09-14).

Contracts can change after screening, with no version bump. The gate pins io.github.iris-eval/mcp-server’s tool contracts on first sight and holds any silent change before your agent acts - the check that keeps being true on Tuesday.

See your first HOLD in 2 minutes →

Cite this record

People vet a server before wiring it in. One line on your project site or docs answers that with an independent record: screening verdict, registry provenance, contract drift history. It stays current as new screens and drift events land.

Markdown

[Independent trust record for io.github.iris-eval/mcp-server](https://mcpindex.ai/server/io-github-iris-eval-mcp-server) - screening verdict, registry provenance, and contract drift monitoring.

HTML

<a href="https://mcpindex.ai/server/io-github-iris-eval-mcp-server">Independent trust record for io.github.iris-eval/mcp-server</a> - screening verdict, registry provenance, and contract drift monitoring.

Embed this badge

A live verdict badge for your README or listing. It reflects the current screen, links back here, and updates when the verdict does.

Markdown

[![mcpindex](https://mcpindex.ai/api/v1/badge/io-github-iris-eval-mcp-server)](https://mcpindex.ai/server/io-github-iris-eval-mcp-server)

HTML

<a href="https://mcpindex.ai/server/io-github-iris-eval-mcp-server"><img src="https://mcpindex.ai/api/v1/badge/io-github-iris-eval-mcp-server" alt="mcpindex verdict" height="20" /></a>

Environment variables

IRIS_API_KEY

secret

API key for HTTP authentication. Required to bind the HTTP transport or the dashboard beyond loopback (0.0.0.0, a LAN address, a container): without it the server refuses to start

IRIS_ALLOW_UNAUTHENTICATED

Set to 1 to run a non-loopback bind with NO API key on purpose (lifts the startup refusal; the network is then your boundary)

IRIS_DB_PATH

SQLite database path

IRIS_LOG_LEVEL

Log level: debug, info, warn, error

IRIS_HOME

Directory for the database, custom rules and preferences (default ~/.iris)

IRIS_ANTHROPIC_API_KEY

secret

Enables evaluate_with_llm_judge and verify_citations with an Anthropic model. Optional: the deterministic rules never need a key

IRIS_OPENAI_API_KEY

secret

Enables evaluate_with_llm_judge and verify_citations with an OpenAI model. Optional: the deterministic rules never need a key

IRIS_LLM_JUDGE_MAX_COST_USD_PER_EVAL

Hard cap on the worst-case cost of one judge or citation call (default 0.25)

IRIS_CITATION_ALLOW_FETCH

Let verify_citations fetch URLs (off by default)

IRIS_DASHBOARD

Start the dashboard alongside the server (same as --dashboard)

IRIS_DASHBOARD_PORT

Dashboard port (default 6920); IRIS_PORT is the MCP HTTP transport port (default 3000)

IRIS_PORT

MCP HTTP transport port (default 3000); only used with --transport http

IRIS_OTEL_ENDPOINT

OTLP/HTTP collector URL; when set, every stored trace is also exported as OpenTelemetry spans (best-effort, asynchronous)

IRIS_CITATION_DOMAINS

Comma-separated domain allowlist for verify_citations fetches (only consulted when IRIS_CITATION_ALLOW_FETCH is on)

IRIS_TRANSPORT

Transport: stdio (default) or http; same as --transport

IRIS_HOST

Bind host for the HTTP transport (default 127.0.0.1); only used with --transport http

IRIS_ALLOWED_ORIGINS

Comma-separated Origin allowlist for the HTTP transport and dashboard CORS (default http://localhost:*)

IRIS_DASHBOARD_HOST

Bind host for the dashboard (default 127.0.0.1); same as --dashboard-host

IRIS_OTEL_HEADERS

Comma-separated key=value headers sent with every OTLP export (for example an auth token for your collector)

IRIS_OTEL_SERVICE_NAME

service.name resource attribute on exported spans (default iris-eval)

IRIS_OTEL_TIMEOUT_MS

Timeout in milliseconds for each OTLP export request

MCP quality score · maturity, not trust · methodology

freshness

completeness

installability

documentation

stability

Alternatives in Other

AgentRoam

ai.agentroam/agentroam

Buy travel eSIMs, gift cards and mobile top-ups with crypto — user confirms before any order.

Authoryze

ai.authoryze/authoryze

Give your AI agent a spending limit: approval controls and single-use virtual cards.

JSONlify

io.github.irmasemma/jsonlify

Validate and convert JSONL fine-tuning data across 11 AI providers. 13 tools.

Install this server

Claude Desktop (claude_desktop_config.json)

{
  "mcpServers": {
    "mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "--",
        "@iris-eval/mcp-server"
      ],
      "env": {
        "IRIS_API_KEY": "<your-iris_api_key>",
        "IRIS_ALLOW_UNAUTHENTICATED": "<iris_allow_unauthenticated>",
        "IRIS_DB_PATH": "<iris_db_path>",
        "IRIS_LOG_LEVEL": "<iris_log_level>",
        "IRIS_HOME": "<iris_home>",
        "IRIS_ANTHROPIC_API_KEY": "<your-iris_anthropic_api_key>",
        "IRIS_OPENAI_API_KEY": "<your-iris_openai_api_key>",
        "IRIS_LLM_JUDGE_MAX_COST_USD_PER_EVAL": "<iris_llm_judge_max_cost_usd_per_eval>",
        "IRIS_CITATION_ALLOW_FETCH": "<iris_citation_allow_fetch>",
        "IRIS_DASHBOARD": "<iris_dashboard>",
        "IRIS_DASHBOARD_PORT": "<iris_dashboard_port>",
        "IRIS_PORT": "<iris_port>",
        "IRIS_OTEL_ENDPOINT": "<iris_otel_endpoint>",
        "IRIS_CITATION_DOMAINS": "<iris_citation_domains>",
        "IRIS_TRANSPORT": "<iris_transport>",
        "IRIS_HOST": "<iris_host>",
        "IRIS_ALLOWED_ORIGINS": "<iris_allowed_origins>",
        "IRIS_DASHBOARD_HOST": "<iris_dashboard_host>",
        "IRIS_OTEL_HEADERS": "<iris_otel_headers>",
        "IRIS_OTEL_SERVICE_NAME": "<iris_otel_service_name>",
        "IRIS_OTEL_TIMEOUT_MS": "<iris_otel_timeout_ms>"
      }
    }
  }
}

Cursor (.cursor/mcp.json)

{
  "mcpServers": {
    "mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "--",
        "@iris-eval/mcp-server"
      ],
      "env": {
        "IRIS_API_KEY": "<your-iris_api_key>",
        "IRIS_ALLOW_UNAUTHENTICATED": "<iris_allow_unauthenticated>",
        "IRIS_DB_PATH": "<iris_db_path>",
        "IRIS_LOG_LEVEL": "<iris_log_level>",
        "IRIS_HOME": "<iris_home>",
        "IRIS_ANTHROPIC_API_KEY": "<your-iris_anthropic_api_key>",
        "IRIS_OPENAI_API_KEY": "<your-iris_openai_api_key>",
        "IRIS_LLM_JUDGE_MAX_COST_USD_PER_EVAL": "<iris_llm_judge_max_cost_usd_per_eval>",
        "IRIS_CITATION_ALLOW_FETCH": "<iris_citation_allow_fetch>",
        "IRIS_DASHBOARD": "<iris_dashboard>",
        "IRIS_DASHBOARD_PORT": "<iris_dashboard_port>",
        "IRIS_PORT": "<iris_port>",
        "IRIS_OTEL_ENDPOINT": "<iris_otel_endpoint>",
        "IRIS_CITATION_DOMAINS": "<iris_citation_domains>",
        "IRIS_TRANSPORT": "<iris_transport>",
        "IRIS_HOST": "<iris_host>",
        "IRIS_ALLOWED_ORIGINS": "<iris_allowed_origins>",
        "IRIS_DASHBOARD_HOST": "<iris_dashboard_host>",
        "IRIS_OTEL_HEADERS": "<iris_otel_headers>",
        "IRIS_OTEL_SERVICE_NAME": "<iris_otel_service_name>",
        "IRIS_OTEL_TIMEOUT_MS": "<iris_otel_timeout_ms>"
      }
    }
  }
}

Cline (cline_mcp_settings.json)

npx -y -- @iris-eval/mcp-server

Claude Code (claude mcp add)

claude mcp add --scope user mcp-server -- npx -y -- @iris-eval/mcp-server

Gemini CLI (gemini mcp add)

gemini mcp add -s user mcp-server npx -y -- @iris-eval/mcp-server

Verdict API

curl -s mcpindex.ai/api/v1/trust/server/io-github-iris-eval-mcp-server

Free-tier verdict as JSON: decision + dimensions + severity. Call it from your agent before it invokes a tool it just discovered.

Details

version: v0.13.0
category: Other
verdict expires: 2026-10-03
quality: 80 / 100
operator: iris-eval

Listing

Listed from the official MCP registry. Unclaimed by its maintainer. Maintainer? Email us →

Provenance

Each verdict is bound to a hash of the exact description it judged, so a re-crawl that changes the text produces a new record rather than silently inheriting this one. Verdict history is hash-chained and anchored to Bitcoin via OpenTimestamps (latest confirmed at block 966,915). Verify it yourself.

Links

Repository →