Description

A Node.js package and GitHub Action for evaluating MCP tool implementations using LLM-based scoring.

Installation 

npx -y mcp-evals
npm install mcp-evals
git clone https://github.com/mclenhard/mcp-evals

Claude Desktop Configuration

Add this configuration to your Claude Desktop config file to enable this MCP server:

Config file location: ~/Library/Application Support/Claude/claude_desktop_config.json

Config file location: %APPDATA%\Claude\claude_desktop_config.json

Config file location: ~/.config/Claude/claude_desktop_config.json

claude_desktop_config.json 
{
  "mcpServers": {
    "mcp-evals": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-evals"
      ]
    }
  }
}