What is the Root Signals MCP Server?

The Root Signals MCP Server acts as a bridge between the Root Signals API and MCP client applications, allowing AI assistants and agents to evaluate responses against various quality criteria.

What is MCP?

MCP stands for Model Context Protocol. It is an open protocol that standardizes how applications provide context to LLMs.

What are the key features of the Root Signals MCP Server?

The key features include:

• Exposing Root Signals evaluators as MCP tools
• Supporting both standard evaluation and RAG evaluation with contexts
• Implementing SSE for network deployment
• Compatibility with various MCP clients such as Cursor

What tools are exposed by the server?

The server exposes tools such as:

• list_evaluators - Lists all available evaluators.
• run_evaluation - Runs a standard evaluation.
• run_rag_evaluation - Runs a RAG evaluation with contexts.
• run_coding_policy_adherence - Runs a coding policy adherence evaluation using policy documents.
• list_judges - Lists all available judges on your Root Signals account.
• run_judge - Runs a judge using a specified judge ID

How do I get started with the Root Signals MCP Server?

1. Get your Root Signals API key.
2. Run the MCP server using Docker.
3. Configure your MCP client to connect to the server.

How can I contribute to the project?

Contributions are welcome. Follow the contribution guidelines outlined in the repository, including setting up your development environment, adding tests, and formatting your code.

What are the limitations of the current implementation?

Currently, the implementation does not include backoff and retry mechanisms for API calls or request throttling for rate limit compliance. Also, the bundled MCP client is for reference only and has no support guarantees.