Home / MCP registry index / io.github.JcJamet/ia-qa-eval

IA-QA Eval & RAG — 38 tools

io.github.JcJamet/ia-qa-eval in the official MCP registry. Endpoint https://www.ia-qa.com/mcp/eval. Source: github.com/ia-qa-com/mcp.

The registry describes it as: LLM & RAG evals: hallucination, eval contracts, semantic tests, tokens & model info. Free, no key.

We read its 38 tools on 2026-10-27. Nothing in them matched our tool-poisoning rules. It also sets server instructions, text a client puts in front of the model on connect; those were read too.

A clean read means these rules found nothing, not that the server is harmless. A server can change its tools at any time, which is why the index reads it again every week.

Tools it advertises

get_testing_guidelines find_tool hallucination_check run_eval_contract run_semantic_tests generate_ci_workflow needle_haystack_generate generate_eval_yaml metamorphic_check test_skill llm_output_validator compare_responses analyze_responses prompt_test_suite llm_format_check consistency_check llm_json_schema_check response_quality_score conversation_analyze cot_analyzer ab_test_report similarity_score run_vlm_test_suite embedding_similarity rag_relevance_rank bm25_score build_rag_prompt rerank_evaluate count_tokens extract_json_from_text estimate_llm_cost token_budget_calculator context_window_check model_info compare_models list_llm_models llm_generate rate_tool

Run this server? Show the check in your README

The badge reflects the latest weekly read: MCP tool check badge

Markdown
[![MCP tool check](https://lazaretto.dev/mcp-registry/io-github-jcjamet-ia-qa-eval/badge.svg)](https://lazaretto.dev/mcp-registry/io-github-jcjamet-ia-qa-eval)

How this was checked

Lazaretto connects to the endpoint the way any MCP client does, asks the server to introduce itself and list its tools, and reads every name, description, parameter schema and server instruction for tool poisoning: hidden directive blocks, orders to read local secrets, parameters built to carry secrets or the conversation out, orders that redirect another server's tools, and invisible characters. It never calls a tool. What we found across the registry.

To run the same check every time Claude Code adds a server, install the free lazaretto-guard plugin. Browse every server in the index.

Related

AI model MCP servers

Citiview Agent Market
com.citiviewgroup.mcp/agent-market
200 tools, nothing matched
2026-10-26
Huggingface
io.github.pipeworx-io/huggingface
54 tools, nothing matched
2026-10-27
io.github.DarthSander/agentdata-nl
io.github.DarthSander/agentdata-nl
53 tools, nothing matched
2026-10-22
Gemini Crypto
io.github.pipeworx-io/gemini-crypto
52 tools, nothing matched
2026-10-27
Rankwise
com.tryrankwise/rankwise
49 tools, nothing matched
2026-10-26
Tensorust
com.tensorust/mcp
46 tools, nothing matched
2026-10-27