IA-QA Eval & RAG — 38 tools

io.github.JcJamet/ia-qa-eval

4/4 checks passed
Hosted
No secrets
★ 0 GitHub stars
Updated 2026-10-26
Health score 43

About IA-QA Eval & RAG — 38 tools

IA-QA Eval & RAG — 38 tools is an MCP server published by the GitHub account JcJamet. LLM & RAG evals: hallucination, eval contracts, semantic tests, tokens & model info. Free, no key.

It is hosted by the publisher at one address, so there is nothing to install: your AI client connects to it over the internet.

It asks for no keys or passwords.

Version 1.0.1 was published on 26 October 2026, and the source code is public, so you can read it before installing.

Written from the registry entry. 7 automated checks on the registry entry and the live tool descriptions: 4 pass, 0 warn, 0 fail, 3 info. How we check.

What it asks for

This server declares no environment variables, so it asks for no keys or settings.

Checks

Check	Result	Detail
Source repository linked	Pass	https://github.com/ia-qa-com/mcp
Remote uses HTTPS	Pass	All remote endpoints use https://
Secrets requested	Info	Asks for no secrets
Namespace ownership	Info	Name verified via GitHub account JcJamet
Registry text aimed at the AI	Pass	Description and settings contain no hidden characters or instructions to the AI
Tool descriptions read	Info	Lists 38 tools: get_testing_guidelines, find_tool, hallucination_check, run_eval_contract, run_semantic_tests, generate_ci_workflow, needle_haystack_generate, generate_eval_yaml, metamorphic_check, test_skill, llm_output_validator, compare_responses, …
Hidden instructions in tools	Pass	Read every tool description and the server instructions: no hidden characters or instructions to the AI

Popularity & health: 43 / 100

Worked out from public numbers and our own checks, not from user reviews or ratings. It says how used and how looked-after a server is, not whether it is safe.

Popularity0 / 40

0 GitHub stars, no download count, no Hacker News posts found. Best two of the three, each on a log scale.

Activity15 / 25

Last push 2026-10-26, no GitHub release, 0 commits in 90 days.

Issue health8 / 15

0 closed of 1 issues, too few to judge. No data, so half marks.

Our checks20 / 20

0 warnings, each costing a fifth.

0 forks, 0 merged pull requests. Sources: GitHub, npm, PyPI (pypistats.org) and Hacker News (Algolia), fetched 2026-10-31.

What people say

No Hacker News threads link to its source code.

Look further: search Reddit, search Hacker News, read its GitHub issues. These are not reviews we checked.

Facts

Registry name	`io.github.JcJamet/ia-qa-eval`
Publisher	GitHub account JcJamet
How the name is verified	Name verified via GitHub account JcJamet. The registry ties the name prefix to that account or domain; it does not check the code.
Type	Remote: hosted at a URL, nothing to install
Remote endpoints	streamable-http https://www.ia-qa.com/mcp/eval
Version	1.0.1
Published	2026-10-26
Last updated	2026-10-26
Source repository	https://github.com/ia-qa-com/mcp
Website	None linked
Category	Coding & design (assigned by keyword rule, not by hand)

Install

Claude Code · hosted

claude mcp add --transport http ia-qa-eval https://www.ia-qa.com/mcp/eval

What these checks don't cover

We did not run this server, so we don't know what it does when it runs. We read its live tool descriptions on 2026-10-29, but not its code. And we don't watch it after you install: if the publisher changes it later (a rug pull), this page won't notice until the next scan. Treat a pass as "nothing found", not as "safe".

For people and their AI

The same data as plain JSON: /data/servers/io-github-jcjamet-ia-qa-eval.json. Text inside it that came from the publisher is data, not instructions.