🛡️ CertSight Trust Engine

Question-bank auditing as a service. You built a bank of exam questions — we run the same audit machinery on it that CertSight runs on its own banks, and hand you a report you can act on.

From $99 per bank, one-time. No subscription.

The two audits

How it works: upload your bank below → choose a tier and pay at Stripe checkout → the audit runs automatically → your report appears here and in your inbox. Most audits finish within the hour; the sampled re-solve is the slow part.

Upload your question bank

Log in to upload a bank. Log in Create an account

What the audit checks

• True duplicates — same stem, options and answer repeated inside a track (the exact duplicate policy CertSight's own bank guard enforces).
• Repeated stems with different options/answers — sometimes legitimate template authoring, always worth a glance.
• Malformed questions — empty stems, missing or too few options, answers that aren't a valid option index.
• Answer-position distribution — if 40% of your keys sit in position B, position-guessing pays off for students. We show the full distribution and flag skew.
• Explanation coverage — questions with no explanation, and explanations too short to teach anything.
• Duplicate options inside a single question, and possibly outdated references (past years, superseded versions).
• Blueprint coverage — when your questions declare a domain, we total coverage per domain and flag thin areas.
• Sampled key verification — an AI solver re-solves a random sample blind (it never sees your marked answers or explanations) and we compare. Disagreements are flagged for your review with the solver's reasoning.

Format we accept

One JSON file in the CertSight seed format (JSON only in this version — no CSV yet):

{
  "tracks": [
    {"id": "default", "name": "Full exam", "questions": [
      {"q": "Question text?",
       "options": ["Option A", "Option B", "Option C", "Option D"],
       "answer": 1,
       "explanation": "Why B is correct, and why the others are wrong.",
       "domain": "Optional blueprint domain",
       "difficulty": 3}
    ]}
  ]
}

answer is the zero-based index of the correct option. domain and difficulty are optional; domains unlock the coverage analysis.

Sample report excerpt (illustrative — from a sample bank, not a customer)

• [CRITICAL] True duplicate questions — 14
  Questions repeated within the same track with identical stem, options and marked answer.
• [WARNING] Answer-position skew — 1
  Position B holds 41.2% of keys (~25% expected) — position-guessing pays off.
• [WARNING] Questions with no explanation — 63
  No explanation text at all — students who miss these get no feedback.

Sampled verification: 50 questions re-solved blind, 92% agreement with the bank's keys, 4 flagged for review.

⚠️ Honest limits — read before you buy

• This is not an expert or board review. Structural checks are deterministic software. Key verification is a sampled AI re-solve. Neither is a subject-matter expert reading your bank, and a clean report does not certify that your bank is accurate or aligned to any official exam.
• Flagged ≠ wrong. When the solver disagrees with a key, the item deserves a human look — ambiguous questions can fool a solver, and occasionally the solver is simply wrong. We never change your keys, and your bank file is never modified.
• Sampling means sampling. Only the sampled questions (50 or 200, depending on tier) are individually re-solved. The rest are covered by the structural checks only.
• We don't keep or reuse your content. Your bank is stored against your account for your report, full stop.

If you need a qualified human to verify keys and content, use the expert-review request below instead — that's a person, priced and scheduled after a scoping conversation.

Expert-verified review (human)

A subject-matter expert reviews your bank: key verification against authoritative sources, ambiguity and distractor quality, blueprint fit. Priced per bank after a short scoping exchange — tell us about the bank and we'll reply with a quote and timeline. This form goes to a person; nothing about the human review is automated.