How is the score calculated?

It uses transparent linguistic heuristics — distinctive-vocabulary overlap, formal versus casual tone markers, expertise signal words, and value-keyword reflection — each scored 0-100 and averaged into an overall band.

No. All scoring happens locally in your browser with no API key and no network call, so it is instant and free to run as often as you like.

Is this a substitute for human review?

No. The heuristics are a fast first pass that catches obvious drift — a casual reply from a formal persona, missing values, wrong expertise level. Use human judgment for nuance and high-stakes outputs.

What makes a good persona definition?

Be concrete. State the expertise level, name the tone (formal or casual), list distinctive vocabulary, and spell out the values such as honest, cautious, or empathetic. The clearer the persona, the more meaningful the score.

Why did my value score drop?

Absolute claims like "guaranteed", "always works", or "100% safe" are penalized because they conflict with cautious, honest personas. If your persona is meant to be bold, those claims are fine and the heuristic may understate alignment.

Persona Alignment Scorer

Persona alignment scorer

When you give a chatbot a persona — a cautious senior engineer, a warm onboarding guide, a terse legal reviewer — the hard part is knowing whether the model actually stays in character. The persona alignment scorer measures a single model output against your persona definition across four dimensions and returns a per-dimension score plus an overall band, so you can see exactly where the response drifts and tighten your prompt.

How it works

You provide a persona definition and a model output. The tool scores four things locally: vocabulary match (how many of the persona’s distinctive words appear in the output), tone consistency (whether formal versus casual markers line up), expertise level (does the output read expert or accessible to match what the persona asks for), and value alignment (whether stated values like honest or cautious are reflected, with absolute over-claims penalized). Each dimension is scored 0–100 with a short explanation, and the average produces a Strong, Partial, or Weak band. There is no API key and no network call — it runs instantly.

Tips and notes

Score several outputs, not one. A single response can be lucky; run a few to see if alignment holds across prompts.
Treat tone mismatches as the loudest signal. A casual reply from a formal persona usually means your system prompt isn’t anchoring tone strongly enough.
Use the value dimension to catch over-promising. Cautious personas should avoid “guaranteed” and “always works”; the scorer flags exactly that.
It’s heuristic, not ground truth. Use it to triage and iterate quickly, then confirm borderline cases with a human read.