What is a guard model?

A guard model is a smaller, cheaper classifier that screens each request (and optionally each response) for policy violations — toxicity, self-harm, jailbreaks, PII — before the expensive main model runs. Examples include OpenAI's moderation endpoint, Meta's Llama Guard, and NVIDIA Nemo Guardrails. It is a safety layer, not the model that does your actual work.

How much does a guard model usually add?

Because guard models are small and process short inputs, the overhead is often a few percent of total cost. The exact figure depends on guard token volume versus your main-model spend — high-volume apps with cheap main models feel it most, which is exactly what this tool quantifies.

Should I guard the input, the output, or both?

Input guarding catches malicious or policy-violating prompts before you spend on generation. Output guarding catches unsafe model responses before they reach the user. Many production systems do both, which roughly doubles the guard token volume — model that by entering combined guard tokens per request.

Can the moderation API be free?

OpenAI's moderation endpoint is currently free for OpenAI customers, in which case set the guard cost to zero and the calculator confirms the overhead is purely latency, not dollars. Self-hosted guards like Llama Guard cost compute instead of per-token fees — estimate that as an effective per-token price.

Is anything uploaded?

No. All figures are computed locally in your browser. Nothing you enter is transmitted.

LLM Guard / Moderation Model Cost Calculator

LLM guard model cost calculator

Putting a moderation or guard model in front of your main LLM is one of the cheapest safety wins available — but “cheap” is not “free.” This tool prices the guard layer precisely: per request, per month, and as a percentage of your total bill, so you can confirm the overhead is acceptable before you wire it into the hot path.

How it works

The guard cost per request is guard_tokens × (guard_price_per_1k / 1000). Multiply by daily requests and 30 days for the monthly guard bill. The tool then compares that to your main-model spend (main_cost_per_request × requests × 30) and reports the percentage overhead the guard adds to your total LLM cost.

It also computes a break-even view: how many blocked-or-unsafe requests the guard must prevent (each saving a wasted main-model call) for the guard to pay for itself purely on saved generation spend — before you even count the value of avoiding a harmful output.

Tips and notes

Guard models are small, so token-for-token they are far cheaper than your main model — the overhead is usually single-digit percent.
If your main model is expensive, every request the guard blocks saves a full generation, which can make the guard net-positive on cost alone.
Guarding both input and output roughly doubles guard token volume; enter the combined figure.
The free OpenAI moderation endpoint makes the dollar overhead zero — at that point the only cost is the added latency of one extra round trip, so keep the guard call fast and parallel where you can.