Turn an LLM into a custom zero-shot classifier
You often need to sort free text — support tickets, model outputs, user feedback — into your own categories without training a model. This tool wraps a single API call in a structured classification prompt: you define the labels, paste the text, and get back one category, a confidence score, and a short justification you can review.
How it works
You list your categories one per line, optionally adding a dash and a short description or example to disambiguate them. The tool builds a classification prompt that pins the model to choosing exactly one of your labels and asks it to respond as JSON with a category, a 0–1 confidence, and one-sentence reasoning. It then parses that JSON, normalizes the confidence (accepting either 0–1 or 0–100 formats), and falls back to a name-match if the model wraps the output in prose or code fences.
Tips and notes
Keep categories mutually exclusive and add a one-line example to each — that single
change is the biggest accuracy lever for zero-shot classification. For high-volume
or production use, switch to a cheaper model like gpt-4o-mini or
claude-3-5-haiku and validate a sample by hand to check the boundaries. Low
confidence usually signals overlapping or under-specified categories rather than a
hard example. Your key never leaves your browser except to call the provider
directly, and it is never stored.