What does a VAE do in Stable Diffusion?

The VAE (Variational Autoencoder) decodes the model's internal latent representation into the final pixel image. A better-matched VAE produces sharper detail, more accurate colours and healthier skin tones, while a mismatched one can wash out or grey the image.

Do I always need to load a separate VAE?

No. Most modern checkpoints have a VAE baked in, and setting the VAE option to Automatic uses it. You only need an external VAE if your images look washed out, grey or muddy, which usually means the baked-in VAE is missing or broken.

Why do my images look washed out or grey?

That is the classic symptom of a missing or NaN VAE. Load a known-good external VAE such as sd-vae-ft-mse-840000 for SD 1.5 or the official SDXL VAE, and the colours and contrast usually snap back.

Can I use an SD 1.5 VAE with SDXL?

No. VAEs are architecture-specific. SD 1.5 VAEs only work with SD 1.5 checkpoints and SDXL VAEs only with SDXL. Using the wrong one produces corrupted or noise-filled output.

SD VAE Selection Guide

Pick a VAE that matches your style

If your Stable Diffusion images look slightly grey, washed out or muddy, the VAE is almost always the culprit. The VAE is the final decode step that turns the model’s latent math into pixels, and different VAEs render colour, contrast and especially skin tones differently. This guide matches your image style to a well-known VAE and tells you exactly which file to download.

How VAEs affect the image

Stable Diffusion works in a compressed latent space; the VAE decodes that latent into the RGB image you see. Two checkpoints with the same prompt can look very different purely because of their VAE:

sd-vae-ft-mse-840000 — the community default for SD 1.5 realism. Slightly softer, very natural skin tones, reliable colour.
vae-ft-mse (original) — a touch more contrast and saturation than 840000; good general purpose.
kl-f8-anime2 / blessed2 — tuned for anime and illustration: punchier colours, cleaner flat regions, crisp lineart.
SDXL VAE (sdxl-vae-fp16-fix) — the standard for SDXL. The fp16-fix variant avoids the black-image NaN bug on some GPUs.

A mismatched or missing VAE shows up as flat, desaturated output — the tell-tale “grey wash.”

Tips and download notes

Drop files in models/VAE/ (Automatic1111/Forge) or your ComfyUI models/vae/ folder, then refresh and select from the VAE dropdown.
Use Automatic first. Many modern checkpoints ship a good baked-in VAE; only override if the image looks washed out.
Match the architecture. SD 1.5 VAEs never work on SDXL and vice versa.
fp16-fix for SDXL on consumer GPUs. If you get pure-black images on SDXL, switch to sdxl-vae-fp16-fix — it solves the half-precision NaN problem.
All of these VAEs are hosted on Hugging Face (stabilityai and community repos); search the exact filename to find the canonical download.