Remove Duplicate Lines

Strip duplicate lines, keeping the first of each.

Ad placeholder (leaderboard)
Enjoying the tools? Go Pro for £4.99 (one-time) and remove all ads — forever, on this device. Remove ads — £4.99

Paste a list and this tool removes repeated lines while keeping the first occurrence of each and preserving the original order — ideal for cleaning email lists, deduping logs, tidying CSV columns, and merging lists without re-sorting.

How it works

The tool reads your text line by line and tracks which lines it has already seen using a set. For each line it builds a comparison key based on your options: with case-insensitive on, the key is lowercased; with trim whitespace on, leading and trailing spaces are stripped before comparing. If the key has not been seen, the line is kept (exactly as you typed it) and the key is remembered; if it has been seen, the line is dropped. Because it walks top to bottom and keeps the first hit, the output preserves your original order. You can also choose whether blank lines are kept or removed.

Example

Input with case-insensitive and trim on:

Apple
banana
apple
  Banana
Cherry

Output:

Apple
banana
Cherry

The two later “apple” / “Banana” lines are removed as duplicates (matched ignoring case and padding), and the result reports 3 kept, 2 removed.

OptionEffect
Case-insensitive”Apple” = “apple”
Trim whitespace” apple” = “apple”
Keep blank linesPreserve empty rows

The whole process runs in your browser and nothing is sent to a server.

Ad placeholder (rectangle)