This tool removes duplicate lines from a text. Paste a list and every line keeps only its first occurrence, in the original order, with a summary of how many duplicates were dropped.
It is built for the everyday cleanup jobs: merged email lists, exported keywords, log output, any list that has picked up repeats.
What you can do
Remove duplicate lines from a list while keeping the original order.
Ignore case, so Foo and foo count as the same line.
Ignore leading and trailing whitespace when comparing.
Remove blank lines in the same pass.
See how many lines went in, came out and were removed.
3Read the deduplicated result on the right, then copy or download it.
What counts as a duplicate
By default two lines must match exactly, character for character. Turn on the options to loosen that: ignoring case treats different capitalizations as the same line, and ignoring whitespace lets an indented copy match a flush one. The kept line is always the first one as you typed it, the options only affect the comparison.
Blank lines are treated as structure, not content. They are never deduplicated against each other, so your paragraph breaks survive, but you can remove them all with the last option.