Search tools

Type to filter all tools

Dedupe Lines

Remove duplicate lines from a list or text, keeping the first occurrence. Optionally ignore case and whitespace, or drop blank lines too.

Everything runs locally in your browser. Your data never leaves your device.

Options

Next steps

Send this tool's output straight into another tool.

About the Dedupe Lines

This tool removes duplicate lines from a text. Paste a list and every line keeps only its first occurrence, in the original order, with a summary of how many duplicates were dropped.

It is built for the everyday cleanup jobs: merged email lists, exported keywords, log output, any list that has picked up repeats.

What you can do

  • Remove duplicate lines from a list while keeping the original order.
  • Ignore case, so Foo and foo count as the same line.
  • Ignore leading and trailing whitespace when comparing.
  • Remove blank lines in the same pass.
  • See how many lines went in, came out and were removed.

How to use the Dedupe Lines

  1. 1Paste your lines into the input on the left.
  2. 2Pick the comparison options: ignore case, ignore surrounding whitespace, remove blank lines.
  3. 3Read the deduplicated result on the right, then copy or download it.

What counts as a duplicate

By default two lines must match exactly, character for character. Turn on the options to loosen that: ignoring case treats different capitalizations as the same line, and ignoring whitespace lets an indented copy match a flush one. The kept line is always the first one as you typed it, the options only affect the comparison.

Blank lines are treated as structure, not content. They are never deduplicated against each other, so your paragraph breaks survive, but you can remove them all with the last option.