ToolsMaxxing

Remove duplicate lines

Keep each line once and see how many duplicates were removed.

Your files stay on your device

How it works

  1. 1Paste your list, one item per line.
  2. 2Choose whether upper and lower case differ and whether to ignore spaces at line ends.
  3. 3Choose to keep the first or last copy.
  4. 4Copy the unique lines.

What the options do

Case sensitive
When on, Apple and apple are different lines. When off they count as duplicates.
Ignore spaces at the ends
Treats " apple" and "apple " as the same line.
Remove empty lines
Deletes blank lines. When off, blank lines are also reduced to one.
Keep
First occurrence keeps the earliest copy where it sits. Last occurrence keeps the final copy.

Privacy

Your text is processed in your browser and never sent to a server. Email lists and customer data stay on your device.

Questions people ask

Does it keep the original order?

Yes. Lines stay in the order you pasted them. Use the sort tool afterwards if you want them alphabetical.

Which copy is kept when case differs?

The one that comes first (or last, if you chose that), exactly as you typed it. The lower-case comparison only decides what counts as a duplicate.

How many lines can it handle?

Hundreds of thousands of lines work on most devices. The limit is browser memory.

Can it remove lines that are only similar?

No. Only lines that match exactly, under the options you choose, are treated as duplicates.

Is there a way to see which lines were removed?

The info line shows how many were removed. To see them, compare the input and result in the Text diff tool.

Related tools