Remove Duplicate Lines
Paste a list, one item per line. The first occurrence of each line is kept in its original position and later repeats are removed.
Runs entirely in your browser. Your text is not uploaded.
0words
0characters
0lines
0 duplicate lines removed
0words
0characters
0lines
How to use the remove duplicates
- Paste your list.
- Choose whether "Apple" and "apple" count as the same line, and whether to ignore spaces at the ends.
- Copy the deduplicated list.
Questions
Does removing duplicates change the order?
No. The first copy of each line stays where it was. If you also want the list sorted, use Sort Lines with "remove duplicates" ticked.
Can I dedupe email addresses that differ only in capitals?
Yes. Tick "ignore case" and "Ann@Example.com" and "ann@example.com" are treated as the same line.
Is there a size limit?
No fixed limit. Lists of a few hundred thousand lines process in about a second on a modern laptop because nothing is uploaded.