Skip to content
TinySolve

Remove Duplicate Lines

Strip repeated lines from a list while keeping the original order intact.

Runs in your browser — nothing you type is sent anywhere

The first time a line appears is kept and the order is never changed, so a list stays in the sequence you pasted it.

Result

The result appears here as you type. Nothing is sent anywhere — the work happens in this page.

About the Remove Duplicate Lines

Lists collect duplicates. Email addresses exported from two places, keywords gathered from several reports, URLs pasted from a dozen tabs — all of them end up with the same entry more than once, and spotting repeats by eye in a list of several hundred is hopeless.

This tool keeps the first time a line appears and removes every later copy. Crucially, it does not sort: the order you pasted is the order you get back. That matters for anything where position carries meaning — a ranked list, a sequence of steps, a log — and it is the main way this differs from piping text through a sort-and-unique command.

Two options change what counts as a duplicate. Ignoring surrounding spaces is on by default, because a trailing space is invisible and would otherwise make two identical entries look different. Matching case exactly is off by default, so Apple and apple are treated as the same entry; turn it on when case is significant, as in a list of identifiers or passwords.

You are told how many lines went in, how many came out, and how many were removed, so you can sanity-check the result rather than trusting it blindly. Everything runs in the page, so a list of customer emails is never uploaded anywhere.

How to use the Remove Duplicate Lines

  1. Paste your list

    One entry per line. It can be anything — email addresses, URLs, product codes, names.

  2. Decide what counts as a duplicate

    Choose whether case matters and whether surrounding spaces should be ignored when comparing two lines.

  3. Read the counts

    The summary shows how many lines went in, how many came out, and how many duplicates were removed.

  4. Copy the clean list

    Copy it to your clipboard or download it as a text file. Your original is untouched in the box on the left.

Frequently asked questions

Does this change the order of my list?
No. The first occurrence of each line stays exactly where it was, and later copies are removed. That is deliberate — sorting a list to deduplicate it destroys any meaning the order carried, such as ranking or sequence.
Which copy of a duplicate is kept?
The first one. Later copies are removed, so if the same entry appears on lines 3, 40 and 91, only line 3 survives and it stays at position 3.
Are Apple and apple treated as the same line?
By default yes, because that is usually what people want when cleaning a list of names or emails. Turn on match case exactly when the difference is meaningful, such as in a list of case-sensitive identifiers.
Why are two identical-looking lines not being merged?
One of them almost certainly has a trailing space or tab, which is invisible. Ignoring surrounding spaces is on by default for exactly this reason, so make sure it has not been switched off.
Is my list uploaded anywhere?
No. The whole thing runs in your browser as you type, and nothing is transmitted or stored. Lists people deduplicate are often customer emails or internal data, which is precisely what should not be pasted into a website that keeps it.