Skip to content

Remove duplicate lines

Paste a list — email addresses, log lines, spreadsheet rows copied as text — and this tool strips out repeated lines while you choose exactly how a "duplicate" is defined: case-sensitive or not, trimmed or not, blank lines counted or not.

  • Nothing you type leaves this page
  • Works offline once loaded
  • Free forever, no signup
  • Lines in {{ result.totalIn }}
  • Lines out {{ result.totalOut }}
  • Removed {{ removedLabel }}
Result

From a free tool to your own software

Data cleaning and deduplication for sales and finance teams

The same lead arrives from a website form, an ad campaign and a trade-show list, and several salespeople end up calling one person in the same week. Duplicates in vendor masters and invoice registers cost more, because a bill entered twice can be paid twice. Deleting repeated rows by hand only catches exact copies; software can match records that differ in spelling, spacing or format and merge them before they cause harm.

  • Lead deduplication across sources

    Leads from forms, ad platforms, calls and imported lists are matched by phone, email and name as they arrive, merged into one record and assigned to a single owner.

  • Customer and patient master data

    Hospitals, lenders and retailers get one record per person by matching near-identical entries, with every merge reviewed and the original records kept for audit.

  • Duplicate invoice detection

    Accounts teams see bills flagged when the vendor, amount, date or invoice number closely matches one already recorded, before the payment run goes out.

  • Mailing and contact list hygiene

    Before each campaign, lists are cleaned of repeats, invalid numbers and opted-out contacts, so every customer receives one message and unsubscribe requests are respected.

Who we build this for: Sales and marketing teams, accounts departments, hospitals, lenders and retailers with large customer databases.

This tool runs entirely in your browser. The team that built it designs custom software for businesses and runs DigiSign, our own signage platform, in production.

How to use this tool

  1. Paste your list

    One item per line — or load the sample to see how the options behave.

  2. Set the matching rules

    Choose whether to keep the first or last copy of each duplicate, ignore case, trim stray spaces, and drop blank lines.

  3. Copy the cleaned list

    The result updates live; copy it back to your spreadsheet or script.

Questions people ask

What counts as a duplicate line?

By default, an exact character-for-character match. Turn on "ignore case" to treat Apple and apple as the same line, and "trim whitespace" to treat "banana" and "banana " (with a trailing space) as the same line too.

What is the difference between keeping the first and last occurrence?

If a line appears three times, "keep first occurrence" keeps it in the position where it first showed up and discards the later copies; "keep last occurrence" keeps it in the position of its final appearance instead. Useful when later entries in a log or export are the more up to date ones.

Does it remove blank lines automatically?

Only if you turn on "ignore blank lines" — otherwise blank lines are treated like any other line, and repeated blank lines get deduplicated the same as repeated text.

Can it sort the result as well?

Yes — the optional "sort result A–Z" checkbox alphabetises the deduplicated list after duplicates are removed, which is handy for turning a messy export into a clean, checkable list.

Is my list uploaded anywhere?

No. Deduplication runs entirely in your browser's JavaScript — there is no server endpoint on this page that accepts text, so the list never leaves your device.

Who makes these tools

Bookmark this page — the tool keeps working offline, and your settings stay in this browser. Built by Dynamb Technologies, who build software for businesses.