All posts

How to Remove Identical Rows From a CSV

··2 min read

To remove identical rows from a CSV, upload it to the remove duplicate rows tool, leave the defaults on and download the list. The first copy of each row stays and later copies that match it in every cell are removed.

When you need this

You pasted a file twice, joined two exports of the same list, or copied a header row into the middle of a sheet. The repeats are exact copies, and they would make you check and email the same person twice.

What you need

  • A CSV or .xlsx file with a header row.

Step 1: load the list

Upload the file or paste the cells with the header row first. Only the first sheet of a workbook is read.

Step 2: choose what counts as identical

Two options, both about how strict the match is:

  • Ignore spaces before and after each cell. On by default. Ava Stone matches Ava Stone.
  • Treat upper and lower case as different. Off by default, so AVA@example.com matches ava@example.com.

Empty cells at the end of a row are ignored, so a row with trailing commas still matches the same row without them. A row with every cell blank is never removed as a repeat; blank rows are kept and counted.

Step 3: read what was removed

Each removed row is shown with the row it matches. Look at a few before you download. If you see rows you expected to stay, the cause is almost always a cell that differs only by spacing or case, so check the two options.

Step 4: know what stays

Two rows with the same email but a different company are not identical, so both stay. That is intended: the tool never decides which cell is right. When you want one row per email, use remove CSV duplicates by column, or keep the newest row per email when you have a date.

Step 5: download and check

Download the list, and the removed rows as a record. Then upload the list to check the addresses so you do not send to dead mailboxes. The pricing page has the plans for larger lists. For where this fits in a full routine, read clean list before campaign checklist and how to clean an email list.

Common problems

  • Repeats remain. They differ in one cell, often a trailing space or a changed company. Use dedupe by column instead.
  • Too many rows removed. Turn on exact case matching and run again.
  • A header row remains in the middle of the list. Its cells match the header, not a body row, so delete it by hand or filter on the header text.

Frequently asked questions

Does it keep the first or last copy? The first.

Can I see which row each removal matches? Yes. The removed rows file has a same_as_row column.

Does it work on any CSV? Yes. It does not need an email column.

Common questions

How do I remove identical rows from a CSV?

Upload the CSV to the remove duplicate rows tool or paste the cells with the header row first. Every row that matches an earlier row in every cell is removed and the first copy stays. Download the list and the removed rows.

What is the difference from removing duplicate emails?

Deduping by email keeps one row per address even if other cells differ. Removing identical rows keeps both rows when any cell differs.

Is the first or the last copy kept?

The first.

Is my file uploaded?

No. The file is read in your browser.

Check your list before you send

Real mailbox checks over SMTP, and nothing is sent to the address. Sign in with Google and your first 100 email checks are free, no card. Plans for bigger lists are on the pricing page.