How to remove duplicate lines from a list
Remove duplicates from the list, keeping the first variation of each line.
What to prepare
Open the tool using the button above and paste the text.
Procedure
Prepare your text
Insert a list: each item on a new line. Decide whether to consider "Moscow" and "Moskva" the same and consider the spaces around the edges.
Select settings
Turn on "Match Case" if you want capital and small letters to be different. Enable Ignore Trailing Spaces if you don't want leading and trailing indentation to affect duplicate detection.
Click the button
Click "Remove Duplicate Rows" and wait until it's ready. If an error appears, read the message and check the file, text, or settings.
Save and check
Click “Download” on the finished result; if there is a copy button, you can copy the text. This leaves the first occurrence of each line in the original order. Check that the desired options were not combined by the selected rules.
Tool Options
Some fields appear after selecting a mode. The default settings are shown here; They are subject to change on the website.
- Match case
Treat large and small letters as different. For example, “Moskva” and “Moscow”.
- Ignore trailing spaces
Ignore leading and trailing spaces when searching for duplicates. The remaining line retains spaces.
Example
The first occurrence of each line is stored.
Was
Москва Тула Москва
It became
Москва Тула
Good to know
Just because spaces are not included in the comparison does not mean they will be removed from the remaining string. There is a separate tool for removing spaces.
Frequently asked questions
Where is the processing performed?
The tool runs on your device, right in your browser. Files and entered text for this operation are not sent to the server.
What to do if the result is not suitable?
Take the original file or text and try other settings in the steps above. Compare the new result with the previous one. The original files on your device remain unchanged.