URL Deduplicator and Sorter
100% PrivateURL & Link ToolsClean a bulk list of URLs by removing duplicates and invalid lines, then sorting it.
Runs entirely in your browser. Your input is not uploaded to Ovatly or anywhere else.
- 1Paste your URL list, one URL per line.
- 2Tick the equivalence options that match your situation (all start off, so exact duplicates are removed first).
- 3Pick a sort order: alphabetical, by domain, by length, or keep the original order.
- 4Read the report, then copy or download the cleaned list.
Paste: https://example.com/page https://www.example.com/page https://example.com/page/ https://example.com/other With all options off, the sorted result keeps all 4 lines (they differ as written). Tick www equivalence and trailing slash, and the first three merge into one: the report shows https://example.com/page appeared 3 times, and the cleaned list is https://example.com/other and https://example.com/page.
- The first occurrence of each URL is the one kept, exactly as written; the toggles only change how URLs are compared, never how the kept line is spelled.
- Tracking parameter removal covers the common set: utm_ parameters, fbclid, gclid, dclid, msclkid, mc_cid, mc_eid, igshid and _ga.
- Lines that are not valid URLs are listed as skipped rather than silently deleted, so you can fix and re-add them.
Usually they serve the same page, and most sites redirect one to the other, but not always. The toggle is off by default so you choose deliberately.
About this tool
The URL Deduplicator and Sorter cleans a bulk list of URLs: it removes duplicates, drops invalid lines, and sorts what remains. You decide what counts as the same URL, with honest toggles for the grey areas: www versus bare domain, http versus https, trailing slashes, letter case, and tracking parameters that make one page look like five different links.
Related tools
Part of Ovatly's free tools in URL & Link Tools.