Sanye Hub

Text Deduplication failed or not working — what can you do?

Paste multi-line text and remove duplicates with one click…

Text Deduplication failed or not working — what can you do?

What you can do

  • Open Text Deduplication and retry with a small known-good sample.
  • Confirm you are not hitting this limit: Full-line matching: only completely identical lines count as duplicates; case, full-width/half-width, and in-line spacing differences stay distinct.
  • Check the FAQ below—encryption, size limits, and format mismatches are the usual causes.
  • Still stuck? Try a private window, or read the full guide /#article/dedupe.

FAQ

What limitations should I know?

Full-line matching: only completely identical lines count as duplicates; case, full-width/half-width, and in-line spacing differences stay distinct.

When might it fail?

With Keep leading/trailing spaces, lines that differ only by edge spaces are not merged.

What else should I watch for?

Sorting changes only how unique results are shown, not dedupe logic or occurrence counts.