Sort

Last updated 12 Sep 2026

Sort processes large text datasets locally. Select a tool, input files, and an output folder, review its options, then select Execute. Input content is not uploaded.

Shared settings

The output folder is local. The read buffer defaults to 64 MB and accepts 1–256 MB. Where a separator is configurable, the choices are colon, pipe, semicolon, @, #, and ~.

All 10 tools

ToolWhat it doesDefault behavior
URL SorterCategorizes url:login:password rowsAll categories; dedup on
URL CleanerValidates and normalizes URL credential rowsProtocol + ads cleanup; dedup on
Archive ExtractorReads archives for credential textRecursive; dedup; 16 threads
CleanerValidates login:password lengths and rulesLogin 3–64; password 4–128
Domain CounterCounts email domains and applies a thresholdDedup on
Anti PublicChecks against a selected local databaseSave public/private; effort auto
DeduperRemoves duplicate linesCase-sensitive
FilterMatches a substring or regular expressionPlain substring; not inverted
SplitterSplits an input by line count500,000 lines; Chunk prefix
JoinerMerges multiple filesDedup on

URL Sorter can emit email, phone, username, unknown, full URL-login-password, and login-password categories. Cleaner has no password-character requirements by default; mail-password mode is off, ad removal is on, and deduplication is on.

Archive Extractor supports ZIP, RAR, 7z, TAR, TAR.GZ/TGZ, TAR.BZ2/TBZ2, TAR.XZ/TXZ, GZ/GZIP, BZ2, XZ, and ZST/ZSTD. It reads .txt, .csv, and .log content, supports nested archives and password lists, and recognizes password-list filenames. Test unfamiliar archive sets with a small sample first.

Output files

  • URL Sorter: mail_pass.txt, phone_pass.txt, user_pass.txt, unknown.txt, url_login_pass.txt, and login_pass.txt.
  • URL Cleaner and Cleaner: cleaned.txt / bad.txt, and valid.txt / invalid.txt.
  • Deduper, Filter, and Joiner: deduped.txt, filtered.txt / unmatched.txt, and joined.txt.
  • Splitter and Domain Counter: Chunk_001.txt onward, and domains.txt.
  • Archive Extractor and Anti Public: category files plus archive_results.txt, or public.txt / private.txt.

Reference benchmarks

These are approximate observed runs, not guarantees. Storage speed, CPU, input shape, options, and deduplication cardinality change the result.

ToolInputObserved time
Archive Extractor100 GBabout 50 seconds
URL Cleaner1 billion URLsabout 2 minutes
URL Sorter1 billion URLs, about 58 GBabout 20 seconds
Deduper1 billion URLs, about 58 GBabout 2 minutes

The test machine specifications and timing procedure were not recorded.

Only process datasets you own or are authorized to handle. Review the output format on a small file before running a destructive downstream workflow.