ITBox

Batch dedupe, sort, reverse, trim — line-oriented text processing.

Switch tool
0 → 0
Input0 lines
Output0 lines

How to use

Purpose

Online text sort and deduplication tool. Sort lines alphabetically (A-Z / Z-A), numerically, by length, naturally ("file2" before "file10"), or randomly. Additional processing: dedupe, drop empty lines, normalize whitespace, trim. Supports custom separators (not just newline — , ; | also work), case sensitivity toggle, keep-original-order dedupe. Common for cleaning lists, log preprocessing, bulk user input handling, test data generation. All processing runs locally.

Steps

  1. Paste multi-line text (one item per line), or custom separator (comma, semicolon, pipe)
  2. Pick sort: alpha asc / desc, numeric, natural, length, random
  3. Pick processing: dedupe, drop empty lines, trim, normalize case, reverse
  4. Right pane shows results in real time
  5. Stats: original X lines, processed Y, duplicates removed Z
  6. Case sensitivity: affects sort order and dedup judgment
  7. Keep-original-order dedupe: retain first occurrence, delete duplicates
  8. Export / one-click copy

FAQ

Natural sort vs alphabetical?
Alphabetical: file1, file10, file2, file20, file3 (ASCII order — "10" < "2" since "1" < "2"). Natural: file1, file2, file3, file10, file20 (numbers by value). Files / versions / reports use natural; otherwise UX is poor. Tool defaults to natural.
How is Chinese sorted?
By Unicode code point default (close to "radical-stroke" but not exact). By Pinyin: convert to pinyin then sort (matches most user expectation, "安" before "陈"). Tool supports both; Unicode default. Note: HK/Taiwan traditional and Mainland simplified are in non-contiguous Unicode ranges; mixed sort may surprise.
Is dedupe case sensitive?
Default yes ("Apple" ≠ "apple"). Disable case-sensitive: dedupe based on lowercased values but preserve original case in output (first occurrence kept). Email list dedup usually disables case (user@example.com == USER@example.com).
Can I sort by a specific field (CSV-style)?
This tool is line-level — does not parse fields. For sort-by-column CSV use csv-json (convert to JSON, then jq / program) or Excel. The "custom separator" can hack simple cases by splitting on comma then sorting full lines.
Will huge data (100K lines) slow it down?
Under 100K lines local sort is fluid (< 1 second). 1 million lines is slow but completes (10-30 seconds). For multi-million lines use Unix `sort` / `awk` (handles tens of millions in seconds). This tool is not for extreme data.

Use cases

  • User list cleanup: imported unsorted list → alpha sort + dedupe
  • Log cleanup: drop duplicate ERROR lines
  • Version sort: v1.0, v1.10, v1.2 → natural sort = v1.0, v1.2, v1.10
  • Word frequency preprocessing: dedupe + sort before analysis
  • Test data: generate ordered inputs from unsorted samples

Use cases

User list cleanup, log preprocessing, version sort, word freq prep, test data. Ops, QA, data analysts, devops. Natural sort, Chinese pinyin/Unicode toggle, stable dedupe, custom separators are the differentiators.