How to Compare Sorted Files Line by Line Using the comm Command in Linux

When you are managing massive corporate data pipelines, you frequently encounter two gigantic lists of data (e.g., a list of active users from Database A, and a list of active users from Database B). To mathematically identify the exact intersections and discrepancies between these two lists, manually reading them is catastrophically inefficient. To force the Linux kernel to execute a deep algorithmic comparison and isolate the commonalities, you must use the comm command.

Understanding the Prerequisite Architecture

CRITICAL ARCHITECTURAL WARNING: The comm (compare) engine operates using an extremely rigid, high-velocity mathematical algorithm. It does not parse chaotic data. Before you can execute the engine, both target files must be perfectly, alphabetically sorted. If you attempt to feed unsorted files into the comm engine, it will violently crash and output corrupted, inaccurate data.

If your files are not sorted, you must pipe them through the sort engine first: sort list1.txt > sorted_list1.txt.

Executing the Algorithmic Comparison

Once you have two perfectly sorted files (sorted1.txt and sorted2.txt), you execute the core engine:

comm sorted1.txt sorted2.txt

The exact millisecond you press Enter, the engine rips through both files line-by-line and outputs a massive, strictly formatted three-column matrix:

• Column 1: Lines that exist only in the first file.
• Column 2: Lines that exist only in the second file.
• Column 3: Lines that are mathematically identical and exist in both files (the absolute intersection).

Suppressing Extraneous Data Columns

In a true data audit, you rarely need all three columns. The comm engine allows you to mathematically suppress specific columns by injecting their numerical identifiers as flags.

If you only want to see the lines that are common to both files (Column 3), you must suppress Column 1 and Column 2:

comm -12 sorted1.txt sorted2.txt

This command instructs the engine to violently obliterate the unique entries from both files. The terminal will instantly output a pristine, single-column list containing only the data points that perfectly intersect across both massive databases.