samtools markdup [-l length] [-r] [-s] [-T] [-S] [-f file] [-d distance] [-c] [-t] [-m] [--mode] [--include-fails] [--no-PG] in.algsort.bam out.bam
Mark duplicate alignments from a coordinate sorted file that has been run through samtools fixmate with the -m option. This program relies on the MC and ms tags that fixmate provides.
Expected maximum read length of INT bases. 
Remove duplicate reads.
Print some basic stats. See STATISTICS.
Write temporary files to PREFIX.samtools.nnnn.mmmm.tmp
Mark supplementary reads of duplicates as duplicates.
Write stats to named file.
The optical duplicate distance. Suggested settings of 100 for HiSeq style platforms or about 2500 for NovaSeq ones. Default is 0 to not look for optical duplicates. When set, duplicate reads are tagged with dt:Z:SQ for optical duplicates and dt:Z:LB otherwise. Calculation of distance depends on coordinate data embedded in the read names produced by the Illumina sequencing machines. Optical duplicate detection will not work on non standard names.
Clear previous duplicate settings and tags.
Mark duplicates with the name of the original in a do tag.
Duplicate decision method for paired reads. Values are t or s. Mode t measures positions based on template start/end (default). Mode s measures positions based on sequence start. While the two methods identify mostly the same reads as duplicates, mode s tends to return more results. Unpaired reads are treated identically by both modes.
Include quality checked failed reads.
Do not add a PG line to the output file.
Number of input/output compression threads to use in addition to main thread .
Estimated library size makes various assumptions e.g. the library consists of unique fragments that are randomly selected (with replacement) with equal probability. This is unlikely to be true in practice. However it can provide a useful guide into how many unique read pairs are likely to be available. In particular it can be used to determine how much more data might be obtained by further sequencing of the library.
Excluded reads are those marked as secondary, supplementary or unmapped. By default QC failed reads are also excluded but can be included as an option. Excluded reads are not used for calculating duplicates. They can optionally be marked as duplicates if they have a primary that is also a duplicate.
samtools collate -o namecollate.bam example.bam
Add ms and MC tags for markdup to use later:
samtools fixmate -m namecollate.bam fixmate.bam
Markdup needs position order:
samtools sort -o positionsort.bam fixmate.bam
Finally mark duplicates:
samtools markdup positionsort.bam markdup.bam
Typically the fixmate step would be applied immediately after sequence alignment and the markdup step after sorting by chromosome and position. Thus no additional sort steps are normally needed.
Written by Andrew Whitwham from the Sanger Institute.
samtools (1), samtools-sort (1), samtools-collate (1), samtools-fixmate (1)
Samtools website: <http://www.htslib.org/>
Copyright © 2019 Genome Research Limited (reg no. 2742969) is a charity registered in England with number 1021457. Terms and conditions.