This repository contains training sets that can be used with the Ribosomal Database Project classifier (Wang et al., 2007) to taxonomically assign Eukaryote CO1 mtDNA sequences. The latest release can be downloaded from https://github.com/terrimporter/CO1Classifier/releases . The trained files ready to be used with the RDP Classifier are available as well as the original files used for training (a taxonomy file and a FASTA file) are available as 'version-ref'.
**As of version 5.0.0, reference sequences formatted for the RDP classifier, BLAST, and SINTAX are also available.**
############ Install the RDP classifier if you need it
# The easiest way to install the RDP classifier v2.13 is using conda
conda install -c bioconda rdp_classifier
# Alternatively, you can install from SourceForge and run with java if you don't use conda
wget https://sourceforge.net/projects/rdp-classifier/files/rdp-classifier/rdp_classifier_2.13.zip
# decompress it
unzip rdp_classifier_2.13
# record path to classifier.jar ex. /path/to/rdp_classifier_2.13/dist/classifier.jar
############ Get the latest COI training set
wget https://github.com/terrimporter/CO1Classifier/releases/download/RDP-COI-v5.1.0/RDP_COIv5.1.0.zip
# decompress it
unzip RDP_COIv5.1.0.zip
# record the path to the rRNAClassifier.properties file ex. /path/to/mydata_trained/rRNAClassifier.properties
############ Run the RDP Classifier
# If it was installed using conda, run it like this:
rdp_classifier -Xmx8g classify -t /path/to/mydata_trained/rRNAClassifier.properties -o rdp.output query.fasta
# Otherwise run it using java like this:
java -Xmx8g -jar /path/to/rdp_classifier_2.13/classifier.jar -t /path/to/mydata_trained/rRNAClassifier.properties -o rdp.output query.fasta
If you use these training sets in a publication, please cite:
Porter, T.M., & Hajibabaei, M. (2018) Automated high throughput animal CO1 metabarcode classification. Scientific Reports, 8, 4226.
Teresita M. Porter. (2017, December 4). Eukaryote CO1 Reference Set For The RDP Classifier (Version v4.0.1). Zenodo. http://doi.org/10.5281/zenodo.4741447
Wang et al. (2007) Naïve Bayesian classifier for rapid assignment of rRNA sequences into the new bacterial taxonomy. Applied and Environmental Microbiology, 73: 5261.
This version was updated to:
- Fix a problem with commas present within result fields causing misalignment of columns.
- Added a step to consolidate BIN IDs in GenBank records with newer Linnean binomial species names (if present) from BOLD data package BOLD_Public.24-Mar-2023 .
This version includes eukaryote COI sequences mined from GenBank [February 2023]. This version includes records deposited between 1982 - 2022 (inclusive). GenBank sequences were filtered to only include sequences 500bp+, containing no nucleotide ambiguities, and preferrably with a Linnean binomial species name and/or a BOLD BIN (new). Sequences were screened to remove human and bacterial contaminants. Bacterial outgroup sequences were added. Human sequences are included.
This version is based on 2,216,547 COI sequences from 236,247 taxa including 185,389 species/BINs. This is an increase of 995,019 more sequences, 81,896 more taxa, and 70,693 more species compared to v4.
Accuracy was assessed using 5-fold cross validation (new). The metazoan sequences in the classifier were divided into 5 groups. For each fold of the data, the remaining four folds were combined (i.e., 20% test, 80% train) with the outgroup sequences to create a training set. The average number of correctly classified metazoan sequences from each fold were used to calculate the cutoffs below.
Assuming that your query sequences are present in the reference set, using these minimum bootstrap support cutoffs should result in at least 99% correct assignments:
| Rank | 500bp+ | 400 bp | 300 bp | 200 bp | 100 bp |
|---|---|---|---|---|---|
| Superkingdom | 0 | 0 | 0 | 0 | 0 |
| Kingdom | 0 | 0 | 0 | 0 | 0 |
| Phylum | 0 | 0 | 0 | 0 | 0 |
| Class | 0 | 0 | 0 | 0 | 0 |
| Order | 0 | 0 | 0 | 0 | 0.1 |
| Family | 0 | 0 | 0 | 0.1 | 0.2 |
| Genus | 0.3 | 0.3 | 0.3 | 0.3 | 0.3 |
| Species | NA | NA | NA | NA | NA |
NA = No cutoff available will result in 99% correct assignments
If you really want to work with species level data, then assuming that your query sequences are present in the reference set, using these minimum bootstrap support cutoffs should result in at least 95% correct assignments:
| Rank | 500bp+ | 400 bp | 300 bp | 200 bp | 100 bp |
|---|---|---|---|---|---|
| Superkingdom | 0 | 0 | 0 | 0 | 0 |
| Kingdom | 0 | 0 | 0 | 0 | 0 |
| Phylum | 0 | 0 | 0 | 0 | 0 |
| Class | 0 | 0 | 0 | 0 | 0 |
| Order | 0 | 0 | 0 | 0 | 0 |
| Family | 0 | 0 | 0 | 0 | 0 |
| Genus | 0 | 0 | 0 | 0 | 0 |
| Species | 0.9 | 0.8 | 0.8 | 0.8 | 0.8 |
If you are okay with more lenient cutoffs, as this method has been shown to have a high false negative rate in practice, then using these minimum bootstrap support cutoffs should result in at least 90% correct assignments:
| Rank | 500bp+ | 400 bp | 300 bp | 200 bp | 100 bp |
|---|---|---|---|---|---|
| Superkingdom | 0 | 0 | 0 | 0 | 0 |
| Kingdom | 0 | 0 | 0 | 0 | 0 |
| Phylum | 0 | 0 | 0 | 0 | 0 |
| Class | 0 | 0 | 0 | 0 | 0 |
| Order | 0 | 0 | 0 | 0 | 0 |
| Family | 0 | 0 | 0 | 0 | 0 |
| Genus | 0 | 0 | 0 | 0 | 0 |
| Species | 0 | 0 | 0 | 0.1 | 0.2 |
This version was updated to include eukaryote COI sequences mined from GenBank [February 2023]. This version includes records deposited between 1982 - 2022 (inclusive). GenBank sequences were filtered to only include sequences 500bp+, containing no nucleotide ambiguities, and preferrably with a Linnean binomial species name and/or a BOLD BIN (new). Sequences were screened to remove human and bacterial contaminants. Bacterial outgroup sequences were added. Human sequences are included.
**This version is based on 2,211,191 COI sequences from 239,382 taxa including 188,534 species/BINs. This is an increase of 989,663 more sequences, 85,031 more taxa, and 73,847 more species compared to v4.**
Accuracy was assessed using 5-fold cross validation (new). The metazoan sequences in the classifier were divided into 5 groups. For each fold of the data, the remaining four folds were combined (i.e., 20% test, 80% train) with the outgroup sequences to create a training set. The average number of correctly classified metazoan sequences from each fold were used to calculate the cutoffs below.
[Cutoff values will NOT be added, please use v5.1.0 instead]
This version was updated to include COI sequences mined from GenBank [April 2019] and the BOLD data releases [iBOL_phase2.0_COI.tsv to iBOL_phase_6.50_COI.tsv] from http://v3.boldsystems.org/index.php/datarelease . GenBank sequences were filtered to only include those 500bp+, containing no nucleotide ambiguities, and with a Linnean binomial species name. BOLD sequences were filtered to only retain sequences 500bp+, with less than 3 ambiguous bases, and containing a Linnean binomial species name. Sequences were screened for human and bacterial contaminants. Bacterial outgroup sequences were added.
This page will be updated with updated cutoffs when available. For now use the recommended cutoffs for v3 (below).
This version was updated to include some invasives species of interest even though their sequences are less than 500bp in length.
The latest release can be downloaded from here: https://github.com/terrimporter/CO1Classifier/releases/tag/v3.2 The CO1v3_2_trained.tar.gz file should be decompressed and used directly with the RDP Classifier to make taxonomic assignments to the species rank.
The reference files for the latest release can be downloaded from here: https://github.com/terrimporter/CO1Classifier/releases/tag/v3.2-ref The CO1v3_2_training.tar.gz file should be cecompressed. The folder contains the original taxonomy and fasta files that are included here for reference only. They are the same as the v3 files except that a few bacterial outgroup sequences that were misannotated as bacteriophage viruses were removed.
The v3 MINIMUM bootstrap cutoff values should be used with this version of the CO1 classifier.
The v3.1 release can be downloaded from here: https://github.com/terrimporter/CO1Classifier/releases/tag/v3.1 The CO1v3_1_trained.tar.gz file should be decompressed and used directly with the RDP Classifier to make taxonomic assignments to the species rank.
The reference files for the v3.1 release can be downloaded from here: https://github.com/terrimporter/CO1Classifier/releases/tag/v3.1-ref The CO1v3_1_training.tar.gz file should be cecompressed. The folder contains the original taxonomy and fasta files that are included here for reference only. They are the same as the v3 files except that a few bacterial outgroup sequences that were misannotated as bacteriophage viruses were removed.
The v3 MINIMUM bootstrap cutoff values should be used with this version of the CO1 classifier.
The v3 release can be downloaded from here: https://github.com/terrimporter/CO1Classifier/releases/tag/v3.0 The CO1v3_trained.tar.gz file should be decompressed and used directly with the RDP Classifier to make taxonomic assignments to the species rank.
The reference files for the v3 release can be downloaded from here: https://github.com/terrimporter/CO1Classifier/releases/tag/v3.0-ref The CO1v3_training.tar.gz file should be decompressed. The folder contains the original taxonomy and fasta files that are included here for reference only. They were originally mined from GenBank in April 2018. These sequences were originally identified to the species rank in the NCBI nucleotide database. All sequences here are at least 500bp long and have been screened to remove human and bacterial contaminant sequences. Sequences containing any nucleotide ambiguities were excluded. Taxonomic composition is largely Arthropoda and Chordata. Outgroup taxa representing other major eukaryote and prokaryote lineages have been included.
Assuming that your query sequences are present in the reference set, using these cutoffs should result in ~99% correct assignments:
| Rank | 500bp+ | 400 bp | 200 bp | 100 bp | 50 bp |
|---|---|---|---|---|---|
| Superkingdom | 0 | 0 | 0 | 0 | 0 |
| Kingdom | 0 | 0 | 0 | 0 | 0 |
| Phylum | 0 | 0 | 0 | 0 | 0 |
| Class | 0 | 0 | 0 | 0 | 30 |
| Order | 0 | 0 | 0 | 20 | 70 |
| Family | 0 | 10 | 20 | 20 | 70 |
| Genus | 40 | 30 | 30 | 40 | 90 |
| Species | NA | NA | NA | NA | NA |
NA = No cutoff available will result in 99% correct assignments
If you really want to work with species level data, then assuming that your query sequences are present in the reference set, using these cutoffs should result in ~95% correct assignments:
| Rank | 500bp+ | 400 bp | 200 bp | 100 bp | 50 bp |
|---|---|---|---|---|---|
| Superkingdom | 0 | 0 | 0 | 0 | 0 |
| Kingdom | 0 | 0 | 0 | 0 | 0 |
| Phylum | 0 | 0 | 0 | 0 | 0 |
| Class | 0 | 0 | 0 | 0 | 0 |
| Order | 0 | 0 | 0 | 0 | 10 |
| Family | 0 | 0 | 0 | 0 | 30 |
| Genus | 0 | 0 | 0 | 0 | 30 |
| Species | 60 | 70 | 70 | 80 | NA |
NA = No cutoff available will result in 95% correct assignments
If you are okay with more lenient cutoffs, since this method has been shown to have a high false negative rate in practice, then using these cutoffs should result in ~90% correct assignments:
| Rank | 500bp+ | 400 bp | 200 bp | 100 bp | 50 bp |
|---|---|---|---|---|---|
| Superkingdom | 0 | 0 | 0 | 0 | 0 |
| Kingdom | 0 | 0 | 0 | 0 | 0 |
| Phylum | 0 | 0 | 0 | 0 | 0 |
| Class | 0 | 0 | 0 | 0 | 0 |
| Order | 0 | 0 | 0 | 0 | 0 |
| Family | 0 | 0 | 0 | 0 | 10 |
| Genus | 0 | 0 | 0 | 0 | 10 |
| Species | 0 | 0 | 0 | 0 | 40 |
The v2.0 release can be downloaded from here: https://github.com/terrimporter/CO1Classifier/releases/tag/v2.0 The CO1v2_trained.tar.gz file should be decompressed and used directly with the RDP Classifier to make taxonomic assignments to the species rank.
The reference files for the v2.0 release can be downloaded from here: https://github.com/terrimporter/CO1Classifier/releases/tag/v2.0-ref The CO1v2_training.tar.gz file should be decompressed. The folder contains the original taxonomy and fasta files that are included here for reference only. This dataset is based on v1.0 except that the species rank was retained.
Assuming that your query sequences are present in the reference set, using these cutoffs should result in ~99% correct assignments:
| Rank | 500bp+ | 400 bp | 200 bp | 100 bp | 50 bp |
|---|---|---|---|---|---|
| Superkingdom | 0 | 0 | 0 | 0 | 0 |
| Kingdom | 0 | 0 | 0 | 0 | 0 |
| Phylum | 0 | 0 | 0 | 0 | 0 |
| Class | 0 | 0 | 0 | 0 | 30 |
| Order | 0 | 0 | 0 | 10 | 70 |
| Family | 0 | 0 | 20 | 20 | 70 |
| Genus | 30 | 30 | 30 | 30 | 80 |
| Species | NA | NA | NA | NA | NA |
NA = No cutoff available will result in 99% correct assignments
Assuming that your query sequences are present in the reference set, using these cutoffs should result in ~95% correct assignments:
| Rank | 500bp+ | 400 bp | 200 bp | 100 bp | 50 bp |
|---|---|---|---|---|---|
| Superkingdom | 0 | 0 | 0 | 0 | 0 |
| Kingdom | 0 | 0 | 0 | 0 | 0 |
| Phylum | 0 | 0 | 0 | 0 | 0 |
| Class | 0 | 0 | 0 | 0 | 0 |
| Order | 0 | 0 | 0 | 0 | 10 |
| Family | 0 | 0 | 0 | 0 | 30 |
| Genus | 0 | 0 | 0 | 0 | 30 |
| Species | 50 | 40 | 50 | 60 | 90 |
NA = No cutoff available will result in 95% correct assignments
The original release described in Porter & Hajibabaei (2017) can be downloaded from here: https://github.com/terrimporter/CO1Classifier/releases/tag/v1.0 The CO1v1_trained.tar.gz file should be decompressed and used directly with the RDP Classifier to make taxonomic assignments to the genus rank.
The reference files for the original release described in Porter & Hajibabaei (2017) can be downloaded from here: https://github.com/terrimporter/CO1Classifier/releases/tag/v1.0-ref The CO1v1_training.tar.gz file should be decompressed. The folder contains the original taxonomy and fasta files that are included here for reference only. They were originally mined from GenBank in August 2016. These sequences were originally identified to the species rank in the NCBI nucleotide database but have been summarized to the genus rank here. All sequences here are at least 500bp long and have been screened to remove human contaminant sequences. Taxonomic composition is largely Arthropoda and Chordata. Outgroup taxa representing other major Eukaryote groups were included if they contained the BARCODE keyword in GenBank.
Assuming that your query sequences are present in the reference set, using these cutoffs should result in ~99% correct assignments:
| Rank | 500bp+ | 400 bp | 200 bp | 100 bp | 50 bp |
|---|---|---|---|---|---|
| Superkingdom | 0 | 0 | 0 | 0 | 0 |
| Kingdom | 0 | 0 | 0 | 0 | 0 |
| Phylum | 0 | 0 | 0 | 0 | 0 |
| Class | 0 | 0 | 0 | 0 | 60 |
| Order | 0 | 0 | 10 | 40 | 80 |
| Family | 20 | 20 | 30 | 40 | 80 |
| Genus | 70 | 60 | 60 | 60 | NA |
NA = No cutoff available will result in 99% correct assignments
Decompress the tar.gz file:
$ tar -xvzf FileName.tar.gz
Use with the RDP classifier:
java -Xmx8g -jar /path/to/rdp_classifier_2.12/dist/classifier.jar classify -t /path/to/CO1version_trained/rRNAClassifier.properties -o ClassifiedQueryFilename QueryFilename
For additional information on choosing appropriate bootstrap support cutoff values, see Porter & Hajibabaei (2017): https://doi.org/10.1101/219675
For additional information on how to run the RDP classifier, see the RDPclassifier 2.12 README.
The RDP classifier v2.12 can be downloaded from: https://sourceforge.net/projects/rdp-classifier/
The custom reference set formatted as a BLAST nucleotide database works with the BLAST+ suite that runs at the command line. Information on where to download the BLAST+ executables directly from the NCBI is available from here https://blast.ncbi.nlm.nih.gov/doc/blast-help/downloadblastdata.html . To map taxonomy to your results, you also need to have the taxdb files downloaded to the same directory you put the custom reference BLAST database files and these can be downloaded from here: https://ftp.ncbi.nlm.nih.gov/blast/db/ .
# If you don't already have it, BLAST+ can be downloaded directly to any conda environment
conda install -c bioconda blast
# If you don't already have a directory for your custom blast database(s) create one
mkdir blast_db
# download the custom blast database into your database directory and decompress it
cd blast_db
wget https://github.com/terrimporter/CO1Classifier/releases/download/BLAST-COI-v5.0.0/BLAST_COIv5.0.0.zip
unzip BLAST_COIv5.0.0.zip
# make sure you've added the taxonomy files to your database directory as well and decompressed the files
wget https://ftp.ncbi.nlm.nih.gov/blast/db/taxdb.tar.gz
tar -xvf taxdb.tar.gz
# Line to add to your .bashrc file (or equivalent) so that blastn can find your custom database(s)
export BLASTDB="$HOME/blast_db"
# Example of a top BLAST hit search using the custom database provided here
blastn -query test.fasta -task megablast -db COIv5.fasta -out test.blastn -evalue '1e-20' -outfmt "6 qseqid sseqid ssciname pident length evalue bitscore qcovs" -max_target_seqs 1 -num_threads 3
The SINTAX formatted database can be used with USEARCH or VSEARCH.
# example of a SINTAX algorithm search via VSEARCH v2.21.1
vsearch --sintax test.fasta --db sintax.udb --tabbedout sintax.txt
Porter, T.M., & Gibson, J.F., Shokralla, S., Baird, D.J., Golding, G.B., Hajibabaei, M. (2014) Rapid and accurate taxonomic classification of insect (class Insecta) cytochrome c oxidase subunit 1 (COI) DNA barcode sequences using a naive Bayesian classifier. Molecular Ecology Resources, 14: 929-942.
Porter, T.M., & Hajibabaei, M. (2018) Automated high throughput animal CO1 metabarcode classification. Scientific Reports, 8, 4226.
Wang, Q., Garrity, G. M., Tiedje, J. M., & Cole, J. R. (2007). Naive Bayesian Classifier for Rapid Assignment of rRNA Sequences into the New Bacterial Taxonomy. Applied and Environmental Microbiology, 73(16), 5261–5267. Available from https://sourceforge.net/projects/rdp-classifier/
We acknowledge support from the Canadian federal Genomics Research & Development Initiative (GRDI), Metagenomics-Based Ecosystem Biomonitoring (Ecobiomics) project.
Last updated: May 24, 2023