Skip to content

Benchmarking computational methods for B cell receptor reconstruction from single cell RNA-seq data

Notifications You must be signed in to change notification settings

tAndreani/scBCR

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

scBCR Benchmarking

Benchmarking computational methods for B cell receptor reconstruction from single cell RNA-seq data. This repository is an extension of scBCR, a platform with all the methods currently available and ready to be installed and used to reconstruct paired haeavy and light chain in individual B cells.

Image

Fig 1 Benchmark framework: (A) Available datasets with ground truth (Canzar et al. 2017, Upadhyay et al. 2018) consisting of plasmablasts with unknown antigen specificity were obtained from the corresponding publications. In addition, a scRNAseq dataset including tetanus toxoid-specific B-cells and B-cells with unknown antigen specificity was generated in this work (Leiden). All the datasets were downsampled to achieve different read coverage and length. (B) An additional dataset was simulated to investigate the effects of different levels of somatic hypermutations in the variable domains of BCRs on the performance of each method. Sensitivity and accuracy were used as metrics to evaluate each method depending on the type of used data. Antibodies were produced using a subset of clonotype-forming patient-specific BCRs and their specificity was experimentally validated. Finally, the execution time was investigated, and a final score was calculated to give a final recommendation on the method choice.

Fig 2 Performance methods on experimental data: Leiden, Canzar, Updahyay

Fig 3 Pairwise overlap of V-(D)-J genes

Fig 4 Performance methods on simulated data: 4 datasets with different amount of somatic hypermutations (from 15 to 60)

Fig 6 Time of execution for each method in the Leiden dataset

Image

Image

Fig 7 Heatmap and decision tree to evaluate the performance of each method and recommendation on different datasets

Credits:

Tommaso Andreani, Linda Slot, Samuel Gabillard, Carsten Struebing, Claus Reimertz, Veeranagouda Yaligara, Aleida Bakker, Reza Olfati-Saber, Hans U. Scherer, Rene E. M. Toes, Franck Auge´, Deimante Simaite. Benchmarking computational methods for B-cell receptor reconstruction from single-cell RNA-seq data in NAR - Genomics and Bioinformatics.