Skip to content

Latest commit

 

History

History

Project

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 

Team-based project     [ELMED219 / BMED365]

Precision medicine and quantitative imaging in glioblastoma

Description

Imagine that you are a group of established, successful scientists that will team up to tackle an important biomedical and medical challenge. There is an open call for research proposals under a new umbrella program entitled “Artificial intelligence and computational (bio)medicine,” where your multidisciplinary group is aiming for a project on “Precision medicine and quantitative imaging in glioblastoma - a multiscale approach.”

The focus of the assignment is

  1. description of relevant imaging technologies and modalities - possibly at different scales,
  2. proposal of imaging-derived biomarkers for glioblastoma,
  3. machine learning techniques for segmentation, classification, treatment stratification, and prediction,
  4. the novelty and expected impact of your approach, and
  5. the evaluation of the ethics of your project, together with a data management plan (and not so much the basic science of brain tumors per se).

Organization of your report

Research plan

(3-5 pages incl. figures and bibliography)

  • A brief background to the field
  • Objectives and expected impact
  • Material and methods
  • Evaluation

Data management plan and ethical considerations

(1 1/2-2 1/2 pages incl. graphics / links)

  • Description of generated data and code
  • Sharing of data and code
  • Ethical considerations

Prepare you and your computer for the team-based project

Orient yourself in the material for the group project and how to use LaTeX for writing your report

  • We will be using the Overleaf online, collaborative LaTeX editor (for more information on LaTeX, see here and here and here, and for LeTeX templates, see e.g. here and here)

  • LaTeX template for the report is found [here] with a dummy figure [here], resulting in the following dummy report [pdf].

  • Expected level of detail is illustrated with a project report from the 2019 Summer School at Seili (for which Prostate Cancer was the topic) to be found on Overleaf [here] and in the present repo as [main.tex], [fig1], [fig2], resulting in the [pdf].

Some sources of information (brain tumors - neuroimaging - AI - software & data)

Pre reading

  • For those of you that have limited knowledge about biology and pathology of brain or want to refresh their knowledge, we recommend the free Coursera course https://www.coursera.org/learn/neurobiology, especially the lecture on brain tumors.

  • Aldape K et al. Challenges to curing primary brain tumors. Nat Rev Clin Oncol 2019;16:509-520. [link]

  • Louis DN et al. The 2016 World Health Organization Classification of Tumors of the Central Nervous System: A Summary. Acta Neuropathol 2016;131(6):803-820. [link]

  • The Brain Atlas https://www.proteinatlas.org/humanproteome/brain

Brain tumors & Neuroimaging (some pointers)

  • Abd-Ellah MK et al. A review on brain tumor diagnosis from MRI images: Practical implications, key achievements, and lessons learned. Magnetic Resonance Imaging 2019;61:300-318. [link]

  • Hamid MAA, Khan NA. Investigation and Classification of MRI Brain Tumors Using Feature Extraction Technique. Journal of Medical and Biological Engineering 2020;40:307–317. [link]

  • Lohmann P et al. PET/MRI Radiomics in Patients With Brain Metastases. Front. Neurol., 07 February 2020. [link]

  • Tiwari A et al. Brain tumor segmentation and classification from magnetic resonance images: Review of selected methods from 2014 to 2019. Pattern Recognition Letters 2020;131:244-260. [link]

  • Nadeem MW et al. Brain Tumor Analysis Empowered with Deep Learning: A Review, Taxonomy, and Future Challenges. Brain Sci 2020;10(2):118. [link]

  • Brain Tumor Segmentation (BraTS) Challenge 2020: Scope (MICCAI2020) - Center for Biomedical Image Computing & Analytics, Perelman School of Medicine, University of Pennsylvania [link] [Data description]

Brain tumors & Artificial intelligence (some pointers)

  • NCI: Artificial Intelligence Expedites Brain Tumor Diagnosis during Surgery. 2020 Feb 12. [link]
  • Hollon TC et al. Near Real-Time Intraoperative Brain Tumor Diagnosis Using Stimulated Raman Histology and Deep Neural Networks. Nature Medicine 2020;26(1):52-58. [link] [GitHub repository] [video]
  • Yogananda CGB et al. A novel fully automated MRI-based deep-learning method for classification of IDH mutation status in brain gliomas. Neuro-Oncology 2020;22(3):402–411. [link]
  • Kickinereer P et al. Automated quantitative tumour response assessment of MRI in neuro-oncology with artificial neural networks: a multicentre, retrospective study. The Lancet Oncology 2019;20(5):728-740. [link]
  • Eitel F et al. Patch individual filter layers in CNNs to harness the spatial homogeneity of neuroimaging data. Scientific Reports 2021;11:24447. [link]
  • Federated Tumor Segmentation Challenge 2021 (FeTS 2021 Challenge) - focuses on federated learning and robustness to distribution shifts between medical institutions for the task of brain tumor segmentation. [link] [GitHub]

Brain tumors & software and data (some pointers for illustration and inspiration)

  • Brain Tumor Segmentation | Papers With Code [https://paperswithcode.com/task/brain-tumor-segmentation/latest]
  • Akshay Kumaar M. Brain Tumor Classification (using ResNet50 and Google Colab) [https://github.com/aksh-ai/brain_tumor_classification]
  • Joohyun Lee. BraTs (Brain Tumor Segmentation) [https://github.com/cv-lee/BraTs]
  • Bakas S et al. Advancing The Cancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic features. Scientific Data 2017;4, Article number: 170117 [https://www.nature.com/articles/sdata2017117] [pdf]
    Excerpt: Considering the value of big data and the potential of publicly available datasets for increased reproducibility of scientific findings, the National Cancer Institute (NCI) of the National Institutes of Health (NIH) created TCGA (cancergenome.nih.gov) and TCIA (www.cancerimagingarchive.net). TCGA is a multi-institutional comprehensive collection of various molecularly characterized tumor types, and its data are available in NCI’s Genomic Data Commons portal (gdc-portal.nci.nih.gov). Building upon NIH’s investment in TCGA, the NCI’s Cancer Imaging Program approached sites that contributed tissue samples, to obtain corresponding de-identified routine clinically-acquired radiological data and store them in TCIA. These repositories make available multi-institutional, high-dimensional, multi-parametric data of cancer patients, allowing for radiogenomic analysis.
  • Beers A et al. DeepNeuro: an open-source deep learning toolbox for neuroimaging. Neuroinformatics 2020, June 23 [link] [pdf]; GitHub: https://github.com/QTIM-Lab/DeepNeuro - A deep learning python package for neuroimaging data. Focused on validated command-line tools you can use today. Created by the Quantitative Tumor Imaging Lab at the Martinos Center (Harvard-MIT Program in Health, Sciences, and Technology / Massachusetts General Hospital).
  • Chang K et al. Automatic assessment of glioma burden: A deep learning algorithm for fully automated volumetric and bi-dimensional measurement. Neuro-Oncology 2019;21(11):1412-1422 [link] [pdf]. Code: https://github.com/QTIM-Lab/DeepNeuro.
  • Ellis DG, Aizenberg MR. Deep Learning Using Augmentation via Registration: 1st Place Solution to the AutoImplant 2020 Challenge. In: Li J., Egger J. (eds) Towards the Automatization of Cranial Implant Design in Cranioplasty. AutoImplant 2020. Lecture Notes in Computer Science, vol 12439. Springer, Cham. [link]; Code: https://github.com/ellisdg/3DUnetCNN; Pretrained models: https://zenodo.org/record/4289225; Augmented Data Set: https://zenodo.org/record/4270278
  • Ellis DG, Aizenberg MR. Structural brain imaging predicts individual-level task activation maps using deep learning. bioRxiv, 2020 [link] [pdf]; Code: https://github.com/ellisdg/3DUnetCNN; "... The reliable functional activation predictions from structural imaging may be of use to clinicians in cases where task activation mapping is critical for patient care, including neurosurgical operative planning. Task mapping predictions could give neurosurgeons the ability to visualize eloquent areas and avoid potential surgically induced deficits, even without collecting any fMRI data. Our future efforts will focus on using CNNs to provide enhanced mapping accuracy and validating the use of structural imaging to predict task activation maps in clinical populations, such as brain tumor patients."
  • Lundervold AS, Lundervold A. An overview of deep learning in medical imaging focusing on MRI. Zeitschrift fur Medizinische Physik. 2019;29(2):102-127. [link] [pdf]

David G. Ellis BraTS 2020 Tutorial using 3DUNetCNN:

Brain Tumor Segmentation (BraTS) Tutorial

Ethics of artificial intelligence and machine learning (some pointers)