Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Research Briefing
  • Published:

Multimodal data integration improves immunotherapy response prediction

Immunotherapy has shown great promise in the treatment of patients with advanced non-small-cell lung cancer. We show that integration of data collected during diagnostic clinical work-up with machine learning has the potential to improve predictions of response to immunotherapy and to identify the patients most likely to benefit.

This is a preview of subscription content, access via your institution

Access options

Buy this article

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: Unimodal and multimodal predictions of treatment response generated by dynamic attention with masking.

References

  1. Bera, K. et al. Predicting cancer outcomes with radiomics and artificial intelligence in radiology. Nat. Rev. Clin. Oncol. 19, 132–146 (2022). A perspective article describing the opportunities for using artificial intelligence in radiological imaging.

    Article  CAS  Google Scholar 

  2. Echle, A. et al. Deep learning in cancer pathology: a new generation of clinical biomarkers. Br. J. Cancer 124, 686–696 (2021). A review article describing deep learning applications to cancer histopathology.

    Article  Google Scholar 

  3. Boehm, K. M. et al. Harnessing multimodal data integration to advance precision oncology. Nat. Rev. Cancer 22, 114–126 (2022). A perspective article offering opinions on integrating modalities with machine learning methods.

    Article  CAS  Google Scholar 

  4. Ilse, M., Tomczak, J. M. & Welling, M. Attention-based deep multiple instance learning. Proceedings of the 35th International Conference on Machine Learning. Proc. Mach. Learn. Res. 80, 2127–2136 (2018). This paper describes the deep learning model that inspired our approach.

    Google Scholar 

Download references

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This is a summary of: Vanguri, R. S. et al. Multimodal integration of radiology, pathology and genomics for prediction of response to PD-(L)1 blockade in patients with non-small cell lung cancer. Nat. Cancer https://doi.org/10.1038/s43018-022-00416-8 (2022).

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Multimodal data integration improves immunotherapy response prediction. Nat Cancer 3, 1149–1150 (2022). https://doi.org/10.1038/s43018-022-00417-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s43018-022-00417-7

Search

Quick links

Nature Briefing: Cancer

Sign up for the Nature Briefing: Cancer newsletter — what matters in cancer research, free to your inbox weekly.

Get what matters in cancer research, free to your inbox weekly. Sign up for Nature Briefing: Cancer