Weakly supervised deep-learning models for the analysis of whole-slide images from tumour biopsies perform better at prognostic tasks if the models incorporate context from the local microenvironment.
This is a preview of subscription content, access via your institution
Access options
Access Nature and 54 other Nature Portfolio journals
Get Nature+, our best-value online-access subscription
$29.99 / 30 days
cancel any time
Subscribe to this journal
Receive 12 digital issues and online access to articles
$99.00 per year
only $8.25 per issue
Buy this article
- Purchase on Springer Link
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
References
Bera, K. et al. Nat. Rev. Clin. Oncol. 16, 703–715 (2019).
Coudray, N. et al. Nat. Med. 24, 1559–1567 (2018).
Campanella, G. et al. Nat. Med. 25, 1301–1309 (2019).
Lu, M. Y. et al. Nat. Biomed. Eng. 5, 555–570 (2021).
Chen, R. J. et al. Whole slide images are 2D point clouds: context-aware survival prediction using patch-based graph convolutional networks. In MICCAI 2021: Medical Image Computing and Computer Assisted Intervention (eds de Bruijne, M. et al.) 339–349 (Springer, 2021).
Lee, Y. et al. Nat. Biomed. Eng. https://doi.org/10.1038/s41551-022-00923-0 (2022).
Jaume, G. et al. Quantifying explainers of graph neural networks in computational pathology. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (eds IEEE staff) 8102–8112 (IEEE, 2021).
Dosovitskiy, A. et al. An image is worth 16x16 words: transformers for image recognition at scale. In International Conference on Learning Representations 2021 Paper 1909 (ICLR, 2021).
Shao, Z. C. et al. TransMIL: transformer based correlated multiple instance learning for whole slide image classification. In Advances in Neural Information Processing Systems 34 (eds Ranzato, M., Beygelzimer, A., Dauphin, Y., Liang, P. S. & Wortman Vaughan, J.) 2136–2147 (NeurIPS, 2021).
Chen, R. J. et al. Scaling vision transformers to gigapixel images via hierarchical self-supervised learning. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (eds IEEE staff) 16144–16155 (IEEE, 2022).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Rights and permissions
About this article
Cite this article
Jaume, G., Song, A.H. & Mahmood, F. Integrating context for superior cancer prognosis. Nat. Biomed. Eng 6, 1323–1325 (2022). https://doi.org/10.1038/s41551-022-00924-z
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41551-022-00924-z