Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Perspective
  • Published:

Sonification and sound design for astronomy research, education and public engagement

Abstract

Over the past ten years there has been a large increase in the number of projects using sound to represent astronomical data and concepts. Motivation for these projects includes the potential to enhance scientific discovery within complex datasets, by utilizing the inherent multidimensionality of sound and the ability of our hearing to filter signals from noise. Other motivations include creating engaging multisensory resources, for education and public engagement, and making astronomy more accessible to people who are blind or have low vision, promoting their participation in science and related careers. We describe potential benefits of sound within these contexts and provide an overview of the nearly 100 sound-based astronomy projects that we have identified. We discuss current limitations and challenges of the approaches taken. Finally, we suggest future directions to help realize the full potential of sound-based techniques in general and to widen their application within the astronomy community.

This is a preview of subscription content, access via your institution

Access options

Buy this article

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: Example of a simulated signal embedded in a dataset from the LIGO gravitational wave detector, plotted as gravitational wave strain versus time.
Fig. 2: Evolution in the number of sonification projects of space science and astronomical data on the basis of project start date.

Image by Yuan Hua. Sonification by Jeff Hannam.

Fig. 3: Summary of goals, users and media used by the 98 astronomy sonification applications reported in the Data Sonification Archive as of December 2021.

Similar content being viewed by others

References

  1. Diaz-Merced, W. L. Sound for the Exploration of Space Physics Data. PhD thesis, Univ. Glasgow (2013).

  2. Cooke, J. et al. Exploring data sonification to enable, enhance, and accelerate the analysis of big, noisy, and multi-dimensional data. Proc. Int. Astron. Union 339, 251–256 (2019).

    Google Scholar 

  3. Pérez-Montero, E. Towards a more inclusive outreach. Nat. Astron. 3, 114–115 (2019).

    Article  ADS  Google Scholar 

  4. Bourne, R. L. A. et al. Magnitude, temporal trend, and projections of the global prevalence of blindness and distance and near vision impairment: a systematic review and meta-data analysis. Lancet 5, 888 (2017).

    Google Scholar 

  5. Noel-Storr, J. & Willebrands, M. Accessibility in astronomy for the visually impaired. Nat. Astron. https://doi.org/10.1038/s41550-022-01691-2 (2022).

  6. Bronkhorst, A. W. The cocktail party phenomenon: a review of research on speech intelligibility in multiple-talker conditions. Acta Acust. United Acust. 86, 117–128 (2000).

    Google Scholar 

  7. Hermann T., Hunt T. & Neuhoff J. G. The Sonification Handbook (Logos, 2011).

  8. Sawe, N., Chafe, C. & Treviño, J. Using data sonification to overcome science literacy, numeracy, and visualization barriers in science communication. Front. Commun. 5, 46 (2020).

    Article  Google Scholar 

  9. Tutchton, R. M. et al. Sonification of Kepler field SU UMA cataclysmic variable stars V344 Lyr and V1504 Cyg. J. Southeast. Assoc. Res. Astron. 6, 21–35 (2012).

    Google Scholar 

  10. Diaz-Merced, W. L. Sonification of astronomical data. Proc. Int. Astron. Union 7, 133–136 (2011).

  11. Guttman, S. E., Gilroy, L. A. & Blake, R. Hearing what the eyes see: auditory encoding of visual temporal sequences. Psychol. Sci. 16, 228–235 (2005).

    Article  Google Scholar 

  12. Walker, B. N. and Nees, M. A. in The Sonification Handbook (eds Hermann, T. et al.) 9–40 (Logos, 2011).

  13. Tzelgov, J., Srebro, R., Henik, A. & Kushelevsky, A. Radiation detection by ear and by eye. Hum. Factors 29, 87–98 (1987).

    Article  Google Scholar 

  14. Pauletto, S. & Hunt, A. A comparison of audio and visual analysis of complex time-series data. In Proc. ICAD 05 11th Meeting of the International Conference on Auditory Display 175–181 (2004).

  15. Lunn, P. and Hunt, A. Listening to the invisible: sonification as a tool for astronomical discovery. In Proc. ADS-VIS 2011: Making Visible the Invisible: Art, Design and Science in Data Visualisation (ed. Hohl, M.) 93 (Univ. Huddersfield, 2011).

  16. Abbott, B. P. et al. Observations of gravitational waves from a binary black hole merger. Phys. Rev. Lett. 116, 061102 (2016).

    Article  ADS  MathSciNet  Google Scholar 

  17. McIsaac, C. black_hole_hunter_sounds. GitHub https://github.com/icg-gravwaves/black_hole_hunter_sounds/blob/main/BHHData.py (2021).

  18. Ediyanto & Kawai, N. Science learning for students with visually impaired: a literature review. J. Phys. Conf. Ser. 1227, 012035 (2019).

    Article  Google Scholar 

  19. Rose, D. & Meyer, A. Teaching Every Student in the Digital Age: Universal Design for Learning (Association for Supervision and Curriculum Development, 2002).

  20. Tomlinson, B. J. et al. Exploring auditory graphing software in the classroom: the effect of auditory graphs on the classroom environment. ACM Trans. Access. Comput. 9, 3 (2016).

    Google Scholar 

  21. Kramer, G. et al. Sonification Report: Status of the Field and Research Agenda Department of Psychology Faculty Publication 444 (Univ. Nebraska—Lincoln, 2010).

  22. National Academies of Sciences, Engineering, and Medicine Pathways to Discovery in Astronomy and Astrophysics for the 2020s (National Academies Press, 2021).

  23. Susini, P., Houix, P. & Misdariis, N. Sound design: an applied, experimental framework to study the perception of everyday sounds. New Soundtrack 4, 103–121 (2014).

    Article  Google Scholar 

  24. Pauletto, S. Special Issue: Perspectives on sound design. New Soundtrack 4, v–vi (2014).

    Article  Google Scholar 

  25. Harrison, C., Trayford, J., Harrison, L. & Bonne, N. Audio universe: tour of the Solar System. Astron. Geophys. 63, 2.38–2.40 (2022).

  26. Kramer, G., et al. The Sonification Report: Status of the Field and Research Agenda Report prepared for the National Science Foundation by members of the International Community for Auditory Display (ICAD, 1999).

  27. Grond, F. & Berger, J. in The Sonification Handbook (eds Hermann, T. et al.) 399–427 (Logos, 2011).

  28. Kellermann, K. I., Bouton, E. N. & Brandt, S. S. in Open Skies. Historical and Cultural Astronomy (Springer, 2020)..

  29. Penzias, A. A. & Wilson, R. W. A measurement of excess antenna temperature at 4080 Mc/s. Astrophys. J. 142, 419–421 (1965).

    Article  ADS  Google Scholar 

  30. Sullivan, W. Signals imply a ‘Big Bang’ Universe. N. Y. Times 21 May, 1 (1965).

  31. Grossman, L. Father of big bang carries its hiss on his cellphone. New Sci. https://www.newscientist.com/article/dn25134-father-of-big-bang-carries-its-hiss-on-his-cellphone/ (2014).

  32. Scarf, F. L. Voyager 2 plasma wave observations at Saturn. Science, 215, 587–594 (1982).

    Article  ADS  Google Scholar 

  33. Landi, E. et al. Carbon ionization stages as a diagnostic of the solar wind. Astrophys. J. 744, 100 (2012).

    Article  ADS  Google Scholar 

  34. Alexander, R. L. et al. (eds) Proc. 17th International Conference on Auditory Display (ICAD, 2011).

  35. Hadhazy, A. Heavenly sounds: hearing astronomical data can lead to scientific insights. Scientific American (30 April 2014).

  36. Candey, R. M., Kessel, R. L. & Plue, J. R. Web-based sonification of space science data. In SIGGRAPH98 Conf. Abstracts and Applications (eds, Parent, R. et al.) 166 (ACM, 1998).

  37. Candey, R. M., Schertenleib, A. M. & Diaz Merced, W. L. Sonification prototype for space physics. AGU Fall Meeting Abstracts 52 (2005).

  38. Candey, R. M., Schertenleib, A. M. & Diaz Merced, W. L. xSonify sonification tool for space physics. In Proc. 12th International Conference on Auditory Display 289290 (ICAD, 2006).

  39. Diaz-Merced, W. L., Candey, R. M., Mannone, J. C., David, F. & Rodriguez, E. Sonification for the analysis of plasma bubbles at 21 MHz. Sun Geosph. 3, 42–45 (2008).

    ADS  Google Scholar 

  40. Lenzi, S., Ciuccarelli, P., Liu, H. & Hua, Y. Data Sonification Archive http://www.sonification.design

  41. Harrison, C., Zanella, A., Bonne, N., Meredith, K. & Misdariis, N. Audible Universe. Nat. Astron. 6, 22–23 (2021).

    Article  ADS  Google Scholar 

  42. Gurnett, D. A. Cassini Encounters Saturn’s Bow Shock http://www-pw.physics.uiowa.edu/space-audio/cassini/bow-shock/ (2014).

  43. Garcia, B., Diaz-Merced, W. L., Casado, J. & Cancio, A. Evolving from xSonify: a new digital platform for sonorization. EPJ Web Conf. 200, 01013 (2019).

    Article  Google Scholar 

  44. Bonne, N., Gupta, J., Krawczyk, C. & Masters, K. Tactile Universe makes outreach feel good. Astron. Geophys. 59, 1.30–1.33 (2018).

    Article  Google Scholar 

  45. Paredes-Sabando, P. & FuentesMunoz, C. Dedoscopio Project: making astronomy accessible to blind and visually impaired (BVI) communities across Chile. CAPjournal 29, 27 (2021).

    Google Scholar 

  46. Elmquist, E., Ejdbo, M., Bock, A. & Rönnberg, N. Openspace sonification: complementing visualization of the solar system with sound. In Proc. 26th International Conference on Auditory Display 135–142 (ICAD 2021).

  47. Barrass, S. The aesthetic turn in sonification towards a social and cultural medium. AI Soc. 27, 177–181 (2012).

    Article  Google Scholar 

  48. Dubus, G. & Bresin, R. A systematic review of mapping strategies for the sonification of physical quantities. PLoS ONE 8, e82491 (2013).

    Article  ADS  Google Scholar 

  49. McDermott, J. H., Lehr, A. J. & Oxenham, A. J. Is relative pitch specific to pitch?. Psychol. Sci. 19, 1263–1271 (2008).

    Article  Google Scholar 

  50. Chion, M. The Audiovision: Sound on Screen (Columbia Univ. Press, 1994).

  51. Gaver, W. The SonicFinder: an interface that uses auditory icons. Hum. Comput. Interact. 4, 67–94 (1989).

    Article  Google Scholar 

  52. Scaletti, C. Why sonification is a joke. In 23rd International Conference on Auditory Display, University Park, PA., 2017 https://www.youtube.com/watch?v=T0qdKXwRsyM (2017).

  53. Mozolic, J. L., Hugenschmidt, C. E., Peiffer, A. M. & Laurienti, P. J. Modality-specific selective attention attenuates multisensory integration. Exp. Brain. Res. 184, 39–52 (2007).

    Article  Google Scholar 

  54. SAS Support SAS Graphics Accelerator https://support.sas.com/software/products/graphics-accelerator/ (2022).

  55. Lenzi S., Terenghi G. & Moreno Ferdnadez-de-Leceta, A. A design-driven sonification process for supporting expert users in real-time anomaly detection: towards applied guidelines. EAI Endorsed Trans. Creative Technol: 7, e4 (2020).

  56. Giordano, B. L., Susini, P. & Bresin, R. in Sonic Interaction Design (eds Franinovic, K. & Serafin, S.) 151–197 (MIT Press, 2013).

  57. Quinton, M., McGregor, I. & Benyon, D. Sonifying the Solar System. In Proc. 22nd International Conference on Auditory Display 28–35 (ICAD, 2016).

  58. Tomlinson, B. J. et al. Solar System sonification: exploring Earth and its neighbors through sound. In Proc. 23rd International Conference on Auditory Display (ICAD, 2017).

  59. Bieryla, A. et al. LightSound: the sound of an eclipse. CAPjournal 28, 3 (2020).

  60. García Riber, A. Planethesizer Windows. Internet Archive https://archive.org/details/PlanethesizerWindows (2017).

  61. Soniverse Galaxy Player https://soniverse.space/galaxy-player/

  62. Sonification World. StarSound and Vox Magellan. YouTube https://www.youtube.com/watch?v=gQdvv-gCa3Y&ab_channel=SonificationWorld (2021).

  63. Audio Universe Tour of the Solar System https://www.audiouniverse.org/tour-of-the-solar-system (2021).

  64. Sonification World. Sonoplanet. YouTube https://www.youtube.com/watch?v=baVtw9MBrA8 (2021).

  65. Jodrell Bank Centre for Astrophysics The Sounds of Pulsars http://www.jb.man.ac.uk/~pulsar/Education/Sounds/sounds.html (2001).

  66. ALMA ALMA Sounds https://www.almaobservatory.org/en/alma-sounds/

  67. Keller, L. SonifySpec https://www.ithaca.edu/faculty/lkeller/research/spectral-sonification (2022).

  68. SYSTEM Sounds Saturn Harp https://www.system-sounds.com/saturn-harp/ (2022).

  69. SYSTEM Sounds TRAPPIST Sounds https://www.system-sounds.com/trappist-sounds/ (2022).

  70. NASA Exoplanet Watch https://exoplanets.nasa.gov/exoplanet-watch/about-exoplanet-watch/team/ (2022).

  71. LISA Consortium Multimedia Audio https://www.lisamission.org/multimedia/audio (2022).

  72. Astronomy Sound of the Month The Sound of a Fast Radio Burst https://astrosom.com/Apr2018.php (2018).

  73. Hannam, J. StarSound https://www.jeffreyhannam.com/starsound (2014).

  74. Alexander, R. Solar wind audification. YouTube https://www.youtube.com/watch?v=OOszY79xSkQ&ab_channel=RobertAlexander (2014).

Download references

Acknowledgements

We are grateful to the Lorentz Centre for supporting the organization of the Audible Universe workshop in September 2021 and to the workshop participants for valuable and insightful discussions. We also thank members of the Sonification World Chat and K. Perkins, for helping us collate information about current astronomy sonification and sound design projects. We thank I. Harry, C. McIsaac and S. Fairhurst for providing information about their Black Hole Hunter project and the possibility to include the data in Fig. 1. We are grateful to Y. Hua and P. Ciuccarelli for their help in creating Figs. 2 and 3. We are grateful to Jeff Hannam for his help in creating the sonification of Fig. 2.

Author information

Authors and Affiliations

Authors

Contributions

A.Z. and C.M.H. led the writing and the researching of current astronomy sonification and sound design projects, S.L. led the preparation of Figs. 2 and 3 and all co-authors participated in the discussion of the content and provided comments on the manuscript.

Corresponding authors

Correspondence to A. Zanella or C. M. Harrison.

Ethics declarations

Competing interests

The authors declare no competing interests.

Peer review

Peer review information

Nature Astronomy thanks Matt Russo for their contribution to the peer review of this work.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zanella, A., Harrison, C.M., Lenzi, S. et al. Sonification and sound design for astronomy research, education and public engagement. Nat Astron 6, 1241–1248 (2022). https://doi.org/10.1038/s41550-022-01721-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41550-022-01721-z

This article is cited by

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing