Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • NEWS FEATURE

AI image generators often give racist and sexist results: can they be fixed?

Researchers are tracing sources of racial and gender bias in images generated by artificial intelligence, and making efforts to fix them.
  1. Ananya

    1. Ananya is a freelance journalist and translator based in Bengaluru, India.

    View author publications

    You can also search for this author in PubMed  Google Scholar

In 2022, Pratyusha Ria Kalluri, a graduate student in artificial intelligence (AI) at Stanford University in California, found something alarming in image-generating AI programs. When she prompted a popular tool for ‘a photo of an American man and his house’, it generated an image of a pale-skinned person in front of a large, colonial-style home. When she asked for ‘a photo of an African man and his fancy house’, it produced an image of a dark-skinned person in front of a simple mud house — despite the word ‘fancy’.

Access options

Rent or buy this article

Prices vary by article type

from$1.95

to$39.95

Learn more

Prices may be subject to local taxes which are calculated during checkout

Nature 627, 722-725 (2024)

doi: https://doi.org/10.1038/d41586-024-00674-9

References

  1. Bianchi, F. et al. Proc. 2023 ACM Conf. Fairness Account. Transpar. (FAccT '23) 1493–1504 (2023); available at https://doi.org/mkw9

  2. Ash, E., Durante, R., Grebenschikova, M. & Schwarz, C. Visual Representation and Stereotypes in News Media. CEPR Discussion Paper No. DP16624 (CEPR, 2021); available at https://ssrn.com/abstract=3960205

    Google Scholar 

  3. Charani, E. et al. Lancet Glob. Health, 11, 155–164 (2023).

    Article  Google Scholar 

  4. Guilbeault, D. et al. Nature 626, 1049–1055 (2024).

    Article  PubMed  Google Scholar 

  5. Mansimov, E., Parisotto, E., Ba, J. L. & Salakhutdinov, R. Preprint at arXiv https://doi.org/10.48550/arXiv.1511.02793 (2015).

  6. Bansal, H., Yin, D., Monajatipoor, M. & Chang, K.-W. in Proc. 2022 Conf. Empir. Methods Nat. Lang. Process. 1358–1370 (Association for Computational Linguistics, 2022); available at https://doi.org/mkxb

  7. Fraser, K. C., Kiritchenko, S. & Nejadgholi, I. in 14th Int. Conf. Comput. Creativity (ICCC'23) (International Conference on Computational Creativity, 2023); available at https://go.nature.com/4abrcyz

  8. Birhane, A., Prabhu, V. U. & Kahembwe, E. Preprint at arXiv https://doi.org/10.48550/arXiv.2110.01963 (2021).

  9. Dodge, J. et al. in Proc. 2021 Conf. Empir. Methods Nat. Lang. Process. 1286–1305 (Association for Computational Linguistics, 2021); available at https://doi.org/mkxc

  10. Birhane, A., Prabhu, V., Han, S., Boddeti, V. N. & Luccioni A. S. Preprint at arXiv https://doi.org/10.48550/arXiv.2311.03449 (2023).

  11. Gebru, T. et al. Commun. ACM 64, 86–92 (2021).

    Article  Google Scholar 

Download references

Subjects

Latest on:

Nature Careers

Jobs

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing

Search

Advanced search

Quick links