awesome-fairness-papers

Papers about fairness in NLP and Multi-Modal Models

Christina Chance, Yixin Wan, Jieyu Zhao, Emily Sheng, Sunipa Dev, Yu (Hope) Hou, Nanyun (Violet) Peng, and Kai-Wei Chang

Background

Fairness, accountability, transparency, and ethics are becoming more and more important in Natural Language Processing (NLP) and Multi-Modal Settings. We provide a list of papers that serve as references for researchers interested in these topics. This repo mainly focuses on papers published in the NLP venues, but we also point to some other resources at the end.

For relevant courses and other resources, please refer to ACL Wiki

Disclaimer: We may miss some relevant papers in the list. If you have any suggestions or would like to add some papers, please submit a pull request or email us. Your contribution is much appreciated!

Contents

• awesome-fairness-papers
  • Background
  • Contents
    • Paper List
      • Surveys
      • Social Impact of Biases
      • Data, Models, & Metrics
      • Word/Sentence Representations
      • Natural Language Understanding
        • Bias Amplification Issue
        • Bias Detection
        • Bias Mitigation
      • Natural Language Generation
        • Machine Translation
        • Dialogue Generation
        • Other Generation
      • Multi-Modal Setting
        • Bias Detection in Multi-Modal Setting
        • Bias Mitigation in Multi-Modal Setting
      • Bias Visualization
      • Others
    • Tutorial List
      • Jupyter/Colab Tutorial
    • Conference/Workshop List

Paper List

Surveys

1. Language (Technology) is Power: A Critical Survey of "Bias" in NLP, Blodgett, Su Lin and Barocas, Solon and Daumé III, Hal and Wallach, Hanna, 2020
2. Predictive Biases in Natural Language Processing Models: A Conceptual Framework and Overview, Shah, Deven Santosh and Schwartz, H. Andrew and Hovy, Dirk, 2020
3. Mitigating Gender Bias in Natural Language Processing: Literature Review, Sun, Tony and Gaut, Andrew and Tang, Shirlyn and Huang, Yuxin and ElSherief, Mai and Zhao, Jieyu and Mirza, Diba and Belding, Elizabeth and Chang, Kai-Wei and Wang, William Yang, 2019
4. A survey on bias and fairness in machine learning, Mehrabi, Ninareh and Morstatter, Fred and Saxena, Nripsuta and Lerman, Kristina and Galstyan, Aram, 2019
5. 50 years of test (Un)fairness: Lessons for machine learning, Hutchinson, Ben and Mitchell, Margaret, 2019
6. Societal Biases in Language Generation: Progress and Challenges, Sheng, Emily and Chang, Kai-Wei and Natarajan, Prem and Peng, Nanyun, 2021
7. Gender Bias in Machine Translation, Savoldi, Beatrice and Gaido, Marco and Bentivogli, Luisa and Negri, Matteo and Turchi, Marco, 2021
8. Quantifying Social Biases in NLP: A Generalization and Empirical Comparison of Extrinsic Fairness Metrics, Czarnowska, Paula and Vyas, Yogarshi and Shah Kashif, 2021
9. Confronting Abusive Language Online: A Survey from the Ethical and Human Rights Perspective, Kiritchenko, Svetlana and Nejadgholi, Isar and Fraser, Kathleen C, 2020
10. On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜, Bender, Emily M., Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. 2021.
11. An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models . Nicholas Meade, Elinor Poole-Dayan, Siva Reddy. ACL 2022
12. Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold. Sebastian Ruder, Ivan Vulić, Anders Søgaard. ACL 2022 Findings.
13. Measuring Fairness with Biased Rulers: A Comparative Study on Bias Metrics for Pre-trained. Language Models Pieter Delobelle, Ewoenam Kwaku Tokpo, Toon Calders, Bettina Berendt. NAACL 2022
14. Benchmarking Intersectional Biases in NLP. John Lalor, Yi Yang, Kendall Smith, Nicole Forsgren, Ahmed Abbasi. NAACL 2022.
15. Measure and Improve Robustness in NLP Models: A Survey. Xuezhi Wang, Haohan Wang, Diyi Yang. NAACL 2022.

Social Impact of Biases

1. The Social Impact of Natural Language Processing, Hovy, Dirk and Spruit, Shannon L., 2016
2. Give Me Convenience and Give Her Death: Who Should Decide What Uses of NLP are Appropriate, and on What Basis?, Leins, Kobi and Lau, Jey Han and Baldwin, Timothy, 2020
3. Situated Data, Situated Systems: A Methodology to Engage with Power Relations in Natural Language Processing Research, Havens, Lucy and Terras, Melissa and Bach, Benjamin and Alex, Beatrice, 2020
4. Re-imagining Algorithmic Fairness in India and Beyond, Sambasivan, Nithya and Arnesen, Erin and Hutchinson, Ben and Doshi, Tulsee and Prabhakaran, Vinodkumar, 2021
5. Improving fairness in machine learning systems: What do industry practitioners need?, Holstein, Kenneth and Wortman Vaughan, Jennifer and Daumé III, Hal and Dudik, Miro and Wallach, Hanna, 2019
6. The problem with bias: Allocative versus representational harms in machine learning, Barocas, Solon and Crawford, Kate and Shapiro, Aaron and Wallach, Hanna, 2017
7. The many dimensions of algorithmic fairness in educational applications, Loukina, Anastassia and Madnani, Nitin and Zechner, Klaus, 2019
8. NLPositionality: Characterizing Design Biases of Datasets and Models. Sebastin Santy, Jenny Liang, Ronan Le Bras, Katharina Reinecke, Maarten Sap. ACL 2023
9. What social attitudes about gender does BERT encode? Leveraging insights from psycholinguistics. Julia Watson, Barend Beekhuizen, Suzanne Stevenson. ACL 2023
10. Examining risks of racial biases in NLP tools for child protective services. Anjalie Field, Amanda Coston, Nupoor Gandhi, Alexandra Chouldechova, Emily Putnam-Hornstein, David Steier, Yulia Tsvetkov. ACM FAccT 2023
11. "I wouldn’t say offensive but...": Disability-Centered Perspectives on Large Language Models. Vinitha Gadiraju, Shaun Kane, Sunipa Dev, Alex Taylor, Ding Wang, Emily Denton, Robin Brewer. ACM FAccT 2023
12. Contrastive Language-Vision AI Models Pretrained on Web-Scraped Multimodal Data Exhibit Sexual Objectification Bias. Robert Wolfe, Yiwei Yang, Bill Howe, Aylin Caliskan. ACM FAccT 2023

Data, Models, & Metrics

1. Data Statements for Natural Language Processing: Toward Mitigating System Bias and Enabling Better Science, Bender, Emily M. and Friedman, Batya, 2018
2. Data and its (dis)contents: A survey of dataset development and use in machine learning research, Paullada, Amandalynne and Raji, Inioluwa Deborah and Bender, Emily M and Denton, Emily and Hanna, Alex, 2020
3. Datasheets for datasets, Gebru, Timnit and Morgenstern, Jamie and Vecchione, Briana and Vaughan, Jennifer Wortman and Wallach, Hanna and Daumé III, Hal and Crawford, Kate, 2018
4. Discovering and categorising language biases in reddit, Ferrer, Xavier and van Nuenen, Tom and Such, Jose M. and Criado, Natalia, 2021
5. Model cards for model reporting, Mitchell, Margaret and Wu, Simone and Zaldivar, Andrew and Barnes, Parker and Vasserman, Lucy and Hutchinson, Ben and Spitzer, Elena and Raji, Inioluwa Deborah and Gebru, Timnit, 2019
6. Counterfactual fairness, Kusner, Matt J and Loftus, Joshua and Russell, Chris and Silva, Ricardo, 2017
7. Fairness through awareness, Dwork, Cynthia and Hardt, Moritz and Pitassi, Toniann and Reingold, Omer and Zemel, Richard, 2012
8. Equality of opportunity in supervised learning, Hardt, Moritz and Price, Eric and Srebro, Nati, 2016
9. The price of debiasing automatic metrics in natural language evalaution, Chaganty, Arun and Mussmann, Stephen and Liang, Percy, 2018
10. Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasets, Geva, Mor and Goldberg, Yoav and Berant, Jonathan, 2019
11. Proposed Taxonomy for Gender Bias in Text; A Filtering Methodology for the Gender Generalization Subtype, Hitti, Yasmeen and Jang, Eunbee and Moreno, Ines and Pelletier, Carolyne, 2019
12. These are not the Stereotypes You are Looking For: Bias and Fairness in Authorial Gender Attribution, Koolen, Corina and van Cranenburgh, Andreas, 2017
13. Discovering Biased News Articles Leveraging Multiple Human Annotations, Lazaridou, Konstantina and L{"o}ser, Alexander and Mestre, Maria and Naumann, Felix, 2020
14. Annotating and Analyzing Biased Sentences in News Articles using Crowdsourcing, Lim, Sora and Jatowt, Adam and F{"a}rber, Michael and Yoshikawa, Masatoshi, 2020
15. Differentially Private Representation for NLP: Formal Guarantee and An Empirical Study on Privacy and Fairness, Lyu, Lingjuan and He, Xuanli and Li, Yitong, 2020
16. Building Better Open-Source Tools to Support Fairness in Automated Scoring, Madnani, Nitin and Loukina, Anastassia and von Davier, Alina and Burstein, Jill and Cahill, Aoife, 2017
17. StereoSet: Measuring stereotypical bias in pretrained language models, Nadeem, Moin and Bethke, Anna and Reddy, Siva, 2020
18. Investigating Sports Commentator Bias within a Large Corpus of American Football Broadcasts, Merullo, Jack and Yeh, Luke and Handler, Abram and Grissom II, Alvin and O{'}Connor, Brendan and Iyyer, Mohit, 2019
19. Artie Bias Corpus: An Open Dataset for Detecting Demographic Bias in Speech Applications, Meyer, Josh and Rauchenstein, Lindy and Eisenberg, Joshua D. and Howell, Nicholas, 2020
20. RtGender: A Corpus for Studying Differential Responses to Gender, Voigt, Rob and Jurgens, David and Prabhakaran, Vinodkumar and Jurafsky, Dan and Tsvetkov, Yulia, 2018
21. Multi-Dimensional Gender Bias Classification, Dinan, Emily and Fan, Angela and Wu, Ledell and Weston, Jason and Kiela, Douwe and Williams, Adina, 2020
22. UNQOVERing Stereotyping Biases via Underspecified Questions, Li, Tao and Khashabi, Daniel and Khot, Tushar and Sabharwal, Ashish and Srikumar, Vivek, 2020
23. CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models, Nangia, Nikita and Vania, Clara and Bhalerao, Rasika and Bowman, Samuel R., 2020
24. Gender Bias in Coreference Resolution, Rudinger, Rachel and Naradowsky, Jason and Leonard, Brian and Van Durme, Benjamin, 2018
25. Gender Bias in Coreference Resolution: Evaluation and Debiasing Methods, Zhao, Jieyu and Wang, Tianlu and Yatskar, Mark and Ordonez, Vicente and Chang, Kai-Wei, 2018
26. Unmasking the Mask -- Evaluating Social Biases in Masked Language Models, Kaneko, Masahiro and Bollegala, Danushka, 2021
27. WIKIBIAS: Detecting Multi-Span Subjective Biases in Language, Zhong, Yang and Yang, Jingfeng and Xu, Wei and Yang, Diyi, EMNLP, 2021
28. Constructing a Psychometric Testbed for Fair Natural Language Processing, Ahmed Abbasi, David Dobolyi, John P. Lalor, Richard G. Netemeyer, Kendall Smith, and Yi Yang, EMNLP 2021
29. Benchmarking Bias Mitigation Algorithms in Representation Learning through Fairness Metrics, Charan Reddy, Deepak Sharma, Soroush Mehri, Adriana Romero, Samira Shabanian, Sina Honari. NeurIPS, 2021.
30. FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processing. Ilias Chalkidis, Tommaso Pasini, Sheng Zhang, Letizia Tomada, Sebastian Felix Schwemer, Anders Søgaard. ACL 2022.
31. French CrowS-Pairs: Extending a challenge dataset for measuring social bias in masked language models to a language other than English. Aurélie Névéol, Yoann Dupont, Julien Bezançon, Karën Fort. ACL 2022
32. Measuring Fairness of Text Classifiers via Prediction Sensitivity. Satyapriya Krishna, Rahul Gupta, Apurv Verma, Jwala Dhamala, Yada Pruksachatkun, Kai-Wei Chang. ACL 2022.
33. Optimising Equal Opportunity Fairness in Model Training. Aili Shen, Xudong Han, Trevor Cohn, Timothy Baldwin, Lea Frermann. NAACL 2022.
34. Benchmarking Intersectional Biases in NLP, John P. Lalor, Yi Yang, Kendall Smith, Nicole Forsgren, Ahmed Abbasi. NAACL 2022.
35. Collecting a Large-Scale Gender Bias Dataset for Coreference Resolution and Machine Translation. Shahar Levy, Koren Lazar, Gabriel Stanovsky. EMNLP 2021
36. Recognition of They/Them as Singular Personal Pronouns in Coreference Resolution. Connor Baumler and Rachel Rudinger. NAACL 2022.
37. Theory-Grounded Measurement of U.S. Social Stereotypes in English Language Models. Yang Trista Cao, Anna Sotnikova, Hal Daumé III, Rachel Rudinger, Linda Zou. NAACL 2022.
38. WinoQueer: A Community-in-the-Loop Benchmark for Anti-LGBTQ+ Bias in Large Language Models. Virginia Felkner, Ho-Chun Herbert Chang, Eugene Jang, Jonathan May. ACL 2023
39. The Tail Wagging the Dog: Dataset Construction Biases of Social Bias Benchmarks. Nikil Selvam, Sunipa Dev, Daniel Khashabi, Tushar Khot, Kai-Wei Chang. ACL 2023
40. Fighting Bias With Bias: Promoting Model Robustness by Amplifying Dataset Biases. Yuval Reif, Roy Schwartz. ACL 2023 Findings
41. FORK: A Bite-Sized Test Set for Probing Culinary Cultural Biases in Commonsense Reasoning Models. Shramay Palta, Rachel Rudinger. ACL 2023 Findings
42. KoSBI: A Dataset for Mitigating Social Bias Risks Towards Safer Large Language Model Applications. Hwaran Lee, Seokhee Hong, Joonsuk Park, Takyoung Kim, Gunhee Kim, Jung-woo Ha. ACL 2023
43. Riveter: Measuring Power and Social Dynamics Between Entities. Maria Antoniak, Anjalie Field, Jimin Mun, Melanie Walsh, Lauren Klein, Maarten Sap. ACL 2023
44. BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation. Tianxiang Sun, Junliang He, Xipeng Qiu, Xuanjing Huang. EMNLP 2022
45. FairLib: A Unified Framework for Assessing and Improving Fairness. Xudong Han, Aili Shen, Yitong Li, Lea Frermann, Timothy Baldwin, Trevor Cohn. EMNLP 2022
46. Towards Identifying Social Bias in Dialog Systems: Framework, Dataset, and Benchmark. Jingyan Zhou, Jiawen Deng, Fei Mi, Yitong Li, Yasheng Wang, Minlie Huang, Xin Jiang, Qun Liu, Helen Meng. EMNLP 2022
47. Detecting Unintended Social Bias in Toxic Language Datasets. Nihar Sahoo, Himanshu Gupta, Pushpak Bhattacharyya. EMNLP 2022
48. Toward Gender-Inclusive Coreference Resolution. Yang Trista Cao, Hal Daumé III. ACL 2020.

Word/Sentence Representations

1. Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings, Bolukbasi, Tolga and Chang, Kai-Wei and Zou, James and Saligrama, Venkatesh and Kalai, Adam, 2016 [github]
2. Semantics derived automatically from language corpora contain human-like biases, Caliskan, Aylin and Bryson, Joanna J. and Narayanan, Arvind, 2017
3. Attenuating Biases in Word Vectors, Dev, Sunipa and Phillips, Jeff M, 2019
4. Gender Bias in Contextualized Word Embeddings, Zhao, Jieyu and Wang, Tianlu and Yatskar, Mark and Cotterell, Ryan and Ordonez, Vicente and Chang, Kai-Wei, 2019
5. Black is to Criminal as Caucasian is to Police: Detecting and Removing Multiclass Bias in Word Embeddings, Manzini, Thomas and Yao Chong, Lim and Black, Alan W and Tsvetkov, Yulia, 2019
6. Towards Understanding Linear Word Analogies, Ethayarajh, Kawin and Duvenaud, David and Hirst, Graeme, 2019
7. Understanding Undesirable Word Embedding Associations, Ethayarajh, Kawin and Duvenaud, David and Hirst, Graeme, 2019
8. Gender Bias in Multilingual Embeddings and Cross-Lingual Transfer, Zhao, Jieyu and Mukherjee, Subhabrata and Hosseini, Saghar and Chang, Kai-Wei and Hassan Awadallah, Ahmed, 2020
9. Nurse is Closer to Woman than Surgeon? Mitigating Gender-Biased Proximities in Word Embeddings, Kumar, Vaibhav and Bhotia, Tenzin Singhay and Kumar, Vaibhav and Chakraborty, Tanmoy, 2020
10. Measuring Bias in Contextualized Word Representations, Kurita, Keita and Vyas, Nidhi and Pareek, Ayush and Black, Alan W and Tsvetkov, Yulia, 2019
11. Unmasking Contextual Stereotypes: Measuring and Mitigating BERT's Gender Bias, Bartl, Marion and Nissim, Malvina and Gatt, Albert, 2020
12. Evaluating the Underlying Gender Bias in Contextualized Word Embeddings, Basta, Christine and Costa-jussà, Marta R. and Casas, Noe, 2019
13. Evaluating Bias In Dutch Word Embeddings, Chávez Mulsa, Rodrigo Alejandro and Spanakis, Gerasimos, 2020
14. Learning Gender-Neutral Word Embeddings, Zhao, Jieyu and Zhou, Yichao and Li, Zeyu and Wang, Wei and Chang, Kai-Wei
15. Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Them, Gonen, Hila and Goldberg, Yoav, 2019
16. It{'}s All in the Name: Mitigating Gender Bias with Name-Based Counterfactual Data Substitution, Hall Maudslay, Rowan and Gonen, Hila and Cotterell, Ryan and Teufel, Simone, 2019
17. Gender-preserving Debiasing for Pre-trained Word Embeddings, Kaneko, Masahiro and Bollegala, Danushka, 2019
18. Debiasing Pre-trained Contextualised Embeddings, Kaneko, Masahiro and Bollegala, Danushka, 2021
19. Dictionary-based Debiasing of Pre-trained Word Embeddings, Kaneko, Masahiro and Bollegala, Danushka, 2021
20. Conceptor Debiasing of Word Representations Evaluated on WEAT, Karve, Saket and Ungar, Lyle and Sedoc, Jo{~a}o, 2019
21. Are We Consistently Biased? Multidimensional Analysis of Biases in Distributional Word Vectors, Lauscher, Anne and Glava{\v{s}}, Goran, 2019
22. AraWEAT: Multidimensional Analysis of Biases in Arabic Word Embeddings, Lauscher, Anne and Takieddin, Rafik and Ponzetto, Simone Paolo and Glava{\v{s}}, Goran, 2020
23. Unequal Representations: Analyzing Intersectional Biases in Word Embeddings Using Representational Similarity Analysis, Lepori, Michael, 2020
24. Monolingual and Multilingual Reduction of Gender Bias in Contextualized Representations, Liang, Sheng and Dufter, Philipp and Sch{"u}tze, Hinrich, 2020
25. Towards Debiasing Sentence Representations, Liang, Paul Pu and Li, Irene Mengze and Zheng, Emily and Lim, Yao Chong and Salakhutdinov, Ruslan and Morency, Louis-Philippe, 2020
26. On Measuring Social Biases in Sentence Encoders, May, Chandler and Wang, Alex and Bordia, Shikha and Bowman, Samuel R. and Rudinger, Rachel, 2019
27. Fair Is Better than Sensational: Man Is to Doctor as Woman Is to Doctor, Nissim, Malvina and van Noord, Rik and van der Goot, Rob, 2020
28. Gender Bias in Pretrained Swedish Embeddings, Sahlgren, Magnus and Olsson, Fredrik, 2019
29. Is Wikipedia succeeding in reducing gender bias? Assessing changes in gender bias in Wikipedia using word embeddings, Schmahl, Katja Geertruida and Viering, Tom Julian and Makrodimitris, Stavros and Naseri Jahfari, Arman and Tax, David and Loog, Marco, 2020
30. The Role of Protected Class Word Lists in Bias Identification of Contextualized Word Representations, Sedoc, Jo{~a}o and Ungar, Lyle, 2019
31. Neutralizing Gender Bias in Word Embeddings with Latent Disentanglement and Counterfactual Generation, Shin, Seungjae and Song, Kyungwoo and Jang, JoonHo and Kim, Hyemi and Joo, Weonyoung and Moon, Il-Chul, 2020
32. A Transparent Framework for Evaluating Unintended Demographic Bias in Word Embeddings, Sweeney, Chris and Najafian, Maryam, 2019
33. Can Existing Methods Debias Languages Other than English? First Attempt to Analyze and Mitigate Japanese Word Embeddings, Takeshita, Masashi and Katsumata, Yuki and Rzepka, Rafal and Araki, Kenji, 2020
34. Exploring the Linear Subspace Hypothesis in Gender Bias Mitigation, Vargas, Francisco and Cotterell, Ryan, 2020
35. Double-Hard Debias: Tailoring Word Embeddings for Gender Bias Mitigation, Wang, Tianlu and Lin, Xi Victoria and Rajani, Nazneen Fatema and McCann, Bryan and Ordonez, Vicente and Xiong, Caiming, 2020
36. Robustness and Reliability of Gender Bias Assessment in Word Embeddings: The Role of Base Pairs, Zhang, Haiyang and Sneyd, Alison and Stevenson, Mark, 2020
37. Diachronic Word Embeddings Reveal Statistical Laws of Semantic Change, Hamilton, William L. and Leskovec, Jure and Jurafsky, Dan, 2016 [github]
38. Measuring Gender Bias in Word Embeddings across Domains and Discovering New Gender Bias Word Categories, Chaloner, Kaytlin and Maldonado, Alfredo, 2019
39. Relating Word Embedding Gender Biases to Gender Gaps: A Cross-Cultural Analysis, Friedman, Scott and Schmer-Galunder, Sonja and Chen, Anthony and Rye, Jeffrey, 2019
40. Modeling Personal Biases in Language Use by Inducing Personalized Word Embeddings, Oba, Daisuke and Yoshinaga, Naoki and Sato, Shoetsu and Akasaki, Satoshi and Toyoda, Masashi, 2019
41. Quantifying 60 Years of Gender Bias in Biomedical Research with Word Embeddings, Rios, Anthony and Joshi, Reenam and Shin, Hejin, 2020
42. Debiasing knowledge graph embeddings, Fisher, Joseph and Mittal, Arpit and Palfrey, Dave and Christodoulopoulos, Christos, 2020
43. Assessing the Reliability of Word Embedding Gender Bias Measures, Du, Yupei and Fang, Qixiang and Nguyen, Dong, EMNLP, 2021
44. Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologies, Dev, Sunipa and Monajatipoor, Masoud and Ovalle, Anaelia and Subramonian, Arjun and Phillips, Jeff M and Chang, Kai-Wei, EMNLP, 2021
45. Sense Embeddings are also Biased -- Evaluating Social Biases in Static and Contextualised Sense Embeddings. Yi Zhou, Masahiro Kaneko, Danushka Bollegala. ACL 2022
46. Understanding Gender Bias in Knowledge Base Embeddings. Yupei Du, Qi Zheng, Yuanbin Wu, Man Lan, Yan Yang, Meirong Ma. ACL 2022
47. On the Intrinsic and Extrinsic Fairness Evaluation Metrics for Contextualized Language Representations . Yang Trista Cao, Yada Pruksachatkun, Kai-Wei Chang, Rahul Gupta, Varun Kumar, Jwala Dhamala, Aram Galstyan. ACL 2022
48. Learning Bias-reduced Word Embeddings Using Dictionary Definitions. Haozhe An, Xiaojiang Liu, Donald Zhang. ACL 2022 Findings.
49. Socially Aware Bias Measurements for Hindi Language Representations. Vijit Malik, Sunipa Dev, Akihiro Nishi, Nanyun Peng, Kai-Wei Chang. NAACL 2022
50. No Word Embedding Model Is Perfect: Evaluating the Representation Accuracy for Social Bias in the Media. Maximilian Spliethöver, Maximilian Keiff, Henning Wachsmuth. EMNLP 2022
51. Gender Bias in Meta-Embeddings. Masahiro Kaneko, Danushka Bollegala, Naoaki Okazaki. EMNLP 2022
52. The Undesirable Dependence on Frequency of Gender Bias Metrics Based on Word Embeddings. Francisco Valentini, Germán Rosati, Diego Fernandez Slezak, Edgar Altszyler. EMNLP 2022

Natural Language Understanding

Bias Amplification Issue

1. Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints, Zhao, Jieyu and Wang, Tianlu and Yatskar, Mark and Ordonez, Vicente and Chang, Kai-Wei, 2017
2. Feature-Wise Bias Amplification, Klas Leino, Emily Black, Matt Fredrikson, Shayak Sen, Anupam Datta. ICLR, 2019.
3. Mitigating Gender Bias Amplification in Distribution by Posterior Regularization, Jia, Shengyu and Meng, Tao and Zhao, Jieyu and Chang, Kai-Wei, 2020
4. Fairness Without Demographics in Repeated Loss Minimization, Tatsunori B. Hashimoto, Megha Srivastava, Hongseok Namkoong, Percy Liang, ICLM, 2018

Bias Detection

1. LOGAN: Local Group Bias Detection by Clustering, Zhao, Jieyu and Chang, Kai-Wei, 2020
2. Examining Gender Bias in Languages with Grammatical Gender, Zhou, Pei and Shi, Weijia and Zhao, Jieyu and Huang, Kuan-Hao and Chen, Muhao and Cotterell, Ryan and Chang, Kai-Wei, 2019
3. Racial Bias in Hate Speech and Abusive Language Detection Datasets, Davidson, Thomas and Bhattacharya, Debasmita and Weber, Ingmar, 2019
4. Social Biases in NLP Models as Barriers for Persons with Disabilities, Hutchinson, Ben and Prabhakaran, Vinodkumar and Denton, Emily and Webster, Kellie and Zhong, Yu and Denuyl, Stephen, 2020
5. Perturbation Sensitivity Analysis to Detect Unintended Model Biases, Prabhakaran, Vinodkumar and Hutchinson, Ben and Mitchell, Margaret, 2019
6. OSCaR: Orthogonal Subspace Correction and Rectification of Biases in Word Embeddings, Dev, Sunipa and Li, Tao and Phillips, Jeff M and Srikumar, Vivek, 2020
7. Women's Syntactic Resilience and Men's Grammatical Luck: Gender-Bias in Part-of-Speech Tagging and Dependency Parsing, Garimella, Aparna and Banea, Carmen and Hovy, Dirk and Mihalcea, Rada, 2019
8. Towards Understanding Gender Bias in Relation Extraction, Gaut, Andrew and Sun, Tony and Tang, Shirlyn and Huang, Yuxin and Qian, Jing and ElSherief, Mai and Zhao, Jieyu and Mirza, Diba and Belding, Elizabeth and Chang, Kai-Wei and Wang, William Yang, 2020
9. Type B Reflexivization as an Unambiguous Testbed for Multilingual Multi-Task Gender Bias, Gonz{'a}lez, Ana Valeria and Barrett, Maria and Hvingelby, Rasmus and Webster, Kellie and S{\o}gaard, Anders, 2020
10. Inflating Topic Relevance with Ideology: A Case Study of Political Ideology Bias in Social Topic Detection Models, Guo, Meiqi and Hwa, Rebecca and Lin, Yu-Ru and Chung, Wen-Ting, 2020
11. Media Bias, the Social Sciences, and NLP: Automating Frame Analyses to Identify Bias by Word Choice and Labeling, Hamborg, Felix, 2020
12. An Annotation Scheme for Automated Bias Detection in Wikipedia, Herzig, Livnat and Nunes, Alex and Snir, Batia, 2011
13. Multilingual Twitter Corpus and Baselines for Evaluating Demographic Bias in Hate Speech Recognition, Huang, Xiaolei and Xing, Linzi and Dernoncourt, Franck and Paul, Michael J., 2020
14. Enhancing Bias Detection in Political News Using Pragmatic Presupposition, Kameswari, Lalitha and Sravani, Dama and Mamidi, Radhika, 2020
15. Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systems, Kiritchenko, Svetlana and Mohammad, Saif, 2018
16. Social Bias in Elicited Natural Language Inferences, Rudinger, Rachel and May, Chandler and Van Durme, Benjamin, 2017
17. The Risk of Racial Bias in Hate Speech Detection, Sap, Maarten and Card, Dallas and Gabriel, Saadia and Choi, Yejin and Smith, Noah A., 2019
18. Social Bias Frames: Reasoning about Social and Power Implications of Language, Sap, Maarten and Gabriel, Saadia and Qin, Lianhui and Jurafsky, Dan and Smith, Noah A. and Choi, Yejin, 2020
19. Do Neural Language Models Overcome Reporting Bias?, Shwartz, Vered and Choi, Yejin, 2020
20. Context in Informational Bias Detection, van den Berg, Esther and Markert, Katja, 2020
21. Comparative Evaluation of Label-Agnostic Selection Bias in Multilingual Hate Speech Datasets, Ousidhoum, Nedjma and Song, Yangqiu and Yeung, Dit-Yan, 2020
22. Detecting and Reducing Bias in a High Stakes Domain, Zhong, Ruiqi and Chen, Yanda and Patton, Desmond and Selous, Charlotte and McKeown, Kathy, 2019
23. Measuring the Effects of Bias in Training Data for Literary Classification, Bagga, Sunyam and Piper, Andrew, 2020
24. Unsupervised Discovery of Implicit Gender Bias, Field, Anjalie and Tsvetkov, Yulia, 2020
25. Evaluating Debiasing Techniques for Intersectional Biases, Subramanian, Shivashankar and Han, Xudong and Baldwin, Timothy and Cohn, Trevor and Frermann, Lea , EMNLP 2021
26. Towards Automatic Bias Detection in Knowledge Graphs, Keidar, Daphna and Zhong, Mian and Zhang, Ce and Shrestha, Yash Raj and Paudel, Bibek, EMNLP, 2021
27. Uncovering Implicit Gender Bias in Narratives through Commonsense Inference, Huang, Tenghao and Brahman, Faeze and Shwartz, Vered and Chaturvedi, Snigdha, EMNLP 2021
28. Is Your Classifier Actually Biased? Measuring Fairness under Uncertainty with Bernstein Bounds, Ethayarajh, Kawin, 2020
29. Suum Cuique: Studying Bias in Taboo Detection with a Community Perspective. Osama Khalid, Jonathan Rusert, Padmini Srinivasan. ACL 2022 Findings
30. Your fairness may vary: Pretrained language model fairness in toxic text classification. Ioana Baldini, Dennis Wei, Karthikeyan Natesan Ramamurthy, Mikhail Yurochkin, Moninder Singh. ACL 2022 Findings
31. Features or Spurious Artifacts? Data-centric Baselines for Fair and Robust Hate Speech Detection. Alan Ramponi, Sara Tonelli. NAACL 2022
32. Gender Bias in Masked Language Models for Multiple Languages. Masahiro Kaneko, Aizhan Imankulova, Danushka Bollegala, Naoaki Okazaki. NAACL 2022
33. Using Natural Sentence Prompts for Understanding Biases in Language Models. Sarah Alnegheimish, Alicia Guo, Yi Sun. NAACL 2022
34. Easy Adaptation to Mitigate Gender Bias in Multilingual Text Classification. Xiaolei Huang. NAACL 2022
35. On Measuring Social Biases in Prompt-Based Multi-Task Learning. Afra Feyza Akyürek, Sejin Paik, Muhammed Yusuf Kocyigit, Seda Akbiyik, Şerife Leman Runyun, Derry Wijaya. NAACL 2022 Findings
36. Unpacking the Interdependent Systems of Discrimination: Ableist Bias in NLP Systems through an Intersectional Lens. Saad Hassan, Matt Huenerfauth, Cecilia Ovesdotter Alm. EMNLP 2021
37. From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Models. Shangbin Feng, Chan Young Park, Yuhan Liu, Yulia Tsvetkov. ACL 2023
38. FairPrism: Evaluating Fairness-Related Harms in Text Generation. Eve Fleisig, Aubrie Amstutz, Chad Atalla, Su Lin Blodgett, Hal Daumé III, Alexandra Olteanu, Emily Sheng, Dan Vann, Hanna Wallach. ACL 2023
39. MISGENDERED: Limits of Large Language Models in Understanding Pronouns. Tamanna Hossain, Sunipa Dev, Sameer Singh. ACL 2023
40. Are Fairy Tales Fair? Analyzing Gender Bias in Temporal Narrative Event Chains of Children’s Fairy Tales. Paulina Toro Isaza, Guangxuan Xu, Toye Oloko, Yufang Hou, Nanyun Peng, Dakuo Wang. ACL 2023
41. Measuring Intersectional Biases in Historical Documents. Nadav Borenstein, Karolina Stanczak, Thea Rolskov, Natacha Klein Käfer, Natália da Silva Perez, Isabelle Augenstein. ACl 2023 Findings.
42. This prompt is measuring : evaluating bias evaluation in language models. Seraphina Goldfarb-Tarrant, Eddie Ungless, Esma Balkir, Su Lin Blodgett. ACL 2023 Findings
43. Speaking Multiple Languages Affects the Moral Bias of Language Models. Katharina Haemmerl, Bjoern Deiseroth, Patrick Schramowski, Jindřich Libovický, Constantin Rothkopf, Alexander Fraser, Kristian Kersting. ACL 2023 Findings
44. With Prejudice to None: A Few-Shot, Multilingual Transfer Learning Approach to Detect Social Bias in Low Resource Languages. Nihar Sahoo, Niteesh Mallela, Pushpak Bhattacharyya. ACL 2023 Findings
45. Run Like a Girl! Sport-Related Gender Bias in Language and Vision. Sophia Harrison, Eleonora Gualdoni, Gemma Boleda. ACL 2023 Findings
46. Race, Gender, and Age Biases in Biomedical Masked Language Models. Michelle Kim, Junghwan Kim, Kristen Johnson. ACL 2023 Findings
47. Stereotypes and Smut: The (Mis)representation of Non-cisgender Identities by Text-to-Image Models. Eddie Ungless, Bjorn Ross, Anne Lauscher. ACL 2023 Findings
48. Towards Procedural Fairness: Uncovering Biases in How a Toxic Language Classifier Uses Sentiment Information. Isar Nejadgholi, Esma Balkir, Kathleen Fraser, Svetlana Kiritchenko. EMNLP 2022
49. “I’m sorry to hear that”: Finding New Biases in Language Models with a Holistic Descriptor Dataset. Eric Michael Smith, Melissa Hall, Melanie Kambadur, Eleonora Presani, Adina Williams. EMNLP 2022
50. Mind Your Bias: A Critical Review of Bias Detection Methods for Contextual Language Models. Silke Husse, Andreas Spitz. EMNLP 2022
51. Bias Against 93 Stigmatized Groups in Masked Language Models and Downstream Sentiment Classification Tasks. Katelyn X. Mei, Sonia Fereidooni, Aylin Caliskan. ACM FAccT 2023
52. On the Independence of Association Bias and Empirical Fairness in Language Models. Laura Cabello, Anna Katrine Jørgensen, Anders Søgaard. ACM FAccT 2023

Bias Mitigation

1. Reducing Gender Bias in Abusive Language Detection, Park, Ji Ho and Shin, Jamin and Fung, Pascale, 2018
2. On Measuring and Mitigating Biased Inferences of Word Embeddings, Dev, Sunipa and Li, Tao and Phillips, Jeff M and Srikumar, Vivek, 2019
3. Debiasing Embeddings for Reduced Gender Bias in Text Classification, Prost, Flavien and Thain, Nithum and Bolukbasi, Tolga, 2019
4. Reducing Gender Bias in Word-Level Language Models with a Gender-Equalizing Loss Function, Qian, Yusu and Muaz, Urwa and Zhang, Ben and Hyun, Jae Won, 2019
5. Linguistic Models for Analyzing and Detecting Biased Language, Recasens, Marta and Danescu-Niculescu-Mizil, Cristian and Jurafsky, Dan, 2013
6. What's in a Name? Reducing Bias in Bios without Access to Protected Attributes, Romanov, Alexey and De-Arteaga, Maria and Wallach, Hanna and Chayes, Jennifer and Borgs, Christian and Chouldechova, Alexandra and Geyik, Sahin and Kenthapadi, Krishnaram and Rumshisky, Anna and Kalai, Adam, 2019
7. Demoting Racial Bias in Hate Speech Detection, Xia, Mengzhou and Field, Anjalie and Tsvetkov, Yulia, 2020
8. Balanced Datasets Are Not Enough: Estimating and Mitigating Gender Bias in Deep Image Representations, Wang, Tianlu and Zhao, Jieyu and Yatskar, Mark and Chang, Kai-Wei and Ordonez, Vicente, 2019
9. Fairness without Demographics through Adversarially Reweighted Learning , Preethi Lahoti, Alex Beutel, Jilin Chen, Kang Lee, Flavien Prost, Nithum Thain, Xuezhi Wang, Ed H. Chi, 2020.
10. On Dyadic Fairness: Exploring and Mitigating Bias in Graph Connections, Peizhao Li, Yifei Wang, Han Zhao, Pengyu Hong, Hongfu Liu, 2021
11. Challenges in Automated Debiasing for Toxic Language Detection, Zhou, Xuhui and Sap, Maarten and Swayamdipta, Swabha and Choi, Yejin and Smith, Noah A, 2021
12. Mitigating Language-Dependent Ethnic Bias in BERT, Ahn, Jaimeen and Oh, Alice, EMNLP, 2021
13. Sustainable Modular Debiasing of Language Models, Lauscher, Anne and Lüken, Tobias and Glavaš, Goran, EMNLP, 2021
14. An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models. Nicholas Meade, Elinor Poole-Dayan, Siva Reddy. ACL 2022
15. Fair and Argumentative Language Modeling for Computational Argumentation. Carolin Holtermann, Anne Lauscher, Simone Paolo Ponzetto. ACL 2022.
16. Upstream Mitigation Is Not All You Need: Testing the Bias Transfer Hypothesis in Pre-Trained Language Models. Ryan Steed, Swetasudha Panda, Ari Kobren, Michael Wick. ACL 2022
17. Mitigating Gender Bias in Distilled Language Models via Counterfactual Role Reversal. Umang Gupta, Jwala Dhamala, Varun Kumar, Apurv Verma, Yada Pruksachatkun, Satyapriya Krishna, Rahul Gupta, Kai-Wei Chang, Greg Ver Steeg, Aram Galstyan. ACL 2022 Findings.
18. How Gender Debiasing Affects Internal Model Representations, and Why It Matters. Hadas Orgad, Seraphina Goldfarb-Tarrant, Yonatan Belinkov. NAACL 2022
19. Are Gender-Neutral Queries Really Gender-Neutral? Mitigating Gender Bias in Image Search. Jialu Wang, Yang Liu, Xin Wang. EMNLP 2021
20. Prompt Tuning Pushes Farther, Contrastive Learning Pulls Closer: A Two-Stage Approach to Mitigate Social Biases. Yingji Li, Mengnan Du, Xin Wang, Ying Wang. ACL 2023
21. Social-Group-Agnostic Bias Mitigation via the Stereotype Content Model. Ali Omrani, Alireza Salkhordeh Ziabari, Charles Yu, Preni Golazizian, Brendan Kennedy, Mohammad Atari, Heng Ji, Morteza Dehghani. ACL 2023
22. BLIND: Bias Removal With No Demographics. Hadas Orgad, Yonatan Belinkov. ACL 2023
23. CHBias: Bias Evaluation and Mitigation of Chinese Conversational Language Models. Jiaxu Zhao, Meng Fang, Zijing Shi, Yitong Li, Ling Chen, Mykola Pechenizkiy. ACL 2023
24. D-CALM: A Dynamic Clustering-based Active Learning Approach for Mitigating Bias. Sabit Hassan, Malihe Alikhani. ACL 2023 Findings
25. Debiasing should be Good and Bad: Measuring the Consistency of Debiasing Techniques in Language Models. Robert Morabito, Jad Kabbara, Ali Emami. ACL 2023 Findings
26. Gender-tuning: Empowering Fine-tuning for Debiasing Pre-trained Language Models. Somayeh Ghanbarzadeh, Yan Huang, Hamid Palangi, Radames Cruz Moreno, Hamed Khanpour. ACL 2023 Findings
27. Bias Beyond English: Counterfactual Tests for Bias in Sentiment Analysis in Four Languages. Seraphina Goldfarb-Tarrant, Adam Lopez, Roi Blanco, Diego Marcheggiani. ACL 2023 Findings
28. On Evaluating and Mitigating Gender Biases in Multilingual Settings. Aniket Vashishtha, Kabir Ahuja, Sunayana Sitaram. ACL 2023 Findings
29. Perturbation Augmentation for Fairer NLP. Rebecca Qian, Candace Ross, Jude Fernandes, Eric Michael Smith, Douwe Kiela, Adina Williams. EMNLP 2022
30. MABEL: Attenuating Gender Bias using Textual Entailment Data. Jacqueline He, Mengzhou Xia, Christiane Fellbaum, Danqi Chen. EMNLP 2022
31. Balancing out Bias: Achieving Fairness Through Balanced Training. Xudong Han, Timothy Baldwin, Trevor Cohn. EMNLP 2022
32. Debiasing Masks: A New Framework for Shortcut Mitigation in NLU. Johannes Mario Meissner, Saku Sugawara, Akiko Aizawa. EMNLP 2022
33. Don’t Just Clean It, Proxy Clean It: Mitigating Bias by Proxy in Pre-Trained Models. Swetasudha Panda, Ari Kobren, Michael Wick, Qinlan Shen. EMNLP 2022
34. To Prefer or to Choose? Generating Agency and Power Counterfactuals Jointly for Gender Bias Mitigation. Maja Stahl, Maximilian Spliethöver, Henning Wachsmuth. EMNLP 2022
35. A Robust Bias Mitigation Procedure Based on the Stereotype Content Model. Eddie Ungless, Amy Rafferty, Hrichika Nag, Björn Ross. EMNLP 2022

Natural Language Generation

Machine Translation

1. Towards Mitigating Gender Bias in a decoder-based Neural Machine Translation model by Adding Contextual Information, Basta, Christine and Costa-jussà, Marta R. and Fonollosa, José A. R., 2020
2. On Measuring Gender Bias in Translation of Gender-neutral Pronouns, Cho, Won Ik and Kim, Ji Won and Kim, Seok Min and Kim, Nam Soo, 2019
3. Fine-tuning Neural Machine Translation on Gender-Balanced Datasets, Costa-jussà, Marta R. and de Jorge, Adrià, 2020
4. Equalizing Gender Bias in Neural Machine Translation with Word Embeddings Techniques, Escudé Font, Joel and Costa-jussà, Marta R., 2019
5. Automatically Identifying Gender Issues in Machine Translation using Perturbations, Gonen, Hila and Webster, Kellie, 2020
6. Gender Coreference and Bias Evaluation at WMT 2020, Kocmi, Tom and Limisiewicz, Tomasz and Stanovsky, Gabriel, 2020
7. Filling Gender & Number Gaps in Neural Machine Translation with Black-box Context Injection, Moryossef, Amit and Aharoni, Roee and Goldberg, Yoav, 2019
8. Reducing Gender Bias in Neural Machine Translation as a Domain Adaptation Problem, Saunders, Danielle and Byrne, Bill, 2020
9. Neural Machine Translation Doesn't Translate Gender Coreference Right Unless You Make It, Saunders, Danielle and Sallis, Rosie and Byrne, Bill, 2020
10. Mitigating Gender Bias in Machine Translation with Target Gender Annotations, Stafanovičs, Artūrs and Pinnis, Mārcis and Bergmanis, Toms, 2020
11. Evaluating Gender Bias in Machine Translation, Stanovsky, Gabriel and Smith, Noah A. and Zettlemoyer, Luke, 2019
12. Getting Gender Right in Neural Machine Translation, Vanmassenhove, Eva and Hardmeier, Christian and Way, Andy, 2018
13. "You Sound Just Like Your Father" Commercial Machine Translation Systems Include Stylistic Biases, Hovy, Dirk and Bianchi, Federico and Fornaciari, Tommaso, 2020
14. Assessing gender bias in machine translation: a case study with google translate, Prates, Marcelo O. R. and Avelar, Pedro H. C. and Lamb, Luis, 2019
15. Gender Bias in Multilingual Neural Machine Translation: The Architecture Matters, Costa-jussà, Marta R. and Escolano, Carlos and Basta, Christine and Ferrando, Javier and Batlle, Roser and Kharitonova, Ksenia, 2020
16. How to Measure Gender Bias in Machine Translation: Optimal Translators, Multiple Reference Points, Farkas, Anna and Németh, Renáta, 2020
17. Gender aware spoken language translation applied to English-Arabic, Elaraby, Mostafa and Tawfik, Ahmed Y and Khaled, Mahmoud and Hassan, Hany and Osama, Aly, 2018
18. Type {B} Reflexivization as an Unambiguous Testbed for Multilingual Multi-Task Gender Bias, Gonz{'a}lez, Ana Valeria and Barrett, Maria and Hvingelby, Rasmus and Webster, Kellie and S{\o}gaard, Anders, 2020
19. Measuring and Mitigating Name Biases in Neural Machine Translation. Jun Wang, Benjamin Rubinstein, Trevor Cohn. ACL 2022
20. GFST: Gender-Filtered Self-Training for More Accurate Gender in Translation. Prafulla Kumar Choubey, Anna Currey, Prashant Mathur, Georgiana Dinu. EMNLP 2021
21. What about “em”? How Commercial Machine Translation Fails to Handle (Neo-)Pronouns. Anne Lauscher, Debora Nozza, Ehm Miltersen, Archie Crowley, Dirk Hovy. ACL 2023
22. How sensitive are translation systems to extra contexts? Mitigating gender bias in Neural Machine Translation models through relevant contexts.. Shanya Sharma, Manan Dey, Koustuv Sinha. EMNLP 2022

Dialogue Generation

1. Conversational Assistants and Gender Stereotypes: Public Perceptions and Desiderata for Voice Personas, Cercas Curry, Amanda and Robertson, Judy and Rieser, Verena 2020
2. Does Gender Matter? Towards Fairness in Dialogue Systems, Liu, Haochen and Dacon, Jamell and Fan, Wenqi and Liu, Hui and Liu, Zitao and Tang, Jiliang, 2020
3. Mitigating Gender Bias for Neural Dialogue Generation with Adversarial Learning, Liu, Haochen and Wang, Wentao and Wang, Yiqi and Liu, Hui and Liu, Zitao and Tang, Jiliang, 2020
4. Queens are Powerful too: Mitigating Gender Bias in Dialogue Generation, Dinan, Emily and Fan, Angela and Williams, Adina and Urbanek, Jack and Kiela, Douwe and Weston, Jason, 2020
5. Ethical challenges in data-driven dialogue systems, Henderson, Peter and Sinha, Koustuv and Angelard-Gontier, Nicolas and Ke, Nan Rosemary and Fried, Genevieve and Lowe, Ryan and Pineau, Joelle, 2018
6. "Nice Try, Kiddo": Ad Hominems in Dialogue Systems, Sheng, Emily and Chang, Kai-Wei and Natarajan, Premkumar and Peng, Nanyun, 2020
7. The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systems. Caleb Ziems, Jane A. Yu, Yi-Chia Wang, Alon Halevy, Diyi Yang. ACL 2022.
8. First the Worst: Finding Better Gender Translations During Beam Search. Danielle Saunders, Rosie Sallis, Bill Byrne. ACL 2022 Findings
9. Hate Speech and Counter Speech Detection: Conversational Context Does Matter. Xinchen Yu, Eduardo Blanco, Lingzi Hong. NAACL 2022.

Other Generation

1. Gender-Aware Reinflection using Linguistically Enhanced Neural Models, Alhafni, Bashar and Habash, Nizar and Bouamor, Houda, 2020
2. Identifying and Reducing Gender Bias in Word-Level Language Models, Bordia, Shikha and Bowman, Samuel R., 2019
3. Investigating African-American Vernacular English in Transformer-Based Text Generation, Groenwold, Sophie and Ou, Lily and Parekh, Aesha and Honnavalli, Samhita and Levy, Sharon and Mirza, Diba and Wang, William Yang, 2020
4. Automatic Gender Identification and Reinflection in Arabic, Habash, Nizar and Bouamor, Houda and Chung, Christine, 2019
5. Reducing Sentiment Bias in Language Models via Counterfactual Evaluation, Huang, Po-Sen and Zhang, Huan and Jiang, Ray and Stanforth, Robert and Welbl, Johannes and Rae, Jack and Maini, Vishal and Yogatama, Dani and Kohli, Pushmeet, 2020
6. PowerTransformer: Unsupervised Controllable Revision for Biased Language Correction, Ma, Xinyao and Sap, Maarten and Rashkin, Hannah and Choi, Yejin, 2020
7. Reducing Non-Normative Text Generation from Language Models, Peng, Xiangyu and Li, Siyan and Frazier, Spencer and Riedl, Mark, 2020
8. The Woman Worked as a Babysitter: On Biases in Language Generation, Sheng, Emily and Chang, Kai-Wei and Natarajan, Premkumar and Peng, Nanyun, 2019
9. Towards Controllable Biases in Language Generation, Sheng, Emily and Chang, Kai-Wei and Natarajan, Premkumar and Peng, Nanyun, 2020
10. RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models, Gehman, Sam and Gururangan, Suchin and Sap, Maarten and Choi, Yejin and Smith, Noah A, 2020
11. "You are grounded!": Latent Name Artifacts in Pre-trained Language Models, Shwartz, Vered and Rudinger, Rachel and Tafjord, Oyvind, 2020
12. Defining and Evaluating Fair Natural Language Generation, Yeo, Catherine and Chen, Alyssa, 2020
13. Counterfactual Data Augmentation for Mitigating Gender Stereotypes in Languages with Rich Morphology, Zmigrod, Ran and Mielke, Sabrina J. and Wallach, Hanna and Cotterell, Ryan, 2019
14. Investigating Gender Bias in Language Models Using Causal Mediation Analysis, Vig, Jesse and Gehrmann, Sebastian and Belinkov, Yonatan and Qian, Sharon and Nevo, Daniel and Singer, Yaron and Shieber, Stuart, 2020
15. Release strategies and the social impacts of language models, Solaiman, Irene and Brundage, Miles and Clark, Jack and Askell, Amanda and Herbert-Voss, Ariel and Wu, Jeff and Radford, Alec and Krueger, Gretchen and Kim, Jong Wook and Kreps, Sarah and others, 2019
16. Automatically neutralizing subjective bias in text, Pryzant, Reid and Martinez, Richard Diehl and Dass, Nathan and Kurohashi, Sadao and Jurafsky, Dan and Yang, Diyi, 2020
17. Language models are few-shot learners, Brown, Tom B and Mann, Benjamin and Ryder, Nick and Subbiah, Melanie and Kaplan, Jared and Dhariwal, Prafulla and Neelakantan, Arvind and Shyam, Pranav and Sastry, Girish and Askell, Amanda and others, 2020
18. BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation, Dhamala, Jwala and Sun, Tony and Kumar, Varun and Krishna, Satyapriya and Pruksachatkun, Yada and Chang, Kai-Wei and Gupta, Rahul, 2021
19. Viable Threat on News Reading: Generating Biased News Using Natural Language Models, Gupta, Saurabh and Nguyen, Hong Huy and Yamagishi, Junichi and Echizen, Isao, 2020
20. Investigating Societal Biases in a Poetry Composition System, Sheng, Emily and Uthus, David, 2020
21. De-Biased Court's View Generation with Causality, Wu, Yiquan and Kuang, Kun and Zhang, Yating and Liu, Xiaozhong and Sun, Changlong and Xiao, Jun and Zhuang, Yueting and Si, Luo and Wu, Fei, 2020
22. Detoxifying Language Models Risks Marginalizing Minority Voices, Xu, Albert and Pathak, Eshaan and Wallace, Eric and Gururangan, Suchin, and Sap, Maarten and Klein, Dan, 2021
23. Detect and Perturb: Neutral Rewriting of Biased and Sensitive Text via Gradient-based Decoding, He, Zexue and Majumder, Bodhisattwa Prasad and McAuley, Julian, EMNLP, 2021
24. Auto-Debias: Debiasing Masked Language Models with Automated Biased Prompts. Yue Guo, Yi Yang, Ahmed Abbasi. ACL 2022.
25. A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translation. David Adelani et. al. NAACL 2022.
26. Exploiting Biased Models to De-bias Text: A Gender-Fair Rewriting Model. Chantal Amrhein, Florian Schottmann, Rico Sennrich, Samuel Läubli. ACL 2023
27. Towards Robust NLG Bias Evaluation with Syntactically-diverse Prompts. Arshiya Aggarwal, Jiao Sun, Nanyun Peng. EMNLP 2022
28. “I’m fully who I am”: Towards Centering Transgender and Non-Binary Voices to Measure Biases in Open Language Generation. Anaelia Ovalle, Palash Goyal, Jwala Dhamala, Zachary Jaggers, Kai-Wei Chang, Aram Galstyan, Richard Zemel, Rahul Gupta. ACM FAccT 2023

Multi-Modal Setting

Bias Detection in Multi-Modal Setting

1. Studying Bias in GANs through the Lens of Race, Maluleke, Vongani H. and Thakkar, Neerja and Brooks, Tim and Weber, Ethan and Darrell, Trevor and Efros, Alexei A. and Kanazawa, Angjoo and Guillory, Devin, 2022
2. Imperfect ImaGANation: Implications of GANs Exacerbating Biases on Facial Data Augmentation and Snapchat Selfie Lenses, Jain, Niharika and Hernandez, Alberto Olmo and Sengupta, Sailik and Manikonda, Lydia and Kambhampati, S., 2020
3. DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models, Cho, Jaemin and Zala, Abhay and Bansal, Mohit, 2022
4. Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scale, Bianchi, Federico and Kalluri, Pratyusha and Durmus, Esin and Ladhak, Faisal and Cheng, Myra and Nozza, Debora and Hashimoto, Tatsunori and Jurafsky, Dan and Zou, James and Caliskan, Aylin, 2022
5. Social Biases through the Text-to-Image Generation Lens, Naik, Ranjita and Nushi, Besmira, 2023
6. T2IAT: Measuring Valence and Stereotypical Biases in Text-to-Image Generation, Wang, Jialu and Liu, Xinyue and Di, Zonglin and Liu, Yang and Wang, Xin, ACL 2023
7. The Bias Amplification Paradox in Text-to-Image Generation, Seshadri, Preethi and Singh, Sameer and Elazar, Yanai, 2023
8. Fair Diffusion: Instructing Text-to-Image Generation Models on Fairness, Friedrich, Felix and Brack, Manuel and Struppek, Lukas and Hintersdorf, Dominik and Schramowski, Patrick and Luccioni, Sasha and Kersting, Kristian, 2023
9. Uncurated image-text datasets: Shedding light on demographic bias., Garcia, Noa and Hirota, Yusuke and Wu, Yankun and Nakashima, Yuta, CVPR 2023
10. Word-Level Explanations for Analyzing Bias in Text-to-Image Models, Lin, Alexander and Paes, Lucas Monteiro and Tanneru, Sree Harsha and Srinivas, Suraj and Lakkaraju, Himabindu, 2023

Bias Mitigation in Multi-Modal Setting

1. Improving the Fairness of Deep Generative Models without Retraining, Tan, Shuhan and Shen, Yujun and Zhou, Bolei, 2020
2. RepFair-GAN: Mitigating Representation Bias in GANs Using Gradient Clipping, Kenfack, Patrik Joslin and Sabbagh, Kamil and Rivera, Adín Ramírez and Khan, Adil, 2022
3. The Bias Amplification Paradox in Text-to-Image Generation, Seshadri, Preethi and Singh, Sameer and Elazar, Yanai, 2023
4. Fair Diffusion: Instructing Text-to-Image Generation Models on Fairness, Friedrich, Felix and Brack, Manuel and Struppek, Lukas and Hintersdorf, Dominik and Schramowski, Patrick and Luccioni, Sasha and Kersting, Kristian, 2023

Bias Visualization

1. Fairsight: Visual analytics for fairness in decision making, Ahn, Yongsu and Lin, Yuru, 2019
2. FairVis: Visual Analytics for Discovering Intersectional Bias in Machine Learning, Cabrera, Ángel Alexander and Epperson, Will and Hohman, Fred and Kahng, Minsuk and Morgenstern, Jamie and Chau, Duen Horng, 2021
3. VERB: Visualizing and Interpreting Bias Mitigation Techniques for Word Representations, Archit Rathore, Archit and Dev, Sunipa and Phillips, Jeff M. and Srikumar, Vivek and Zheng, Yan and Yeh, Chin-Chia Michael and Wang, Junpeng and Zhang, Wei and Wang, Bei, 2021
4. DebIE: A Platform for Implicit and Explicit Debiasing of Word Embedding Spaces, Friedrich, Niklas and Lauscher, Anne and Ponzetto, Simone Paolo and Glavaš, Goran, 2021

Others

1. Gender bias in neural natural language processing, Lu, Kaiji and Mardziel, Piotr and Wu, Fangjing and Amancharla, Preetam and Datta, Anupam, 2020
2. Equity Beyond Bias in Language Technologies for Education, Mayfield, Elijah and Madaio, Michael and Prabhumoye, Shrimai and Gerritsen, David and McLaughlin, Brittany and Dixon-Rom{'a}n, Ezekiel and Black, Alan W, 2019
3. Shedding (a Thousand Points of) Light on Biased Language, Yano, Tae and Resnik, Philip and Smith, Noah A., 2010
4. Dialect Diversity in Text Summarization on Twitter, Celis, L Elisa and Keswani, Vijay, 2020
5. Identifying and Measuring Annotator Bias Based on Annotators' Demographic Characteristics, Al Kuwatly, Hala and Wich, Maximilian and Groh, Georg, 2020
6. Multilingual sentence-level bias detection in Wikipedia, Aleksandrova, Desislava and Lareau, François and Ménard, Pierre André, 2019
7. Automated Essay Scoring in the Presence of Biased Ratings, Amorim, Evelin and Cançado, Marcia and Veloso, Adriano, 2018
8. Predicting Factuality of Reporting and Bias of News Media Sources, Baly, Ramy and Karadzhov, Georgi and Alexandrov, Dimitar and Glass, James and Nakov, Preslav, 2018
9. We Can Detect Your Bias: Predicting the Political Ideology of News Articles, Baly, Ramy and Da San Martino, Giovanni and Glass, James and Nakov, Preslav, 2020
10. The Multilingual Affective Soccer Corpus (MASC): Compiling a biased parallel corpus on soccer reportage in English, German and Dutch, Braun, Nadine and Goudbeek, Martijn and Krahmer, Emiel, 2016
11. Word-order Biases in Deep-agent Emergent Communication, Chaabouni, Rahma and Kharitonov, Eugene and Lazaric, Alessandro and Dupoux, Emmanuel and Baroni, Marco, 2019
12. Importance sampling for unbiased on-demand evaluation of knowledge base population, Chaganty, Arun and Paranjape, Ashwin and Liang, Percy and Manning, Christopher D., 2017
13. Bias and Fairness in Natural Language Processing, Chang, Kai-Wei and Prabhakaran, Vinod and Ordonez, Vicente, 2019
14. Learning to Flip the Bias of News Headlines, Chen, Wei-Fan and Wachsmuth, Henning and Al-Khatib, Khalid and Stein, Benno, 2018
15. Analyzing Political Bias and Unfairness in News Articles at Different Levels of Granularity, Chen, Wei-Fan and Al Khatib, Khalid and Wachsmuth, Henning and Stein, Benno, 2020
16. Detecting Media Bias in News Articles using Gaussian Bias Distributions, Chen, Wei-Fan and Al Khatib, Khalid and Stein, Benno and Wachsmuth, Henning, 2020
17. Modelling Annotator Bias with Multi-task Gaussian Processes: An Application to Machine Translation Quality Estimation, Cohn, Trevor and Specia, Lucia, 2013
18. Masking Actor Information Leads to Fairer Political Claims Detection, Dayanik, Erenay and Padó, Sebastian, 2020
19. CLARIN: Towards FAIR and Responsible Data Science Using Language Resources, de Jong, Franciska and Maegaard, Bente and De Smedt, Koenraad and Fišer, Darja and Van Uytvanck, Dieter, 2018
20. Semi-Supervised Topic Modeling for Gender Bias Discovery in English and Swedish, Devinney, Hannah and Björklund, Jenny and Björklund, Henrik, 2020
21. Is Your Classifier Actually Biased? Measuring Fairness under Uncertainty with Bernstein Bounds, Ethayarajh, Kawin, 2020
22. Team Peter Brinkmann at SemEval-2019 Task 4: Detecting Biased News Articles Using Convolutional Neural Networks, Färber, Michael and Qurdina, Agon and Ahmedi, Lule, 2019
23. Biases in Predicting the Human Language Model, Fine, Alex B. and Frank, Austin F. and Jaeger, T. Florian and Van Durme, Benjamin, 2014
24. Analyzing Biases in Human Perception of User Age and Gender from Text, Flekova, Lucie and Carpenter, Jordan and Giorgi, Salvatore and Ungar, Lyle and Preoţiuc-Pietro, Daniel, 2016
25. Reference Bias in Monolingual Machine Translation Evaluation, Fomicheva, Marina and Specia, Lucia, 2016
26. Analyzing Gender Bias within Narrative Tropes, Gala, Dhruvil and Khursheed, Mohammad Omar and Lerner, Hannah and O'Connor, Brendan and Iyyer, Mohit, 2020
27. Detecting Political Bias in News Articles Using Headline Attention, Gangula, Rama Rohit Reddy and Duggenpudi, Suma Reddy and Mamidi, Radhika, 2019
28. Detecting Independent Pronoun Bias with Partially-Synthetic Data Generation, Munro, Robert and Morrison, Alex (Carmen), 2020
29. Analyzing Gender Bias in Student Evaluations, Terkik, Andamlak and Prud{'}hommeaux, Emily and Ovesdotter Alm, Cecilia and Homan, Christopher and Franklin, Scott, 2016
30. Ethics Sheets for AI Tasks. Saif M. Mohammad. ACL 2022
31. VALUE: Understanding Dialect Disparity in NLU.Caleb Ziems, Jiaao Chen, Camille Harris, Jessica Anderson, Diyi Yang. ACL 2022.
32. Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detection. Maarten Sap, Swabha Swayamdipta, Laura Vianna, Xuhui Zhou, Yejin Choi, Noah Smith. NAACL 2022
33. Multi-VALUE: A Framework for Cross-Dialectal English NLP. Caleb Ziems, William Held, Jingfeng Yang, Jwala Dhamala, Rahul Gupta, Diyi Yang. ACL 2023
34. Trade-Offs Between Fairness and Privacy in Language Modeling. Cleo Matzken, Steffen Eger, Ivan Habernal. ACL 2023 Findings
35. Bridging Fairness and Environmental Sustainability in Natural Language Processing. Marius Hessenthaler, Emma Strubell, Dirk Hovy, Anne Lauscher. EMNLP 2022
36. Fair NLP Models with Differentially Private Text Encoders. Gaurav Maheshwari, Pascal Denis, Mikaela Keller, Aurélien Bellet. EMNLP 2022
37. Should We Ban English NLP for a Year?. Anders Søgaard. EMNLP 2022
38. Controlling Bias Exposure for Fair Interpretable Predictions. Zexue He, Yu Wang, Julian McAuley, Bodhisattwa Prasad Majumder. EMNLP 2022

Tutorial List

• Fairness in Machine Learning, NeurIPS 2017
• The Trouble with Bias, NeurIPS 2017
• Socially Responsible NLP, NAACL 2018
• Tutorial: Bias and Fairness in Natural Language Processing, EMNLP 2019
• Fairness-Aware Machine Learning: Practical Challenges and Lessons Learned, KDD 2019
• Dealing with Bias and Fairness in Building Data Science/ML/AI Systems, KDD 2020
• A Visual Tour of Bias Mitigation Techniques for Word Representations, AAAI 2021
• How to test the fairness of ML models? The 80% rule to measure the disparate impact, Giskard 2023

Jupyter/Colab Tutorial

• Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints
• Mitigating Gender Bias Amplification in Distribution by Posterior Regularization

Conference/Workshop List

• Ethics in NLP, ACL Wiki
• ACM FAccT conference
• Gendered Ambiguous Pronoun (GAP) Shared Task at the Gender Bias in NLP Workshop 2019, Webster, Kellie and Costa-jussa, Marta R. and Hardmeier, Christian and Radford, Will, 2019
• Proceedings of the First Workshop on Gender Bias in Natural Language Processing, Costa-juss{`a}, Marta R. and Hardmeier, Christian and Radford, Will and Webster, Kellie, 2019
• Proceedings of the Second Workshop on Gender Bias in Natural Language Proceedings, Costa-juss{`a}, Marta R. and Hardmeier, Christian and Radford, Will and Webster, Kellie, 2020
• Team Kermit-the-frog at SemEval-2019 Task 4: Bias Detection Through Sentiment Analysis and Simple Linguistic Features, Anthonio, Talita and Kloppenburg, Lennart, 2019
• Fairness and machine learning