FairReFuse: Referee-Guided Fusion for Multimodal Causal Fairness in Depression Detection

2024-01-01
Cheong, Jiaee
Kalkan, Sinan
Gunes, Hatice
Machine learning (ML) bias in mental health detection and analysis is becoming an increasingly pertinent challenge. Despite promising efforts indicating that multimodal methods work better than unimodal methods, there is minimal work on multimodal fairness for depression detection. We propose a causal multimodal framework which consists of two modules. Module 1 performs causal interventional debiasing via backdoor adjustment for each modality to achieve group fairness. Module 2 adaptively fuses the different modalities using a referee-based individual fairness guided fusion mechanism to address individual fairness. We conduct experiments and ablation studies on three depression datasets, D-Vlog, DAIC-WOZ and EDAIC, and show that our framework improves classification performance as well as group and individual fairness compared to existing approaches.
33rd International Joint Conference on Artificial Intelligence, IJCAI 2024
Citation Formats
J. Cheong, S. Kalkan, and H. Gunes, “FairReFuse: Referee-Guided Fusion for Multimodal Causal Fairness in Depression Detection,” presented at the 33rd International Joint Conference on Artificial Intelligence, IJCAI 2024, Jeju, Güney Kore, 2024, Accessed: 00, 2024. [Online]. Available: https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85204291481&origin=inward.