Interpretable zero-shot classification with concept bottleneck models

Date

2025-8-05

Author

Özdemir, Onat

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

379
views

0
downloads

Cite This

Concept Bottleneck Models (CBMs) have shown promise in improving the interpretability of neural networks by generating intermediate, human-understandable concepts before making predictions. Existing approaches focus on training downstream classifiers jointly with CBMs to produce interpretable classification results, but they often struggle to generalize to unseen classes. In this work, we propose Zero-shot Concept Bottleneck Models (ZS-CBMs), which enable interpretable open-vocabulary recognition. Our methods leverage pre-trained vision-language models to identify attributes related to given image and text inputs and project these inputs into a shared concept space. This allows for zero-shot classification of unseen classes while providing interpretable justifications for model decisions. The accuracy and interpretability of the proposed approaches are evaluated on widely used datasets, including CIFAR-100, CUB-200-2011, CC3M, and ImageNet-100.

Subject Keywords

Zero-shot learning, Interpretable machine learning, Concept bottleneck models, Attribute-based classification, Vision-language models

URI

https://hdl.handle.net/11511/115995

Collections

Graduate School of Natural and Applied Sciences, Thesis