AviBERT: Transformer-based Aircraft Text Classification AviBERT: Transformer Tabanli Hava Araci Metni Siniflandirma

2025-01-01
Unal, Muhammed Cihat
Yurtalan, Gokhan
Karatas, Yahya Bahadir
Karamanlıoğlu, Alper
Demirel, Berkan
In recent years, transformer-based models pre-trained on extensive corpora have played a critical role in the advancement of Natural Language Processing methodologies. Particularly, methods based on BERT have demonstrated remarkable performance across various tasks by offering robust capabilities in deeply understanding texts semantically. However, despite these advancements, there is a notable scarcity of studies applying these technologies in the aviation sector. This paper develops a multi-class classification model for aviation-specific texts using variants of BERT. The study encompasses the processes of collecting web content related to aircraft, labeling and model training. The details of the dataset are explained and the outcomes of the study are assessed based on the macro F1-score and accuracy of different models.
33rd IEEE Conference on Signal Processing and Communications Applications, SIU 2025
Citation Formats
M. C. Unal, G. Yurtalan, Y. B. Karatas, A. Karamanlıoğlu, and B. Demirel, “AviBERT: Transformer-based Aircraft Text Classification AviBERT: Transformer Tabanli Hava Araci Metni Siniflandirma,” presented at the 33rd IEEE Conference on Signal Processing and Communications Applications, SIU 2025, İstanbul, Türkiye, 2025, Accessed: 00, 2025. [Online]. Available: https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=105015382990&origin=inward.