Conversational Web Interaction Guided By Automated Web Page Segmentation

2024-9-04
Suleiman, Suleiman Abubakar Tanko
The web has grown to become an essential part of our daily lives. And yet, even with its widespread use, we mostly explore it through its graphical interface, using clicks and typing operations for interaction. However, this is limited in the level of accessibility it can provide to visually impaired people and those who are temporarily unable to use normal interaction methods. This can be due many reasons, such as when trying to use the computer in a very bright or dim environment, thus making it difficult to see the screen. These situations make users experience situationally induced disabilities (SIID). So far, users have screen readers and voice assistants to help them navigate the web in such situations. Recently, however, research has been done into the creation of conversational web interfaces to allow users to interact with the web using their voice. The most prominent of these studies employ the use of heuristics and manual annotations in identifying the different sections within the web page structure. These solutions, however, are not without their challenges. Manual annotation for websites is costly, and heuristics are difficult to implement in a generalized way, given the diverse nature of websites. In this thesis, we propose a conversational web architecture that incorporates a special automated segmentation algorithm, and present our prototype implementation of said architecture called ConvoBot, as a proof of concept tool, using existing technologies to address the limitations of manual annotations, while also testing the usability of such a prototype. Our implementation was tested by 12 participants and evaluated using the System Usability Scale (SUS). Our results show that ConvoBot achieved an average SUS score of 80, which is considered acceptable and `Good' by the SUS adjective rating. The main contribution of this thesis is the automated segmentation-driven architecture and a usable prototype implementation of that architecture for conversational web interaction.
Citation Formats
S. A. T. Suleiman, “Conversational Web Interaction Guided By Automated Web Page Segmentation,” M.S. - Master of Science, Middle East Technical University, 2024.