Skip to content
DSML.KZ
Publications

Talk · International Conference on Artificial Intelligence in Information and Communication · February 19, 2024

ChatGPT for Visually Impaired and Blind

Askat Kuzdeuov, Olzhas Mukayev, Shakhizat Nurgaliyev, Alisher Kunbolsyn, Hüseyin Atakan Varol

Askat Kuzdeuov
Open via DOI

Abstract

According to the World Health Organization (WHO), hundreds of million people have some type of visual disability. Vision impairment has a personal impact with lifelong consequences because more than 80 % of our perception, cognition, learning, and daily activities are mediated through vision. Moreover, in the era of rapid advancements in artificial intelligence (AI), visually impaired and blind people face challenges at work and in education because of inaccessibility to AI technologies. In this regard, we present an assistive mobile application with an intuitive user interface (UI) for visually impaired and blind people to interact with ChatGPT via natural conversation. The app employs automatic speech recognition (ASR), text-to-speech (TTS), keyword spotting (KWS), voice activity detection (VAD), and a convenient UI to interact with ChatGPT effortlessly. We have made the source code, pre-trained models, and VI publicly available at https://github.com/IS2AI/talk-llm to stimulate the development of assistive mobile applications.

Assistive Technology in Communication and MobilityDigital Accessibility for DisabilitiesTactile and Sensory InteractionsChatGPTvisually impaired usersblind users

More by Askat Kuzdeuov