Individuals with aphasia, a language disorder, are seldom able to utilize the Internet as a source of information, because their disability makes many written words incomprehensible. A similar situation exists for individuals who read and speak a second language but do not possess a vocabulary as extensive as in their native language. Pictures have been demonstrated to help in both cases. However, few existing paper or electronic picture dictionaries provide efficient, scalable, and adaptable support for looking up unknown terms encountered when browsing the web. For my thesis research, I am designing and developing an Online Multimedia Language Assistant, which allows a reader to click on an unknown word and receive interpretations of the word in as many as five different multimedia representations. The system provides a popup dictionary, images, animations and audio, where applicable. It is also adaptable (by user) and adaptive (system).
/lp/association-for-computing-machinery/an-online-multimedia-language-assistant-for-people-with-aphasia-and-YSP6JSq10i