Mobile Games for Children with Learning Disabilities are designed at ŞEHİR
4/13/2017
Mobile games which will enhance the development of children/youth with learning disabilities are designed at the laboratories of İstanbul Şehir University

​Mobile games which will enhance the development of children/youth with learning disabilities are designed at the laboratories of İstanbul Şehir University ​​as part of the project titled "Intelligent Serious Games for Social and Cognitive Competence" coordinated by Prof. Shervin Shirmohammadi, Faculty Member at İstanbul Şehir University College of Engineering and Natural Sciences Department of Computer Science and Engineering.

Supported by the Ministry of European Union Affairs and Turkish National Agency, the project is carried out by researchers from 5 different countries within the scope of Erasmus+ Strategic Partnership Project. The main objectives of the project are to help the children with learning disabilities improve their professional skills, increase their learning competence, and acquire basic skills.

The 3D games designed at ŞEHİR laboratories as part of the project are as follows:

MEMORI: This game targets Visual Sequential Memory (VSM) deficit. VSM allows a person to perform tasks such as remembering letters, numbers, objects or shapes in th e correct order. Its deficit can lead to challenges in one's personal life, including dyslexia and dyscalculia. Detecting Visual Sequential Memory Deficit (VSMD) is essential for those who suffer from its related consequences. But current clinical methods don't have a high rate of diagnosis, and also for treatment are limited to the few hours the person spends in the clinic. In this project, we have designed an Origami b ased Serious Game, called Memori, for the diagnosis, performance measurement, and treatment of people with VSMD. Our preliminarily performance evaluations with 24 adults reveal a 13% improvement of memory and 1.00 score increase in performance while a slight decrease occurred in attentiveness from 2.33 to 2.02 for people who use our tool.​​​

 

 

INTO THE FOREST: Speech impediment affecting children with hearing loss and speech disorders requires speech therapy and much practice to overcome. To motivate the children to practice more, we have designed a serious game that can be used both as therapy and as a tool to measure the performance of children with speech impediments. The game has an avatar which can be controlled by the child through speech, with the objective of moving the avatar around the environment to earn coins. The avatar is controlled by both voice commands such as Jump, Ahead, Back, Left, Right, and arrow keys of the keyboard. The game allows the child to practice longer hours, compared to clinical approaches under the supervision of a therapist, which are time-limited. Our preliminary performance measurements indicate an improvement of 40% for children who play our game 5 times. ​

ATTENTION: Attention Deficit Hyperactivity Disorder (ADHD) is one of the most spread mental disorders characterized by the lack of attention and focus. One way to measure focus is through Electroencephalogram (EEG) signals that can be read using the new wireless EEG reading devices often used by Brain-computer Interface (BCI) researchers. In parallel, serious games have been recently providing opportunities for the rehabilitation of various cognitive and emotional deficiencies. In this paper, we put the two things together, and we investigate the integration of an EEG-controlled serious game that trains and strengthens patients' attention ability while using machine learning to detect their attention level. Our preliminary experiments with healthy individuals show an accuracy of up to 96% in classifying the EEG data to detect the correct attention state during gameplay. This promising result serves as motivation to test our models with actual ADHD patients in the future.​

 

 

- SEQUENCE: Teamwork and social competences are other important aspects that children must learn. In this game, players must cooperate together in order to solve a puzzle where multiple pictures must be put in the correct sequence. Each player can only see his/her own picture. So children need to communicate, work together, and socialize, on order to describe and understand their pictures and put them in the correct order.

For more information about the project, please visit www.isg4competence.com.

Partners: