I’ve been doing a literature search for autism (general) and technology & autism applications to become familiar with the area, and to understand how people have attempted to use technology applications to help people on the spectrum, especially kids. On the first pass, I’ve found a lot of references! LOTS of research being done in this area. The problem is not finding references, but weeding through them, picking out which ones are important, which areas I think are the most interesting, where the best unexplored territory is, articulating some interesting research questions to pursue, and proposing tasks/projects to work on.
But first weeding through things. On the first pass, I’ve found a handful of books and about 300 publications on technology and autism (290, to be exact). I didn’t have to dig to find this stuff, so I’m expecting that when I center on a specialized area or two, digging deeper will turn up a lot more references.
I imported all of the references from the first pass into Mendeley, have sorted through them, and found that the technologies used tend to land in the following areas:
- Brain Imaging
- Genetic Analysis
- Face & Eye Tracking (measures attention and social connection)
- Robotic Apps (interactive robots like dolls, pets, etc.)
- Assistive Technology
- Sensors & Mobile Devices
- Virtual and Augmented Reality
- Other Interactive Systems
- Affective Applications
- Speech & Hearing Analysis
These technologies have different purpuses. From reading through the abstracts, it looks like common motivations are:
- Diagnostic (what can be used to observe, measure, and diagnose the problem)
- Classroom Teaching (how to help someone who is high functioning enough to learn and focus)
- Unstructured Teaching (e.g., can you teach a child socialization skills with a robot? or by playing games)
- Immediate Assists (can you automate feedback for desirable and undesirable behaviour)
- Skills Improvement (can you improve, for example, attention, eye contact, etc.)
- Determining Causes (genetic markers, environmental stresses, disease, etc.)
- Understanding How to Intervene
- Helping Parents Help their Kids, and Cope (telemedicine, e.g.)
- Understanding how customization can help
I took a pass through all of the abstracts, and about 100 of them look like they could apply, so I’m in the process of downloading the papers. At this point I have about half of them. Some of them are hard to find, and I have to go through the library proxy to get them (most of them aren’t just ACM, IEEE accesses). I’ve run into one or two journals that the library hasn’t licensed, and one specific article on eye tracking that the authors didn’t want to release electronically.
So I’m prioritizing getting the papers by what is most interesting to me, but making sure that I get a few samples in each area, right now, so I have an idea of the scope.
I’m still very interested in anything to do with sound, speech, and hearing.
And anything with sensors and mobile devices.
I would like to investigate music therapy. How could this help? An environment for creating music? Combine it with interactive visuals, too. Multimodal and immersive.
Movement therapy? Could some sort of creative movement or dance help?
Anything affective is intriguing. How to attribute emotion, or teach emotional cues.
The robot apps sound cute (pets and dolls, for teaching emotion, measuring attention and response). Adorable.
Also some storytelling apps.