tpp
A rough cardboard prototype

The Kalimba app is for users with weak hand muscles, but are able to use a smart device to engage in music. It also requires facial movement to operate.

Idea

Metaphor

Model

Display

nose key board

Play Music without the use of hands for arm mobility-challenged people.

dancing figure

Moving to music

machine learning graph

Use ML5's gesture control model, with p5.js piano keys example

kalimba app

Kalimba app interface

Error

Scenario

Task

Control

user injury

Some people have weak arm / hand muscles and can not play a traditional thumb piano.

rehabilitation setting

The app is used for therapeutic purposes, to engage the senses. perhaps in occupational therapy.

  • Download Kalimba app
  • Read instructions for facial movements to keys
  • Play African songs
  • Play folk tunes

face tracking app

A face tracking app to play the sounds of a traditional thumb-piano.

 

Above: Verplank's IxD framework

 

 

7 axis dimension space diagram for the kalimba app
7-axis dimension space diagram