In 2012, 41 touchscreen tablets were given to children in two villages in rural Ethiopia. These v... more In 2012, 41 touchscreen tablets were given to children in two villages in rural Ethiopia. These villages had no schools, and the children had no access to literacy. Nicknamed the 'literacy tablet', this technology was intended as an educational delivery mechanism to bootstrap reading. The tablet was designed to help remotely located rural children teach themselves to read. Throughout the year-long study, usage data was tracked as 41 children encountered technology and literacy for the first time. We present visualisations of this data, acquired by the tablets using open source tools. These digital ethnographic artefacts provide insight into what types of applications and experiences are interesting to users as they explore early literacy. Beyond usage data, the social relationships and personal stories of learning were revealed. The resulting narrative describes how children become passionate learners and teachers of their community. The idea of a tablet-based education has ...
ACM SIGGRAPH 2006 Emerging technologies on - SIGGRAPH '06, 2006
Graphical User Interfaces (GUIs) separate intangible representations (pixels) and remote controll... more Graphical User Interfaces (GUIs) separate intangible representations (pixels) and remote controllers (mouse, keyboard). We present an opposite approach, "Tangible User Interfaces" (TUIs), that tightly couples representations and controls to take advantage of multimodal human senses and skills to manipulate physical objects. We showcase the latest examples of TUIs with a special focus on play, improvisation, and creativity.
A method is provided for encoding device independent multi-modal content including an arrangement... more A method is provided for encoding device independent multi-modal content including an arrangement comprising one or more of a plurality of tokens, where each token corresponds to a standard predefined effect. The method includes defining a token for one or more standard predefined effects, wherein the token is adapted for being mapped to one or more effect producing elements in a target device. One or more tokens are then composed for playback together as an arrangement.
An input roller device (50) includes a roller (58), an eccentric rotating mass (59) within the ro... more An input roller device (50) includes a roller (58), an eccentric rotating mass (59) within the roller, a drive mechanism (54, 56 and 57) causing the eccentric rotating mass to rotate within the roller, and a processor (52) coupled to the drive mechanism. The drive mechanism can also optionally include a drive link (57) if not directly driven by the shaft of the motor. The input roller device 50 can further include a rotary encoder (60) coupled to the roller such that the rotary encoder can provide data to the processor on a rotation of the roller. Note, the ...
An electronic device (100) comprises a housing (112), an input (118, 122) coupled mechanically to... more An electronic device (100) comprises a housing (112), an input (118, 122) coupled mechanically to the housing for receiving data, an output (114, 118) coupled mechanically to the housing for presenting information to a user of the electronic device in at least one of an audio and visual mode, an electronic circuit (210) coupled mechanically to the housing for providing intelligent operations that receives the data from the input and provides the information to the output, and at least two electromechanical transducers (226), each ...
A tag is provided, which can be associated with one or more individuals and/or a connection to a ... more A tag is provided, which can be associated with one or more individuals and/or a connection to a predetermined network resource, and which can be used to facilitating interaction of the wireless communication device with the corresponding individual (s) and/or resource. The tag includes a transmitter and a storage element including an ID value, which associates the tag with the individual (s) and/or resource. In at least some instances the tag will additionally include a trigger element, such as a user actuatable switch, which will enable an action to ...
This paper proposes a new haptic interface called ComTouch to augment remote voice communication ... more This paper proposes a new haptic interface called ComTouch to augment remote voice communication by integrating a touch-to-vibration mapping into a cellular phone. The goal of this work is to enrich interpersonal communication by complementing voice with a new tactile channel. ComTouch, a one -handed device, converts pressure into vibrational intensity between users in real -time. We present preliminary user studies performed on 24 people to observe possible uses of the tactile channel when used in conjunction with audio. By recording and examining both audio and tactile data, we found strong correlations between the two communication channels. Some participants developed encoding systems similar to that of Morse code. Three original usages were also observed: Emphasis, Mimicry, and Turn-taking. We demonstrate the potential of the tactile channel to enhance the existing voice communication channel.
Proceedings of the 12th International Conference on Interaction Design and Children, 2013
Educational interface designers are in an unprecedented position to facilitate autonomous learnin... more Educational interface designers are in an unprecedented position to facilitate autonomous learning in neurodiverse learners (children with special needs). These learners are particularly in need of special design, given the disproportionate impact it can have on their quality of life and the current vulnerability they experience due to changes in special education law. In response to the urgent conditions facing these students, we construct and define a set of design principles that are grounded in maximizing the potential of these learners by importing the meta-cognitive skills, algorithmic structures, and multiple sensory modalities that are both proven successful in their remediation and uniquely suited to technological design adaptation. We draw from our main author's experience as a heavily remediated Dyslexic, a lifelong user of modified, adaptable and assistive technology, and a self-aware learner taught to understand why the methods behind her remediation worked. We additionally draw on our cumulative experience as users, teachers and developers of technology and on interviews with participants from a wide variety of sociocultural functions and pedagogical practices involved with special education. Based upon these and existing methods and applications, we present our insights in the form of guidelines for universal design that have the potential to not only embrace the differences of all learners but to maximize the potential of underserved neurodiverse learners so they can become self-sufficient masters of their own skills and interests across their lifetime.
Proceedings of the 8th ACM conference on Creativity and cognition - C&C '11, 2011
In interactive storytelling systems, we see common challenges of artistic expression that pertain... more In interactive storytelling systems, we see common challenges of artistic expression that pertains to presentation, standing apart from narrative structure. We believe this expression can be achieved computationally, which is a core challenge in using procedurally-generated worlds in interactive storytelling. This computational expression so is what we call dynamic dramaturgy. We intend dynamic dramaturgy as a complement to interactive narrative systems, particularly drama management, and as a fundamentally distinct task from plot-level narrative construction, yet it is still a basic medium for artistic expression by an author. It is, in effect, an art of presentation in interactive storytelling.
We present an adaptive educational narrative that combines an interactive storybook with drama ma... more We present an adaptive educational narrative that combines an interactive storybook with drama management. By understanding our underlying value system, we are able to create an adaptive narrative that provides features adequate for the target context. Our value system and design needs invite a reexamination and reapplication of interactive storytelling systems, and results in an adaptive narrative framework that is both feasible and extensible to a wide range of experiences.
Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems Extended Abstracts - CHI EA '12, 2012
This paper presents textual tinkerability, a new concept for fostering early literacy skills duri... more This paper presents textual tinkerability, a new concept for fostering early literacy skills during parent-child reading. Textual tinkerability maps storytelling gestures to changes in animation and text to assist reading exploration and demonstration of the link between text, spoken word, and concept. TinkRBooks are flexible tablet-based storybooks that allow readers to actively explore concepts in text using textual tinkerability. When reading TinkRBooks, both parents and children can alter text (character attributes and parts of speech) by manipulating story elements (props and characters) as they read. We demonstrate how textual tinkerability encourages more dialog, print referencing and dialogic questioning between parentchild dyads in shared reading as compared to paper books. In addition, our study reports observations of storytelling performance behaviors that foster playful and socially intimate shared reading behaviors that are closely mapped to the teaching and learning of emergent literacy skills.
Proceeding of the twenty-sixth annual CHI conference extended abstracts on Human factors in computing systems - CHI '08, 2008
The purpose of this research is to build and evaluate collaborative touch devices that influence ... more The purpose of this research is to build and evaluate collaborative touch devices that influence behavior change over individuals in small group situations. This paper presents touch proxy objects for collocated collaboration and communication. Touch proxy objects afford and represent touch in order to allow the sense of touch to be shared between people. This paper presents preliminary observations from studies performed on existing touch communication objects.
We describe a perspective on the evolution of TUIs with regard to personalization, by proposing a... more We describe a perspective on the evolution of TUIs with regard to personalization, by proposing a research theme emerging from trends in industry and academia. We present a framework for this design space and how TUIs populate this space. Elements of personalization and issues surrounding further incorporation of personalization are discussed. We propose research in personalization as a way to increase the commercial viability of TUIs.
A device for enhancing interpersonal communication over distance through use of touch. A vibrotac... more A device for enhancing interpersonal communication over distance through use of touch. A vibrotactile (touch-and-vibration) interface is used to improve existing remote communication by allowing tactile cues to augment the audio-visual information in real-time. The pressure exerted by each finger of the transmitter produces patterns of vibration against the corresponding finger of the receiver. A hand-held device using the interface allows a user to transmit and receive patterns of vibration to and from a remote user and signify tactile ...
Remote, non-verbal interpersonal communication is facilitated between communication stations loca... more Remote, non-verbal interpersonal communication is facilitated between communication stations located remotely from each other. A first communication station registers proximity of a user thereto and communicates to a second communication station a signal indicative of the registered proximity. The first communication station also registers a physical gesture and communicates a signal indicative of the gesture to the second communication station. The second communication station, in turn, receives the signals and, in response thereto, ...
In 2012, 41 touchscreen tablets were given to children in two villages in rural Ethiopia. These v... more In 2012, 41 touchscreen tablets were given to children in two villages in rural Ethiopia. These villages had no schools, and the children had no access to literacy. Nicknamed the 'literacy tablet', this technology was intended as an educational delivery mechanism to bootstrap reading. The tablet was designed to help remotely located rural children teach themselves to read. Throughout the year-long study, usage data was tracked as 41 children encountered technology and literacy for the first time. We present visualisations of this data, acquired by the tablets using open source tools. These digital ethnographic artefacts provide insight into what types of applications and experiences are interesting to users as they explore early literacy. Beyond usage data, the social relationships and personal stories of learning were revealed. The resulting narrative describes how children become passionate learners and teachers of their community. The idea of a tablet-based education has ...
ACM SIGGRAPH 2006 Emerging technologies on - SIGGRAPH '06, 2006
Graphical User Interfaces (GUIs) separate intangible representations (pixels) and remote controll... more Graphical User Interfaces (GUIs) separate intangible representations (pixels) and remote controllers (mouse, keyboard). We present an opposite approach, "Tangible User Interfaces" (TUIs), that tightly couples representations and controls to take advantage of multimodal human senses and skills to manipulate physical objects. We showcase the latest examples of TUIs with a special focus on play, improvisation, and creativity.
A method is provided for encoding device independent multi-modal content including an arrangement... more A method is provided for encoding device independent multi-modal content including an arrangement comprising one or more of a plurality of tokens, where each token corresponds to a standard predefined effect. The method includes defining a token for one or more standard predefined effects, wherein the token is adapted for being mapped to one or more effect producing elements in a target device. One or more tokens are then composed for playback together as an arrangement.
An input roller device (50) includes a roller (58), an eccentric rotating mass (59) within the ro... more An input roller device (50) includes a roller (58), an eccentric rotating mass (59) within the roller, a drive mechanism (54, 56 and 57) causing the eccentric rotating mass to rotate within the roller, and a processor (52) coupled to the drive mechanism. The drive mechanism can also optionally include a drive link (57) if not directly driven by the shaft of the motor. The input roller device 50 can further include a rotary encoder (60) coupled to the roller such that the rotary encoder can provide data to the processor on a rotation of the roller. Note, the ...
An electronic device (100) comprises a housing (112), an input (118, 122) coupled mechanically to... more An electronic device (100) comprises a housing (112), an input (118, 122) coupled mechanically to the housing for receiving data, an output (114, 118) coupled mechanically to the housing for presenting information to a user of the electronic device in at least one of an audio and visual mode, an electronic circuit (210) coupled mechanically to the housing for providing intelligent operations that receives the data from the input and provides the information to the output, and at least two electromechanical transducers (226), each ...
A tag is provided, which can be associated with one or more individuals and/or a connection to a ... more A tag is provided, which can be associated with one or more individuals and/or a connection to a predetermined network resource, and which can be used to facilitating interaction of the wireless communication device with the corresponding individual (s) and/or resource. The tag includes a transmitter and a storage element including an ID value, which associates the tag with the individual (s) and/or resource. In at least some instances the tag will additionally include a trigger element, such as a user actuatable switch, which will enable an action to ...
This paper proposes a new haptic interface called ComTouch to augment remote voice communication ... more This paper proposes a new haptic interface called ComTouch to augment remote voice communication by integrating a touch-to-vibration mapping into a cellular phone. The goal of this work is to enrich interpersonal communication by complementing voice with a new tactile channel. ComTouch, a one -handed device, converts pressure into vibrational intensity between users in real -time. We present preliminary user studies performed on 24 people to observe possible uses of the tactile channel when used in conjunction with audio. By recording and examining both audio and tactile data, we found strong correlations between the two communication channels. Some participants developed encoding systems similar to that of Morse code. Three original usages were also observed: Emphasis, Mimicry, and Turn-taking. We demonstrate the potential of the tactile channel to enhance the existing voice communication channel.
Proceedings of the 12th International Conference on Interaction Design and Children, 2013
Educational interface designers are in an unprecedented position to facilitate autonomous learnin... more Educational interface designers are in an unprecedented position to facilitate autonomous learning in neurodiverse learners (children with special needs). These learners are particularly in need of special design, given the disproportionate impact it can have on their quality of life and the current vulnerability they experience due to changes in special education law. In response to the urgent conditions facing these students, we construct and define a set of design principles that are grounded in maximizing the potential of these learners by importing the meta-cognitive skills, algorithmic structures, and multiple sensory modalities that are both proven successful in their remediation and uniquely suited to technological design adaptation. We draw from our main author's experience as a heavily remediated Dyslexic, a lifelong user of modified, adaptable and assistive technology, and a self-aware learner taught to understand why the methods behind her remediation worked. We additionally draw on our cumulative experience as users, teachers and developers of technology and on interviews with participants from a wide variety of sociocultural functions and pedagogical practices involved with special education. Based upon these and existing methods and applications, we present our insights in the form of guidelines for universal design that have the potential to not only embrace the differences of all learners but to maximize the potential of underserved neurodiverse learners so they can become self-sufficient masters of their own skills and interests across their lifetime.
Proceedings of the 8th ACM conference on Creativity and cognition - C&C '11, 2011
In interactive storytelling systems, we see common challenges of artistic expression that pertain... more In interactive storytelling systems, we see common challenges of artistic expression that pertains to presentation, standing apart from narrative structure. We believe this expression can be achieved computationally, which is a core challenge in using procedurally-generated worlds in interactive storytelling. This computational expression so is what we call dynamic dramaturgy. We intend dynamic dramaturgy as a complement to interactive narrative systems, particularly drama management, and as a fundamentally distinct task from plot-level narrative construction, yet it is still a basic medium for artistic expression by an author. It is, in effect, an art of presentation in interactive storytelling.
We present an adaptive educational narrative that combines an interactive storybook with drama ma... more We present an adaptive educational narrative that combines an interactive storybook with drama management. By understanding our underlying value system, we are able to create an adaptive narrative that provides features adequate for the target context. Our value system and design needs invite a reexamination and reapplication of interactive storytelling systems, and results in an adaptive narrative framework that is both feasible and extensible to a wide range of experiences.
Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems Extended Abstracts - CHI EA '12, 2012
This paper presents textual tinkerability, a new concept for fostering early literacy skills duri... more This paper presents textual tinkerability, a new concept for fostering early literacy skills during parent-child reading. Textual tinkerability maps storytelling gestures to changes in animation and text to assist reading exploration and demonstration of the link between text, spoken word, and concept. TinkRBooks are flexible tablet-based storybooks that allow readers to actively explore concepts in text using textual tinkerability. When reading TinkRBooks, both parents and children can alter text (character attributes and parts of speech) by manipulating story elements (props and characters) as they read. We demonstrate how textual tinkerability encourages more dialog, print referencing and dialogic questioning between parentchild dyads in shared reading as compared to paper books. In addition, our study reports observations of storytelling performance behaviors that foster playful and socially intimate shared reading behaviors that are closely mapped to the teaching and learning of emergent literacy skills.
Proceeding of the twenty-sixth annual CHI conference extended abstracts on Human factors in computing systems - CHI '08, 2008
The purpose of this research is to build and evaluate collaborative touch devices that influence ... more The purpose of this research is to build and evaluate collaborative touch devices that influence behavior change over individuals in small group situations. This paper presents touch proxy objects for collocated collaboration and communication. Touch proxy objects afford and represent touch in order to allow the sense of touch to be shared between people. This paper presents preliminary observations from studies performed on existing touch communication objects.
We describe a perspective on the evolution of TUIs with regard to personalization, by proposing a... more We describe a perspective on the evolution of TUIs with regard to personalization, by proposing a research theme emerging from trends in industry and academia. We present a framework for this design space and how TUIs populate this space. Elements of personalization and issues surrounding further incorporation of personalization are discussed. We propose research in personalization as a way to increase the commercial viability of TUIs.
A device for enhancing interpersonal communication over distance through use of touch. A vibrotac... more A device for enhancing interpersonal communication over distance through use of touch. A vibrotactile (touch-and-vibration) interface is used to improve existing remote communication by allowing tactile cues to augment the audio-visual information in real-time. The pressure exerted by each finger of the transmitter produces patterns of vibration against the corresponding finger of the receiver. A hand-held device using the interface allows a user to transmit and receive patterns of vibration to and from a remote user and signify tactile ...
Remote, non-verbal interpersonal communication is facilitated between communication stations loca... more Remote, non-verbal interpersonal communication is facilitated between communication stations located remotely from each other. A first communication station registers proximity of a user thereto and communicates to a second communication station a signal indicative of the registered proximity. The first communication station also registers a physical gesture and communicates a signal indicative of the gesture to the second communication station. The second communication station, in turn, receives the signals and, in response thereto, ...
Printed words are an abstract representation of concepts. Today parents teach children how to rea... more Printed words are an abstract representation of concepts. Today parents teach children how to read by demonstrating how text is related to imagery. I present textual tinkerability, an idea for demonstrating reading by using multisensory gestures to expose and alter the text-graphic relationship within the story. Tinkerability allows readers to physically express words as they read, giving them some degree of control over the narrative. Two interactive storybooks called TinkRBooks demonstrate how tinkerability supports parent-child ...
CHI 2006 Workshop What is the Next Generation of Human-Computer Interaction, 2006
In this paper, we describe a perspective on the evolution of HCI toward personalized interfaces, ... more In this paper, we describe a perspective on the evolution of HCI toward personalized interfaces, moving toward unique customized interfaces that possess expressive qualities defined by their end-users. The increasing availability of personal portals and configurable skins, coupled with the means to distribute personalizations, allow a wealth of novel interface mappings to coexist. We reflect on potential social implications of personalization.
Uploads
Books by Angela Chang
Papers by Angela Chang