Check out our Blog!
Spearcons as X-axis markers in Sonifications
From early sonification development with lead-PI Amy Bower and our co-design session at Perkins School for the Blind, we discovered that sounds for location and context are essential. I started including spearcons, sped-up speech as auditory icons, to indicate x-axis ticks in the data as part of sonification prototypes.* Beyond contextual cues, there is some…
Using Audio Markers as Sonification Exploration Prototype
While reading “Rich Screen Reader Experiences for Accessible Data Visualization” by Zong, et al., two items struck me related to data sonification. First, the literature review and study’s co-design experience amplified the message that screen reader users desire “an overview,” followed by user exploration as part of “information-seeking goals” (Zong et al. 2018). Even though…
Kyma: Sound Design Workstation
As part of the NSF pilot, I am designing many of the data sonifications using Kyma by Symbolic Sound. Symbolic Sound was founded and is owned by Carla Scaletti and Kurt Hebel. I like to describe Kyma as a sound design workstation, a recombinant sound language, a live-performance machine, a data sonification toolkit, and a…
Audification
One of the most direct ways to sonify a data stream is that of audification, which is “a direct translation of a data waveform to the audible domain” (Kramer 1994). Turning data into a waveform consists of treating data points as amplitude values in an audio signal. The direct correlation of data-as-audio signal has advantages…
Inclusive Design: Including Graph Divisions in Sonification
I held a basic assumption that sonifications should only be comprised of “non-speech sound” (Sterne and Akiyama 2012), based upon a few definitions of and experiences listening to sonification. So, I made every effort to avoid the use of speech in sonification. While working on the initial grant with PI Amy Bower, however, I questioned…
Sound Design
Sonification involves the field of sound design, which is the craft of developing sounds to meet a variety of needs. Sound design is common to video game and media industries, which require the creation of sound effects, human sounds, ambiance, and dialogue. Data sonification involves mapping data values to sound parameters, and we often have…
The Parameters of Sound
Data sonification commonly involves taking data-numeric values-and assigning those values onto sound parameters to highlight particular aspects of the data. Making choices about the ordering and controlling of sound parameters over time is as old as music notation. In fact, standard music notation highlights certain aspects of sound in its writing. For example, music notation…
What is Data Mapping?
Data mapping refers to the design choices of applying values from a data set onto any number of controls of sound. Controls may include modifications of digital sound synthesis, audio samples, audio effects, and spatialization, among many others. Data mapping and choices around mapping play a critical role in sonification. In sonification, choices in data…
- « Previous
- 1
- 2