Skip to content

Audio Description Prototypes for Data Nuggets graphics

I’ve been a fan of Audio Descriptions (AD) in film and TV for awhile now. Most Netflix original content includes audio descriptions and I used to listen to more shows than I watch. I never have seen Daredevil, but I listened to every minute of it. And Stranger Things never sounded so good — and I still don’t know what the monster looks like. For those that want to listen and learn about the technology, there’s a good podcast on audio descriptions. Host Dallas Taylor describes how audio descriptions “could be for the masses,” and I agree. Audio descriptions are not simply for the blind and visually impaired. Just look at how podcasts have become a regular part of our media diet. Why not listen to our data visualizations and graphs too?

While audio descriptions are not sonifications, I wanted to explore the idea of creating audio descriptions as a baseline for sounding a graph when sonification isn't possible. I’m not a trained audio describer, so I may have conflated the “say what you see” rule with some science behind the graph a few times. As a document of the process, I created a script for all audio descriptions, recorded all audio descriptions in my home studio with a Sennheiser MKH-416 microphone, and edited and mixed the audio inside Logic Pro X with a little bit of EQ, compression, and de-essing (FabFilter Pro-Q3; Pro-C2; Pro-DS; and a bx_console SSL 9000J channel strip).

Below includes graphs from all five Data Nuggets our team has selected as part of the NSF AISL pilot. I’ve included only the graphics of data we are using for our sonification work. I copied most if not all of the audio description scripts as the alt-text for the graph images. I placed the matching audio description as .mp3 files next to each graph.

2015 Axial Seamount Eruption

graph that depicts changes in the bottom pressure of the ocean over one month. The data was taken from sensors on the Juan de Fuca plate in the NE Pacific Ocean. The changes in bottom pressure in the graph depict daily fluctuations of the tidal cycle across the entire graph, but is marked by a large shift in bottom pressure in the middle of the data on April 24, 2015. The bottom pressure shifted as a result of the volcanic eruption — an indication that the seafloor dropped.

Audio Description for the 2015 Axial Volcano Eruption Seafloor Deflation graph.

2015 Axial Seamount Eruption

Graphic that displays time-series plot of the long term record of seafloor from 1997 through 2021 in the Axial Caldera in the NE Pacific Ocean. The 1998, 2011, and 2015 volcanic eruptions are labelled in the graph and two horizontal, red dashed lines mark the 2011 and 2015 inflation threshold. In 2021, the 2011 inflation threshold was breached, but there hasn’t been an eruption yet.

Audio Description for the long-term seafloor inflation and deflation in the Axial caldera graph.

Daily Vertical Migration Gets Eclipsed!

The graphic contains two sets of data as two vertical panels aligned to show the same 36 hour period across the 2017 Total Solar Eclipse. The top panel graph contains a single line that depicts the daily solar radiation cycle. The bottom panel is a color image of water depth and shows zooplankton daily vertical migration movement from Bio-acoustic Sonar data.

Audio Description for the solar radiation and bio-acoustic sonar graphs during the 2017 Total Solar Eclipse.

Flux of CO2 Between Ocean and Atmosphere

Graphic that contains two data sets of Coastal carbon dioxide flux between ocean and atmosphere. These data sets show the seasonal cycles of CO2 air-sea gas exchange during 2017 at two coastal locations – the Endurance Array in the NE Pacific (shown as black dots), and the Pioneer Array in the NW Atlantic (shown as white dots). Most of the outgassing — or CO2 release from the ocean into the atmosphere, occur during the summer months. CO2 absorption — a net flux of CO2 from the atmosphere into the ocean occurs throughout the year.

Audio Description for the graph of Coastal carbon dioxide flux between ocean and atmosphere.

Flux of CO2 Between Ocean and Atmosphere

The High-latitude carbon dioxide flux between ocean and atmosphere graphic depicts CO2 air-sea gas exchange during 2016 at the Global Argentine Basin Array in the SW Atlantic. Throughout the entire year, there is no outgassing — or CO2 release from the ocean into the atmosphere. There is only CO2 absorption — a net flux of CO2 from the atmosphere into the ocean due in part to the colder ocean waters.

Audio Description for the graph of high-latitude carbon dioxide flux between ocean and atmosphere.

Turbulent Mixing from Extratropical Storm Hermine

A time-series plot of five meteorological measurements — relative wind speed, precipitation, surface current, temperature, and salinity — are shown as individual panels stacked vertically. The five time-series plots show the response to the storm passage of Extratropical Storm Hermine over the Pioneer mooring array off the coast of New England during the first week of September 2016. A green band over the data during Sept 5th and 6th highlights how the mooring documented an increase in wind speed, an increase in precipitation, an increase in surface current speed, a decrease in sea surface temperature, and an increase in sea surface salinity.

Audio Description for the time-series plot of five meteorological measurements during the storm passage of Extratropical Storm Hermine over the Pioneer mooring array off the coast of New England.

Warm-Core Ring Driven Shelf/Slope Exchange

The graph depicts the profiler mooring temperature data across its water column over one week in June 2014. Each day contains eight colored bands representing water temperature across various depths and range from 12 to 26 degrees Celsius. The data over the week documents a warm core ring that contain warm Sargasso Sea water that travelled north into the cooler North Atlantic waters. Three slices of profiler mooring data are numbered 1, 2, and 3. Each number on the profiler mooring corresponds to a separate panel with three 2D images depicting sea surface temperatures on the ocean and match the time of the mooring data. The NetCDF 2D images show the formation of the warm core ring on the surface of the ocean.

Audio Description for the profiler mooring temperature data graph across its water column over one week in June 2014 and the three 2D images of sea surface temperatures.

References

Smith, L.M., L. Garzio. "2015 Axial Seamount Eruption". Data Nuggets. Ocean Data Labs. 2020. https://datalab.marine.rutgers.edu/data-nuggets/axial-eruption/

Chadwick, B., and S. Nooner. "Blog to chronicle eruption forecasts at Axial Seamount." PMEL Earth-Ocean Interactions Lab. NOAA. https://www.pmel.noaa.gov/eoi/axial_blog.html

Smith, L.M., L. Garzio. "Daily Vertical Migration Gets Eclipsed". Data Nuggets. Ocean Data Labs. 2020. https://datalab.marine.rutgers.edu/data-nuggets/zooplankton-eclipse/

Smith, L.M., L. Garzio. "Flux of CO2 Between Ocean and Atmosphere". Data Nuggets. Ocean Data Labs. 2020. https://datalab.marine.rutgers.edu/data-nuggets/co2-flux/

Smith, L.M., L. Garzio. "Turbulent Mixing from Extratropical Storm Hermine". Data Nuggets. Ocean Data Labs. 2020. https://datalab.marine.rutgers.edu/data-nuggets/extratropical-storm-hermine/

Smith, L.M., L. Garzio. "Warm-Core Ring Driven Shelf/Slope Exchange". Data Nuggets. Ocean Data Labs. 2020. https://datalab.marine.rutgers.edu/data-nuggets/warm-core-ring/

Miellyn Fitzwater Barrows. “Audio Descriptions.” Twenty Thousand Hertz Podcast. DeFacto Sound. February 2017. https://www.20k.org/episodes/audio?rq=audio%20

Learn More

Learn more about audio descriptions (takes you to another site)

Learn more about The Audio Description Project.

Learn more about an audio description narrator and writer.

by Jon Bellona

Follow

Follow this blog

Get every new post delivered right to your inbox.

Email address