Study 25
The visualization was an attempt to map the difference between human and algorithmic attention, inspired by the concept of efference copy. Efference copy can be understood as the mental copy a nervous system keeps of its own outgoing signals. It is a record of its own activity that allows it to stay oriented to its own actions.
The data used in the visualization is from an EEG study conducted by Octave Etard, Rémy Ben Messaoud, Gabriel Gaugain and Tobias Reichenbach, published in the Journal of Cognitive Neuroscience in 2022, in which listeners were asked to respond to Bach’s Invention 4 in D minor. The two voices of the invention are played on guitar and piano. The listener hears the piece twice, once while following the guitar and then the piano. In the study, specific notes were designed to tremble. The listener was asked to identify those notes by pressing a key.
The visualization takes the form of a music box. The inner cylinder carries the notes of the invention as a series of pins, with the guitar’s voice at one end and the piano’s at the other. The trembling notes are drawn as wavy pins. In the visualization, each of the recorded presses is represented by a little bead above the cylinder. As each pin sounds, the listener’s response to the note is drawn as a little comet coming from the pin. The stronger the response, the longer and brighter its tail.
The second cylinder is a visualization of the model that was trained on the listener’s responses. The algorithm is trying to guess the human response to each note. The difference between them can be seen in the model’s pins, which stay faint when it guesses accurately and brighten when it is wrong. It is also audible in the slight delay of the model’s version, which sounds an octave lower and a little after the listener’s.
Sources
Study: Etard, O., Ben Messaoud, R., Gaugain, G. and Reichenbach, T. (2022). No Evidence of Attentional Modulation of the Neural Response to the Temporal Fine Structure of Continuous Musical Pieces. Journal of Cognitive Neuroscience 34(3), 411–424. doi:10.1162/jocn_a_01811.
Data: listener EBIP02, Bipolar EEG dataset, music (Imperial College London, 2020; Zenodo 4470135, CC BY 4.0).
Efference: Godfrey-Smith, P. (2016). Other Minds: The Octopus, the Sea, and the Deep Origins of Consciousness. New York: Farrar, Straus and Giroux.
Model: a two-layer transformer trained on inventions 2, 3, 6 and 7 in both hearings, invention 4 held out. Designed by the artist; model trained by Claude (Anthropic). © 2026 Alexandra Emberley.