Skip to main content

Research Article

The Science of Harmony: A Psychophysical Basis for Perceptual Tensions and Resolutions in Music

Paul Yaozhu Chan1,2, Minghui Dong1, and Haizhou Li1,3

1Institute for Infocomm Research, A⁎STAR, Singapore
2Nanyang Technological University, Singapore
3National University of Singapore, Singapore
Correspondence should be addressed to Paul Yaozhu Chan; gs.ude.rats-a.r2i@nahcy

Abstract

This paper attempts to establish a psychophysical basis for both stationary (tension in chord sonorities) and transitional (resolution in chord progressions) harmony. Harmony studies the phenomenon of combining notes in music to produce a pleasing effect greater than the sum of its parts. Being both aesthetic and mathematical in nature, it has baffled some of the brightest minds in physics and mathematics for centuries. With stationary harmony acoustics, traditional theories explaining consonances and dissonances that have been widely accepted are centred around two schools: rational relationships (commonly credited to Pythagoras) and Helmholtz’s beating frequencies. The first is more of an attribution than a psychoacoustic explanation while electrophysiological (amongst other) discrepancies with the second still remain disputed. Transitional harmony, on the other hand, is a more complex problem that has remained largely elusive to acoustic science even today. In order to address both stationary and transitional harmony, we first propose the notion of interharmonic and subharmonic modulations to address the summation of adjacent and distant sinusoids in a chord. Based on this, earlier parts of this paper then bridges the two schools and shows how they stem from a single equation. Later parts of the paper focuses on subharmonic modulations to explain aspects of harmony that interharmonic modulations cannot. Introducing the concept of stationary and transitional subharmonic tensions, we show how it can explain perceptual concepts such as tension in stationary harmony and resolution in transitional harmony, by which we also address the five fundamental questions of psychoacoustic harmony such as why the pleasing effect of harmony is greater than that of the sum of its parts. Finally, strong correlations with traditional music theory and perception statistics affirm our theory with stationary and transitional harmony.

1. Introduction

Even though it is one of the most important components in music, and possibly the most widely studied [1], the definition of harmony differs vastly across time, genre, and individuals, reflecting how little is understood about it [2, 3].

There are three aspects to the complete understanding of our perception of harmony, which we will, for brevity, refer to as what, why, and when. The what of harmony refers to an attribution to a defining quality. Its why goes further to explain the means by which such a quality ascribes to consonance or dissonance (or even sentiment or emotions). Finally, it should be recognized that the same harmony perceived as consonant in one context can be perceived as dissonant in another. This takes the what and why of stationary harmony (sonorities) into the context of transitional harmony (progression). We refer to this as the when of harmony and it has remained largely unaddressed by acoustic science.

1.1. Background

Early works effectively attributed the what of harmony to rational relationships [1, 4]. This ascribes a chord’s consonance to the ratio amongst its contributing string lengths (and consequently, wave periods and fundamental frequencies), being fractional with integer numerators and denominators. A fascinating number of esteemed mathematicians, physicists, and philosophers have made different contributions in this aspect. The development of the Pythagorean tuning system is commonly credited to Pythagoras in the fourth century BC [3, 5, 6]. Euclid wrote the earliest surviving record on the tuning of the monochord [7] and documented numerous experiments on rational tuning [8]. Aristotle and Plato made various contributions to the development of ancient Grecian (rationally scaled) music that was later integrated into the diatonic system [8, 9]. Ptolemy developed the syntonic diatonic system as early as the second century [10]. Euler proposed a grading system of chord aesthetics based on the assertion that the notes have a least common multiple (i.e., that they are rational) [11]. Since string lengths correspond to wavelengths, which correspond to wave period, and since notes used in harmony are taken from the scale, it can be said that the Pythagorean school effectively attributes harmony to temporal features.

It was not until 1877 that Helmholtz pioneered the psychoacoustic approach [3, 8, 12, 13]. Isolating adjacent harmonic sinusoids from different notes using specifically devised acoustic resonators, he was able to record how amplitude modulation that resulted from their summation grew perceptually unpleasant as their modulation frequency increased towards a certain threshold [8], thus attributing dissonance to what he called beating frequencies and addressing the questions what sounds bad and why. Numerous others [1425] conducted further studies in this approach, while others raised several questions with Helmholtz’s theory [13, 17, 26]. For example, Plomp and Levelt [12] and Schellenberg and Trehub [27] have separately shown that consonances and dissonances are still perceived in harmonies with pure tones (tones without harmonics). Itoh [28] and Bidelman [29], amongst others, also showed that electrophysiological responses to pure-tone intervals did not agree with Helmholtz. All in all, the Helmholtz school attributes harmony to frequency features and comprises a large part of what is referred to in this paper as interharmonic modulations.

In 1898, a notable but short-lived [3] attempt at what sounds good and why was seen in Stumpf’s tonal fusion theory [30], which theorized that harmony was the effect the harmonics of its component notes fusing together to sound like a single note with a common fundament [12, 13, 26, 30].

Because of the nonlinear relationship between tonal scale and frequency, scales derived from rational lengths of a string tended to leave certain intervals more rational than others. With this realization, Western music eventually adopted 12-tone equal temperament scale. This equally segments the octave in the log-frequency scale [31] such that each semitone interval is a factor of , evenly redistributing the dissonances to accommodate to different keys. Despite its late adoption, original development of this scale predates Helmholtz to the 1500s. Vincenzo Galilei (father of Galileo Galilei) made the earliest known estimate of this in the West by approximating with [32], while Zhu was credited for perfecting it in the East by computing it to accurately to the 25th decimal, both in the 1580s [12]. The earliest recorded estimate of this in the East was by He in the 5th century, whose estimate was already about as accurate as Galilei’s [33, 34].

In Rameau’s Treatise on Harmony [1], which paved the foundations of harmony in modern music theory, notes of basic chords are derived from the division of the length of a common string [35]. However, this remains disjoint with the rest of the treatise, and modern music theory remains more of a compilation of rules and deductions from the pattern clustering of perceptual experiences [3642], addressing the questions what sounds good and when without the scientific reasoning of why [37].

More recently, several studies have found high correlations between harmony and periodicity measures of the resultant signal [43, 44]. This novel leap advances the Pythagorean school while presenting a persuasive attribute of what sounds good and why.

Several notable studies have also been conducted that relate harmony to nonacoustic attributes such as statistics and geometry. An example is Tymoczko’s exploration of how multidimensional geometric patterns correlate strongly with patterns that exist in historic harmony use, addressing what sounds good and when [4547]. Authors in [48] explored properties of musical scales on the Euler lattice, addressing the what of harmony. Numerous others such as [4951] have worked on other mathematical relationships in harmony, addressing its what.

Yet others have looked towards a biological rationale towards our perception of harmony to address what sounds good and why. A recent example is Purves’ attribution of the effect of the tonal scale to the familiarity of excited or subdued speech [14, 5254]. Other examples are the works of [43, 55, 56] in the neuronal mechanism of harmony perception.

1.2. Scope

In this work, we first seek a mathematical resolution across both acoustic schools by a single psychophysical theory. To start off somewhere familiar, we first describe the concept of interharmonic modulations (which adopts and encompasses Helmholtz’s beating frequencies), from which we then introduce the concept of subharmonic [57] modulations and show how the two categories of modulations relate. (At some point after which, we also show how a specific case of subharmonic modulations addresses Pythagoras, thus integrating the two schools.) After explaining how perceptual tensions [18, 36, 58, 59] in musical harmony may be identified in subharmonic tension in the stationary context, we continue to explain how perceptual tension resolutions [18, 42] in transitional harmony (chord progressions) may be visualized in subharmonic trajectories. By these, we address the what, why, and when of harmony. Numerical results show strong to near-complete correlations with perception and chord-use statistics that are presented towards the end of the paper.

By applying our theory and equations, we will answer the five fundamental questions of psychoacoustic harmony. These are as follows.

(1)

The phenomenon that the effect of harmony is greater than the sum of its parts [18, 60]:

where denotes the harmonious effect of , , and representing notes of the chord and ‘+’ denotes simultaneous presentation or cumulation.

(2)

There are the definition and explanation of stationary harmony, i.e., what sounds good and why, or, mathematically, to quantify , where represents chord .

(3)

There are the definition and explanation of transitional harmony, i.e., what sounds good, why, and when, or, mathematically, to quantify , where ‘→’ denotes transition from one chord to another.

(4)

We have the following phenomena.

(a)

A chord that sounds better than another out of context can sound worse than being in context [42]. Given this shows that

(b)

A chord that sounds better than another in one context can sound worse than being in another context [42]. Given this shows that

(5)

We have the phenomenon that the transition from a low-tension chord to a high-tension one can still bring about the effect of tension release (resolution). Given this shows that

Apart from Pythagoras [3, 5, 6] and Helmholtz [8], we will, in closing, also briefly explain how our theory mathematically bridges other subsidiary psychophysical theories such as Stumpf [30], Euler [11], Galilei [33, 34, 61], and Zhu [12].

2. A Universal Theory of Harmony

In this section, a psychophysical basis for harmony is proposed as follows.

The human perception of harmony is composed of auditory events produced by the combination of sinusoids that make up each note in the harmony. These may be classified into interharmonic and subharmonic modulations.

First-order interharmonic modulations are those produced by the interplay amongst adjacent sinusoids across differing notes. These are loosely categorized by the frequency of the resultant amplitude modulation into dissonant beating frequencies [8] and consonant low-frequency modulations, triggering a variety of emotions according to their modulation and carrier frequencies. Second-order interharmonic modulations are produced by the alignment of first-order ones. The consonance types of different intervals may be identified according to patterns cast by interharmonic modulations on the interharmonic plot.

Despite the significance of interharmonic modulations, the effect of consonances and dissonances is still experienced in the absence of harmonics with pure tone harmonies. This implies that interharmonic modulations are not exclusive in our perception of harmony [12, 13, 17, 2629]. From this, it may be deduced that subharmonic modulations also play a significant role.

Subharmonic modulations are produced by the interplay of sinusoids much further apart than interharmonic modulations. Unlike interharmonic modulations, which are analysed primarily in the frequency domain, subharmonic modulations are analysed primarily in the temporal domain and they are comprised of two parts. The first part is subharmonic wave formation, which occurs with the summation of component waveforms from each note to produce a waveform largely periodic to a common subharmonic frequency. The second is subharmonic wave deformation (an example is provided in Supplementary Video S1.), which is a distortion to every successive period of this composite subharmonic waveform due to the imperfect alignment of contributing wave periods. Stationary tension and transitional resolution may both be derived from subharmonic features which serve as measures of stationary and transitional harmony.

In order to explain interharmonic and subharmonic modulations in detail and how they unify the two prevailing schools of harmony, we will start from first principle by looking at the notes of a chord as the sum of their composite sinusoids.

2.1. Modulations in Sinusoidal Summation

When waveforms of two notes, and , at amplitudes and , respectively, are presented together, the result may be expressed as a sum of their composite sinusoids such thatwhere, respectively, and represent the individual harmonics from each note, and represent the highest harmonics that need to be considered because of audible range, and represent the amplitude coefficients of each harmonic, and represent the frequencies of each harmonic with and representing the fundamental frequency of each note, and represent the starting phases of each harmonic, and represents monotonically increasing time.

Isolating a single pair of adjacent sinusoids from differing notes we getwhere and are the pair of harmonics from differing notes, , , , and .

Since we are considering the modulating frequency resultant of the summation of both sinusoids spanning all phase combinations, it no longer matters which starting phase we take reference from. Hence, and can both be set to zero.

In the case of A=B, the resultant amplitude modulation is trivial and, as illustrated in Figure 1 (left), is given by the sum-to-product rulewhere is the normalized modulating frequency and is given by is the normalized carrier frequency given byand the values of A and B are normalized to 1.

Figure 1

Alt text
Summation of sinusoids of equal (left) versus unequal (right) amplitudes. Notice the difference in modulating frequencies even though frequencies of component sinusoids remain unchanged.

However, in most cases, , and the problem becomes nontrivial, because of the change in modulation frequency as the modulating waveform no longer crosses zero. This can be seen in Figure 1 (right).

We approximate the summation of these sinusoids to bewhere is bounded by and and is approximated to be (which denormalizes to ; denotes the magnitude of signed according to the quadrant of . denotes the larger of the amplitudes and and are normalized to .

When , this simplifies to (4), where the modulating frequency is .

However, as increases with respect to , gravitates towards 2, and for which the modulating frequency is .

We can see from the plots in Supplementary Figure S1 that this estimation is accurate for values of B marginally larger than A to much larger than A.

For consistency, the effective modulating frequency for the case of will be considered by the frequency of its rectified modulating waveform which is then, similarly, . In music, we are interested in this frequency in hertz. Hence, we denormalize this to be

In the next two sections, we will move on to see how this is applicable not only to the summation of adjacent harmonics in interharmonic modulations but also to distant sinusoids in subharmonic modulations.

3. Interharmonic Modulations

Interharmonic modulation refers to modulations across adjacent pairs of sinusoids from different notes that fall within a certain threshold, with modulation frequency corresponding to in (9).

Figure 2 shows a plot of all harmonics of notes (blue) and (red) under 3 kHz. All adjacent sinusoids less than 120 Hz apart are identified in the figure, with their centre, , and modulating, , frequencies labeled accordingly.

Figure 2

Alt text
Identifying the interharmonic modulations across and .

3.1. Beating Frequencies and Low-Frequency Modulations

Interharmonic modulations with that increase towards a certain threshold are known to become increasingly dissonant, and, as coined by Helmholtz, are known as beating frequencies [8]. Interharmonic modulations with small , on the other hand, contribute to the harmonious effect perceived in consonance [65]. Figure 3 illustrates this.

Figure 3

Alt text
Types of interharmonic modulation on the scale of .

3.2. Perceptual Responses across thef- Feature Space

It is known that different combinations of notes contribute to different emotive valences [66]. This too may be decomposed into a sum of its harmonics. Hence, further to the consonances and dissonances, emotive responses may also be mapped onto the interharmonic plot. Although, as one might imagine, such responses would be different for every individual, we can plot the response for an individual as an example. Figure 4 shows an example of auditory responses triggered in the mind of the (first) author when exposed to frequencies in the horizontal ( ) axis modulated by frequencies in the vertical (f) axis. The value of is indicated in the horizontal axis in both Hz and its corresponding note names. The degree of pleasure derived from interharmonic modulation is coded in the colored background as a reference. The green regions are perceived to be pleasing, yellow as somewhat pleasing, orange as unpleasant, but not to the point of annoying, red as dissonant, and black as beyond beating range. The black dots mark the locations of the thoughts or emotions labelled. This shows that interharmonic modulations bring about a large variety of thoughts or emotions. If several of these are triggered simultaneously when just one pair of notes sound simultaneously, one can imagine how ten fingers on a piano or all the instruments in an orchestra could combine several (thoughts or emotions) to paint stories on the interharmonic feature-space over time.

Figure 4

Alt text
Example of auditory responses triggered by pure-tone frequencies on the horizontal axis modulated at frequencies on the vertical axis. Green, yellow, orange, red, and black indicate pleasing, somewhat pleasing, unpleasant, dissonant, and beyond beating range, respectively.

3.3. Intervals and Second-Order Modulations on the ∆f- Feature Space

The interharmonic modulations of each interval within an octave are similarly plotted in Figures 5, 6, and 7. However, this time, the plots are in the linear scale. Green, yellow, orange, and red, again, represent regions of different degrees of consonance or dissonance according to the same color scheme as Figure 4. However, because this time both horizontal and vertical axes are in the linear scale, consonance-dissonance levels that populate the space on the nonlinear plot in Figure 4 now populate lower right regions of these linear plots. The remaining upper left regions are then populated with dissonance levels from [12]. These colors provide a simple background reference for the dark blue dots that each represent a modulation at their corresponding and values, which results from the summation of neighboring pairs of sinusoids (at frequencies and ) of the notes specified by the indicated interval. Also, for reference, are the two white lines that run across each plot, indicating the locations where the values of coincide with a semitone (gentler slope) and a tone (steeper slope) of the corresponding values of (where and , resp.). The semitone and the tone are regarded as the most dissonant intervals up to halfway in either direction around the cyclic chroma [12, 21, 54].

Figure 5

Alt text
Interharmonic plots for all intervals within an octave regarded, in classical music theory, to be perfectly consonant with a root of . These are, namely, the Perfect 4th ( and ), Perfect 5th ( and ), and Octave ( and ) intervals.

Figure 6

Alt text
Interharmonic plots for all intervals within an octave regarded, in classical music theory, to be imperfectly consonant with a root of . These are, namely, the Minor 3rd ( and ), Major 3rd ( and ), Minor 6th ( and ), and Major 6th ( and ) intervals.

Figure 7

Alt text
Interharmonic plots for all intervals within an octave regarded, in classical music theory, to be dissonant with a root of . These are, namely, the Minor 2nd ( and ), Major 2nd ( and ), Minor 7th ( and ), Major 7th ( and ), and Diminished 5th ( and ) intervals.

The plots of perfect consonances are presented in Figure 5. These intervals are described with a bit of a dilemma in classical music theory [67]. They may be described as so consonant that they sound almost like one note. As such, their use contributes in a limited way to harmony [15]. For example, the use of perfect fifths is forbidden in parallel motion and octaves are regarded as the same note in a different register [42].

The interharmonic plot reveals the perceived traits of each category of intervals in a way that explains why they sound the way they do, and in a way music theory alone has never been able to. As shown in Figure 5, the constellations formed by interharmonic modulations of perfect intervals line up almost horizontally (While the methods used in this study are applicable with any form of tuning, only equitempered tuning is assumed in the computations in this section. This is consistent throughout this paper, unless otherwise stated.). Since each point that falls on the same horizontal has the same , this means that they modulate synchronously and may be perceived collectively as a single modulation. This may be interpreted as fewer modulating microevents taking place, making them less interesting than other consonance intervals.

Dissonant intervals are presented in Figure 7. As can be seen in the figure, these intervals have points that fall mostly within the central dissonant region and line up along the two dissonant lines. Evenly spaced points along a line that passes through the origin also reveal that their share a harmonic relationship. This has a similar (although this is somewhat lesser) redundant effect to that of the synchronous modulation described with perfect consonances.

Consonances that properly contribute to harmony are called imperfect consonances [67] and are presented in Figure 6. As can be seen in the figure, imperfectly consonant intervals have points better distributed. This may be interpreted as erratic modulations that create a continuous stream of unpredictable events to stimulate aural attention, and thus, interest.

A lot of work has already been done on interharmonics since Helmholtz [12, 1921, 24, 25]. While the main focus of this work is not interharmonics, one purpose of this section is, nevertheless, to provide sufficient background to complete our theory of how the human experience of stationary harmony is based around modulations of both interharmonic and subharmonic nature. From the interharmonic plots in Figures 57, a simple predictor of dissonance may be identified to bewhere will be our shorthand for , , or referring to the number of interharmonic modulations that fall within the central region of dissonance region, iterates through all interharmonic modulations on the plot, is the total number of modulations considered, and refer to the pair of and that describe the th interharmonic modulation, respectively, and and define the lower and upper boundaries of the region on the interharmonic plot, respectively.

In this section, we have seen how interharmonic modulations are significant to our perception of consonance, dissonance, and emotive response in music. When listening to a duet of instruments with no overtones such as a sinewave theremin or a very pure musical saw, we realize that consonance, dissonance, and emotion remain present even in harmony without harmonics (i.e., across a well-spaced pair of fundamental frequencies alone). This is just one amongst the several different ways [12, 13, 17, 28, 68, 69] from which we can deduce that interharmonic modulations cannot be the only determinant of our perception of harmony, which thereby leads to our hypothesis on subharmonic modulations.

4. Subharmonic Modulations

Apart from the modulations that arise from the summation of adjacent harmonic sinusoids across differing notes, we can (as explained above) deduce that another category of modulations is significant to our perception of harmony. We call these subharmonic modulations. There are two levels of subharmonic modulations, which we dub subharmonic wave formation and subharmonic wave deformation. In this section, we will show how these are significant to our perception of not only stationary harmony, but also transitional harmony.

Figure 8 shows the waveforms of a C Major chord (C) and a C minor 7 chord (Cm7) composed of the fundamental sinusoids of each composite note. We let each sinusoid start at phase zero since; for purpose of example, we are only interested in wave period. Only the fundament needs to be considered for the same reason. In both cases, the waveform resultant of this summation repeats at a frequency approximately subharmonic to all its composite waveforms. In the figure, its period is marked We call this subharmonic wave formation and say that is a common subharmonic to all its composite waveforms.

Figure 8

Alt text
Subharmonic wave formation and deformation in the C and Cm7 chords.

In the case of the C chord, as shown in the figure, each composite sinusoid crosses zero at nearly the same point around . As marked in the figure, (which is the difference between the first and the last negative-to-positive zero-crossing around the region) is small. However, in the case of the Cm7 chord, is much larger. One can imagine that each successive period of the resultant waveform looks less and less like the first as it gets more and more deformed. This happens slowly for the C chord because of the small but faster for the Cm7 because of the large . We call this subharmonic wave deformation. Supplementary Video S1 compares subharmonic wave deformation in a low-tension C chord to that in a high tension Cm7 chord.

Recalling our wave equation from (3), we can rewrite , or , as where is an approximate common factor of and , and are integer multipliers, and and are small values that balance the equation by making up for the discrepancies that arise with finding a common factor.

In (11), two fundamental frequencies and are described as the multiple of a lower subharmonic frequency that is common to them ( ). We call this their common subharmonic.

Since all harmonics are multiples of their fundamental, a subharmonic to any fundamental would inherently be subharmonic to all its harmonics. For this reason, only the fundamental of each note needs to be considered.

Since harmony in music is commonly composed of more than just two notes, we generalize this to describe fundamentals and common subharmonics from any number of notes to getwhere is the number of notes in the chord, cycles through each of them, and is the amplitude coefficient of note .

Beyond this point, it would be easier to visualize subharmonics in the time domain. With the fundamental frequency of note given bythe fundamental period of each note is thenwhere is the fundamental period of the note.

Hence, the period of any common subharmonic can be expressed as . We can then compensate for nonintegral discrepancies in period rather than in frequency. In doing so, we getfor all , where is the common subharmonic wave period (we will simply say common subharmonic) of the chord. What carries over as is essentially just the th subharmonic of note which lies in the region of . Since this is true for all pairs of and across all values of when they are each balanced by appropriate , may be dropped from the left hand side of the equation.

Although the common subharmonic was introduced as the period between primary zero crossings as in Figure 8, we shall, for computational simplicity, redefine it as the mean of across all notes of the chord. Hence, Figure 9 shows how the period of each subharmonic in the C Major chord from Figure 8 may be plotted. The left column first shows how the period of each subharmonic of may be plotted in red. The right column then extends this to every remaining note in the chord, with orange, yellow, and blue for the notes , , and , respectively. It may be seen in the right column that a subharmonic period from every note in the chord nearly coincides at around 30 ms. Hence, we say that this is its common subharmonic, , as defined in (16).

Figure 9

Alt text
Plotting subharmonic wave periods of the C Major chord.

Having reduced the waveform plot to subharmonic periods in the vertical axis, we can represent time spanned by each subharmonic in the horizontal axis. We will do this for a song stanza in the next section, in a subharmonic plot.

4.1. Subharmonic Modulations in Stationary Harmony

Figure 10 shows an example of a subharmonic plot. In the horizontal axis there is time in bars and in the vertical axis there is the subharmonic wave period in milliseconds. Note that the subharmonic axis runs top down to put shorter wave periods at the top because they correspond to higher frequencies. Larger wave periods, which correspond with lower frequencies sit conversely at the bottom. The tails that run horizontally represent the span of time covered by each note. Subharmonics are colored to match their corresponding notes on the music score. For example, in the first bar, all subharmonics of are marked out in red, followed by in orange, in yellow, in green, in blue, and in purple. The musical score runs in parallel at the bottom of the plot as reference. Once again, all plots and computations in our examples assume equal temperament unless stated otherwise. This example shows the opening stanza of Pachelbel’s Cannon in D [70] and focuses on stationary harmony, leaving transitional harmony to a later example.

Figure 10

Alt text
Subharmonic plot of the opening stanza of Pachelbel’s Cannon in D with period in milliseconds on the vertical axis and time in bars on the horizontal axis. Subharmonics are colored to match the color of their corresponding notes on the music score below. The subharmonic tensions of each chord, , are marked out on the plot with white arrows. Significant wave periods, along with common subharmonic periods, , are marked against the vertical axis on the right. In the interest of visiting all common chords of the key, Em is used in the 7th bar instead of G, which already occurs in the 5th bar. Considering the fact that this example is not used for transitional harmony, all chords are presented in its root position at the expense of introducing parallel 5ths in the interest of normalization for fairer comparison.

Subharmonics. For every bar, the dashes that flush with the reference point at 0 ms mark . Carrying on top down with each bar in accordance to color, we get subharmonics at , , , , etc.

Notes and Melody Line. Since the topmost dash of each color for every bar below the 0 ms reference represents , they relate to the fundamental period of each note; of these, the topmost ones of every bar across all colors mark the melody line, - - - - - - - . (They are red in this particular example.) Hence, it is easy to interpret the melody line in a subharmonic plot. The periods, , of each note of the melody are marked against the vertical axis in milliseconds as well as their common note names.

Chords and Coincidence. Common subharmonics may be visualized in regions with the (approximate) coincidence of dashes of every color. Again, the common subharmonics ( ) of each chord in the stanza are marked out against the vertical axis in both milliseconds and their respective chord names.

Key. Every note of the diatonic shares a common subharmonic. Hence, it is possible to identify the key of a song by its common subharmonic, assuming minimal deviations from its key. The common subharmonic associated with the key of this song is marked out much further down the plot. Dotted lines indicate discontinuity. (This part of the figure is plotted in just intonation to avoid the snowballing of to better illustrate this.)

Stationary Tension. Most of the time, contributing subharmonics from different notes are not precisely coincident. Major chords have better coincidence than minor chords, and triads coincide better than sevenths and extended chords. With subharmonic modulations, perceptual tension arises with the noncoincidence of common subharmonics. Noncoincidence is measured by an overall as reflected in Figures 8 and 10. We call this its (stationary) subharmonic tension.

This is given by the difference between the largest and smallest subharmonics in the chord that coincides around .where and denote the largest and the smallest subharmonics in the chord that (nearly) coincides around (mathematically, they are the maximum and minimum values of , resp.).

and are the primary features of stationary tension. may be normalized by expressing it like a duty cycle by takingFrom Figure 3 in the section on interharmonic modulation, recall that dissonances increased and decreased with interharmonic modulation frequency while consonances behaved inversely. This happens only within a certain range. When interharmonic modulation frequency shrinks to the brink of zero, it falls below musical significance.

Subharmonic tension behaves similarly. Figure 11 describes different types of harmony on the subharmonic tension scale. As can be seen in the figure, our response to subharmonic tension is likewise. Perceived dissonances increase and decrease with subharmonic tension while perceived consonances behave inversely within common range. Mathematically,where is the harmonious effect of chord X and is its stationary subharmonic tension (its ).

Figure 11

Alt text
The effect of harmony, , on the scale of subharmonic tension, .

However, as described in the figure, modulations from subharmonic tension fall below musical significance; the effect of harmony drops to zero as modulations from subharmonic tension fall below musical significance. Hence, where is the said threshold of musical significance, as ,Thus, perceptual tensions and consonances are experienced in slew-like modulations of the waveform at common subharmonic locations. (This is the effect of periodically changing phase relationships amongst the contributing waveforms, for which is a measure.) While there may be several common subharmonics for every chord within reasonable range, we theorize that our ears identify most with the shortest few. Subharmonic consonances are described by gentler modulations (small ) at the shortest common subharmonic locations (short ), while subharmonic dissonances are described by more turbulent ones (associated with absence of small at short ).

The sensation of a chord can be highly complex, with different tensions and consonances perceived simultaneously, an experience inadequately represented by a single term for dissonance. Attempting to rate every chord by its dissonance level alone can be compared to rating every variety of chocolate in a candy store by only how sweet or bitter it is. The advantage of , as opposed to existing correlates of harmony [3, 13, 43, 54], is the way it explains abstract notions of perceptual tensions and consonances by ascribing them to regions across the subharmonic spectrum with a strong sense of attribution or identification. While, for purpose of illustration, Figures 9 and 10 have shown examples where a modal (shortest with smallest ) is easiest to identify, we theorize complex chords with ambiguous (where it is difficult to attribute the collection of modulations experienced to a single modal); our ears often identify with several common subharmonics simultaneously. In other words indeterminate cases could possibly arise with particularly discordant harmonies without small at short . Thus, for programmatic analysis of a large number of chords, it is, nevertheless, useful to have a single term to represent the overall dissonance of each chord. For this, we usewhere a single term, , represents the overall subharmonic tension, and refer to individual candidates of and with iterating through each candidate pair, is the preemphasis (while serves as “post de-emphasis”), and denotes summing over the smallest values out of a range of values considered. In our work, is always chosen to be half of unless stated otherwise. Note that here serves as a weighting factor to weight down higher subharmonics, which, as aforementioned, are less significant. Inverting before (and rectifying after) summation mimics our hearing by allowing smaller values of to contribute better towards a smaller .

We will see how representative is of stationary harmony in the next section. But before that, we will first explain subharmonic modulations in transitional harmony.

4.2. Subharmonic Modulations in Transitional Harmony

While stationary harmony studies chord sonorities (how a chord sounds on its own), transitional harmony deals with chord progressions and resolutions (how chords transit from one to another). It is remarkable how a low tension (consonant) chord can transit to a high tension (dissonant) one yet still bring about the perceptual effect of tension release (resolution) [18]. From this it may be deduced that transitional harmony stands largely independent of stationary harmony, even though both are considered when assigning harmony in composition. Even though numerous studies have been conducted on stationary harmony from the psychoacoustic approach, work on transitional harmony remains primarily nonpsychophysical.

Traditional classical music theory uses the term resolution to describe the perception of tension released when a chord is suitably followed by another chord [18]. With subharmonic modulation, we theorize that these abstract perceptions of tensions released may be identified and quantified in the perceived trajectories of subharmonics as one chord progresses to the next. Figure 12 illustrates this.

Figure 12

Alt text
Subharmonic plot of the opening line of Beethoven’s Moonlight Sonata with period in milliseconds on the vertical axis and time in bars in the horizontal axis. Subharmonics are colored to match their corresponding notes on the music score. Names of relevant notes are marked out on the left, at values corresponding to their wave period. The region of each transition is numbered in white. Colored arrows follow voice leading along the notes across chord changes.

Figure 12 shows the opening line of Beethoven’s Moonlight Sonata [71]. Before we begin our analysis, one should note that unlike Pachelbel’s Cannon the use of arpeggios (broken chords) means that notes contributing to the harmony may not necessarily start at the same time, but, when the sustain pedal on the piano is applied, they sustain and overlap until the end of each bar. The names of the chords formed by the notes are labelled along the top of the score to aid the reader in this analysis. Another thing to note would be the fact that this piece maintains a strong sense of voice leading [72], which means that each note from a chord has strong progressive associations with a note from the previous and another from the succeeding chord. The subharmonics of all notes that are associated in this way (i.e., of the same voicing) across the song are coded with the same color to aid the reader in this analysis. For example, all notes in red on the music score represent the bass (lowest) notes throughout the song, and every subharmonic of these notes is portrayed in red.

We theorize that in chord transitions every subharmonic ( ) that (nearly) coincides around the common subharmonic ( ) of a succeeding chord is perceived to transit from the nearest corresponding (i.e., of the same voicing) subharmonics in the preceding chord. These transitions are marked out by the arrows in Figure 12, which are colored according to the notes they are associated with. Arrows are usually convergent (with the exception of, for example, a basic triad progressing onto an extended chord of the same root) because the subharmonics of the succeeding chord always identify with a common subharmonic whereas those of the preceding chord usually do not.

The central hypothesis of transitional subharmonic theory is that perceptual tension resolution, which is so often described in traditional music theory but never physically identified in acoustics, lies in the degree of convergence seen here.

Assuming transition to be abrupt (since notes do not commonly glide from one pitch to another in music) we compute a for the succeeding common subharmonic and a for its preceding corresponding subharmonics and simply measure this degree of convergence as the difference between the two. As such,where refers to the of the succeeding chord and refers to the defined by its nearest preceding subharmonics.

This can be normalized by dividing by such thatwhere denotes normalized and refers to that of its succeeding chord.

is, thus, a quantification of the tension; is released over the transition at the wave period of the succeeding common subharmonic.

According to our theory, tension resolution is perceived in the release of this tension across each transition. Thus, mathematically,where denotes the perceptual resolving effect of tension release and denotes the across the transition of chord to chord .

Since resolution (tension release) [18, 42] in harmony progression is perceived in the convergence of , what we will refer to as complication (build-up of tension or negative resolution) is seen in its divergence, where and is negative.

Three possibilities arise when looking at and from this perspective, by which we can divide transitional harmony into three classes. As illustrated in Figure 13, these are as follows.

(1)

Resolution, also called tension release: this is the most common occurrence and occurs with the convergence of (i.e., ) and a positive . The larger the , the larger the perceptual tension release.

(2)

Complication, also called tension buildup: this is the least common occurrence and occurs with the divergence of (i.e., ) and a negative . Just as negative aesthetics may be used expressively in a painting, it may similarly be used in music [73]. The larger the magnitude of , the larger the perceptual tension buildup. Complications usually only occur when the preceding is equal or nearly equal to the succeeding . Musically speaking, it usually occurs when a simpler chord is followed by a more complex chord of the same root.

(3)

Excursion: Because of the circular nature of the musical chroma, the preceding and the succeeding may be computed to differ by up to 6 semitones in either direction. When the difference is 1 or 2 semitones, this corresponds to a neighboring note, and the collective (uplifting or detrimental) effect of melodic movement (i.e., melody) across each note of the chord can overpower the effect of harmony. In such cases, our ears are persuaded to identify with of the nearest preceding . When this happens, and move in the same direction; hence, neither convergence nor divergence is perceived. There are 2 such cases as follows.

(a)

Escalation: this occurs when each shortens simultaneously, shortens by a factor equivalent to 1 or 2 semitones ( to times), and rises, producing the uplifting effect of melodies rising by 1 or 2 semitones.

(b)

Descent: this occurs when each lengthens simultaneously, lengthens by a factor equivalent to 1 or 2 semitones ( to times), and falls, producing the detrimental effect of melodies falling by 1 or 2 semitones.

Figure 13

Alt text
Trajectories of in different states of tension development (states of convergence).

It is fascinating to note how the perceptual development (build-up and resolution) of tension that is so often described in music [18, 42] but never identifiable with an acoustic attribute may here be visualized in the convergence and divergence of common subharmonics. Figure 13 further illustrates how trajectories reflect the development of tension build-up and release. Additionally, trajectories for excursions are illustrated in the same figure.

Returning to Figure 12, the transitions between each chord are labeled 1 to 7 in the figure and correspond to 1 to 7 as follows.

(1)

The song starts off with a C#m chord. Hence, the common subharmonic is observed around a wave period of c#. Our ears adhere especially to the shortest one, which is at . Large is attributed to the complex tensions within a minor chord. At the region marked 1, this transits to a C#m/B chord. The tension built up with the divergence of may be visualized in the divergence of the arrows in the figure (of which the dotted ones across the plot are used to indicate the continuation of subharmonics, i.e., that do not change). Both perceptually in music and acoustically, as defined above, this translates to a further complication to the existing minor tension.

(2)

At region 2, there is a convergence to a momentary (half-bar) low-tension A chord. The uplifting effect of a large tension release, , is counterbalanced by the detrimental effect of a falling melodic sequence (lengthening ), adding to the complexity of the song.

(3)

At region 3, A transits to a D/F#, which is a Neapolitan chord. The low f# bass extends over 2 octaves below the treble notes, putting a strong at a nonroot period of and creating an amount of stationary tension that is unusual for a major chord. (In such cases, there is usually another common subharmonic with lower but at a wave period corresponding to a root at a much larger .)

(4)

At region 4, the Neapolitan chord resolves to the Dominant 7th, marked G#7 in the figure, with a large perceptual resolution that is signature to II6-V7 transitions in music [42]. This large tension release is visualized as a large convergence in the subharmonic plot as indicated by the arrows.

(5)

Musically, the Dominant 7th typically plays the role of building an anticipation for the upcoming return to the Tonic [42]. Beethoven enhanced this function particularly well with a double suspension with staggered resolutions in regions 5a through 5c. The subharmonic plot gives tangibility to the perceptual details with suspension-resolution long theorized about in music that can now be affirmed with visualization.

(a)

At region 5a, the transition from the G#7 progresses to what is labeled C#m. However, this C#m is functionally still a G# with a double suspension of the 3rd (b#) to a 4th (c#) and the 5th (d#) to a 6th ( ), respectively. The perceptual complication that arises with this transition can be visualized in the subharmonic plot as indicated by the divergence of the green and cyan arrows, respectively. The deviation of the suspended notes from the primary triad is visualized as a deviation of their from .

(b)

At region 5b, the tension resolution with the 6th being resolved back down to the 5th can be visualized in the subharmonic plot by its resolving back to as indicated by the convergent cyan arrow. The continuation of the suspended 4th is visualized in the dotted green arrow.

(c)

At region 5c, the tension resolution with the 4th being resolved back down to the 3rd can be visualized in the subharmonic plot by its resolving back to as indicated by the solid green arrow. In preparation for a major resolution back to the upcoming tonic, Beethoven’s touch of genius combines this resolution with a simultaneous complication in the introduction of the 7th at this point. This is visualized in the deviation of its away from as indicated by the divergent solid yellow arrow.

(6)

At region 6, the Dominant 7th is resolved back to the Tonic with a tension release unique to V7-tonic cadences that is so immense that it is has been long established as the de facto cadence for the end of musical passages [42]. This immense perceptual release of tension, too, is identifiable in the subharmonic plot. From the figure, it may be seen that the common subharmonic, , of C#m (located at the period of this time, because of the in purple) lies right in the middle of two common subharmonics of G#7 (located at the periods and ). This unique subharmonic behavior allows our ears to quite possibly identify with both for the preceding making significantly larger than its . Its staggering convergence produces an immense sense of tension resolution with this transition.

(7)

A final landmark that is interesting to note is at region 7, where the triad in the treble flips from the 1st inversion to the 2nd inversion while the chord remains unchanged. Notice that this brings about no change to both and while . This, again, shows how subharmonic analysis agrees with music theory where, despite the change of notes, harmony remains the same at this point.

In this section, we have seen how, even in the context of transitional harmony, perceptual tensions and resolutions in a song may be visualized in its subharmonic modulation. We will move on to see how well numerical values computed with such modulations verify against listening tests and chord use statistics.

5. Experiment and Results

For both stationary and transitional harmony, tensions computed from our models show strong correlations with consonance rankings and historical chord use statistics. Table 1 tabulates a summary of the results of our experiment.

Table 1

Summary of correlations with consonance rankings and historical chord use.
Alt text

We will explain each of these results in detail in the following subsections.

5.1. Stationary Harmony

For stationary harmony, we take the overall tension of a chord to be a simple weighted sum of and where is overall tension, and are taken to represent the tensions contributed by interharmonic and subharmonic modulations, respectively (normalized by linearly scaling to fit between 0 and 1), and and are their weights, or summing coefficients respectively, where and 0.61 and 0.39 are found to provide a good distribution.

We use a simple estimate of , takingwhere and are a tally of interharmonic modulations (given by (10)). By visual inspection of the interharmonic plot, regions of dissonance are defined by and for and and for .

For , we use , where is given by (21) preemphasized with across a range of . (A preemphasis of just over 2 provided the sufficient discrimination without driving data into saturation. A broad range of -values are suitable but we settled on a smaller value of 5 for computational simplicity.)

Numerous previous authors have performed notable work for stationary harmony both within and outside the psychophysical context [8, 12, 13, 18, 2125, 43, 53, 6264]. For dyads (intervals, or two-note chords) and triads (three-note chords), we the use precollated information in Tables 2–5 from Stolzenburg [43] for comparison. Dyads (intervals) are compared against the results of an average across 7 notable studies collated by Schwartz et al. [54] on a ranking of 12 chords. Stolzenburg adds the unison to Schwartz’s list, which he reasonably assumes to be the most consonant, hence, we have appropriately included it as well. Triads are compared to results from an experiment by Johnson-Laird, Kang, and Leong [13] as cited in Stolzenburg [43]. For consistency with Stolzenburg’s statistics in the comparison, these were first converted to ordinal rankings before computing the correlation as practised by Stolzenburg [43]. Table 2 lists our correlations for dyads and triads in stationary harmony against known relevant work as taken from Stolzenburg’s [43]. A detailed tabulation of all available values for each chord is provided in the appendix.

Table 2

Proposed and existing correlates of stationary harmony.
Alt text

5.2. Transitional Harmony

For transitional harmony, from (22) is suitable for hand-computation of transitional harmony across individual locations of succeeding common subharmonics, , across the soundscape. While this is advantageous for visualizing individual complications and resolutions at multiple locations across the tensional soundscape, it requires manual identification of a modal for every transition which can be ambiguous for particularly discordant harmonies. For a consistent programmatic approach with larger datasets, we take the measure of overall of a transition defined by where is representative of overall tension resolved, , , and refer to individual candidates of , , and , respectively, is the range of nodes considered, iterates through all relevant common subharmonics of the succeeding chord, denotes the distance between two adjacent , denotes summing across all values of wherever is less than half the distance between the adjacent on either side, is the number of nodes summed, and is the preemphasis as explained with (21).

This effectively computes the preemphasized, weighted, and compensated mean across all eligible common subharmonics within a range of for a given transition. weights down larger subharmonics which are less significant according to the theory. (It is a reciprocal as opposed to (21) because greater pleasure is associated with larger tension released.) compensates for the fact that, apart from tension resolution alone, stationary consonance also affects one’s preference for the succeeding chord. effectively sets the criterion for a node to be considered a common subharmonic. In our experiments, we set . (A broad range of will work, but we choose a smaller value for computational simplicity. Larger values may be required with larger range or dataset size.) In consideration of divergent transitions in the dataset, we set (no preemphasis) because divergent transitions have negative which can be distorted by preemphasis.

With transitional harmony, conducting an accurate listening test is less straightforward. Rather than attempting to acquire a small number of fresh unproven opinions, it is reasonable to use statistics from a large number of well-esteemed premade decisions. A simple way to measure how well numerical values of subharmonic transition agree with the music theorists’ school is to compare them with statistics of an expert music theorist’s chord use. Capturing chord-use statistics from music score is again, however, a labor-intensive process requiring domain expertise [46, 47, 74]. Details such as melody-harmony discrimination, transition onset, and root ambiguity (e.g., Dm7/F versus F6) are often not precisely defined in a song. We find the largest relevant data readily available that also meets chord-spelling precision requirements in Tymoczko’s Study on the Origins of Harmonic Tonality [45]. In this study, Tymoczko interpreted and recorded the statistics of 11,000 chord transitions from Palestrina’s [75] corpus. Palestrina was highly regarded for his style of harmony by Helmholtz himself [76]. He is widely considered amongst music theorists to be the pinnacle of contrapuntal harmony [77].

Table 3 lists against frequencies of occurrence for each of the 17 most frequently used chords that follow V as read-off Tymoczko [45]’s chord tendency histogram. C, D, X , and X indicate the convergence type of the progression. Just intonation was used as being opposed to equal temperament in this case to be consistent with Palestrina.

Table 3

Tabulation of for chords that most commonly follow V against Palestrina’s chord tendencies as cited in [45].
Alt text

Their correlations are listed in Table 4. shows a significantly strong positive correlation of 0.903 with Palestrina’s chord tendencies in general. It is close to perfect at 0.996 for resolutions since the programmatic version of the model was designed with resolutions in mind. Complications may be interpreted as the negative release of tension. Even though a large number of contributing are negative, only one negative can be seen in the table due to the influence of nonnegative candidates. Nevertheless, shows a strong negative correlation of -0.761 with [45] for complications (agreeing with the fact that this resolution is negative). As earlier explained, with excursions the perception of a succeeding chord is also influenced by the rising or falling of parallel melodies. Unfortunately, descending excursions were insufficiently popular in Palestrina and only V-IV was being tallied. For escalating excursions, however, we have enough statistics to compute a correlation of 0.863. We have also computed the correlation across all other chords separately from complications (because, as explained, they correlate negatively) to be 0.970.

Table 4

Tabulation of correlations between and Palestrina’s chord use statistics as collated in [45]. Correlations are listed in the top row with corresponding significance in brackets below.
Alt text

6. Discussion

Addressing the Fundamental Questions of Psychoacoustic Harmony. At this point, let us address the fundamental questions of psychoacoustic harmony as promised at the start of this paper in the context of subharmonic modulations. We will begin with question 2 and leave the first question for the last.

(2)

We discussed the definition and explanation of stationary harmony, i.e., what sounds good and why, or, mathematically, to quantify , where denotes the harmonious effect of and represents chord .

With large subharmonic tension being perceived as dissonance while small subharmonic modulations are perceived as consonance, the aesthetics of a chord may be visualized in the subharmonic tension acting on its shortest common subharmonics. Mathematically, they are inversely related. As described by (19), .

(3)

We have the definition and explanation of transitional harmony, i.e., what sounds good, why, and when, or, mathematically, to quantify , where ‘ ’ denotes transition from one chord to another.

The aesthetics of a chord transition may be visualized in the release of subharmonic tension at the shortest common subharmonics of the succeeding chord. As explained in (22) and indicated by the arrows in Figure 12, this refers to the transition to the shortest common subharmonics of the succeeding chord from the nearest subharmonics of the preceding chord. Thus, resolution (tension release) in a chord transition is perceived in the convergence of (where ) while what we call complication (build-up of tension or negative resolution) is seen in its divergence (where ). Mathematically, as described by (24), .

(4)

We have the following phenomena.

(a)

A chord that sounds better than another out of context can sound worse than being in context [42]. Given this shows that

The section on subharmonic modulations differentiates between stationary tension and transitional tension. The tension release brought about by a transition to a chord may be large even for high tension succeeding chords. To prove this, we will use an example with , , and . Taking , , and , the stationary subharmonic tension for and may be computed by (18) to be and , respectively. Thus, , whereas the transitional subharmonic resolution (tension resolution) for and may be computed by (22) to be and , respectively. Thus, despite the fact that .

(b)

A chord that sounds better than another in one context can sound worse than being in another context [42]. Given this shows that

With reference to (22) and our answer in question 3, since our ears identify the subharmonics of preceding notes that correspond to the succeeding common subharmonic, transitional harmony is contextual. Continuing from our answer to question 4 , we take to be . The transitional subharmonic resolution (tension resolution) for and may be computed by (22) to be and , respectively. Thus, despite the fact that .

(5)

phenomenon that the transition from a low-tension chord to a high-tension one can still bring about the effect of tension release (resolution). Given this shows that .

The answer to this is in the independence of stationary and transitional tension, as established in our answer to Question 4 .

Taking and , the transitional subharmonic resolution (tension resolution) for may be computed by (22) to be . The stationary subharmonic tension for and may be computed by (18) to be and , respectively. Hence, despite the fact that .

(6)

There is the phenomenon that the effect of harmony is greater than the sum of its parts [18, 60].

Apart from certain exceptions with rational intonation and octaves, the stationary tension of any combination of unique notes is observed to be larger than zero on the subharmonic plot. Hence, . Likewise, the stationary tension of each note on its own is observed to be zero on the subharmonic plot. Hence, , , and for all , , and within musical range. Thus, by (19), , whereas by (20) , , , and . Therefore, .

7. Conclusion

In this paper the notion of interharmonic and subharmonic modulations was proposed as a psychophysical basis for both stationary and transitional harmony.

In the domain of stationary harmony (tension in chord sonorities), this work presents subharmonic modulations as an integral complement to interharmonic modulations and shows how perceptual tensions [18, 36, 58, 59] and consonances [17, 19, 44] may be visualized through which.

In the domain of transitional harmony (resolution in chord progression), it unlocks the means of physically identifying, quantizing, and, thus, verifying perceptual resolutions and complications [18, 42] in acoustic features that have until now remained abstract and nontangible.

This work can be seen to bind prevailing psychoacoustic schools into a single theory. The Helmholtz school [3, 8, 1217, 19, 20, 23] is represented by the interharmonic in (11). The Pythagorean school [5, 6, 11] generally seeks small values of integer in (15) and (16) while requiring to be zero. Taking this further, if is ignored, in (15) would then correspond to the fusion tone in Stumpf’s tonal fusion theory [3, 30]. Euler’s gradus suavitatis [11] graded the goodness of -combinations for . The adoption of 12-tone equal temperament [12, 33, 34] sought to evenly distribute interharmonic in (11). Since the aforementioned conditions may be generalized by a central theory of modulations across adjacent (interharmonic) and distant (subharmonic) sinusoids which stems from (3), this effectively integrates them into a general theory.

Computed values correlate strongly with perception and harmony-use statistics for both stationary (tension) and transitional (resolution) harmony.

Finally, this paper presented a psychoacoustic solution to the five fundamental questions of harmony.

Conflicts of Interest

The authors declare no conflicts of financial interest.

Acknowledgments

Paul would like to thank Dr. Nancy Chen for lengthy initial discussions on the manner of approach of this cross-disciplinary topic towards nonmusical readers; A/Prof. Eng Siong Chng for his tireless mentorship and motivation, as well as his review on the writing style of this paper; Prof. Dmitri Tymoczko for his kind correspondence over details of his work cited here; and Dawn Chan without whom this work would have been completed earlier, but the journey towards its completion would have had been far less meaningful.

Supplementary Materials

Supplementary 1. Supplementary Figure S1: Sinusoidal Summation across 8 Amplitude Ratios. for various values of B normalized to A=1.

Supplementary 2. Supplementary Table S1: Correlation for Intervals. There is tabulation of ordinal ranking of dyads (intervals) using against available rankings collated in [43].

Supplementary 3. Supplementary Table S2: Correlation for Triads. There is tabulation of ordinal ranking of triads using against available rankings collated in [43].

Supplementary 4. Supplementary Audio S1: Low-Frequency Modulation. There is audio example of consonant low-frequency modulation with and .

Supplementary 5. Supplementary Audio S2: Beating Frequency. There is audio example of dissonant high-frequency modulation with and .

Supplementary 6. Supplementary Video S1: Low versus High Subharmonic Tension. There is video example comparing subharmonic wave deformation in low tension C chord against high tension Cm7 chord.

Supplementary 7. Supplementary Video S2: Stationary Tensions in Pachelbel’s Canon. We visualize stationary harmony with subharmonic tension in Pachelbel’s Canon [70].

Supplementary 8. Supplementary Video S3: Transitional Tensions in Moonlight Sonata. We visualize transitional harmony with subharmonic tension in Beethoven’s Moonlight Sonata [71].

References

  1. J. P. Rameau, Treatise on Harmony, Courier Corporation, 1722.
  2. P. Hindemith, The Craft of Musical Composition: Theoretical Part, vol. 1, Schott Co Ltd, 1970.
  3. N. McLachlan, D. Marco, M. Light, and S. Wilson, “Consonance and pitch,” Journal of Experimental Psychology: General, vol. 142, no. 4, pp. 1142–1158, 2013. View at Publisher · View at Scopus · View at Google Scholar
  4. J. Sauveur, Principes d'acoustique et de musique: ou, Système général des intervalles des sons, Editions Minkoff, 1701.
  5. K. J. Hsü and A. J. Hsü, “Fractal geometry of music,” Proceedings of the National Academy of Sciences, vol. 87, no. 3, pp. 938–941, 1990. View at Google Scholar
  6. B. V. Rivera, “Theory Ruled by Practice: Zarlino's Reversal of the Classical System of Proportions,” Indiana Theory Review, vol. 16, pp. 145–170, 1995. View at Google Scholar
  7. G. Pont, “Philosophy and Science of Music in Ancient Greece,” Nexus Network Journal, vol. 6, no. 1, pp. 17–29, 2004. View at Publisher · View at Google Scholar
  8. H. v. Helmholtz, On the Sensations of Tone as a Physiological Basis for the Theory of Music, Longmans, Green, 1912.
  9. E. Wellesz and J. A. Westrup, Ancient and Oriental Music, vol. 1, Oxford University Press, 1957.
  10. J. M. Barbour, Tuning and Temperament: A Historical Survey, Courier Corporation, 2004.
  11. A. Gräf, “On musical scale rationalization,” in Proceedings of the International Computer Music Conference, ICMC 2006, pp. 91–98, USA, November 2006. View at Scopus
  12. R. Plomp and W. J. Levelt, “Tonal Consonance and Critical Bandwidth,” The Journal of the Acoustical Society of America, vol. 38, no. 4, pp. 548–560, 1965. View at Publisher · View at Google Scholar
  13. P. N. Johnson-Laird, O. E. Kang, and Y. C. Leong, “On musical dissonance,” Music Perception, vol. 30, no. 1, pp. 19–35, 2012. View at Publisher · View at Scopus · View at Google Scholar
  14. D. L. Bowling and D. Purves, “A biological rationale for musical consonance,” Proceedings of the National Acadamy of Sciences of the United States of America, vol. 112, no. 36, pp. 11155–11160, 2015. View at Publisher · View at Scopus · View at Google Scholar
  15. H. E. White and D. H. White, Physics and Music: The Science of Musical Sound, Courier Corporation, 2014.
  16. G. Dillon, “Calculating the dissonance of a chord according to Helmholtz theory,” The European Physical Journal Plus, vol. 128, no. 8, Article 90, 2013. View at Scopus · View at Google Scholar
  17. I. S. Lots and L. Stone, “Perception of musical consonance and dissonance: An outcome of neural synchronization,” Journal of the Royal Society Interface, vol. 5, no. 29, pp. 1429–1434, 2008. View at Publisher · View at Scopus · View at Google Scholar
  18. N. D. Cook and T. X. Fujisawa, The Psychophysics of Harmony Perception: Harmony Is a Three-Tone Phenomenon, 2006.
  19. Y. I. Fishman, I. O. Volkov, M. D. Noh et al., “Consonance and dissonance of musical chords: Neural correlates in auditory cortex of monkeys and humans,” Journal of Neurophysiology, vol. 86, no. 6, pp. 2761–2788, 2001. View at Publisher · View at Scopus · View at Google Scholar
  20. E. Zwicker and H. Fastl, Psycho-Acoustics: Facts and Models, Springer, Berlin, Germany, 2nd edition, 1999.
  21. W. A. Sethares, “Local consonance and the relationship between timbre and scale,” The Journal of the Acoustical Society of America, vol. 94, no. 3, pp. 1218–1228, 1993. View at Publisher · View at Scopus · View at Google Scholar
  22. R. Parncutt, Harmony: A Psychoacoustical Approach, vol. 19 of Springer Science & Business Media, Springer, Berlin, 1989. View at Publisher · View at MathSciNet · View at Google Scholar
  23. W. Hutchinson and L. Knopoff, “The acoustic component of Western consonance,” Journal of New Music Research, vol. 7, no. 1, pp. 1–29, 1978. View at Google Scholar
  24. A. Kameoka and M. Kuriyagawa, “Consonance Theory Part I: Consonance of Dyads,” The Journal of the Acoustical Society of America, vol. 45, no. 6, pp. 1451–1459, 1969. View at Publisher · View at Scopus · View at Google Scholar
  25. A. Kameoka and M. Kuriyagawa, “Consonance Theory Part II: Consonance of Complex Tones and Its Calculation Method,” The Journal of the Acoustical Society of America, vol. 45, no. 6, pp. 1460–1469, 1969. View at Publisher · View at Scopus · View at Google Scholar
  26. P. Lalitte, “The theories of Helmholtz in the work of Varese,” Contemporary Music Review, vol. 30, no. 5, pp. 327–342, 2011. View at Publisher · View at Scopus · View at Google Scholar
  27. E. G. Schellenberg and S. E. Trehub, “Frequency ratios and the perception of tone patterns,” Psychonomic Bulletin & Review, vol. 1, no. 2, pp. 191–201, 1994. View at Publisher · View at Scopus · View at Google Scholar
  28. K. Itoh, S. Suwazono, and T. Nakada, “Cortical processing of musical consonance: An evoked potential study,” NeuroReport, vol. 14, no. 18, pp. 1061–1069, 2003. View at Publisher · View at Scopus · View at Google Scholar
  29. G. M. Bidelman, “The role of the auditory brainstem in processing musically relevant pitch,” Frontiers in Psychology, vol. 4, no. 264, 2013. View at Scopus · View at Google Scholar
  30. C. Stumpf, “Konsonanz und dissonanz [Consonance and dissonance],” Beiträge zur Akustik und Musikwissenschaft, vol. 1, pp. 1–108, 1898. View at Google Scholar
  31. W. S. B. Woolhouse, Essay on Musical Intervals, Harmonics, and The Temperament of The Musical Scale, 1835.
  32. D. D. Nolte, Galileo Unbound: A Path Across Life, the Universe and Everything, Oxford University Press, 2018. View at Scopus
  33. H. L. Goodman and Y. E. Lien, “A Third Century AD Chinese System of Di-Flute Temperament: Matching Ancient Pitch-Standards and Confronting Modal Practice,” The Galpin Society Journal, pp. 3–24, 2009. View at Google Scholar
  34. G. J. Cho, The Discovery of Musical Equal Temperament in China and Europe in The Sixteenth Century, vol. 93, Edwin Mellen Press, 2003.
  35. T. Christensen and J. P. Rameau, “Eighteenth-century science and the" corps sonore:" the scientific background to rameau's" principle of harmony,” Journal of Music Theory, vol. 31, no. 1, pp. 23–50, 1987. View at Publisher · View at Google Scholar
  36. E. Bigand, R. Parncutt, and F. Lerdahl, “Perception of musical tension in short chord sequences: The influence of harmonic function, sensory dissonance, horizontal motion, and musical training,” Perception & Psychophysics, vol. 58, no. 1, pp. 125–141, 1996. View at Publisher · View at Scopus · View at Google Scholar
  37. P. F. Broman, C. Geertz, and O. Neurath, Music Theory Art, Science, or What? What Kind of Theory Is Music Theory? 17 (2007).
  38. E. Bigand and B. Poulin-Charronnat, “Are we "experienced listeners"? A review of the musical capacities that do not depend on formal musical training,” Cognition, vol. 100, no. 1, pp. 100–130, 2006. View at Publisher · View at Scopus · View at Google Scholar
  39. T. M. Fiore, Music and mathematics (2007). Recuperado de: http://www-personal.umd.umich.edu/~tmfiore/1/musictotal.pdf.
  40. R. Parncutt, “Revision of Terhardt's psychoacoustical model of the root (s) of a musical chord. Music Perception,” An Interdisciplinary Journal, vol. 6, no. 1, pp. 65–93, 1988. View at Google Scholar
  41. R. Scruton, The Aesthetics of Music, Oxford University Press, 1999.
  42. P. I. Tchaikovsky, Guide to The Practical Study of Harmony, Courier Corporation, (1872/2005).
  43. F. Stolzenburg, “Harmony perception by periodicity detection,” Journal of Mathematics and Music, vol. 9, no. 3, pp. 215–238, 2015. View at Publisher · View at Google Scholar
  44. L. Hofmann-Engl, “Consonance/DissonanceA historical Perspective,” in Proceedings of the 11th International Conference on Music Perception and Cognition, pp. 852–856, 2010.
  45. D. Tymoczko, A Study on the Origins of Harmonic Tonality. Paper delivered to the national meeting of the Society for Music Theory, Indianapolis, Indiana, USA, 2014.
  46. D. Tymoczko, A Geometry of Music: Harmony and Counterpoint in The Extended Common Practice, Oxford University Press, 2010. View at MathSciNet
  47. D. Tymoczko, “Scale theory, serial theory and voice leading,” Music Analysis, vol. 27, no. 1, pp. 1–49, 2008. View at Publisher · View at Google Scholar
  48. A. Honingh and R. Bod, “In search of universal properties of musical scales,” Journal of New Music Research, vol. 40, no. 1, pp. 81–89, 2011. View at Publisher · View at Scopus · View at Google Scholar
  49. G. J. Balzano, “What are musical pitch and timbre?” Music Perception: An Interdisciplinary Journal, vol. 3, no. 3, pp. 297–314, 1986. View at Publisher · View at Scopus · View at Google Scholar
  50. G. J. Balzano, “The pitch set as a level of description for studying musical pitch perception,” in Music, Mind, and Brain, pp. 321–351, Springer, Boston, MA, USA, 1982. View at Google Scholar
  51. N. Carey and D. Clampitt, “Aspects of well-formed scales,” Music Theory Spectrum, vol. 11, no. 2, pp. 187–206, 1989. View at Publisher · View at Scopus · View at Google Scholar
  52. D. Purves, Music as Biology, Harvard University Press, 2017.
  53. K. Z. Gill and D. Purves, “A biological rationale for musical scales,” PLoS ONE, vol. 4, no. 12, Article ID e8144, 2009. View at Publisher · View at Scopus · View at Google Scholar
  54. D. A. Schwartz, C. Q. Howe, and D. Purves, “The statistical structure of human speech sounds predicts musical universals,” The Journal of Neuroscience, vol. 23, no. 18, pp. 7160–7168, 2003. View at Publisher · View at Scopus · View at Google Scholar
  55. G. Langner, M. Sams, P. Heil, and H. Schulze, “Frequency and periodicity are represented in orthogonal maps in the human auditory cortex: Evidence from magnetoencephalography,” Journal of Comparative Physiology - A Sensory, Neural, and Behavioral Physiology, vol. 181, no. 6, pp. 665–676, 1997. View at Publisher · View at Scopus · View at Google Scholar
  56. G. Langner and C. E. Schreiner, “Periodicity coding in the inferior colliculus of the cat. I. Neuronal mechanisms,” Journal of Neurophysiology, vol. 60, no. 6, pp. 1799–1822, 1988. View at Publisher · View at Scopus · View at Google Scholar
  57. T. Houtgast, “Subharmonic pitches of a pure tone at low S/N ratio,” The Journal of the Acoustical Society of America, vol. 60, no. 2, pp. 405–409, 1976. View at Publisher · View at Google Scholar
  58. M. M. Farbood, “A parametric, temporal model of musical tension,” Music Perception, vol. 29, no. 4, pp. 387–428, 2012. View at Publisher · View at Scopus · View at Google Scholar
  59. C. K. Madsen and W. E. Fredrickson, “The experience of musical tension: a replication of nielsen's research using the continuous response digital interface,” Journal of Music Therapy, vol. 30, no. 1, pp. 46–63, 1993. View at Publisher · View at Scopus · View at Google Scholar
  60. E. Terhardt, G. Stoll, and M. Seewann, “Algorithm for extraction of pitch and pitch salience from complex tonal signals,” The Journal of the Acoustical Society of America, vol. 71, no. 3, pp. 679–688, 1982. View at Publisher · View at Scopus · View at Google Scholar
  61. S. Drake, “Renaissance music and experimental science,” Journal of the History of Ideas, pp. 483–500, 1970. View at Google Scholar
  62. F. Stolzenburg, “Harmony perception by periodicity and granularity detection,” Cambouropolos, pp. 958-959, 2012. View at Google Scholar
  63. M. Ebeling, “Neuronal periodicity detection as a basis for the perception of consonance: A mathematical model of tonal fusion,” The Journal of the Acoustical Society of America, vol. 124, no. 4, pp. 2320–2329, 2008. View at Publisher · View at Google Scholar
  64. L. J. Hofmann-Engl, Virtual Pitch and The Classification of Chords in Minor and Major Keys, 2008.
  65. S. Ternström, “Physical and acoustic factors that interact with the singer to produce the choral sound,” Journal of Voice, vol. 5, no. 2, pp. 128–143, 1991. View at Publisher · View at Google Scholar
  66. D. Temperley and D. Tan, “Emotional connotations of diatonic modes,” Music Perception, vol. 30, no. 3, pp. 237–257, 2013. View at Publisher · View at Scopus · View at Google Scholar
  67. E. C. Bairstow, Counterpoint and harmony, Read Books Ltd, 2013.
  68. M. J. Tramo, “Music of the hemispheres,” Science, vol. 291, no. 5501, pp. 54–56, 2001. View at Publisher · View at Scopus · View at Google Scholar
  69. D. Harrison, Harmonic Function in Chromatic Music: A Renewed Dualist Theory and An Account of Its Precedents, University of Chicago Press, 1994.
  70. J. Pachelbel, Canon And Gigue for 3 Violins and Basso Continuo, 1680-1706.
  71. L. v. Beethoven, Piano Sonata No. 14 in C minor, “Quasi una fantasia”, Op. 27, No. 2 (1801).
  72. E. Aldwell and A. Cadwallader, Harmony and voice leading, Cengage Learning, 2018.
  73. M. Guernsey, “The Role of Consonance and Dissonance in Music,” The American Journal of Psychology, vol. 40, no. 2, pp. 173–204, 1928. View at Publisher · View at Google Scholar
  74. D. Tymoczko, “The Geometry of Musical Chords,” Science, vol. 313, no. 5783, pp. 72–74, 2006. View at Publisher · View at Google Scholar
  75. M. Farbood and B. Schöner, “Analysis and Synthesis of Palestrina-Style Counterpoint Using Markov Chains,” in Proceedings of the ICMC, 2001.
  76. J. Kursell, “A Third Note: Helmholtz, Palestrina, and the Early History of Musicology,” Isis, vol. 106, no. 2, pp. 353–366, 2015. View at Publisher · View at Google Scholar
  77. C. Marvin, Giovanni Pierluigi da Palestrina: A Research Guide, Routledge, 2013.

Copyright © 2019 Paul Yaozhu Chan et al. Exclusive Licensee Science and Technology Review Publishing House. Distributed under a Creative Commons Attribution License (CC BY 4.0).

  • Views 363
  • Citations 0
Altmetric Attention Score
Find out more