Research

Prosody · 2 min read

Same sentence, only the melody changes

In a question, the voice rises at the end. And the end of the sentence is where generated voices fail most.

In Portuguese, a yes or no question can use the same words as a statement. "Tá tudo certo." (All good.) and "Tá tudo certo?" (All good?) differ only in melody, the pitch contour across the sentence. In the readings below, the statement rises in the middle and falls at the end; the question stays almost flat and jumps up on the last syllable.

The end of the sentence

The end of a sentence carries much of its meaning: a statement falls and fades, a question rises, and human voices often finish in creak (vocal fry). We compared the pitch of each generated sentence with a human reading of the same sentence, aligned in time, looking at the last second on its own. The generated voice has a narrower melody (7.4 vs 10.0 semitones), creaks less at the end (21% vs 33%) and, when it goes wrong, tends to end higher, as if the sentence were not over. Listen to the pairs.

Next postSame note, three sounds

Read next

  1. Acoustics · 2 min read

    Same note, three sounds

    Three sounds with the same 220 Hz note. What makes each one sound different is timbre.Read
  2. Acoustics · 2 min read

    Inside the sound

    The same speech seen as an image: time across, frequency up, energy as color.Read
  3. Acoustics · 2 min read

    Sound as numbers

    Before any model, a voice is a list of numbers. Take a close look.Read