Block’s New Hyperrealistic Dessa Voice AI Learned From Human Speech Alone


TL;DR

  • Speech Training: Block unveiled Dessa, a voice AI it says learned to converse from human speech without text or pretrained models.
  • Conversation Limits: Selected demos combine expressive voices with mistakes, including continued guesses after the model is told it has won.
  • Existing Alternatives: Kyutai’s Moshi and NVIDIA’s PersonaPlex already listen and speak simultaneously, using language models trained on text.
  • Research Access: Block is inviting a small group of AI safety researchers; Dessa is not publicly available.

Block has unveiled Dessa, a voice AI model it says learned from human speech alone to hold conversations that include interruptions, laughter and changes in tone. The company is inviting AI safety researchers to try the model through a small early-access program.

The new AI model comes from a research lab inside Block, the company behind Square and Cash App. Ragavan Thurairatnam leads the lab, which reports directly to Block cofounder Jack Dorsey. Its model and the lab share the Dessa name.

Learning the Rhythm of Conversation

Dessa takes in audio and produces audio. Block says it trained the model solely on human conversations, without text or a pretrained model supplying an existing language foundation.

Dessa is full-duplex, meaning it can keep listening while it speaks. That lets a conversation include overlapping speech and brief acknowledgments before the other person finishes. The lab says Dessa chooses its own words, timing, voice and personality in the recordings it published.

The company describes laughter midway through a person’s sentence and a voice that grows louder when asked to speak up. Those changes in delivery are part of what the team wants Dessa to learn directly from sound, alongside the words themselves.

Natural Speech, Uneven Answers

Thurairatnam also claims Dessa acquired world knowledge and learned to reason from audio. In a guessing-game recording he shared, a Block intern asks Dessa to identify everyday objects. 

Dessa also might mistake its conversation partner for someone named Ronaldo as reported by The Verge. In another clip, a discussion of Christopher Nolan’s films veers into Bryan Singer’s Superman films.