Block's Dessa learned to talk from speech alone — and runs on a laptop

Share
Block's Dessa learned to talk from speech alone — and runs on a laptop

Every voice assistant you have used in the past three years hears you through a text layer: speech recognition, then a language model, then a voice synthesizer. Block's research lab says it built a model that skips all three steps — and that it fits on a laptop.

Block released Dessa on October 23, a full-duplex speech model trained from scratch on human conversation and nothing else — no text, no pretrained weights — that runs locally on a MacBook Pro M4 Max or better. The company published sample conversations and a waitlist, not a paper, a benchmark, or an API. R&D lead Ragavan Thurairatnam called it "a GPT-3 moment for speech" on X. That is a claim, not a result, and it deserves to be read as one.

What Block did publish is more interesting than most voice-model launches, because the design bet is unusual. Instead of bolting emotion onto a text pipeline with style tags — the approach ElevenLabs v4 and Fish Audio's Drama 3 take — Dessa never sees a word written down. It learned prosody, turn-taking and backchanneling from raw audio, which is why the demos have it laughing mid-sentence, dropping a quiet "oh my god" under its breath, or getting louder when the person on the other end asks it to speak up.

What it actually is

Audio in, audio out, full-duplex: it listens while it talks, so it can cut in and interject the way people do rather than waiting politely for a silence. Block says inference runs faster than real time, which is the difference between a conversation and a walkie-talkie. The whole thing was trained on a single NVIDIA GB200 NVL72 rack, according to Block's release post — small by frontier-lab standards, and a deliberate part of the pitch.

The training argument is the part worth taking seriously. Text is cheap and repetitive; speech is not. Say a sentence twice and the waveform still differs, and a single spoken word takes thousands of times more bytes than the same word typed. Speech also carries accents, pauses, breath, sarcasm and hesitation, and every one of those changes what a person means. Block's framing is that the industry has been throwing that signal away at the first step of the pipeline, and that a model trained directly on sound can keep it.

Block also claims Dessa learned language from "hundreds of times fewer words" than a comparable text model, since audio carries far more per token. There is no way to check that from outside: Block has not disclosed parameter count, training data volume, or hours.

The ceiling nobody is advertising

Every fact Dessa knows came from conversation, which means it knows a lot about how people talk and comparatively little about anything else. It cannot search, call a tool, or read a document. That constraint is visible in Block's own demo lineup: the most impressive clip is Dessa talking to GPT-Live-1, OpenAI's voice model, with a disclaimer noting OpenAI is not affiliated and has not reviewed Dessa. Two models, one conversation — the speech-native one providing the human sound, the other presumably providing the knowledge.

So the honest description of Dessa today is a voice, not an assistant. That is a narrower product than "the most authentic full-duplex speech model ever built," and it is also a more defensible one. A model that sounds like a person is useful in a call centre, a drive-through, a language tutor, or a support line even if it cannot answer a question about your account without help.

The commercial logic is not hard to find. Block owns Square, and Square already sells AI voice ordering to restaurants, TechCrunch notes. A voice model that runs on-device, with no per-minute API bill and no audio leaving the merchant's hardware, changes the unit economics of that business. Contrast it with OpenAI's hosted full-duplex model at five cents a minute — OpenAI puts its full-duplex voice model in the API at $0.05 a minute — where at a few thousand calls a day, that meter adds up. Local inference trades the meter for a machine.

The demo problem

Dessa is not available to use. There is a waitlist and an application form aimed at AI safety researchers, who will get early access in small numbers. No weights, no code, no licence, no latency numbers, no accuracy figures, no safety report. Every clip on the site is a curated recording made by the team, and the person in each recording is a Block employee or a colleague.

That is not disqualifying — frontier labs routinely show demos before papers — but it means the adjectives are doing work that evidence has not yet done. The field has a long record of "you cannot tell it from a human" launches that fell apart under blind listening tests, background noise, or a five-minute conversation about something the model did not know. The interesting engineering claim here, speech-only training, is exactly the kind of claim that needs an ablation: how much of the naturalness comes from the data, and how much from the fact that Block chose the good takes.

The second unproven claim is the hardware one. "Runs on a MacBook Pro M4 Max or better" is a strong statement about model size and memory, and it sits awkwardly beside "frontier speech model" — those two facts together imply a very compressed architecture. Block has not said how much memory it takes, how many milliseconds of latency it adds, or what happens to quality when the laptop is also running a browser. Anyone who has tried to run a local speech model on a fanless machine will want those numbers before believing the demo is reproducible.

The risk Block is already naming

A voice that carries emotion and a voice that fakes it are the same technology, and the difference is intent. Commentators on X went straight to the obvious use case — scam calls that no longer sound like scam calls — and CoinDesk framed its coverage around exactly that split between awe and fear. Block's answer is the researcher access programme, which is a tacit acknowledgement that it has shipped something it cannot fully characterise yet.

There is also a subtler issue. Dessa reads emotional state from voice and responds to it. That is a feature in a tutor or a support agent and a manipulation surface everywhere else, and no regulator has written rules for a model that adapts to your mood in real time. The company has said nothing about watermarking or provenance for audio it generates, which is the first question any deployment in payments or customer service will face.

What to watch

Three things would settle this. First, whether the safety access turns into a published evaluation with numbers rather than testimonials. Second, whether Square ships Dessa into voice ordering, which would make it the first speech-only model in production at scale and give outsiders a real workload to measure. Third, whether Block releases weights or an API — a local model nobody can download is a demo, and the entire pitch rests on the model being small enough to hand out.

Until one of those happens, the correct read is that Block has made the most interesting argument in voice AI this month and has not yet shown its work. The argument is worth taking seriously: the text bottleneck is real, and a model that never learned to read is a genuinely different object from one that did.

Would you trust a voice on the phone more or less if you knew it was trained only on speech? Write to us via our contact page.

Get SiliconNoon in your inbox

One email a day with the AI stories that matter — what happened, the numbers, and why it matters. No spam, unsubscribe in one click.

Read more

Anthropic ships Sonnet 5.5 as cyber safeguards move down a tier

Anthropic ships Sonnet 5.5 as cyber safeguards move down a tier

Anthropic's second Claude 5.5 model lands with frontier-class benchmark deltas at a mid-tier price — and the safety machinery that used to sit only on the top model. Meanwhile a chipmaker buys into the financing layer of the AI buildout, and Congress gets its most detailed AI-safety bill yet, with no path to a vote. Anthropic released Claude Sonnet 5.5 on September 28, and the interesting part is not the score — it is that Sonnet 5.5 beats Anthropic's own top model on the hardest agentic…

H company opens Holo4: a 27B agent that drives your desktop

H company opens Holo4: a 27B agent that drives your desktop

Two releases in the same morning frame the agent debate neatly: a small open-weight model that can take over a desktop cheaply, and a safety stack being sold on silicon because the model-level guardrails keep failing. H company released Holo4, a computer-use agent family in two open-weight sizes — 27B dense and 35B-A3B mixture-of-experts — alongside Holo4's weights in BF16, FP8, NVFP4 and 4-bit GGUF formats on Hugging Face.

Grok 4.7 ships at 4.6's price — and a hardened safety stack

Grok 4.7 ships at 4.6's price — and a hardened safety stack

xAI's latest flagship landed this morning with the price left untouched, and New York turned its AI safety law into an operational deadline with dates attached. SpaceXAI released Grok 4.7 today, priced identically to Grok 4.6 at $2 per million input tokens and $6 per million output tokens. The company says the model was built on a larger base and put through longer-horizon reinforcement learning aimed at tasks that take hours rather than minutes, with the gains showing up in self-verification…

Honor ships the first phone with a system-level agent harness

Honor ships the first phone with a system-level agent harness

Two stories from the Chinese AI beat this morning, one about where the agent runs and one about what it can simulate. Honor unveiled MagicOS 11 today with what it calls the industry's first commercially deployed system-level Agent Harness, and the numbers behind it are bigger than the label. Its YOYO assistant now strings together more than 100 steps in a single instruction, with roughly 700 system tools it can call — nearly double the previous set — and more than 500 third-party Skills…

Mostik's bridge puts a 753B model's thinking inside a 4B phone model

Mostik's bridge puts a 753B model's thinking inside a 4B phone model

Two stories from the same frontier: a startup arguing that the next capability jump comes from wiring models together rather than scaling them up, and a Chinese robotics lab arguing that a world model is only useful if it knows what the robot's own actions did. Mostik, a four-month-old startup whose chief scientist is 2010 Fields Medalist Stanislav Smirnov, says it has built a translation layer that lets a 753-billion-parameter GLM-5.2 pass its internal state straight into a…

XPeng ships VLA 630: on-device driving model up 3.5×, 3× faster

XPeng ships VLA 630: on-device driving model up 3.5×, 3× faster

Chinese electric-vehicle maker XPeng is pushing the self-driving model arms race from the datacenter down into the car, announcing a major upgrade to its second-generation visual-language-action (VLA) model that runs entirely on-vehicle. XPeng unveiled the first big update to its second-generation VLA, version 6.3.0 — dubbed the "630" — with the on-device model tripling its parameters and its end-to-end response getting three times faster.

vivo's 3B on-device model tops phone LLM chart, nears cloud scores

vivo's 3B on-device model tops phone LLM chart, nears cloud scores

A SuperCLUE benchmark released Friday found that a small model living entirely on a phone is competitive with the cloud. vivo's BlueLM 3.5 Nano 3B took the top spot on the group's on-device leaderboard with 89.86 points, edging past the field while scoring within a small margin of flagship cloud systems it wasn't even competing against. vivo's on-device BlueLM 3B topped SuperCLUE's phone-LLM chart — and nearly matched the big cloud models.

Attack exposes hidden reasoning traces inside Claude, GPT, Gemini

Attack exposes hidden reasoning traces inside Claude, GPT, Gemini

Two stories frame the day: researchers found a way to pry open the hidden chain-of-thought inside frontier models, and Germany moved to treat Meta's AI glasses the way it treated a spy doll. Researchers from the University of Tübingen, the Max Planck Institute, MATS Research, and security firm Snyk have found a way to extract the hidden reasoning traces of frontier models — and the method turned up the strongest evidence yet that some Chinese open-weight models were trained on US rivals'…