The Frontier

Xiaomi open-sources CocktailASR-1 to pick one voice out of a crowd

Editorial

Editorial

— 2 min read
Share
Xiaomi open-sources CocktailASR-1 to pick one voice out of a crowd

Xiaomi just gave away one of the harder pieces of the voice stack. On September 11 the company released and open-sourced Xiaomi-CocktailASR-1, an end-to-end speech recognition model built to solve the cocktail party problem — transcribing one specific person's speech from an audio mix where several people are talking over each other, without a separation stage in front of the model.

The design is unusually direct. You feed the model a short reference clip of the target speaker (one to four seconds) alongside the mixed audio, and it treats the clip as a voiceprint prompt: it transcribes only that person and ignores the rest, rather than first splitting the audio into separate speaker tracks the way classical pipelines do. It is built on an LLM-based architecture, and it keeps two abilities that earlier target-speaker models traded away — single-speaker accuracy comparable to mainstream ASR models (no model switching when the crowd leaves the room) and negative sample rejection, meaning it outputs empty text when the target speaker is absent instead of hallucinating a transcript from the wrong voice. A chain-of-thought mode can also expose its reasoning — speaker count, gender, voiceprint similarity — before committing to the transcript.

The numbers back the claim. On LibriSpeechMix 2mix, the target-speaker word error rate drops from 5.40% for the previous state of the art to 2.90% — a 46% relative reduction — and on LibriMix 2mix it improves from 4.84% to 4.11%. The report is blunt about the competition: top-tier ASR models like Qwen3-ASR-1.7B and StepAudio2 cannot handle overlapping speakers at all, scoring word error rates between 60% and 160% on highly overlapping synthetic sets, while Gemini 2.5 Pro manages 30% to 80% but lacks specialized training for noisy, real-world acoustics.

Why this matters beyond the benchmark table. Smart speakers, wearables, and meeting recorders all live in multi-person environments, and false triggers are the failure users actually notice — the device transcribing a conversation it was never meant to hear. A rejection mechanism baked into the model weights (no extra threshold to tune at inference) is the kind of unglamorous reliability work consumer voice products have needed for a decade. It also follows the open-source pattern that has defined Chinese consumer-AI players this year: ship the weights, let the ecosystem build on them, and set the reference implementation. Worth noting the scale of the training corpus behind it — roughly 600,000 hours of single-speaker TS-ASR data plus dedicated negative-sample sets — which is not something most labs can replicate casually.

What to watch: whether Xiaomi follows up with on-device variants for its phones and wearables, and whether the rejection capability gets adopted as a standard eval for voice agents.

If you build voice products, does baked-in speaker targeting change your stack — or is Whisper-style general transcription still good enough? Tell us in the comments.

Read more

Houmo moves compute inside memory — and A20 enters production

Houmo moves compute inside memory — and A20 enters production

Beijing chipmaker Houmo used its partner conference this week to lay out two compute-in-memory routes at once — and to say the first chip built on the newer one is already in production. Houmo's A20, its first chip built on a 3D compute-in-memory architecture, has entered production. The part supports up to 16 chips fully interconnected, claims a 50% improvement in compute utilization over the previous generation, and covers models from 3B to 30B parameters, according to co-founder and product

Kling 4.0 goes live with 30-second native video at 10-bit HDR

Kling 4.0 goes live with 30-second native video at 10-bit HDR

Kuaishou's Kling AI has spent two years becoming the video model people actually finish projects with. Its new flagship, Kling 4.0, went fully live on October 15 — and this round is less about prettier frames than about the two things that make a generated shot usable in a real edit: length and control. Kling 4.0 generates up to 30 seconds in a single native pass, outputs 10-bit HDR at 4K, 1080p and 21:9, and takes up to 15 reference assets in one task. That budget splits across ten images, fi

Brain organoids classified Braille at 83% — in a trio, not alone

Brain organoids classified Braille at 83% — in a trio, not alone

Two stories today: human brain tissue on a chip decoded a tactile signal, and the data-centre company behind some of the largest AI contracts in Europe turns out to be six months behind on its flagship site. Human forebrain organoids grown on a microelectrode array classified Braille letters with 61 percent accuracy on their own and 83 percent when the responses of three organoids were combined, in a peer-reviewed study from the University of Bristol. The team took event-based tactile readings

Suleyman says Microsoft's base model beat OpenAI's on a quarter compute

Suleyman says Microsoft's base model beat OpenAI's on a quarter compute

Microsoft finished pre-training its biggest in-house model yet — then used it to make a point about the company it bankrolls. Microsoft AI completed pre-training of MAI-Base-2, a mixture-of-experts foundation model with 80 billion active and 2.8 trillion total parameters, and says the recipe is 4.2–12.3x more pre-training FLOPs-efficient than DeepSeek-V4-Pro-Base. The run itself is the number worth keeping: 16,000 Nvidia GB200 GPUs for 38 days across August and September, at 21% average model