Chips & Hardware

Gimlet Labs raises $300M to break inference out of the single-chip box

The Arena

Gimlet Labs raises $300M to break inference out of the single-chip box

Two things worth your attention tonight: a $3 billion bet that the future of inference is heterogeneous rather than Nvidia-shaped, and a slipped timetable that pushes Anthropic's IPO marketing past the point where an election can move the market. Gimlet Labs raised $300 million at a $3 billion valuation to build what it calls the industry's first multi-silicon inference cloud, with Andreessen Horowitz leading the round.

AI 101 — What is speculative decoding?

The Stack

AI 101 — What is speculative decoding?

If you've ever wondered why an LLM feels slow to type out long answers — or why Nvidia's engineers spent a September 2026 blog post telling model designers how many attention groups to use — the answer is a technique called speculative decoding. Speculative decoding is an inference speedup where a small, fast "draft" model guesses several upcoming tokens, and the big target model verifies them all in a single pass instead of generating one token at a time.

Jane Street commits $13 billion to Crusoe for GPUs

The Arena

Jane Street commits $13 billion to Crusoe for GPUs

The trading firm's second enormous compute deal in a month, plus a forecasting model that beats everything and can't be used commercially. Jane Street signed a five-year cloud contract with Crusoe worth about $13 billion, its second huge GPU commitment in weeks. Bloomberg reported the deal, which gives the trading firm clusters of GPUs and supporting infrastructure for AI training and inference through Crusoe's cloud platform, and Reuters confirmed the report.

Nvidia signs the Hugging Face deal at $12.9 billion

The Arena

Nvidia signs the Hugging Face deal at $12.9 billion

The rumors are over. Nvidia confirmed Thursday that it has a definitive agreement to acquire Hugging Face, the closest thing the open-model world has to a town square — and on the same day, a UAE research institute shipped what it calls the largest fully open model fleet in history, with training data attached. Nvidia has agreed to acquire Hugging Face for $12,930,300,000, ending a week of speculation and putting the chipmaker in ownership of the platform where most of the world's open models…

AI designs, verifies and deploys a chip in two weeks

The Frontier

AI designs, verifies and deploys a chip in two weeks

Two stories pulled today's frontier in opposite directions: an AI system designed a working accelerator from scratch in under two weeks, and Sam Altman said that type of system is now roughly 80% of the way to AGI. Architect Labs says its end-to-end AI system designed, verified and deployed a frontier AI accelerator called Redwood from scratch in under two weeks — with zero human intervention below a spec that two human architects wrote, and no pre-existing accelerator IP.

Broadcom wants to catch shadow AI in the packet path

The Guardrails

Broadcom wants to catch shadow AI in the packet path

Two threads worth pulling as the day closes: the infrastructure layer is quietly claiming the job of policing AI agents, and the enterprise is pushing back on the price of admission for frontier models. Both point the same way — the bottleneck on agentic AI is no longer capability, it's control. Broadcom is moving agent security into the network itself, betting that the place to catch a rogue agent is the traffic it can't avoid generating.