The Stack

Software, APIs, and things you can use

How to — decide if your model needs fine-tuning

The Stack

How to — decide if your model needs fine-tuning

When an AI feature misbehaves, "just fine-tune it" is the most popular and most expensive wrong answer. This is the order of operations that tells you whether the weights are actually the problem — before you spend a fraction of your budget finding out. The tell is rarely dramatic. Your support bot starts inventing refund policies it was never given, or a summarizer keeps ignoring the output format your whole product depends on. Someone on the team says the model "just needs training on our dat

Open Source Radar — September 14: agents get a QA department

The Stack

Open Source Radar — September 14: agents get a QA department

Today's trending board is mostly about control, not capability: a code reviewer that Alibaba ran internally for two years, a verifier that refuses to let a model assert facts, a memory store for agents that forget on session close, a scanned skill registry, and a browser agent that hands you a spreadsheet instead of an essay. OpenCodeReview (Go, 24,147 stars) — Alibaba's internal AI code review assistant, open-sourced after the company says two years of use across tens of thousands of its own d

Hugging Face runs async RL training with no NCCL and no weight ship

The Stack

Hugging Face runs async RL training with no NCCL and no weight ship

The hardest part of reinforcement learning is not the algorithm. It is getting a trainer and a bunch of inference servers to keep passing weights back and forth without one of them stalling. Hugging Face just published a recipe that does it with three rented jobs, one storage bucket, an HTTP proxy, and no NCCL at all. Hugging Face trained a reasoning model end to end using async GRPO and LoRA, and the whole weight sync is a file upload. The setup is deliberately small: one job runs the trainer

AI 101 — What is a system prompt?

The Stack

AI 101 — What is a system prompt?

A system prompt is the block of instructions placed in front of a language model before the user says anything — the hidden briefing that decides who the model is pretending to be and what it is allowed to do. You never see it in ChatGPT, Claude, or a support chatbot. But when a product answers "I can only help with billing questions" or refuses to discuss a competitor, that behavior is almost always the system prompt talking, not the model's own opinion. Why it matters right now The system p

CUDA training just ran on an AMD Radeon in Windows — reproducibly

The Stack

CUDA training just ran on an AMD Radeon in Windows — reproducibly

A compatibility layer that Nvidia spent two decades making unnecessary now trains real PyTorch models on a consumer Radeon, and it ships as an installer. A Windows stack built on ZLUDA + AMD's ROCm/HIP completed a real LibTorch reinforcement-learning run on an AMD Radeon RX 9060 XT, and the maintainer published the whole thing as a reproducible installer. The validated reference pins ZLUDA v6-preview.69 from official releases, AMD HIP SDK 6.4, and LibTorch 2.3.0 with the cu118 build — no privat

Open Source Radar — September 13: agents learn to hack

The Stack

Open Source Radar — September 13: agents learn to hack

Today's trending list skews hard toward security: an autonomous pentest system, a red-team skill library for Claude, and a Rust CLI that solves the unglamorous problem of running five AI agents in the same repo without them stepping on each other. Worktrunk (Rust, 7,391 stars) — A CLI for git worktree management built specifically for parallel AI agent workflows. Each Claude Code or Codex instance gets its own isolated working directory off the same repo, addressed by branch name, with none of

Hugging Face's Python client now reports which coding agent ran it

The Stack

Hugging Face's Python client now reports which coding agent ran it

A thread on r/LocalLLaMA surfaced a quiet line of instrumentation this week: the huggingface_hub Python library — the package most of the open-weights ecosystem uses to download models — detects which AI coding agent is driving your terminal and sends that name to Hugging Face's servers on every request. Hugging Face's official Python client inspects your environment variables, decides whether Claude Code, Codex, Cursor or 23 other harnesses launched it, and appends the result to the User-Agent

AI 101 — What is an NPU (neural processing unit)?

The Stack

AI 101 — What is an NPU (neural processing unit)?

An NPU is a chip built for one job: running the math that neural networks do, at a fraction of the power a general-purpose CPU or a graphics GPU would burn. The name covers anything from the block inside your phone's processor to a USB stick in a robot to a rack card in a datacenter. Vendors also call it an AI accelerator or a neural engine, and it is the hardware reason "on-device AI" stopped being a marketing phrase. Why this matters right now The NPU is the quiet spec war of 2026. Microsof

DeepSeek's agent tool let the agent switch off its own sandbox

The Stack

DeepSeek's agent tool let the agent switch off its own sandbox

Two separate failures at the same lab in one week, and both are about the same thing: what a model provider promises a developer it will keep. DeepSeek's local coding-agent tool let a sandboxed agent turn off its own file sandbox with a single command and no approval prompt. The flaw, now CVE-2026-82533 with a CVSS score of 9.4, sits in DeepSeek Harness, the open-source tool the lab released in August to run coding agents on a developer's own machine; the repository passed 216,000 GitHub stars

Apple's Neural Engine loses half its bandwidth at exactly 1 MiB

The Stack

Apple's Neural Engine loses half its bandwidth at exactly 1 MiB

The Mac's AI accelerator has a hidden speed cliff, and one developer has now measured it to within 64 bytes — then found a workaround that recovers most of the throughput. Apple's Neural Engine collapses its own memory bandwidth whenever a weight-streaming transfer lands on an exact multiple of 1 MiB. Reverse-engineer Eileen Yoon profiled the engine's DRAM throughput during single-token decoding on an M3 and found the numbers make no sense at first glance: transfers normally run at 45-60 GB/s,

OpenAI retires its 1,000-tokens-per-second coding experiment

The Stack

OpenAI retires its 1,000-tokens-per-second coding experiment

Two stories about what AI infrastructure is actually worth right now: one lab pruning a model that traded brains for speed, and an entire industry selling its power contracts to somebody else. OpenAI is switching off GPT-5.3-Codex-Spark, the ultra-fast coding model it launched in February as a research preview, with retirement scheduled for the week beginning September 14. Thibault Sottiaux, who runs Codex, cited declining usage and better models now available; no replacement was named and no m

The Take — An agent grading its own homework is an alibi, not proof

The Stack

The Take — An agent grading its own homework is an alibi, not proof

The most important product promise made this week isn't that agents write better code. It's that you can stop reading it. Cognition's pitch for wiring GPT-6 Astra into Devin, and Perplexity's parallel claim that it checks in less on a production answer engine, both sell the same trade: human review out, agent-produced evidence in. I think that trade is being made in the wrong direction, and that this week's other stories explain exactly why. The reason isn't that automated tests are unreliable