Open Source Radar — November 5: A 2.78T Model on a Laptop CPU

Share
Open Source Radar — November 5: A 2.78T Model on a Laptop CPU

Today's trending list is about plumbing rather than demos: the tools that make coding agents act like a team, keep a 2.78-trillion-parameter model off the GPU, and hand an agent data it can actually trust. Four worth a look, none of them repeat coverage from this week.

gstack (TypeScript, about 139,000 stars) is Garry Tan's own Claude Code setup, published as MIT-licensed Markdown — 23 tools that reassign the agent into roles with names you'd recognise from a real org chart: a CEO that reconsiders the product, an engineering manager that locks the architecture, a designer whose job is catching AI slop, a reviewer hunting production bugs, QA that drives a real browser, and a release engineer that ships the PR. The author is the president and CEO of Y Combinator, and the repo is now the fastest-growing thing in the daily trending list by a wide margin. The interesting part isn't the prompts, it's the division of labour: instead of one enormous instruction file, each role gets a narrow brief and a handoff, which is how you stop an agent from trying to do design review and release management in the same breath. Forking it costs nothing but a clone, and it needs Bun on the machine.


kimi-k3-in-c (C99, about 10,600 stars) runs Kimi K3 — 2.78 trillion parameters, a 1.56 TB checkpoint — on one CPU, with no BLAS, no framework and no GPU. The whole engine is 176 KB of portable C, and peak memory measured 8.24 GB on an ordinary 8 GB laptop. Read the latency before you get excited: that same laptop produces one token every 26.5 seconds, because the entire model streams off disk on each step; a 128 GB workstation holding the weights in memory gets down to 5.6 seconds per token, with byte-identical output. Nobody is replacing an API key with this. What it does prove is how much of the "you need a data centre" story is really a memory-bandwidth story — MoE routing plus 4-bit weights means you touch a fraction of the model per token, and one person wrote that down in readable C.


Auto Ontology (Python, about 6,100 stars) is NVIDIA's Apache-licensed context layer for agents that query databases. The pitch is aimed at the failure everyone hits: an agent can retrieve a document and write SQL, but a revenue figure answered quickly is worthless if the definition of revenue was wrong. Auto Ontology builds a semantic graph from enterprise metadata, reconciles conflicting metric definitions across systems, checks generated queries against certified definitions and lineage, and serves the result to any agent harness over MCP, a CLI or an API, with provenance returned alongside each answer. Natural-language questions run against Postgres through NVIDIA NIM, and it ships a web UI plus Helm and Docker deploys. One caveat: NVIDIA says the repo is not accepting external contributions.


Horizon (Python, about 12,800 stars) is a self-hosted news radar that behaves like a small newsroom rather than an RSS reader. It pulls RSS, Hacker News, Reddit, Telegram, X, GitHub and financial feeds, scores every item against a rubric you define per "profile" — tech news gets impact and community discussion, engineering blogs get background and practical takeaways — merges duplicate stories, and caps each category so one busy topic can't crowd out the rest. Output is a daily briefing in English or Chinese, delivered as Markdown, a Pages site, email or a webhook, and the pipeline is also callable stage by stage over MCP so another agent can drive it. If you have ever built a folder of feeds and stopped reading it after a week, this is the missing filter.

If you've tried one of these on real work — especially gstack's role split — tell us whether the handoffs held. Write to us via our contact page.

Get SiliconNoon in your inbox

One email a day with the AI stories that matter — what happened, the numbers, and why it matters. No spam, unsubscribe in one click.

Read more

Open Source Radar — November 3: GLM-5.2 on a laptop

Open Source Radar — November 3: GLM-5.2 on a laptop

Today's trending board has one theme: shrinking the machine AI needs. A C engine that streams a 744B model off your SSD, a tool that strips refusals out of a model in under an hour, desktop control that skips screenshots entirely, and a git wrapper built for running ten coding agents at once. colibri (C, 46,865 stars) runs mixture-of-experts models far bigger than your RAM by keeping the always-on parts resident and reading the rest of the experts from disk as each token needs them.

Open Source Radar — November 2: 290B models on a desktop GPU

Open Source Radar — November 2: 290B models on a desktop GPU

Today's board is about putting big models on hardware you already own — one serving engine for gaming PCs, one foundation model for stock charts, and one security operations center that runs without a single API key. FreeToken (Python, 15,691 stars, Apache-2.0) is an inference engine built for the opposite of a datacenter: it runs frontier-scale mixture-of-experts models — 290B parameters and up — on a gaming PC by treating your GPU, CPU and system memory as one elastic pool, according to its…

Open Source Radar — October 30: OpenMausBot, an Open Grok Bot

Open Source Radar — October 30: OpenMausBot, an Open Grok Bot

Today's board keeps circling one question: what if your coding agent had coworkers? Two projects answer with a desktop app that hands every bot its own computer; a third gives a single session the org chart of a game studio. OpenMausBot (TypeScript, 7,848 stars, Apache-2.0) is the open-source answer to xAI's Grok Bot — a chat app where each contact in the sidebar is a real agent, Claude or Codex running under the hood, with its own personality, its own model, its own sandboxed computer and…

Open Source Radar — October 27: Agent Skills Get a Security Scanner

Open Source Radar — October 27: Agent Skills Get a Security Scanner

Four projects on today's board sit on the same layer — the skills that tell a coding agent how to behave, how to look and what it may read. The layer now has a supply chain, and someone is finally scanning it. andrej-karpathy-skills (MIT, ~225,000 stars, 22,486 forks) — A single CLAUDE.md file, and one of the most-starred repos on GitHub, built from Andrej Karpathy's public complaints about coding models: they make assumptions and run with them, they overcomplicate into a thousand lines where…

Open Source Radar — October 25: AWS MCP Toolkit Goes Official

Open Source Radar — October 25: AWS MCP Toolkit Goes Official

Today's board is vendor plumbing and agent taste: AWS put its own MCP servers and agent plugins in a public repo, a design skill with 32,000 stars shipped a version that screenshots your real product, and a Chinese-built desktop agent open-sourced its client. agent-toolkit-for-aws (Python, ~3,250 stars, Apache 2.0) — AWS's official, AWS-supported repo of MCP servers, skills and plugins, and the smart part is that it targets the agents you already run instead of asking you to switch tools…