Headless Chrome isn't why your web agent gets blocked — fingerprints are

Share
Headless Chrome isn't why your web agent gets blocked — fingerprints are

Your agent's model is fine. Its browser disguise is what's blowing your scraping runs — and a maintainer of an open-source automation library has the test numbers to show it.

The most useful agent engineering post of the day didn't come from a lab or a vendor — it came from a Reddit thread by thalissonvs, maintainer of Pydoll, an MIT-licensed Python library that drives Chromium directly over the Chrome DevTools Protocol with no WebDriver layer. His claim: web agents don't get blocked because the model is weak or because headless mode is detectable. They get blocked because their browser fingerprint is incoherent. He tested it with live bot-score checks: plain headless Chrome scored 100 out of 100 — maximum bot. The same run with a fingerprint profile matched to the host machine dropped to 15, indistinguishable from a normal user's browser.

The failure mode that should make every agent builder wince: a mismatched profile scores worse than no spoofing at all. A Windows profile running on his Mac scored 57 — because one signal that contradicts all the others is itself the tell. Detection engines like CreepJS and commercial bot managers don't check whether your User-Agent looks human; they check whether a dozen signals agree, and disagreement is what flags you.

There's a hard limit worth stating plainly: none of this touches the network layer. Your TLS handshake and egress IP stay exactly what they are, so this is identity coherence for the browser layer only — which is why the advice is to match the profile to the machine you actually run on instead of faking everything. Pydoll's own documentation is blunt about it: an inconsistent fingerprint is more detectable than an unmodified browser.

Why it matters: browser-use agents are shipping everywhere right now, and most teams debug blocks by swapping models, adding retries, or rotating proxies — when the actual defect sits in the browser identity layer nobody instrumented. The fix is architectural, not expensive: coherent profile, matched to hardware, applied before first navigation.

Our take: treat this as infrastructure knowledge, not scraping tricks. Every team running production browsing agents will need fingerprint-coherence work within the year — and the counter-pressure from detection vendors is about to get interesting.

What to watch: whether major bot-detection vendors start scoring cross-layer coherence explicitly (some already do), and whether agent frameworks bake fingerprint matching in as a default rather than leaving it to each developer.

If your web agent keeps getting blocked despite a frontier model behind it — is the browser layer the first place you'd look now? Tell us in the comments.

Sources: Pydoll on GitHub

Read more

Kling 4.0 goes live with 30-second native video at 10-bit HDR

Kling 4.0 goes live with 30-second native video at 10-bit HDR

Kuaishou's Kling AI has spent two years becoming the video model people actually finish projects with. Its new flagship, Kling 4.0, went fully live on October 15 — and this round is less about prettier frames than about the two things that make a generated shot usable in a real edit: length and control. Kling 4.0 generates up to 30 seconds in a single native pass, outputs 10-bit HDR at 4K, 1080p and 21:9, and takes up to 15 reference assets in one task. That budget splits across ten images, fi

Brain organoids classified Braille at 83% — in a trio, not alone

Brain organoids classified Braille at 83% — in a trio, not alone

Two stories today: human brain tissue on a chip decoded a tactile signal, and the data-centre company behind some of the largest AI contracts in Europe turns out to be six months behind on its flagship site. Human forebrain organoids grown on a microelectrode array classified Braille letters with 61 percent accuracy on their own and 83 percent when the responses of three organoids were combined, in a peer-reviewed study from the University of Bristol. The team took event-based tactile readings

Suleyman says Microsoft's base model beat OpenAI's on a quarter compute

Suleyman says Microsoft's base model beat OpenAI's on a quarter compute

Microsoft finished pre-training its biggest in-house model yet — then used it to make a point about the company it bankrolls. Microsoft AI completed pre-training of MAI-Base-2, a mixture-of-experts foundation model with 80 billion active and 2.8 trillion total parameters, and says the recipe is 4.2–12.3x more pre-training FLOPs-efficient than DeepSeek-V4-Pro-Base. The run itself is the number worth keeping: 16,000 Nvidia GB200 GPUs for 38 days across August and September, at 21% average model

Amazon's new Bee devices listen all day — for $11.99 a month

Amazon's new Bee devices listen all day — for $11.99 a month

Amazon turned its always-listening Bee line into a two-device family on Thursday, and NVIDIA opened a 2.8-trillion-token Indic corpus recipe. The connecting thread: both are bets that the next AI money is in memory — yours, or your model's. Amazon put two new always-listening devices on sale, and both now lead to a subscription. Bee Frontier, the next-generation wristband that also clips to clothing, ships now at $74.99 in Onyx, Lavender and Sage — up from the $50 predecessor — with seven-day