When the Market Gets a Better Backpropagation Engine: Building on Patrick Collison’s Agent Thesis
In a thoughtful note on personal AI agents, Stripe CEO Patrick Collison described the market as a vast, imperfect value-attribution machine—and suggested that personal agents will improve its 'backpropagation' so companies that care deeply about product craft finally feel the wind at their backs. Looking closely at his full text reveals a nuanced vision that already accounts for taste diversity, quality signals, and the signaling value of ad spend. Building on his framework, two complementary questions emerge: how do we build the verification infrastructure that lets disembodied agents perceive real-world craft, and how will great advertising evolve from attention arbitrage into the art of awakening new human desires?
Conversational walkthrough of the core argument
Recently, Stripe CEO Patrick Collison shared a remarkably thoughtful set of reflections on X about how personal AI agents will reshape economic life. Calling corporations "the original superintelligences," he observed that businesses have long deployed their amortized analytical surplus against consumers whose decisions are constrained by what Herbert Simon called "bounded rationality"—our human tendency to be busy, distracted, or under-informed when facing an overpriced insurance upsell at the end of a booking flow. With personal agents acting on the buyer's side, Collison noted, familiar mechanics like coupon hunting and the quiet cross-subsidy where forgetful subscribers fund active users will shift. Most memorably, he described the market as a massive, decentralized, and highly imperfect "value-attribution machine," arguing that personal agents will change the nature of market "backpropagation"—acting as a structural subsidy for product quality so that companies taking pride in their craft finally feel the world tilting in their favor.
Reading Collison’s full note closely, what stands out is how measured and generous his thinking actually is. Far from a simplistic attack on marketing or human judgment, he explicitly acknowledges that advertising spend is not pure deadweight loss because willingness to pay is itself a meaningful market signal, wonders aloud whether agents will drive winner-take-all concentration or unlock long-tail diversity across individual tastes, and flags the foundational question of whether personal agents will truly remain loyal to the consumer. It is one of the clearest frameworks anyone in technology has offered on where commerce is headed.
Taking his "market backpropagation" thesis seriously invites us to push the inquiry one step further along the exact tracks he laid down. If personal agents are going to help the market reward genuine product quality and individual taste, two complementary questions immediately open up: first, how do we build the epistemic infrastructure that allows a software agent to actually perceive product quality in the wild? And second, once agents strip away the shallow "demand routing" of clicking whatever ranks first, what becomes of the honorable art of great advertising and brand storytelling?
Giving the Agent Eyes: The Epistemic Infrastructure of "Quality Signals"
Collison puts his finger on a crucial corollary of his own argument: in an economy where every buyer effectively has ten hours of research behind every purchase, information about product quality becomes vastly more valuable. While humans have limited time to synthesize scattered data, personal agents have a nearly infinite appetite for quality signals—making rich product data a vital complement to cheaper intelligence.
That insight raises a fascinating practical challenge: what kind of quality signals can a machine actually trust? In economics, standardized search goods—like cloud compute, flight routes, or commodity cables—can be verified on a spec sheet before purchase. But most of the products where human craft truly matters are experience goods: a mattress, a wool coat, a chef's knife, or a piece of collaborative software whose real quality only reveals itself after months of daily use. Because an AI agent has no body, it cannot feel the balance of a tool or the texture of a fabric firsthand; left to its own devices on today's internet, an agent researching a purchase is mostly reading text written about the product.
If the "quality signals" feeding our agents consist merely of scraped web reviews and forum threads, merchants will quickly adapt. Just as companies once paid to game search engine rankings, an entire cottage industry of Agent Engine Optimization will spring up to flood the open web with synthetic reviews and structured descriptions designed to flatter the model's rubric. If that happens, the market's backpropagation signal gets noisy again.
For Collison’s vision to work in practice, the complementary data layer he describes cannot just be more text on the open web; it has to be verifiable, skin-in-the-game telemetry. We will need infrastructure that lets personal agents audit provenance at the source—verifying mill certifications and customs filings, running live sandbox benchmarks on software APIs, and reading privacy-preserving aggregates of post-purchase reality across payment networks, such as verified twelve-month durability, actual defect rates, and repeat ownership among real buyers. Even then, we should recognize a healthy boundary: hard telemetry is brilliant at filtering out shoddy manufacturing, while the unquantifiable nuances of proportion, feel, and aesthetic daring will still rely on trusted human curators whose taste our agents learn to weight.
From "Demand Routing" to the Art of Great Advertising
That brings us to the second half of the commercial equation: how brand building and advertising fit into an agent-assisted market. In his post, Collison draws a careful distinction. He critiques the inefficiency of modern internet "demand routing," where platforms monetize fleeting human attention—our habit of clicking whatever sits at the top of the screen—by forcing businesses to pay tolls to shifting ranking algorithms. Yet he immediately adds a nuanced parenthetical: such promotional spend is not entirely deadweight loss, because a firm's willingness to pay is itself a valuable signal of commitment.
That distinction deserves to be expanded, because it separates two things that often get blurred together in tech debates: the mechanics of attention routing on one side, and the substantive power of great advertising on the other. When an airline buries an overpriced insurance toggle at checkout, or when a merchant buys top-of-page placement to catch a tired shopper at midnight, that is friction and attention arbitrage. Letting personal AI agents neutralize those tactics is an unalloyed win for everyone who builds honest products.
Great advertising, however, has never been about tricking a distracted finger into clicking the first link. At this point, a strict utilitarian might still ask: "Even if we set aside search-ranking tolls, why should a rational buyer in an agentic world ever be moved by a brand campaign or a narrative film? Once your agent has ten hours of quality telemetry, shouldn't the story around the product fade to zero?"
Looking at how human beings actually live and choose shows why great advertising is a complement to Collison’s thesis rather than its victim. First, as Collison himself hints when he asks whether agents will help us break out of artificial clustering and match our idiosyncratic tastes, human preferences are not a single one-dimensional leaderboard. In Kant’s account of the mind, determining judgment applies an existing rule to a known category—which is what an agent does when it filters out defective appliances. Reflective judgment, by contrast, is how we form taste, aesthetic affinity, and identity. When an enduring piece of advertising—whether Nike celebrating athletic resolve or a heritage workshop sharing the philosophy behind its craft—resonates with people, it is not exploiting bounded rationality. It is articulating a sensibility and a set of values that help people recognize what their own taste actually is.
Second, for a conscious human being, the meaning and aesthetic world surrounding a product are part of the product's quality. Wearing a watch or a jacket whose design lineage means something to you, or supporting a company that stands for a craft you admire, genuinely changes your lived experience of the object. When Collison speaks of companies that care deeply about their products and take pride in what they make, that pride is communicated not only through tolerances and durability, but through the story, design language, and public commitment the brand puts into the world.
Third, there is a natural division of labor between interpolation and discovery. A personal agent is a master of interpolation: given a desire you already know you have, and a set of preferences you have already formed, it can search the world for ten hours to find the most honest, highest-quality match. Great advertising and cultural storytelling, on the other hand, are instruments of discovery—they awaken desires and possibilities we did not yet know how to ask for. No one instructs an agent to search for a category of art, cuisine, or design they have never encountered; it takes human storytelling and creative presentation to expand the horizon of what we care about in the first place.
A Cleaner Market for Both Craft and Story
Put these pieces together, and Patrick Collison’s optimism about the market's "backpropagation" becomes even more compelling. If personal AI agents remain genuinely aligned with consumers, they will act as a powerful filter against the lowest forms of commercial noise—stripping away checkout traps, neutralizing forgotten-subscription subsidies, and freeing companies from paying endless algorithmic tolls just to be seen at the top of a cluttered feed.
Far from making human persuasion obsolete, clearing away that transactional clutter will raise the bar for both halves of commerce. On the engineering and operations side, companies will have to compete on verifiable product integrity that can survive a ten-hour audit by a discerning agent. And on the human side, instead of pouring budgets into gaming ranking algorithms, brands will be freed to invest in the kind of honest, imaginative advertising that speaks to human taste, identity, and aspiration. When agents handle the friction, both true craftsmanship and great storytelling will find the wind at their backs.
Follow the next link in this sequence to trace how the bottleneck of knowledge retreats inward in the age of generative AI:
What Counts as a "Good" US–China Relationship?
CONTINUE EXPLORING
Related Essays in This Domain
What Counts as a "Good" US–China Relationship?
In a recent conversation with a senior Washington policy advisor about the earlier extension of the trade truce, one fundamental question emerged: when a once-and-for-all comprehensive deal to settle every dispute is hard to achieve in practice, what does success actually look like? Treating recurring pauses as reality does not mean friction itself is a virtue. What truly preserves the baseline are two sober realizations: a clear awareness of mutual cost, and the tangible construction of institutional guardrails and summit diplomacy—positive signs that affirm the resolve to compete instead of decouple.
A Good Society Gives People Both Roots and Wings
China and the United States emphasize different foundations for human flourishing. A good society should give ordinary people both the roots to stand securely and the wings to choose their own lives.
Folded Humans and the Machine Nation: Re-thinking the Threat and the Posture of Openness
The advantage of democracy is self-correction, but correction is not development itself. While we point at external adversaries to divert our attention, the real threat to Western survival is quietly spreading on our own streets.
One essay a week on law, AI, and judgment.
Bilingual essays, audio podcasts, and new book chapters straight to your inbox.
READER SALON & MARGINALIA