Agent Optimization: The SEO Discipline Nobody Is Practicing Yet

WebMCP flips robots.txt on its head. Sites that declare structured functions for agents early may win a new kind of visibility contest, but only for the...

5 min read

For thirty years, the web's core machine-facing contract has been robots.txt, a file whose entire vocabulary is refusal. Don't crawl this. Stay out of that. The default posture toward automated visitors has been defensive.

WebMCP inverts that posture. Instead of telling machines what they can't touch, a site declares navigator.modelContext with structured functions that agents can call directly. The message changes from "keep out" to "here is exactly how to interact with me properly."

The inversion matters more than the spec itself.

How agents reach the web today

AI agents currently interact with websites through three flawed channels:

  • Scraping. Brittle by design. A layout change breaks the integration, and nobody is notified.
  • Reverse-engineered APIs. A legal gray zone that terms-of-service teams and courts are still arguing about.
  • Browser automation. Slow, resource-heavy, and detectable, which means sites actively fight it.

None of these is a contract. WebMCP proposes an actual contract: the site publishes callable functions, the agent calls them, and both sides know the terms.

A ranking war, with a caveat

When search engines became the front door to the web, an entire discipline emerged around being findable. SEO grew out of the competitive dynamics search created, not the crawler spec itself.

WebMCP could set up similar dynamics for a different audience, but the analogy has a limit worth stating up front. Search engines route open-ended discovery: a user types a vague query and the engine decides which sites surface. Agents, much of the time, execute specific delegated intent. When someone says "book my Delta flight," the agent is not shopping around, and no amount of callable-function polish on a competitor's site changes that.

The competitive dynamics apply to the other slice of agent traffic: requests where the user has left the vendor choice open. "Find me the cheapest flight to Denver." "Order more of the coffee I like from wherever has it in stock." For that slice, whichever site an agent can reliably transact with holds a structural advantage, and that slice is where an SEO-like contest could emerge.

Call it Agent Optimization. The early playbook, for the flexible-intent case, looks something like:

  • Declare functions for your core actions. Booking, purchasing, querying, filing. When the user has given the agent latitude to choose a vendor, a site that completes the task through a declared function is easier to select than one that has to be scraped.
  • Make function signatures legible. Clear parameters and predictable errors are the new page speed. An agent that fails on your endpoint will most often surface an error to its user rather than silently trying rivals, but repeated failures still teach both the agent's developers and its user that your site is unreliable.
  • Ship early, even behind incomplete coverage. SEO rewarded early adopters disproportionately because they accumulated authority while competitors deliberated. There is a plausible case the same first-mover dynamic applies here, though it depends on how fast agent traffic actually grows and how much of it carries flexible intent.

The inversion of who optimizes for whom

SEO trained the web to optimize for an intermediary, the search engine, in hopes of reaching humans. Agent Optimization changes the intermediary's role. The agent is an executor acting with delegated authority to book, buy, or fetch, within whatever constraints the human set. It does not gatekeep, and it does not decide whether to show you to a customer.

That changes what "conversion" means. A human funnel tolerates friction because persuasion happens along the way. An agent funnel does not persuade and cannot be persuaded. If the user named your brand, friction does not send the agent to a competitor; it produces a failed task and a user who hears that your site could not complete their request. If the user left the choice open, friction quietly removes you from consideration. Either outcome is worse than the human equivalent, because there is no hero image, no retargeting, and no second impression.

Current status

  • WebMCP is emerging through the W3C standards process. Emerging, not finished.
  • A Chrome implementation reportedly exists behind a flag as of early 2026. Behind a flag means experimental, not shipped.
  • Firefox and Safari have not committed, as far as public signals show. Browser vendor politics have killed cleaner specs than this one.
  • Major SaaS adoption has not happened yet. One possible sequence is browser implementation first, then framework support, then SaaS providers, but that ordering is speculative and each step is a real gate, not a formality.

So the honest claim: the strategic logic of a callable web is sound for the portion of agent traffic that carries flexible intent, one major browser is experimenting, and the cost of preparing early is low relative to the cost of scrambling late. WebMCP itself has won nothing yet.

What to do if you run a site or a product

  • Inventory the actions on your site that an agent would plausibly want to perform on a user's behalf, and note which of them tend to arrive with a named brand versus an open-ended request.
  • Watch the WebMCP spec and the Chrome flag. Implementation effort is small compared to a search ranking overhaul.
  • If you build agents, plan for a hybrid world where some sites expose functions and most still require scraping or automation. That world will last years.

The web spent three decades optimizing for human attention. The next contest may be about machine callability, at least for the traffic where humans delegate the choosing, and unlike the last one, nobody has a fifteen-year head start yet.