How To Brief An AI SEO Agency Properly
What Honest Reporting Contains The prompt set, versioned and unchanged since last month. The raw answers, kept in full rather than summarised. Which competitors were named. Which sources were cited. What work was done. What moved, and the specific claim about which work caused it.
Assume the pitch is good. Everyone's pitch is good, and the vocabulary in this field is easy enough that a competent salesperson can hold a convincing conversation without anyone behind them who can do the work.
Screenshots of favourable answers with no run count, which say nothing about how many attempts produced them. Impressions or traffic from unrelated channels included to fill a report. And activity described in the language of effort, such as ongoing optimisation, with no countable output attached.
A reasonable definition: after two quarters, no increase in mentions on buying intent prompts, no improvement in the accuracy of how you are described, and no new citations from the sources your category's answers are built on. If all three are flat, the work is not landing.
One reframing helps when presenting this internally. Report the channel as influence rather than acquisition. Acquisition framing invites a comparison against paid media on cost per lead, which this channel will lose on the reported numbers even where it is working, because most of its effect never appears as a referral. Influence framing invites the right question, which is whether more of your market arrives already knowing who you are.
Fair Reasons for Flat Results Not every flat quarter is a failure, and being unfair about this loses good suppliers. A saturated category takes longer. A site that needed substantial technical work will have spent the first months on it. Earned coverage depends on other organisations publishing, which nobody can schedule.
One final practical check costs nothing. Ask for a client reference in a category structurally similar to yours rather than a famous name, and when you speak to them ask what the agency got wrong rather than what went well. References are chosen to be positive, so the useful information is in how candidly they describe the difficult parts.
Before leaving, make sure you take the prompt set, the baseline archive and everything published. If those were not yours under the contract, that is a lesson for the next agreement rather than something to negotiate at the exit.
One check is worth running independently once a quarter, without telling anyone. Take ten prompts from the agreed set, run them yourself in a signed out session, and compare what you find against the most recent report. Broad agreement is reassuring. A consistent gap in the agency's favour is the single most informative finding available to you, and it is not something a report will ever surface.
The Signals That Mean Something Four things are hard to fake and worth watching closely. Your own pages beginning to appear in cited sources, which is directly observable in any assistant that shows citations.
This is where the two disciplines meet. Work done to make pages quotable for assistants tends to help here as well, because the underlying problem is the same. A model is looking for a passage it can lift and attribute.
They will not quote statistics without sources, and they will not present a tool's sampled estimate as a count of what happened. If none of these boundaries come up unprompted, ask directly and listen for whether the answer sounds rehearsed or considered.
One section most briefs omit is worth adding: what has already been tried and what happened. Agencies frequently propose work that was done two years ago and abandoned, because nobody told them. Listing previous efforts, including the ones that failed, saves a month and signals that you will be a straightforward client to work with.
Watch the quality of enquiries as well as the count. A common early signal is that conversations start further along, with the prospect already aware of your price band, your typical timeline and what you do not do, because a machine told them before they arrived. That shows up in sales cycle length and in fewer wasted calls long before it shows up in any dashboard.
Be wary of pricing tied to a proprietary visibility score, since the vendor controls both the number and the prompt set that produces it. Be equally wary of performance pricing tied to mentions, which sounds aligned and creates pressure to game the measurement rather than improve the business.
Ask What Happens in Month One A proposal that opens with content production has skipped the diagnosis. There is no way to know what to write before you know which questions matter, which assistants answer engine optimization them badly and which sources they draw on.
Search marketing has a long history of reporting numbers that rise while the business does not. Impressions, rankings for terms nobody buys on, traffic to pages with no commercial intent. The new channel has arrived with its own version of this, and the version is worse, because there is no independent console to check the claims against.
