How Often Should You Re-Test Your AI Visibility
Give journalists and analysts accurate material to work from, in a form they can use without rewriting. Where an independent comparison exists and gets your details wrong, a polite factual correction is accepted far more often than people expect, because publishers generally do not want to be wrong.
How to Prioritise When Everything Is Slow This work is slower than anything else in the discipline, so sequencing matters. Start with sources you can edit directly, since claiming and correcting listings is nearly free and takes effect within weeks.
Testing too rarely means you find out about a problem a quarter after it started. Testing too often means drowning in variance that looks like signal and reacting to noise. Both failures are common and the second is more expensive, because it produces work.
What analytics cannot tell you is how often you were named without a click, which in this channel is most of the time. A recommendation that a buyer acts on three weeks later leaves no trace in any report you own. This is why the manual prompt set is not optional, and why nobody should be asked to justify this work on referral traffic alone.
You Have No Stable Identity Models need to connect scattered mentions to a single entity. If your company appears under three different spellings, lists two different founding years, and gives an address on your site that does not match your directory listings, those mentions may never be joined up.
Write it once, covering the category question, the problem question, the comparison question, the competitor question and the branded question. Fifty is a workable minimum. Then freeze it, and if you must add prompts later, add them as a separate cohort so the original series stays comparable.
Product recommendations are a harder case than service recommendations, because the answer has to be specific enough to act on. A model naming a product is committing to a name, usually a price band and often a comparison, and it needs sources confident enough to support that.
One practical note on prioritising outreach. Sort your citation list by frequency and start at the top, not at the most prestigious name. A directory that appears in half your category's answers is worth more than a publication that impresses your board and has never been cited once. This is the point at which visibility work and conventional public relations objectives diverge, and it is worth saying out loud before the two budgets start competing.
Run Each Prompt Multiple Times Generation involves randomness and retrieval can return different pages between runs, so a single answer is a sample. Three runs per prompt is the practical minimum and five is better where the stakes are high.
One additional check is worth building into your product page template. Every page should be able to answer, in text, what the product is, what it costs, what size or specification options exist, what it is compatible with and who it is not suitable for. Most templates cover the first two and leave the rest to imagery or to a downloadable document, which removes exactly the details that a purchase recommendation needs.
What Not to Do, and Why It Backfires Fabricated reviews, seeded forum threads under false identities, and paid placements presented as independent all exist and all fail on the same axis. Detection has improved, platforms enforce against it, and the reputational cost when it surfaces exceeds anything the visibility was worth.
Control the Session Conditions Personalisation quietly corrupts this. Run from a signed out session, or a fresh session with memory and history disabled, and do not use an account that has been researching your own company all week.
If you must change the prompt set, add new prompts as a separate cohort and keep the original series running unchanged. Editing the instrument retrospectively destroys the comparison you have been building.
Why One Snapshot Proves Almost Nothing Generation involves randomness, and retrieval can return different pages between runs. The same prompt asked twice in a row can produce different companies in different orders.
Where Analytics Can and Cannot Help Referral traffic from assistant domains does show up in analytics, and it is worth segmenting into its own report. Treat the numbers as a floor rather than a count, since some assistants strip referrer information and some traffic arrives looking direct.
Include the Awkward Ones Two categories get left out for uncomfortable reasons and are among the most informative. First, prompts naming your competitors directly, which show whether you appear as an alternative to them.
So attribute it by name every time it appears in a report. A visibility figure presented without saying which tool produced it and how it was sampled will eventually be quoted back at you as fact by somebody who did not know it was an estimate, and that is a difficult correction to make in front of a board. ai search optimization