How to Audit AI Search Mentions Without Overstating the Results
A manual AI search check can show what a service returned for a particular question at a particular time. It cannot tell you every answer customers received or establish why one business appeared. Start with a repeatable record and keep those limits visible.
Choose questions tied to real services
Select a manageable set of customer questions about services you actually provide in places you serve. Include both broad discovery questions and specific needs. Record the exact wording so later comparisons use the same questions.
For each observation, record the service, date, location context and relevant search settings. Note whether web search was active and whether an AI answer appeared. Keep a missing AI feature, a technical failure and an answer that omits your business as separate outcomes.
Separate mentions from recommendations and citations
- A mention names the business. It may be neutral or negative.
- A recommendation suggests choosing the business.
- A citation links to a source. Record the actual URL, including whether it is your website or a third-party page.
- A visit or inquiry needs separate evidence from analytics or business records.
Save the answer or a screenshot with the observation. Open the sources and check whether they support the associated statement. OpenAI's search guidance warns that results and citations can be incomplete or incorrect. A displayed source is evidence to inspect, not proof of every claim in an answer.
Report the sample honestly
State the number of successful observations and the number containing your business. Show the questions, dates and platforms behind the count. Report missing features and failed attempts separately. Do not label this fraction as customer reach or market share: your chosen questions are not a census of customer searches.
Bing's AI Performance report can supplement manual observations with website citation data for supported experiences. Its grounding queries are sampled retrieval phrases, not a complete record of customer prompts. Keep those metrics separate from your manual sample and from booked jobs.
Investigate before prescribing a fix
Check verifiable problems first: an incorrect phone number, outdated service information, an inaccessible page or a citation that does not support the answer. Record the evidence, the proposed correction and how you will verify it. A competitor's larger review count does not establish that reviews caused your absence.
Do not manufacture review text to influence answers. Google prohibits requesting specific review content, and Yelp prohibits soliciting reviews. Follow each platform's rules rather than using one request script everywhere.
Repeat the same observations after a documented change. Report what changed and what remains uncertain; do not promise citations within a fixed period or attribute an improvement to one edit without stronger evidence.