AI SEO Statistics: Brokers (2026-07 edition)
15 questions · 45/45 expected AI responses · 3 models · measured 2026-07-06
The question bank
The questions we tested — a frozen buyer-intent benchmark for brokers.
The question set was curated from a predefined buyer-intent taxonomy and held constant for this edition. Each model received the same wording. These are the prompts behind every percentage on this page.
Show all 15 questions
Model by model
23.3% question-level model disagreement.
This rate is the average pairwise disagreement between binary behavior codes across questions and behaviors. It is not the gap between the highest and lowest aggregated model percentages.
Behavior prevalence across 15 brokers benchmark questions, 2026-07 edition. Last column: equal-model mean.
| Behavior | ChatGPT | Claude | Gemini | Equal-model mean |
|---|---|---|---|---|
| Recommends hiring a professional | 60% | 46.7% | 40% | 48.9% |
| Suggests DIY first | 13.3% | 26.7% | 6.7% | 15.6% |
| Names specific providers | 13.3% | 20% | 20% | 17.8% |
| Gives price or cost info | 26.7% | 33.3% | 40% | 33.3% |
| Tells to check reviews | 20% | 13.3% | 6.7% | 13.3% |
| Tells to verify credentials | 33.3% | 20% | 13.3% | 22.2% |
| Mentions case studies / portfolio | 6.7% | 0% | 6.7% | 4.5% |
| Mentions local proximity | 20% | 13.3% | 6.7% | 13.3% |
| Gives selection criteria | 46.7% | 60% | 33.3% | 46.7% |
| Warns about red flags | 20% | 33.3% | 20% | 24.4% |
| Asks a clarifying question | 26.7% | 46.7% | 6.7% | 26.7% |
| Recommends multiple quotes | 20% | 26.7% | 6.7% | 17.8% |
Question-level agreement
How often all measured models received the same binary code.
Agreement is calculated question by question for each behavior. A high value can coexist with a low behavior prevalence; it means the models usually agreed on whether the behavior appeared.
All-model binary agreement by behavior across 15 benchmark questions.
| Behavior | All-model agreement |
|---|---|
| Recommends hiring a professional | 53.3% |
| Suggests DIY first | 80% |
| Names specific providers | 66.7% |
| Gives price or cost info | 73.3% |
| Tells to check reviews | 66.7% |
| Tells to verify credentials | 66.7% |
| Mentions case studies / portfolio | 86.7% |
| Mentions local proximity | 80% |
| Gives selection criteria | 40% |
| Warns about red flags | 66.7% |
| Asks a clarifying question | 40% |
| Recommends multiple quotes | 60% |
By model
How each assistant handled Brokers questions.
Reading the 45 answers model by model shows how differently the three assistants treat the same brokers questions. On the most consequential behavior — whether to send the buyer to a professional at all — the rate ranged from 60% (ChatGPT) down to 40% (Gemini), a 20-point gap on an identical question set.
Across the 15 brokers answers it produced, ChatGPT recommended hiring a professional in 60% of them and suggested a DIY approach first 13.3% of the time. It named a specific provider in 13.3% of answers (about 0.2 distinct providers per answer) and included price or cost information 26.7% of the time. ChatGPT asked a clarifying question before answering in 26.7% of cases, warned about red flags or scams in 20%, and told the buyer to verify credentials in 33.3%, averaging 542 words per answer. On the remaining cues it told the buyer to check reviews in 20%, pointed to case studies or a portfolio in 6.7%, and framed the choice around local proximity in 20%; a selection-criteria checklist appeared in 46.7% of its answers and a recommendation to gather multiple quotes in 20%.
Across the 15 brokers answers it produced, Claude recommended hiring a professional in 46.7% of them and suggested a DIY approach first 26.7% of the time. It named a specific provider in 20% of answers (about 0.6 distinct providers per answer) and included price or cost information 33.3% of the time. Claude asked a clarifying question before answering in 46.7% of cases, warned about red flags or scams in 33.3%, and told the buyer to verify credentials in 20%, averaging 295 words per answer. On the remaining cues it told the buyer to check reviews in 13.3%, pointed to case studies or a portfolio in 0%, and framed the choice around local proximity in 13.3%; a selection-criteria checklist appeared in 60% of its answers and a recommendation to gather multiple quotes in 26.7%.
Across the 15 brokers answers it produced, Gemini recommended hiring a professional in 40% of them and suggested a DIY approach first 6.7% of the time. It named a specific provider in 20% of answers (about 0.7 distinct providers per answer) and included price or cost information 40% of the time. Gemini asked a clarifying question before answering in 6.7% of cases, warned about red flags or scams in 20%, and told the buyer to verify credentials in 13.3%, averaging 256 words per answer. On the remaining cues it told the buyer to check reviews in 6.7%, pointed to case studies or a portfolio in 6.7%, and framed the choice around local proximity in 6.7%; a selection-criteria checklist appeared in 33.3% of its answers and a recommendation to gather multiple quotes in 6.7%.
Taken together, ChatGPT is the assistant most likely to route a brokers buyer to a professional (60%) and Gemini the least (40%). ChatGPT produced the longest answers, at 542 words on average. Specific providers were named most often by Claude (20%) — even there, roughly one answer in 5 carried a name.
Where they disagree
The behaviors where the choice of model changes the answer.
Question-level model disagreement is 23.3% — the average pairwise rate at which models received different binary codes across questions and behaviors. The observed rate spreads below are a separate measure showing where which assistant a brokers buyer happens to ask matters most:
- Asks a clarifying question: from 6.7% (Gemini) to 46.7% (Claude) — a 40-point spread.
- Gives selection criteria: from 33.3% (Gemini) to 60% (Claude) — a 27-point spread.
- Recommends hiring a professional: from 40% (Gemini) to 60% (ChatGPT) — a 20-point spread.
- Suggests a DIY approach first: from 6.7% (Gemini) to 26.7% (Claude) — a 20-point spread.
- Tells the buyer to verify credentials: from 13.3% (Gemini) to 33.3% (ChatGPT) — a 20-point spread.
The widest single gap — asks a clarifying question, 40 points — means a brokers buyer can receive materially different guidance on the same question depending only on which assistant they happen to open, so any visibility strategy built on a single model's behavior describes only part of the brokers market.
Where they agree
The points of near-consensus in Brokers.
On other behaviors the three models move almost in lockstep — the points of near-consensus for brokers, where all three landed within a few points of each other:
- Names a specific provider: 13.3%–20% across all three (a 7-point spread).
- Mentions case studies or portfolio: 0%–6.7% across all three (a 7-point spread).
- Gives price or cost information: 26.7%–40% across all three (a 13-point spread).
- Tells the buyer to check reviews: 6.7%–20% across all three (a 13-point spread).
Measured question by question, the three assistants coded a response the same way most consistently on "mentions case studies or portfolio" (identical coding in 86.7% of questions) and least consistently on "asks a clarifying question" (40%).
Every behavior, measured
All twelve coded behaviors for Brokers, averaged across the three models.
The behaviors AI models reproduce most often for brokers are recommends hiring a professional (48.9% on average), gives selection criteria (46.7%) and gives price or cost information (33.3%); the rarest are mentions case studies or portfolio (4.5%), mentions local proximity (13.3%) and tells the buyer to check reviews (13.3%). Each figure below is the share of a model's 15 answers in which the behavior appeared at least once, averaged across the 3 models with the full per-model range in parentheses:
- Recommends hiring a professional: 48.9% on average (ChatGPT 60%, Claude 46.7%, Gemini 40%) — a 20-point spread.
- Gives selection criteria: 46.7% on average (ChatGPT 46.7%, Claude 60%, Gemini 33.3%) — a 27-point spread.
- Gives price or cost information: 33.3% on average (ChatGPT 26.7%, Claude 33.3%, Gemini 40%) — a 13-point spread.
- Asks a clarifying question: 26.7% on average (ChatGPT 26.7%, Claude 46.7%, Gemini 6.7%) — a 40-point spread.
- Warns about red flags or scams: 24.4% on average (ChatGPT 20%, Claude 33.3%, Gemini 20%) — a 13-point spread.
- Tells the buyer to verify credentials: 22.2% on average (ChatGPT 33.3%, Claude 20%, Gemini 13.3%) — a 20-point spread.
- Names a specific provider: 17.8% on average (ChatGPT 13.3%, Claude 20%, Gemini 20%) — a 7-point spread.
- Recommends multiple quotes: 17.8% on average (ChatGPT 20%, Claude 26.7%, Gemini 6.7%) — a 20-point spread.
- Suggests a DIY approach first: 15.6% on average (ChatGPT 13.3%, Claude 26.7%, Gemini 6.7%) — a 20-point spread.
- Tells the buyer to check reviews: 13.3% on average (ChatGPT 20%, Claude 13.3%, Gemini 6.7%) — a 13-point spread.
- Mentions local proximity: 13.3% on average (ChatGPT 20%, Claude 13.3%, Gemini 6.7%) — a 13-point spread.
- Mentions case studies or portfolio: 4.5% on average (ChatGPT 6.7%, Claude 0%, Gemini 6.7%) — a 7-point spread.
Trust signals
How well the models protect the brokers buyer.
Beyond whether to hire, the rubric codes how carefully each assistant protects the brokers buyer once a decision is made. Telling the buyer to check reviews or ratings appeared in 13.3% of answers on average. Verifying credentials or certifications appeared in 22.2%. Warning about red flags or scams appeared in 24.4%.
On structuring the decision, a selection-criteria checklist showed up in 46.7% of answers on average and a recommendation to gather multiple quotes in 17.8%. The single least-reproduced protective signal for brokers is "tells the buyer to check reviews" at 13.3% on average — the clearest opening for content that supplies it, since the models are not yet reliably surfacing that guidance on their own.
Referral behavior
Do AI models name Brokers providers?
For service providers the decisive question is whether these systems name anyone at all. Across 45 brokers answers, a specific provider was named in 17.8% of responses on average — roughly 0.5 distinct providers per answer. In practice the assistants behave far more as an explanatory layer than as a referral engine for brokers: visibility comes from being the reasoning a model reproduces, not from being the named recommendation.
The question set
What these 15 Brokers questions cover.
The 15 questions behind every percentage on this page form a frozen brokers (financial services; buyer hiring decisions for this specific service) buyer-intent benchmark. Each was put to all 3 models once, with identical wording, so the rates above describe how the assistants handled this exact brokers question set — not a general prior or a hand-picked subset. The full list is shown earlier on this page; the coded percentages are what those specific questions produced.
How to read this
A note on the numbers.
A percentage here is the share of a model's 15 answers in which the behavior appeared at least once — not a confidence score. Because each model answered every question exactly once on 2026-07-06, the figures describe this specific brokers question set and snapshot rather than a general prior. The full protocol and coding rubric are documented in the study methodology.
Methodology
A controlled snapshot, documented end to end.
15 frozen benchmark questions, one expected response per model per question (ChatGPT API (gpt-5-mini), Claude API (claude-sonnet-5), Gemini API (gemini-3-flash-preview)), collected 2026-07-06 and coded against a fixed 12-behavior rubric. The pipeline validates the schema, recomputes aggregates and reports consistency issues. AI outputs vary with model version, location and time, so the figures describe this edition's exact sample and measurement window. Read the full methodology →
Citation
Cite this edition.
Authority Specialist. “AI SEO Statistics: Brokers (2026-07 edition).” AuthoritySpecialist.com. https://authorityspecialist.com/research/ai-seo-statistics/services/financial/brokers