Score each candidate from 1 to 5 across these five dimensions and record the evidence behind every score. A combined score below 18 is a meaningful warning sign: identify which capability is missing and whether that gap matters for your scope.
1. SaaS Business Model Fluency
Ask the candidate to explain how search supports your acquisition model. A strong answer should distinguish self-serve acquisition, product-led adoption, demo-led sales, and longer buying cycles without forcing every SaaS company into the same funnel. The vendor should reference MRR, churn, trial activation, or demo conversion without prompting and be comfortable discussing qualified pipeline, assisted discovery, evaluation content, and how search contributes before the final conversion. Agencies that default to e-commerce or local SEO mental models will misalign your content strategy from day one.
Evidence to request: examples of prior work where the agency can explain the buyer journey, the conversion event used for measurement, the role of organic search, and what it would do differently. Do not accept a traffic graph as a substitute for business context.
2. Technical SEO Depth for SaaS Architecture
Ask how the vendor evaluates JavaScript rendering, application and marketing-site boundaries, login-gated areas, documentation, integration pages, programmatic templates, canonicals, redirects, internal linking, and crawl access. The answer should identify diagnostic steps and implementation dependencies rather than jump directly to a preferred architecture.
Evidence to request: an anonymized technical deliverable, issue prioritization logic, or a walk-through of how the team would validate a fix after engineering ships it.
3. Content Strategy Connected to Buyer Intent
The agency should explain how it decides which product, comparison, integration, solution, documentation, educational, or other pages deserve priority. The goal is not to force every query into a rigid funnel label, but to connect the searcher's problem and evaluation stage to the page that can satisfy it.
Evidence to request: a sample content brief or content map showing query intent, page purpose, product evidence required, internal-link relationships, and the conversion action the page supports.
4. Measurement and Attribution Discipline
For a B2B motion, ask how the team separates leading indicators from commercial outcomes. Rankings, impressions, clicks, qualified sessions, trials, demos, opportunities, assisted influence, and closed revenue answer different questions. A credible agency should know the difference between last-click and first-touch attribution in long B2B sales cycles and explain what can be measured directly and how assisted conversion paths are interpreted. Vague answers about reporting dashboards are not sufficient.
Evidence to request: a reporting example that distinguishes search visibility from pipeline contribution and shows how the team investigates a mismatch between the two.
5. Transparency on Timeline, Ownership, and Risk
The vendor should state what it controls, what depends on your team, and which assumptions could move the timeline. Green flag: the vendor tells you organic search takes 4-6 months to compound and explains why. Red flag: it promises first-page results in 60 days instead of explaining implementation, competition, crawl behavior, content quality, and product-market demand, or refuses to discuss what happens if results underperform projections. Honest vendors price risk into their communication, not just their contracts.