
Reviews
Before you trust technical SEO reviews, check the method
A practical technical SEO review checklist: assess scoring, sources, reproducibility, commercial interests and compliance before relying on a result.
What to take away
- The mistake most teams make is reading the score before the method: a number with no published weighting is marketing, not evidence.
- Insist on a dated, named source for every statistic. If a review says "40% faster", it should say who measured it and when.
- Check the commercial model behind the review. Affiliate links, sponsorship and vendor-funded research all change what gets tested.
- Compliance claims need the same scrutiny as performance claims: a supplier's marketing copy is not proof of accuracy.
- A review is only useful if you can reproduce the test or the comparison on your own site.
Why most technical SEO reviews fail on method
A technical SEO review is a claim about cause and effect. Someone changed a canonical tag, a render path or a crawl budget setting, and something moved. To believe the claim you need the method: what was measured, on which site, over what period, and against what baseline.
Most published reviews skip that. They rank tools by feature count, repeat vendor copy, and present a single score. The score looks objective because it is a number. It is not.
When you read technical SEO review methodology in England, look for the parts a reviewer cannot fake: the test site, the crawl date, the version of the tool, and the person who ran it. If those are missing, treat the review as an opinion piece and price it accordingly.
One practical test: could you run the same check next Tuesday and get a comparable result? If the answer is no, the review cannot support a purchase decision worth thousands of pounds.
The four review types you will actually meet
Almost every technical SEO review falls into one of four shapes. Each has a different failure mode.
Four review types and failure modes
Review type
- Single-tool deep dive
- Describes interface only
- Head-to-head comparison
- Different crawl settings
- Agency/provider review
- No downloadable evidence
- Feature-count ranking
- Repeats vendor copy
Failure mode
- Single-tool deep dive
- Head-to-head comparison
- Agency/provider review
- Feature-count ranking
Single-tool deep dives
These examine one crawler, log analyser or monitoring platform in detail. They are useful when the reviewer publishes raw output, such as crawl exports or log samples. They fail when the reviewer only describes the interface.
Examples of named technical SEO crawlers include Screaming Frog SEO Spider and Sitebulb. A review should state which product and version it tested and show relevant output, rather than relying on descriptions of the interface.
Ask what the tool got wrong. A deep dive with no limitations section is a brochure.
Head-to-head comparisons
Two or more tools run against the same site. This is the most useful format and the hardest to do honestly. The comparison is only fair if both tools crawl the same URLS, at the same time, with the same JavaScript rendering setting.
For a worked example, suppose a team pays £400 a month for tool A and £250 a month for tool B. Over a year that is £4,800 against £3,000, a difference of £1,800. If the head-to-head test used different crawl settings, that £1,800 difference is not evidence of anything. It is just a price gap.
Agency and provider reviews
These assess services rather than software. The evidence problem is bigger, because you cannot download an agency and inspect it. You rely on case studies, references and public filings.
Companies House's public company record, including filed accounts and confirmation statements, helps you confirm a supplier exists, who its directors are, and whether its accounts are overdue. That is basic due diligence, not a character judgement.
Roundups and listicles
Roundups are convenient but often weak: a list of product names is not evidence that each was tested, and a missing test date makes results hard to reproduce. Treat the names as leads, then check each product against a dated, reproducible review.
How to score a review before you read the score
Build your own scoring sheet for the review, not the tool. Five criteria cover most of the risk.
Use these five criteria on the review itself:
- Named evidence and date:Does it identify the site or test source, crawl date and tool version?
- Reproducibility:Does it give the URL scope and settings, including JavaScript rendering where relevant?
- Raw output and coverage:Does it show exports or samples and explain what the crawler found, fetched and excluded?
- Fair comparison and baseline:Were tools tested on the same site, at the same time and with the same settings? Are performance claims compared with a stated baseline?
- Independence and limitations:Does it disclose affiliate links, sponsorship or vendor funding, and describe what the test could not establish?
Five criteria for scoring a review
- Sourcingnamed source and date
- Reproducibilitytest conditions repeatable
- Disclosurecommercial relationship stated
- Recencytested within twelve months
- Limitationssays what it did not test
Score each out of two, giving a maximum of ten. A review scoring below six is background reading. A review scoring eight or above can inform a shortlist.
This is not academic. If you are comparing products across the England market, a structured sheet stops you comparing a genuine test with a rewritten press release. The same discipline applies when you look at technical SEO product comparison in England, where the temptation to rank by feature count is strongest.
Checking the data behind provider claims
Provider claims arrive in three flavours: performance, coverage and compliance. Each needs a different check.
Checking provider claims by type
Performance claim?
ask for analytics export and baseline
Coverage claim?
Performance claims sound like "we improved organic traffic by 60%". Ask for the analytics export, the date range and the baseline. A percentage without a baseline is decoration.
Coverage claims sound like "we audit every page". Ask how many URLS the crawler found, how many it fetched, and what it did with the rest. Crawl coverage is measurable, so there is no excuse for vagueness.
Ask for a crawl summary or export that separates discovered, fetched and excluded URLs, with reasons for exclusions. Compare those counts with the URL scope the reviewer says was included; the discovered total alone does not show that the crawl covered the intended pages.
Compliance claims are the ones teams skip, yet they carry the most risk. If a provider says its content or outreach meets advertising standards, that claim should be checkable against published decisions.
The Advertising Standards Authority publishes rulings on complaints and claims showing how the regulator has treated similar marketing assertions. A handful of relevant rulings tells you more than any supplier deck.
For UK non-broadcast marketing, check claims against the UK Code of Non-broadcast Advertising and Direct & Promotional Marketing (the CAP Code) as well as relevant ASA rulings. A ruling shows how a similar claim was treated; the Code sets out the applicable standard.
Where a supplier operates in the United States or targets US audiences, enforcement history is also public. The Federal Trade Commission's published warning letters show the kind of marketing conduct that attracts regulator attention. This is not about scaring you off a vendor. It is about matching the compliance language in a proposal to the regulator's actual behaviour.
If a provider cannot point to the rule or the ruling behind a compliance claim, treat the claim as unverified.
Accessibility and mobile parity in any audit review
Two technical areas deserve their own line in your scoring sheet because they are frequently claimed and rarely tested: accessibility conformance and mobile parity.
Accessibility claims are usually vague. "WCAG compliant" means different things to different suppliers. The W3C's WCAG conformance FAQ sets out what conformance actually requires, including the difference between partial and full conformance. If a review repeats a supplier's compliance claim without checking it against that definition, the claim is untested.
Mobile parity is similar. Google's official guidance on mobile-first indexing explains that Google predominantly uses the mobile version of a page for indexing and ranking. Any audit review that checks desktop rendering but not mobile rendering is checking the wrong thing.
Add both to your sheet as pass or fail. Did the review test mobile rendering parity? Did it test against a named WCAG level? Two yes or no answers will separate serious reviews from summaries.
The worked example: scoring three reviews
Suppose you are choosing between three published reviews of the same crawl tool. Each review claims the tool found more issues than its competitors.
Cost of a bad tool choice
- £30,000annual tooling and services budget
- £2,500monthly equivalent
- 15%share lost on a poor choice
- £4,500wasted licence and staff time per year
Scoring three published reviews
Criterion
- Named source and date
- Yes
- Reproducible conditions
- Yes
- Relationship disclosed
- No
- Test within 12 months
- Yes
- Limitations stated
- No
- Score out of 10
- 6
Review A
- Named source and date
- Yes
- Reproducible conditions
- No
- Relationship disclosed
- Yes
- Test within 12 months
- Yes
- Limitations stated
- Yes
- Score out of 10
- 8
Review B
- Named source and date
- No
- Reproducible conditions
- No
- Relationship disclosed
- Yes
- Test within 12 months
- No
- Limitations stated
- No
- Score out of 10
- 2
Review C
- Named source and date
- Reproducible conditions
- Relationship disclosed
- Test within 12 months
- Limitations stated
- Score out of 10
Scoring three reviews
Review A
- Named source and date
- Yes
- Reproducible test conditions
- Yes
- Commercial relationship disclosed
- No
- Test within 12 months
- Yes
- Limitations stated
- No
- Score out of 10
- 6
Review B
- Named source and date
- Yes
- Reproducible test conditions
- No
- Commercial relationship disclosed
- Yes
- Test within 12 months
- Yes
- Limitations stated
- Yes
- Score out of 10
- 8
Review C
- Named source and date
- No
- Reproducible test conditions
- No
- Commercial relationship disclosed
- Yes
- Test within 12 months
- No
- Limitations stated
- No
- Score out of 10
- 2
Review B is the only one that clears your bar. It does not have to be the most entertaining, and it may not rank the tool you already like first. That is the point.
Now put money against it. A team with a £30,000 annual tooling and services budget, roughly £2,500 a month, can lose a meaningful share on a bad choice. A poor tool choice costing 15% of that budget is £4,500 a year in wasted licence and staff time.
A few hours spent scoring the reviews is cheap against that number.
The figures here are illustrative examples, not measured outcomes from any named supplier.
Red flags in technical SEO reviews
Treat these as warning signs:
- No named source, test site or date for a factual claim.
- No tool version, crawl settings or raw output to reproduce the test.
- Tools compared using different sites, URL scopes, dates or rendering settings.
- Vendor claims repeated without independent evidence, or commercial relationships left undisclosed.
- Results presented without limitations, including what the tool missed or the test could not establish.
- Accessibility or compliance claims without a named standard or a description of how conformance was checked.
Red flags that end your reading
- No test date anywhere
- Screenshots with no URL or date
- Single score with no weighting
- Claims of finding everything
- Undisclosed affiliate links
- Case studies with no baseline
Two or more of these together mean the review is content marketing. That does not make it worthless, but it does mean you cannot use it to justify a purchase.
For an agency, ask for named case studies and references, then check that reported outcomes include a source, period and baseline. Companies House filings can help verify corporate details, but do not prove the agency delivered the claimed results.
Building a repeatable comparison process
A process beats vigilance. Set it up once and reuse it every procurement cycle.
Repeatable comparison process
- Define the three problems to solve
- Shortlist reviews scoring eight or above
- Crawl 500 URLs with each tool
- Document results in a one-page memo
- Review the decision after twelve months
First, define the job before you look at any review. Write down the three problems you need solved, such as crawl budget waste, index bloat or render errors on templates.
Second, shortlist from reviews that score eight or above on your sheet. Ignore the rest, even if they are popular.
Third, run your own small test. Crawl 500 URLS on your own site with each shortlisted tool, on the same day, with the same settings. Compare the issue lists, not the dashboards.
Fourth, document the result in a one-page memo with dates and figures. This becomes your evidence if the decision is challenged later.
Fifth, review the decision after twelve months. Tooling needs change, and a choice that was right in 2026 may not be right in 2027.
For providers rather than tools, use the same five steps but assess references, dated case studies and published data as well as the proposal. Treat each as evidence to verify, not proof of quality on its own.
What good evidence looks like
Good evidence is boring. It has dates. It names the site or describes it precisely enough to be useful. It states the tool version. It shows the raw output somewhere, even in an appendix.
Good evidence also separates observation from interpretation. "The crawler missed 214 of 5,000 URLS" is an observation. "The crawler is unreliable" is an interpretation. You need both, but you need to know which is which.
Finally, good evidence survives a hostile reading. Ask yourself what a sceptical colleague would challenge. If the answer is "the whole test setup", the review is not ready to inform a decision.
Common questions
How many reviews should I read before choosing a tool?
Three or four well-sourced reviews are usually enough to build a shortlist. Beyond that you are mostly reading the same claims reworded, and the marginal value drops quickly.
Can I rely on vendor-published benchmarks?
Treat them as a starting point, not evidence. Vendor benchmarks are useful for understanding what a tool claims to do, but they are produced by the party with the strongest interest in the result.
What if no review discloses its commercial relationships?
Assume there is one until proven otherwise, and downgrade the review accordingly on your scoring sheet. Undisclosed commercial relationships are the single most common reason a review cannot be trusted for procurement.
Do I need a formal procurement process for a small tool purchase?
No, but you still need a dated note of what you tested and what you found. A short memo protects you if the tool is renewed, replaced or questioned at budget time.
In this guide
- Technical SEO providers: which sources to checkHow to vet technical SEO providers in the UK: corporate records, ad rulings, accessibility law and references, plus a scored worked example.
- How to run a technical SEO product comparison buyers can defendA method for comparing technical SEO products on evidence: define needs, verify claims, score usability, and keep an audit trail with a due diligence checklist.
- How to assess technical SEO agencies with evidenceA technical SEO agency assessment: check claims against platform documentation, score evidence consistently and record what remains unverified.
- What a technical SEO selection checklist means for your next reviewA technical SEO selection checklist for supplier reviews, with crawl, indexing, rendering and performance checks, named tools and evidence to score.



