About

SEO Tools and What Each One Reveals

Each SEO tool provides specific data points like index status, status codes, and conversion values. Ivan Sp uses a fixed toolset to extract these findings from Screaming Frog, Search Console, GA4, Ahrefs, and SEMrush.

Google Search Console

Google Search Console reports how Google itself sees a site, which makes it the first place any diagnosis starts. Branded terms and unset queries get filtered out of exports before analysis, so unbranded organic performance is visible on its own rather than inflated by people already searching the company name.

Coverage data gets cross-referenced against a crawl to find pages Google sees differently than the site presents them. Impression tiers then decide which keywords count as protected territory before any new content publishes.

Screaming Frog

Screaming Frog crawls a site the way a search engine does, surfacing problems invisible during normal browsing. The crawl produces redirect chains, orphaned pages, broken internal and external links, duplicate or missing title tags, and missing or duplicated H1 headings.

Crawl output also establishes real numbers for scoping. One audit found between 9,000 and 10,000 images on a site where the team had been working from a rough estimate of 6,000, which changed the scope of the image work entirely.

Google Analytics 4 and Google Tag Manager

Google Analytics 4 measures what happens after the click, and the reported numbers get audited before they get trusted. Revenue values in particular get traced back through the events configuration and the data layer, because a misconfigured value produces confident and wrong return-on-investment reporting.

Google Tag Manager handles event tracking and conversion measurement. A frequent finding is a container reported as broken that turns out to be blocked by an ad blocker rather than misconfigured.

Ahrefs and SEMrush

Ahrefs and SEMrush cover keyword research and backlink analysis. Backlink profiles get examined for concentration and for gaps, such as a profile with hundreds of local referring domains and no national coverage despite the business holding international awards.

Competitor link data gets used to find realistic and relevant link sources rather than an aspirational list. A source plausible for the client’s authority level is worth more than one that is not.

Bing Webmaster Tools

Bing Webmaster Tools applies the same technical checks to Bing, which carries a meaningful share of desktop search. Bing also feeds some AI answer systems, so its index is worth more attention than its market share alone suggests.

Custom Scripts

Custom scripts in Python and PHP cover what commercial tools do not. Server log file analysis shows which pages crawlers actually request and how often. Page-level content scoring rates every page for helpfulness, originality, legal risk, and spam signals. Reporting pipelines in BigQuery join data sources no single product connects.

The tooling behind these scripts is described under custom AI agents built for marketing work.

What Each Tool Is Used to Find

Google Search Console
Index status per URL, query performance, and the exact reason a page was excluded.
Screaming Frog
Directives, canonicals, status codes, click depth, and orphan pages after crawl analysis.
Google Analytics 4
What happened after the click, including conversions and revenue values.
Google Tag Manager
Tag deployment, and the preview mode used to verify a tag before it goes live.
Ahrefs and SEMrush
Competitor keyword sets and inbound link profiles, used as a second opinion.
Bing Webmaster Tools
Independent index coverage and a full exportable link list with anchor text.
Custom scripts
Python and PHP, where the question needs data no product joins.
What no tool supplies
Which finding matters commercially, which stays a judgement.

Where the Standard Tool Advice Breaks Down

When did anyone last read your Search Console account properly?

The usual advice
Buy the tool the professionals use, since the right software is what separates good SEO from guesswork.
What holds up in practice
Every finding on this site starts in Google Search Console, which is free. Paid tools add competitor data and speed, and none of them answers a question the free ones cannot reach more slowly.

Consider a business buying a full-tier subscription to a major platform before anyone has read its own Search Console account. The tool is excellent.

The index coverage gap that explains most of the problem was sitting in a free report the whole time. The subscription bought speed on a question nobody had asked yet.

Ivan Sp starts in Search Console on every engagement. Paid tools enter once the free data has named the problem.

Buying tooling before diagnosis is spending budget on capability rather than on an answer. The answer was usually already available.

The report that explains your problem is probably free, already collecting data, and has not been opened this quarter.

Five Things Commonly Assumed About SEO Tools

Which of these have you assumed about SEO tooling?

I meet these assumptions on most first calls.

Commonly assumedWhat actually holds
Paid tools see more than Google’s own.Search Console reports Google’s own index decisions. No third-party tool has access to that, and all of them estimate.
Third-party metrics are ranking factors.Domain Rating and Domain Authority are vendor scores. Google has confirmed it does not use them.
More tools means better analysis.Each tool is another interface to reconcile. Two independent sources on a question is useful, and six is noise.
The tool produces the finding.Tools produce data. Which finding matters commercially is a judgement no tool makes.
A free tier is not enough to start.Search Console is free and complete for your own site. Screaming Frog’s free tier covers up to 500 URLs.

The most valuable report about your site is free, already running, and probably unread. Every paid tool on this page is a supplement to it.

A Worked Example: Which Tool Answers Which Question

Consider five questions and where each is actually answered. The mapping below is illustrative, written to show what each tool is for. No client engagement is described here.

QuestionWhere it is answeredCost
Why is this page not indexedSearch Console Page Indexing reportFree
Which URLs carry a noindex directiveScreaming Frog crawl, Directives tabFree up to 500 URLs
Which pages have no internal linksScreaming Frog with crawl analysis and a sitemapPaid licence
What do competitors rank forAhrefs or SEMrushPaid
Did that conversion actually fireGA4 DebugViewFree
What did Googlebot actually requestRaw server logsFree, where logs exist

I read the cost column as a sequence rather than a shopping list. Four of six rows are free, and they cover most first engagements.

Buying tooling before diagnosis is buying a full toolkit before looking at what is broken. Sometimes it is a fuse.

The competitor row is the honest case for a paid subscription. Nothing free answers it well, and it is one question among many.

How the Toolset Gets Used

I work from free sources outward, adding paid tools once the question needs them.

  1. Open Search Console first and read the Page Indexing report by status group.
  2. Export query data from the Performance report, filtered to organic search.
  3. Crawl the site with Screaming Frog, connecting the sitemap and analytics before starting.
  4. Run crawl analysis as a separate step, which is what populates orphan and depth data.
  5. Verify tracking in GA4 DebugView before trusting any conversion figure.
  6. Read raw server logs where they exist, since nothing else shows actual crawler requests.
  7. Check the same index questions in Bing Webmaster Tools, which reports independently.
  8. Add Ahrefs or SEMrush once the question is genuinely competitive rather than diagnostic.
  9. Cross-check any link finding against a second independent index.
  10. Write custom scripts where the question needs data no product joins.

How This Engagement Is Scoped

What Tooling an Engagement Requires

What the client supplies
Read access to Search Console and analytics, which is free to grant.
What this practice supplies
Every paid licence used during the engagement.
What the client keeps
Every export produced, including the full scored crawl.
What is never required
A client subscription to any paid platform.
Where a client subscription helps
Ongoing competitor monitoring after an engagement ends.
What no tooling replaces
The judgement about which finding matters commercially.
Cost of the free stack
Nothing, and it covers most of a first diagnosis.

Tools and Primary Sources

The references below are the tools named above. Each opens in a new tab.

  • Google Search Console reports Google’s own index decisions for your site, at no cost.
  • Screaming Frog SEO Spider crawls a site and exports directives, canonicals, depth, and orphan data.
  • Google Analytics 4 reports what happened after the click, including conversions and revenue.
  • Bing Webmaster Tools reports index coverage independently and publishes a full link list.
  • Ahrefs supplies competitor keyword and link data from its own index.
  • Semrush supplies the same categories from a different index, useful as a cross-check.

Read Your Own Free Data First

I suggest three free checks before anyone buys anything.

  1. Open Search Console, then Indexing, then Pages, and read the largest excluded group by name.
  2. Open Performance and compare the last three months against the same period last year.
  3. Install the free tier of a crawler and crawl your most important section.
  4. Open the Directives view and check for anything carrying an unintended noindex.

Most first engagements find their main problem in one of those three. None of them costs anything, and all three take under an hour.

Common Questions About SEO Tools

Do I need to buy these tools myself?

No. Tool access is covered on the consultant side for audit work. Ongoing in-house use is a separate decision, and the audit report notes where a subscription would genuinely pay for itself.

Why use both Ahrefs and SEMrush?

Their link indexes and keyword databases differ, and each finds things the other misses. Cross-checking matters most for backlink audits, where a single source gives an incomplete picture.

Is log file analysis necessary for small sites?

Rarely. Log analysis earns its cost on large sites where crawl budget genuinely constrains indexation. A 40-page site almost never has that problem.

Which SEO tool should a small business buy first?

None, until the free ones have been read. Search Console is complete for your own site, and a free crawler tier covers a small site entirely. Paid tools earn their place on competitor questions rather than diagnostic ones.

Scroll to Top