SEO Recap covering August 4, 2026: Top Stories in AI Overviews and Cloudflare blocking Googlebot

Built by Stephanie Chung·5 min read·6 stories

Daily summary of what matters in SEO, GEO, AEO, and AI search generated with Claude Code (beware of hallucinations)

Generative Engine Optimization (GEO) & Answer Engine Optimization (AEO)

Three AI visibility signals add pre-click context to paid search reporting:
- Grounding queries, the retrieval searches AI systems run to answer a prompt
- Citations, when your content is referenced in an AI-generated response
- Share of authority, how much citation activity your domain owns versus other cited domains
Grounding queries show how AI translates human intent into retrievable topics. Treat them as inputs for keyword tests, search themes, and landing page updates, not as literal keywords.
When AI systems cite your brand for the wrong topics, audit landing page content before blaming bidding, budget, or targeting, since AI-powered campaign tools like Performance Max and final URL expansion inherit that misinterpretation.
Use share of authority to find where competitors are cited more often on high-value topics, then invest in landing pages, proof points, and product detail to close the gap.

Google's Generative AI performance reports, announced June 3, 2026, show impressions from AI Overviews and AI Mode segmented by page, country, device, and date, but exclude queries, clicks, CTR, average position, citation placement, and conversion data.
An impression counts when a link is shown within a generative feature. In AI Overviews a link must be scrolled or expanded into view, and in AI Mode each follow-up counts as a new query. Property-level and page-level totals will not always add up because of aggregation.
Do not blend generative and organic impressions into a single "total search visibility" number or compute a blended CTR, since the metrics measure different experiences.
Compare which pages appear in generative search against their organic performance:
- High organic but low AI visibility flags pages that rank but are hard to synthesize
- Modest organic but high AI visibility flags pages with clean definitions, stats, or comparisons worth modeling
- Visibility concentrated in a few URLs points to template or content structure differences
Track multi-week trends rather than daily swings, and report AI referral traffic and conversions separately from impressions.

NewzDash's John Shehata found that among trending news queries showing Top Stories, 15.5% in the US and 17.46% in the UK now embed the carousel inside the AI Overview rather than as a standalone module.
Entertainment queries lead, clearing 35% in the US and 31.5% in the UK, while World News hits nearly 32% in the US. The embedded and standalone placements are mutually exclusive.
Blocking Google-Extended in robots.txt does not remove a site from AI Overviews, AI Mode, or embedded Top Stories, since it only governs AI training and grounding uses.
The Search Console generative AI exclusion, still limited to a subset of UK site owners, is the actual lever that removes content from AI Overviews, AI Mode, and generative Discover, and likely from the embedded carousel too.
Audit your controls separately, test the Search Console exclusion on a single section before going sitewide, and pull Search Console generative AI reports to establish a baseline before opting out.

A Redditor in r/SEO reported that setting Cloudflare's AI Training block to Block causes Googlebot and Bingbot to receive HTTP 403 responses when fetching the sitemap, resolved by disabling the block.
Cloudflare classifies Googlebot and Bingbot as "Search + Training" mixed-usage bots, so an AI training block can catch them too.
Cloudflare's documentation says that starting September 15, 2026, new domains will block Training and Agent bots on ad-bearing pages and block mixed-purpose Search plus Training crawlers under all AI training blocks. Customers can opt out before that date.
Google's John Mueller asked the poster for a DM to investigate. It is unclear whether the current behavior is a bug or user error.

Google is running a limited test that asks searchers to "sign in to verify you're a human and see more results" instead of serving the usual captcha, spotted by Kamlesh Shukla on X.
The prompt appeared after a searcher paged deep past the first few pages of results, so most users would not hit it.
If rolled out widely, it could disrupt SEO rank tracking tools and services like SerpApi, which recently won a scraping lawsuit against Google.

Ranking volatility hit August 1 through August 3, following spikes on July 24, 18, and 11. Google added Gemini 3.5 Flash-Lite to some AI Overviews and AI Mode.
The EU fined Google $1 billion under the DMA for anti-competitive search dominance, modest against $120 billion in the prior quarter. Google's ad revenue rose 14.5% in its biggest quarter ever.
Google's lawsuit against SerpApi over scraping search results was dismissed, a win for SEO tools. Large publishers are strongly considering blocking Google Search entirely.
Search Console now shows Instagram, TikTok, X, and YouTube content performance via platform properties, and generative AI controls are rolling out beyond UK sites.
Almost half of Google searches now show AI Overviews and climbing. Google updated its crawl budget doc so every site starts on conservative crawl, and said the Cloudflare content signals robots.txt directive has no effect.

Published on August 6, 2026