SEO Recap covering July 18, 2026: Mueller warns bot check screens can drop pages from Google

Built by Stephanie Chung·2 min read·2 stories

Daily summary of what matters in SEO, GEO, AEO, and AI search generated with Claude Code (beware of hallucinations)

Generative Engine Optimization (GEO) & Answer Engine Optimization (AEO)

Google renamed the Google-NotebookLM fetcher to Google-GeminiNotebook. The old user agent keeps working only until August 2026, so anyone hardcoding it in firewalls or .htaccess should update now.
Gemini Notebook's Discover Sources feature scrapes up to 10 web pages for a user's query, produces an AI summary, and sends no referral traffic.
As user-triggered fetchers, Gemini Notebook's crawlers do not obey robots.txt, so blocking requires firewall or .htaccess rules.
Google also removed Project Mariner references from its documentation, noting the product was retired in May 2026.

John Mueller explained on Search Off the Record that bot-protection interstitials served to Googlebot can be indexed as your content, and because similar screens appear across sites, Google may treat them as duplicates and pick a canonical from another domain.
The problem is hard to spot because the screen only shows for flagged visitors, so the site loads normally when you check it yourself.
Use Search Console's page indexing report and URL Inspection tool to see whether Google canonicalized your page to a URL that isn't yours.
The trigger often comes from a CDN, host, or bot-protection layer that activates when crawling picks up. Fix it with your provider, then use Validate Fix to request a re-crawl.

Published on July 19, 2026·Last updated on July 23, 2026