BetterAISearch

Latest AI search research

Evidence-backed findings from controlled studies, peer-reviewed research, and official platform documentation — updated as new research lands. No opinion pieces. No tips roundups. Only hard evidence.

ChatGPTPerplexityGoogle AI OverviewsGemini
May 2026
11 sources

Search results layout has changed significantly over seven to eight years, with AI overviews and commerce links now dominating above organic results.

TBPN· · Observational studyPlatform official

Google officially launched SynthID verification in Search with planned Chrome rollout in coming weeks.

Google· · Official documentationPlatform official✓ Official

Google reported AI Mode has surpassed 1 billion monthly active users with query volume doubling quarterly since launch and reaching an all-time high in the most recent quarter.

Google· · Official documentationPlatform official✓ Official

A controlled experiment tracking AI bot visits to webpages with LLMs.txt files over a 3-month period found zero AI bot visits to the test pages.

Reboot Online· · Controlled experimentIndependent study

Web Bot Auth is in experimental phase with limited rollout; not all Google user agents currently implement the protocol.

Google· · Official documentationPlatform official✓ Official

AI search engines collectively drive approximately 1% of publisher traffic.

Conductor· · Observational studyIndependent study

GPT-5.5 achieved an 84.9% win-or-tie rate against human professionals across 44 tested occupations in the GDPval benchmark.

OpenAI· · Official documentationPlatform official✓ Official

Year-over-year LLM referral traffic increased 72.7%, with ChatGPT referrals growing 66.7% and Claude referrals growing 23x.

Duda· · Observational studyIndependent study

Real-time answer fetching accounted for 56.9% of crawler activity (primarily ChatGPT), training 28.8%, and discovery/indexing 14.3%.

Duda· · Observational studyIndependent study
April 2026
49 sources

Consistently pairing a brand name with a descriptive expertise label ('unoccupied home insurance experts') across BBC News and The Times coverage produced a 194% increase in GEO traffic and 382% rise in ChatGPT referral visits — demonstrating the context wrapping technique.

Reboot Online· · Observational studyIndustry report

YouTube receives 200x more AI citations than any competing video platform (Vimeo, TikTok, and Dailymotion each below 0.1%), accounting for 20% average citation share and 29.5% of all Google AI Overview citations — ranking as the #1 cited domain in AI Overviews.

BrightEdge· · Observational studyIndustry report

Anthropic's ClaudeBot crawls web content for potential use in AI model training; site owners can block it via robots.txt using the 'ClaudeBot' user agent string, with IP verification available at Anthropic's published endpoint.

Anthropic· · Official documentationPlatform official✓ Official

OpenAI operates two separate crawlers: GPTBot for training data and OAI-SearchBot for ChatGPT search results — each requires independent robots.txt configuration; allowing one does not enable the other.

OpenAI· · Official documentationPlatform official✓ Official

Core Web Vitals are a Google ranking signal but act as a floor rather than a ceiling: Google will surface sub-par page experience content if it is the most relevant result available.

Google· · Official documentationPlatform official✓ Official

Bing-indexed content is included in Bing Chat (Copilot) answers by default; sites must use the NOARCHIVE meta tag to opt out — confirming that Bing indexing status directly controls inclusion in Copilot AI answers.

Microsoft Bing· · Official documentationPlatform official✓ Official

ChatGPT Search for Enterprise and Edu workspaces uses Bing as its sole third-party search provider — confirming Bing indexing is a prerequisite for ChatGPT visibility in enterprise contexts.

OpenAI· · Official documentationPlatform official✓ Official

Microsoft 365 Copilot uses the Bing search service for web grounding; URLs not indexed by Bing cannot be used as knowledge sources — making Bing indexing a hard prerequisite for Copilot visibility.

Microsoft· · Official documentationPlatform official✓ Official

86% of AI citations across ChatGPT, Gemini, and Perplexity come from brand-managed or brand-influenced sources: 44% from brand websites, 42% from listings/directories, and 8% from reviews/social, based on 6.8 million citations from 1.6 million queries.

Yext· · Observational studyIndustry report

Brands cited in Google AI Overviews receive 120% more organic clicks per impression than non-cited brands on the same AIO-present SERP (2.07% vs 0.94% organic CTR for informational queries), based on 5.47 million queries and 2.43 billion impressions across 53 brands.

Seer Interactive· · Observational studyIndustry report

HTTP Archive analysis of 12 million websites shows AI crawler blocking grew from zero to 125,000 sites within one month of GPTBot's documentation — and continued accelerating, with higher-traffic sites most likely to implement AI bot restrictions.

paulcalvano.com· · Observational studyIndependent study

AI crawler traffic grew 96% in one year (May 2024–May 2025), with GPTBot's share of crawler traffic rising from 5% to 30%, based on Cloudflare analysis.

Search Engine Land· · Observational studyAcademic research

OpenAI, Anthropic (ClaudeBot), Meta, ByteDance, and Perplexity crawlers do not render JavaScript. Google (Gemini) and Applebot are the only AI crawlers with full JavaScript rendering. ChatGPT hits 34.82% 404s per crawl session; Claude 34.16%. Prioritize SSR/ISR/SSG for main content, meta information, and navigation. Client-side rendering only for enhancement features.

Vercel· · Observational studyIndustry report

Google has patented a persistent background search system (US12536233B1) that stores unanswered user queries and proactively delivers results across future sessions and devices — including unrelated assistant conversations. The system eliminates the need for users to repeat searches by tracking information needs over time. This represents a fundamental shift toward agentic, proactive search and has GEO implications: content addressing specific unanswered questions is more likely to be surfaced in these autonomous delivery cycles, making direct-answer-format pages and comprehensive FAQ content more valuable.

Search Engine Journal· · Observational studyIndependent study

Google AI Mode in Chrome now opens cited pages side-by-side with the AI conversation, allowing users to compare details and ask follow-up questions without losing context. This change increases the click-through value of AI Mode citations: pages cited in AI Mode are now directly visited more often because the friction of switching tabs is removed. For GEO, this reinforces the importance of being cited in AI Mode — citations now deliver direct page visits, not just AI summary impressions. Pages that are crawlable, mobile-responsive, and load quickly will benefit most from this change.

Google· · Official documentationPlatform official✓ Official

AI-sourced visitors now convert 42% better than other digital channels — a dramatic reversal from a prior period when AI traffic converted 38% worse than average. Revenue per visit from AI referrals is 37% higher, and AI traffic has grown 393% year-over-year across industries. This data establishes the business case for GEO investment: AI search does not merely drive volume, it drives higher-quality visitors who are further into the buying journey when they arrive. Brands optimising for AI visibility are capturing visitors with higher purchase intent.

Adobe Digital Insights· · Observational studyIndustry report

JSON-LD structured data — Google's recommended schema implementation format — is invisible to all 6 AI crawlers tested (0/6 readability score). Meta descriptions and Open Graph tags score equally low: 0/6. Only the <title> tag achieves reliable readability across AI crawlers (5/6). This directly challenges the assumption that implementing schema markup improves AI citation rates through metadata signals. The practical implication: schema markup may benefit traditional search crawlers and humans but does not influence how current AI crawlers ingest page metadata. Content signal, not metadata signal, drives AI discoverability.

Writesonic· · Observational studyIndustry report

The original large-scale empirical confirmation that ChatGPT's citation engine draws primarily from Bing, not Google. 87% of SearchGPT citations match Bing's top organic results; Google achieves only a 56% match at a median citation rank of 17 — meaning pages ranking deep in Google still get cited if they rank well in Bing. This finding, corroborated by subsequent studies, establishes Bing SEO as a distinct and necessary investment for any brand seeking ChatGPT visibility. A Google-only SEO strategy leaves 31% of the citation surface unaddressed.

Seer Interactive· · Observational studyIndependent study

Bing search rankings predict ChatGPT citation rates more reliably than Google rankings. A hotel with dominant Bing presence was cited 19% of the time; a comparable hotel with stronger Google rankings but weaker Bing presence was cited only 1.5% of the time — a 12x difference driven entirely by which search engine ChatGPT draws from. The study corroborates earlier data showing 87% of SearchGPT citations align with Bing's top results. For ChatGPT visibility, Bing SEO is not optional — it is the primary ranking signal.

Search Engine Land· · Controlled experimentIndependent study

LinkedIn is the second most cited domain across all three major AI search platforms — ChatGPT Search, Google AI Mode, and Perplexity — appearing in 11% of AI responses on average. This establishes LinkedIn as a primary AI citation surface, not a secondary channel. AI responses show semantic similarity scores of 0.57–0.60 with original LinkedIn content, indicating substantial direct quotation and paraphrase. For brands and professionals, LinkedIn content is not just a social signal — it is crawled, indexed, and cited by AI search at near-domain-level frequency, making it a first-class GEO publishing surface.

Semrush· · Observational studyIndustry report

In AI Mode, 64% of users make high-stakes purchase decisions without clicking a single link — a complete inversion of traditional search behavior where 89% click through. This means the AI response itself is the product page, the comparison guide, and the salesperson. Being cited accurately and favourably in the AI's text is more commercially valuable than ranking #1 in search results, because the user never arrives at your site to see the ranking.

Growth Memo· · Controlled experimentIndependent study

ChatGPT's internal retrieval rank is the single most powerful predictor of citation — pages at position 1 are cited 58% of the time versus 14% at position 10, a 4× gap. Critically, 58% of pages are never cited and 25% are always cited, with only 17% falling between these poles. This bimodal distribution confirms that citation is not a spectrum — it's a threshold. Content that doesn't rank well in ChatGPT's internal retrieval won't be cited regardless of quality. The practical implication: Bing SEO (which predicts ChatGPT retrieval rank) is more important for AI citation than on-page content optimisation alone.

AirOps· · Observational studyIndustry report

Prompt framing drives an 18x difference in brand mention frequency: a prompt naming a brand generates 14.5 average brand mentions; a category-level query generates 1.68; a generic informational query generates fewer than 1. For brands, this means that being present in the "soft-brand" query space — category-level content that doesn't name a brand but implies one — is the battleground for AI visibility. Brands not appearing in topic-category content lose the majority of AI brand mentions before the user ever types their name.

Moz· · Controlled experimentIndustry report

Each finding is scored by source credibility, recency, and independence.