Kolkata, India — September 2026 — Google and Cloudflare are introducing significant changes to the relationship between search, artificial intelligence and online publishers. This week's developments include Google's pilot program for paying publishers whose content contributes to AI-generated answers, changes to how AI search visibility is reported, Cloudflare's separation of AI training controls from search crawling, and a lower eligibility threshold for Google's Search Profiles.
These developments could have implications for publishers, SEO professionals, content creators and businesses that depend on organic search visibility.
Google Tests Payments for Content Used in AI Answers
Google is testing a program that pays participating publishers when their content contributes significantly to answers generated through products including the Gemini app, AI Overviews and AI Mode.
According to the information provided for this release, Google has confirmed that the program remains in its early stages, with at least dozens of publishers approached about participation.
Under the pilot, publishers may receive payments when their content makes a significant contribution during the creation of an AI answer. Content used only to verify information or content added after an answer has been created does not qualify.
Participating websites receive access to a Search Console panel showing monthly earnings and some historical information. Publishers can also opt out through the relevant settings.
However, the exact calculation behind individual payments remains unclear. The contribution panel reportedly shows a payout without providing a detailed breakdown of how that amount was calculated.
This creates an important question for publishers: while the program provides a new potential source of compensation for content appearing in AI answers, publishers may have limited visibility into how individual contributions are valued.
Google Says AI Search Position Reporting Is Difficult
Google Search's traditional ranking model has historically focused on positions such as first, second and third place. AI-generated search experiences make that model more difficult to apply.
Google's John Mueller recently commented on the challenge of reporting AI search positions in a useful way.
The AI-related Search Console report does not provide traditional position data. Instead, the underlying Search performance information uses existing web-search data.
An impression is recorded when the relevant feature appears on the served search-results page, while links located behind a "Show More" interaction are not counted until that section is expanded.
For links appearing within an AI-generated result, the reported position reflects the location of the overall AI feature rather than the precise position of the individual link inside the generated answer.
This creates a measurement challenge for SEO teams attempting to understand exactly where their content appears within AI-generated search experiences.
The traditional "position 1–10" framework does not necessarily describe visibility inside AI-generated answers accurately.
Cloudflare Separates AI Training From Search Crawling
Cloudflare has introduced a Disallow AI Training setting designed to allow websites to prevent AI training use while continuing to permit search-engine crawling.
The change is particularly relevant for mixed-use crawlers that may perform both search and AI-related activities.
Under the new approach, websites can publish a no-training preference through robots.txt while continuing to allow crawlers such as Googlebot, Applebot and Bingbot to access content for search purposes.
Cloudflare previously explained that its broader blocking option could prevent both AI and search crawling. The new setting provides a more specific alternative for website owners who want to distinguish between search indexing and AI training.
Existing training-related configurations will be updated to correspond with the new approach, while older Cloudflare options such as Block AI Bots and Managed Robots.txt are being deprecated.
Google manages its corresponding training preference through Google-Extended, while Apple uses Applebot-Extended.
Cloudflare has also stated that Microsoft does not yet support a robots.txt no-training preference, although work on such support is expected in early 2027.
Importantly, preventing AI training does not automatically determine whether pages appear in Google AI Overviews or AI Mode. Those search-appearance controls are managed separately.
Google Lowers Search Profile Eligibility to 10,000 Followers
Google has also reduced the follower requirement for its Search Profiles feature to 10,000 followers.
The requirement is calculated per account on platforms including:
• YouTube
• Instagram
• X
• TikTok
When Search Profiles launched in June, the threshold was reportedly 100,000 followers on YouTube, Instagram or X and 300,000 followers on TikTok.
The threshold was subsequently reduced to 35,000 followers across the four platforms before being lowered again to 10,000.
The feature currently remains available only in the United States.
Google's Search Profiles allow eligible publishers to establish a profile associated with their content. Media organisations can also use a single login across multiple brands.
Google has stated that Search Profiles do not directly influence traditional Search rankings. Instead, profiles can appear in Discover, where followers may receive more content from the associated publisher.
For example, a U.S.-based publisher with 12,000 YouTube subscribers that previously fell below the eligibility threshold may now qualify for a Search Profile.
A Changing Relationship Between Search and AI
Together, these developments highlight a broader change in how publishers interact with search platforms and AI systems.
Google is experimenting with direct compensation when publisher content contributes significantly to AI answers.
At the same time, Search Console is still working through how to measure visibility within AI-generated results.
Cloudflare is giving website owners greater control over whether content can be used for AI training without necessarily blocking traditional search crawlers.
Meanwhile, Google's lower Search Profile threshold provides more publishers with access to a feature designed to strengthen their presence within Google's ecosystem.
Why These Developments Matter to Publishers
For publishers and SEO professionals, several areas deserve attention.
AI Content Monetisation
Google's payment pilot could create a new model in which publishers receive compensation for content that makes significant contributions to AI-generated answers.
However, the current information indicates that the underlying payment calculation is not fully transparent.
AI Search Measurement
Traditional ranking reports may not adequately explain visibility inside AI-generated answers.
SEO teams may therefore need to consider impressions, appearances, citations and other signals alongside conventional ranking positions.
AI Training Controls
Website owners can increasingly distinguish between allowing search crawlers to access content and permitting that content to be used for AI training.
This gives publishers another consideration when developing their crawler and content-access policies.
Publisher Identity
The reduction of the Search Profile threshold to 10,000 followers potentially expands eligibility to a larger group of publishers and creators in the United States.
The Bigger Picture
One theme connects these developments: the numbers are becoming easier to see, but the underlying calculations are not always equally clear.
Google's AI payment pilot provides publishers with payout information but reportedly offers limited detail about how individual contributions are valued.
Google's AI search reporting provides impressions but does not provide a conventional position for individual links inside AI-generated answers.
Cloudflare, meanwhile, is introducing more explicit controls around AI training and crawler behaviour.
For publishers, understanding the difference between visibility, contribution, indexing, AI training and compensation will become increasingly important as search continues to evolve.
About Alphanumeric Ideas
Alphanumeric Ideas is a Digital Growth and Digital Empowerment Organization working at the intersection of culture, design and technology.
The organisation focuses on helping modern businesses build stronger digital identities through strategy, design, technology and digital marketing.
Alphanumeric Ideas believes that effective brands are built around clarity. Its approach focuses on creating digital experiences and marketing strategies that help businesses communicate their value more effectively.
Website: https://alphanumericideas.com
Email: [email protected]
Phone: 1800 890 1188