Cloudflare and OpenAI Launch Pilot to Index Millions of New Web Pages for ChatGPT

Cloudflare and OpenAI launched a research pilot in July 2026 to test whether Cloudflare's network signals can help ChatGPT users discover new content more efficiently. The pilot incorporates previously unknown pages into OpenAI's search index, providing ChatGPT with more sources to reference. The pilot utilizes about 1% of Cloudflare's global participation queue, and OpenAI has discovered and indexed hundreds of millions of new web pages. OpenAI ranks the content by relevance and usefulness, and ChatGPT Search allows users to view the original content and publishers through backlinks. Observations indicate that automated traffic may make non-existent pages appear noteworthy, with some sites redirecting arbitrary addresses to their homepages or pointing to duplicate content. The two parties are also testing signals to identify potentially harmful pages, such as fake login pages embedded on legitimate sites, and advocate for marking single pages rather than entire domains. Relevant signals are used to filter out non-existent or redirecting pages and to assess whether unchanged pages are worth revisiting. Page signals do not constitute access permission; the research uses web metadata intended for search and discovery, rather than page content for model training. Site owners can understand and manage how AI systems access their websites through Cloudflare's AI Crawl Control. The next phase will improve page selection and test faster, more reliable change signals.

This content is provided for general informational purposes only and doesn't constitute financial, investment, legal, or tax advice. Any events, rewards, online promotions, or related information mentioned herein should not be considered a recommendation, solicitation, or invitation to purchase, sell, trade, or otherwise deal in any crypto assets. Crypto assets are highly volatile and may result in loss. The availability of WEEX services, products, and related events may vary by region. You are responsible for ensuring that your participation is in accordance with applicable local laws and regulations.