Google Now Offers Publishers The Option To Hide Their Content From Bard AI

Google has introduced an additional control feature within its robots.txt indexing file called Google-Extended. This new functionality grants web publishers the authority to determine the utilization of their content by the Bard and Vertex AI generative APIs.

The core purpose of this control is to provide publishers with the option to exclude their work from participation in these specific artificial intelligence applications. Google’s decision to implement this feature is in response to feedback from web publishers who desire increased autonomy and influence over how their content is employed in generative AI use cases.

The primary objectives of Google-Extended are centered around transparency and control in the context of AI models. Publishers have expressed reservations regarding consuming and redistributing their material by generative chatbots like Bard and Bing AI. These systems aggregate information from various sources and deliver it to users, potentially reshaping traffic patterns for individual websites and affecting advertising revenue and business models.

It’s important to note that these opt-out options will extend to the next generation of Bard and Vertex AI models. Publishers can maintain control over their content by continuing to employ the Googlebot user agent and the NOINDEX meta tag within their robots.txt document, effectively excluding their work from inclusion in the Search Generative Experience (SGE).

As AI applications continue to expand, web publishers face the growing challenge of managing content usage at scale. The development of tools based on generative AI has witnessed substantial growth in recent times. Google’s introduction of a control feature highlights its awareness of the potential impact its products could have on the web ecosystem.

[via Google, Engadget and 9to5Google, Photo 276573426© Waingro| Dreamstime.com]