Skip to main content

Should we all configure our web servers to return a HTTP 402 (Payment Required) when #AI bots are crawling?

Right now I have https://linux-audit.com/ still open for AI, but must admit I also have some doubts.

cc @nixCraft @LWN @itsfoss

#AI @It's FOSS @LWN.net @nixCraft 🐧
This entry was edited (2 months ago)
in reply to Michael Boelen

It's FOSS
It's FOSS
• •
This is something we haven't considered yet. Many AIs are turning into search engines of their own and what was SEO earlier, now changes to AIO. Blocking all AI may result in losing (some) potential traffic from popular AI services. A double-edged sword, it is.
in reply to It's FOSS

Michael Boelen
Michael Boelen
• •
Yes, but they don't provide a search engine in the classical way. They care more about the answer they return than rewarding the contributor of the answer. Some do display the sources they used to come up with the answer, but most likely you will not get anything out of it (no click, very limited visibility). I want to go with the flow and support new technologies, but I'm not on board yet with this AI train.
in reply to Michael Boelen

It's FOSS
It's FOSS
• •
That is indeed true. This is why we have not been able to make up our minds about it. For now, we keep on producing content for readers.

Lo, thar be cookies on this site to keep track of your login. By clicking 'okay', you are CONSENTING to this.

⇧