I don't think this is something where looking for a technical solution makes sense. It should be illegal for AI crawlers to collect unlicensed training material, rather than requiring every website to keep up with an every growing list of AI crawlers that are free to ignore robots.txt.
@Gargron It should be, and maybe it even is, but until someone actually stops them from doing it, the problem persists. Some lightweight protections feel important in that context.
Eugen Rochko
in reply to Ben Werdmuller • • •Ben Werdmuller
in reply to Eugen Rochko • • •