Jason Koebler / 404 Media:

Some popular sites like Condé Nast's and Reuters' have robots.txt files meant to block Anthropic's bots, but Anthropic has just made new bots with other names  —  Hundreds of sites have put old Anthropic scrapers on their blocklist, while leaving a new one unblocked.

Jason Koebler / 404 Media:

Some popular sites like Condé Nast's and Reuters' have robots.txt files meant to block Anthropic's bots, but Anthropic has just made new bots with other names  —  Hundreds of sites have put old Anthropic scrapers on their blocklist, while leaving a new one unblocked.

Source: TechMeme
Source Link: http://www.techmeme.com/240729/p12#a240729p12