robotstxt
-
Perplexity Is Reportedly Letting Its AI Break a Basic Rule of the Internet
Perplexity wants to change how we use the internet, but the AI search startup backed by Jeff Bezos might be breaking its rules to do so. The company appears to be ignoring a widely accepted web standard, the Robots Exclusion Protocol, to scrape parts of the web that operators don’t want to be accessed by…