In June 2024, independent investigations with the magazine Wired and World wide web developer Robb Knight uncovered that Perplexity would not regard the Robot Exclusion Protocol (or robots.txt) common, which can include requests for World wide web crawlers not to scrape sections of the internet site