Amazon Is Investigating Perplexity over Claims of Scraping Abuse
Amazon's cloud division investigates Perplexity AI for potential scraping abuse, examining violations of AWS rules by using content from blocked websites. Concerns raised over copyright violations and compliance with AWS terms.
Read original article
Amazon's cloud division is investigating Perplexity AI for potential scraping abuse, examining whether the startup violated Amazon Web Services rules by scraping websites that had blocked access. Perplexity, backed by the Bezos family fund and Nvidia, allegedly used content from sites that had forbidden access through the Robots Exclusion Protocol. Despite Perplexity's denial of wrongdoing, investigations revealed instances of scraping abuse and plagiarism. The startup's chatbot, PerplexityBot, was found to ignore robots.txt in specific cases, contrary to AWS terms of service. The IP address associated with Perplexity was traced to an AWS server, prompting the investigation. Digital Content Next expressed concerns over potential copyright violations if Perplexity is found to be disregarding terms of service or robots.txt. Perplexity's spokesperson maintains that their operations comply with AWS terms, except in rare cases where users prompt specific URLs. The investigation continues as Amazon scrutinizes Perplexity's practices regarding scraping and compliance with AWS regulations.
Related
OpenAI and Anthropic are ignoring robots.txt
Two AI startups, OpenAI and Anthropic, are reported to be disregarding robots.txt rules, allowing them to scrape web content despite claiming to respect such regulations. TollBit analytics revealed this behavior, raising concerns about data misuse.
We need an evolved robots.txt and regulations to enforce it
In the era of AI, the robots.txt file faces limitations in guiding web crawlers. Proposals advocate for enhanced standards to regulate content indexing, caching, and language model training. Stricter enforcement, including penalties for violators like Perplexity AI, is urged to protect content creators and uphold ethical AI practices.
Bots Compose 42% of Overall Web Traffic; Nearly Two-Thirds Are Malicious
Akamai Technologies reports 42% of web traffic is bots, 65% malicious. Ecommerce faces challenges like data theft, fraud due to web scraper bots. Mitigation strategies and compliance considerations are advised.
Perplexity's Grand Theft AI
Perplexity, a search engine rivaling Google, faces criticism for being a middleman that undermines original sources' revenue by summarizing content unethically. The CEO's deceptive practices raise concerns about trust and integrity.
Perplexity's Grand Theft AI
Perplexity, a search engine rivaling Google, faces criticism for bypassing original sources, dodging paywalls, and promoting unethical behavior. The CEO's defense raises concerns about trust and integrity online.
2 commentsRelated
OpenAI and Anthropic are ignoring robots.txt
Two AI startups, OpenAI and Anthropic, are reported to be disregarding robots.txt rules, allowing them to scrape web content despite claiming to respect such regulations. TollBit analytics revealed this behavior, raising concerns about data misuse.
We need an evolved robots.txt and regulations to enforce it
In the era of AI, the robots.txt file faces limitations in guiding web crawlers. Proposals advocate for enhanced standards to regulate content indexing, caching, and language model training. Stricter enforcement, including penalties for violators like Perplexity AI, is urged to protect content creators and uphold ethical AI practices.
Bots Compose 42% of Overall Web Traffic; Nearly Two-Thirds Are Malicious
Akamai Technologies reports 42% of web traffic is bots, 65% malicious. Ecommerce faces challenges like data theft, fraud due to web scraper bots. Mitigation strategies and compliance considerations are advised.
Perplexity's Grand Theft AI
Perplexity, a search engine rivaling Google, faces criticism for being a middleman that undermines original sources' revenue by summarizing content unethically. The CEO's deceptive practices raise concerns about trust and integrity.
Perplexity's Grand Theft AI
Perplexity, a search engine rivaling Google, faces criticism for bypassing original sources, dodging paywalls, and promoting unethical behavior. The CEO's defense raises concerns about trust and integrity online.