Microsoft confirms Reddit blocked Bing Search
Reddit will block Bing and other search engines from crawling its site starting July 1, 2024, while maintaining access for Google, amid a partnership that boosts traffic to the platform.
Read original article
Reddit has updated its robots.txt file to block Bing and several other search engines from crawling its site, effective July 1, 2024. A Microsoft representative confirmed that Bing ceased crawling Reddit following this update, which prohibits all crawling of the site. Despite speculation, Reddit has not blocked Google from crawling its content. The decision to restrict access to most other search engines comes amid Reddit's recent partnership with Google, which has significantly increased traffic to the platform. Reddit's spokesperson stated that discussions with various search engines have not led to agreements, particularly regarding the use of Reddit content for AI purposes. As a result, Bing users will notice a lack of new Reddit content in search results. This move raises questions about the potential for other large websites to adopt similar strategies, potentially impacting smaller publishers and content creators.
Related
Bing censors mentions of Xi Jinping more than Chinese competitors
A study by University of Toronto's Citizen Lab found Microsoft's Bing heavily censors Xi Jinping mentions in China, more than local services. U.S. lawmakers express concerns over compliance with Beijing's demands.
Reddit has updated its robots.txt to block all web crawlers
Reddit updated its robots.txt file to block web crawlers, aiming to protect user privacy and prevent content misuse. This change impacts data access for entities like Google, potentially hindering legitimate research. CEO Steve Huffman emphasizes balancing data use costs. The effects on search engines and partnerships are uncertain.
Google Now Defaults to Not Indexing Your Content
Google has changed its indexing to prioritize unique, authoritative, and recognizable content. This selective approach may exclude smaller players, making visibility harder. Content creators face challenges adapting to Google's exclusive indexing, affecting search results.
Link-Busters Sent a Billion DMCA Takedown Requests to Google Search
Link-Busters sends over a billion DMCA takedown requests to Google Search to combat shadow libraries. Penguin Random House leads the effort, with 75% success rate in removing infringing URLs.
Google Is the Only Search Engine That Works on Reddit Now Thanks to AI Deal
Google secures exclusive search rights on Reddit through a lucrative deal, hindering other search engines' access. Reddit tightens restrictions to safeguard content and address challenges posed by dominant search engines.
8 commentsI would imagine the publishing industry to follow suit shortly and the academic knowledge discovery which was one of the core early reasons for the web to dissappear. And now we will lose much more than reddit reviews about products...etc.
I think this is another case where market forces does work but against the interests of the society. Usually when people say market forces work, they are right but don't specify in which direction and who benefits from that.
Just like ads company completely ignoring Do Not Track because it's always set to deny / opt-out by the browser. It's already been fixed, but the damages is already done.
https://en.wikipedia.org/wiki/Do_Not_Track#Internet_Explorer...
And as a reddit user, I can assure you nothing of value has been lost.
But some good news —- Duck Duck Go will now be Reddit free!
Google is the only search engine that works on Reddit now, thanks to AI deal
Related
Bing censors mentions of Xi Jinping more than Chinese competitors
A study by University of Toronto's Citizen Lab found Microsoft's Bing heavily censors Xi Jinping mentions in China, more than local services. U.S. lawmakers express concerns over compliance with Beijing's demands.
Reddit has updated its robots.txt to block all web crawlers
Reddit updated its robots.txt file to block web crawlers, aiming to protect user privacy and prevent content misuse. This change impacts data access for entities like Google, potentially hindering legitimate research. CEO Steve Huffman emphasizes balancing data use costs. The effects on search engines and partnerships are uncertain.
Google Now Defaults to Not Indexing Your Content
Google has changed its indexing to prioritize unique, authoritative, and recognizable content. This selective approach may exclude smaller players, making visibility harder. Content creators face challenges adapting to Google's exclusive indexing, affecting search results.
Link-Busters Sent a Billion DMCA Takedown Requests to Google Search
Link-Busters sends over a billion DMCA takedown requests to Google Search to combat shadow libraries. Penguin Random House leads the effort, with 75% success rate in removing infringing URLs.
Google Is the Only Search Engine That Works on Reddit Now Thanks to AI Deal
Google secures exclusive search rights on Reddit through a lucrative deal, hindering other search engines' access. Reddit tightens restrictions to safeguard content and address challenges posed by dominant search engines.