WebCrawler – search engine operating for 30 years
WebCrawler, active since 1994, was one of the first search engines with full-text search. Acquired by AOL and later Excite, it now belongs to System1 after facing competition and ownership changes.
Read original articleWebCrawler is a search engine that has been active since April 1994, making it one of the oldest search engines still in operation. Initially developed by Brian Pinkerton as a desktop application at the University of Washington, WebCrawler was the first search engine to offer full-text search capabilities. Over the years, it underwent various ownership changes, including being acquired by AOL in 1995 and later by Excite in 1997. Eventually, WebCrawler was integrated into Excite's database in 2001, marking the end of its independent search engine status. In 2018, the search engine underwent a redesign and rebranding. Despite its early success, WebCrawler faced challenges with server overload and competition from other search engines like Yahoo!, Infoseek, Lycos, and Excite. Today, WebCrawler is owned by System1, formerly known as OpenMail, after being sold by InfoSpace in 2016.
Related
Before Smartphones, an Army of Real People Helped You Find Stuff on Google
Before smartphones, human-powered services like GOOG-411, 118 118, and AQA provided information. They declined with cheaper data plans, giving way to automated search engines, missing the personal touch and unique responses.
The Greatest Social Media Site Is Craigslist (Yes, Craigslist)
Craigslist, founded in 1995, remains popular with 180 million visits in May 2024. It offers free services with select paid posts, focusing on simplicity and user trust. Despite criticisms, it provides a unique space for genuine connections in a profit-driven digital world.
Organize Links with Precision and Speed
WebCull is a privacy-focused bookmark management tool with efficient features like folder creation, drag-and-drop organization, sharing via custom URLs, encryption, browser extensions, and planned multilingual support and AI integration.
Show HN: Crawlee for Python – a web scraping and browser automation library
Crawlee for Python is a powerful web scraping and browser automation library with features like scaling, proxy management, and Playwright integration. It's open source, supports Python 3.9+, and aids in efficient web scraping.
WhatWeb: Next Generation Web Scanner (2021)
WhatWeb is a web scanner on GitHub by Andrew Horton and Brendan Coles. It identifies websites, web technologies, and CMS. With 1800+ plugins, it offers detailed insights on websites.
Related
Before Smartphones, an Army of Real People Helped You Find Stuff on Google
Before smartphones, human-powered services like GOOG-411, 118 118, and AQA provided information. They declined with cheaper data plans, giving way to automated search engines, missing the personal touch and unique responses.
The Greatest Social Media Site Is Craigslist (Yes, Craigslist)
Craigslist, founded in 1995, remains popular with 180 million visits in May 2024. It offers free services with select paid posts, focusing on simplicity and user trust. Despite criticisms, it provides a unique space for genuine connections in a profit-driven digital world.
Organize Links with Precision and Speed
WebCull is a privacy-focused bookmark management tool with efficient features like folder creation, drag-and-drop organization, sharing via custom URLs, encryption, browser extensions, and planned multilingual support and AI integration.
Show HN: Crawlee for Python – a web scraping and browser automation library
Crawlee for Python is a powerful web scraping and browser automation library with features like scaling, proxy management, and Playwright integration. It's open source, supports Python 3.9+, and aids in efficient web scraping.
WhatWeb: Next Generation Web Scanner (2021)
WhatWeb is a web scanner on GitHub by Andrew Horton and Brendan Coles. It identifies websites, web technologies, and CMS. With 1800+ plugins, it offers detailed insights on websites.