Lycos / Excite / HotBot / WebCrawler / Magellan

~ here lie the second-tier search engines ~

Before Google won the search war, there was a real search-engine market. Between 1994 and 2000, perhaps a dozen credible competitors fought for share, each with their own technology, brand, and editorial sensibility, because the major ones:

• Lycos (founded 1994, Carnegie Mellon University), the dog logo, the slogan "Lycos has changed the world," the eventual Telefónica buyout.
• Excite (founded 1994, Stanford). "concept-based search," the @Home Network merger that destroyed the company.
• HotBot (founded 1996, Inktomi), the futuristic dark UI, the search-it-all marketing.
• WebCrawler (founded 1994, University of Washington), the first full-text web search engine, sold to AOL.
• Magellan (founded 1995); the first to rate web pages with editorial reviews.
• Inktomi (founded 1996); not a consumer brand, but the search backend powering many of the above.
• Northern Light (founded 1995), aimed at researchers, with a "subscriber" model for premium results.

By 2003, all of these had either been bought, pivoted away from search, or quietly retired, because google's market dominance from 2004 onwards reduced the remainder to a long tail of also-rans. As of 2026, Lycos technically still exists as a search portal, run by a Korean parent company; Excite has had several owners; HotBot is dormant. The brands persist; the cultural moment is firmly historical.

~ the era ~

The window between 1994 and 1999 was, the only period when general-purpose web search was a competitive market. The dynamics:

Each engine had its own technology. Lycos's algorithm prioritised certain ranking signals; Excite's prioritised others. HotBot used Inktomi's backend. AltaVista (covered separately in this graveyard) used DEC's technology. None of these engines returned the same results for a given query.

Power users used multiple engines. A serious researcher in 1996 might run the same query through Lycos, AltaVista, Excite, and HotBot, comparing results. Some sites (Dogpile, Mamma) explicitly aggregated results across engines, what we would now call "metasearch."

The portal pivot. By 1998, several search engines had repositioned themselves as "portals", homepage destinations bundling search with news, weather, stock prices, email, instant messaging, horoscopes, and shopping. Excite was aggressive about this. The portal pivot was supposed to monetise users beyond search. It failed: search users wanted to search, not browse a Yahoo-style cluttered homepage.

~ how Google killed them all ~

Google's launch in September 1998 was, at first, not noticed. The site was a clean white page with a search box. No portal features. No bundled email. No homepage clutter. The search returned, on most queries, more useful results than the competition.

Three things Google did differently:

• PageRank. Larry Page's algorithm used the structure of inbound links to web pages as a relevance signal. Pages that other reputable pages linked to were ranked higher. The signal was difficult to game (briefly) and produced visibly better results than competitors' approaches.
• Speed. Google's pages loaded faster than the competition. The competitors' homepages were 50-100KB of HTML; Google's was 5KB. On 1999 internet connections this difference was noticeable.
• The simplicity discipline. Google deliberately did not add portal features. The search box was the homepage. The competitors interpreted this as Google being "less full-featured." Users interpreted it as Google respecting their attention.

By 2002, Google had become the default search engine for power users. By 2004, Google had passed Yahoo for total search market share. By 2007, Google had over 60% of US search and was approaching dominance. The competitors were, by then, irrelevant.

~ specific brand stories ~

• Lycos. Bought by the Spanish telecom Terra Networks in 2000 for $12.5 billion (one of the largest dot-com-bubble acquisitions). Sold to a Korean company, Daum Communications, in 2004 for $95 million, a 99.2% loss in four years. Lycos was rebooted multiple times. The current Lycos.com is a small ad-supported search portal.
• Excite. The Excite@Home merger in 1999 combined Excite (a portal) with @Home (a cable broadband ISP). The combined company had a market cap of $36 billion in 2000. By September 2001 the combined entity was bankrupt. Excite the brand was sold in 2004 to InfoSpace and now exists as a small portal.
• HotBot. Owned by Wired Magazine briefly, then Lycos, then Daum Kakao. The brand has been dormant since about 2010.
• WebCrawler. Sold to AOL in 1995, then to Excite in 1996. Now owned by InfoSpace and runs as a metasearch engine aggregating results from Google and Bing.

~ aftermath ~

The search market. Google's monopoly on search has produced a single ranking algorithm that determines what gets visibility on the open web. The pre-Google era had multiple algorithms competing. The diversity of ranking philosophies was real: AltaVista's link-counting, Excite's concept-matching, Lycos's keyword-density, Northern Light's editorial-curated. Modern search is a single voice.

The "metasearch" model. Sites like Dogpile and Mamma that aggregated results across multiple engines are now meaningless because the aggregated engines all use Google or Bing as their backend. The metasearch concept makes sense only when there are multiple independent search providers. There aren't.

The portal homepage. Google's clean-page philosophy won. The portal homepages of Lycos and Excite, with their cluttered news-weather-stocks layouts, are universally considered bad design now. But the portal model also offered something: a single landing page with everything you might need. The current internet has no equivalent. We log into Google for search, Twitter for news, Spotify for music. The portal era at least tried to put it all in one place.

~ the eulogies ~

"i had lycos as my homepage from 1996 to 2001. when i finally switched to google in 2001 it felt like turning off a radio that had been playing in the background for five years.". a.k. 49

"the lycos dog mascot, ren the labrador, was on my screensaver in 1998. i did not have a dog. i wanted to. ren was a substitute friendship.". m.r. 47

"the moment google won the search war was the moment a particular kind of internet plurality died. we did not know it at the time. it has not been better since.", e.t. 51