Yahoo! Site Explorer

» see siteexplorer.search.yahoo.com as it lived, on the wayback machine

~ the obituary ~

yahoo site explorer was a single text box. you typed in a url. the page returned the list of urls yahoo had indexed on that domain plus the list of urls that linked to it. for the second half of the 2000s this was the canonical free backlink tool on the web. ahrefs did not exist yet. majestic was small. moz open site explorer launched only in 2010. ysed was the default.

yahoo opened it on 29 september 2005 at siteexplorer.search.yahoo.com. authenticated webmasters got extra features: sitemap submission, url removal requests up to twenty per domain, dynamic-url parameter handling. unauthenticated users got the bare query, which was the part that made the tool famous. you could read anyone's link graph without owning their domain. that part stayed free for six years.

site explorer's run from 2005 to 2011 overlaps with my dorm broadband and my early professional years. i did not do seo work then. the tool surfaced for me later as a citation in 'rip yse' blog posts after the bing migration. engineer-side awareness of what it was, not user-side memory of using it.

~ the case file ~

~ what it actually did ~

the two real queries were "show all pages indexed on this domain" and "show all pages pointing inbound at this domain or url". the first one was a sitemap-style audit. the second one was the seo workflow: take a competitor's url, dump its inbound link list, sort by referring domain, find the link sources you did not yet have, go pitch yourself onto those same pages. the entire 2006 to 2011 seo industry ran on a version of this loop.

the underlying index was inktomi infrastructure, which yahoo had bought in 2002 and rebuilt into yahoo search. inktomi's crawler was old enough to have rich link-graph data, and yahoo did not gate access. you got the raw counts plus a paginated list. for a free tool with no api key required, this was a generous surface.

~ what it influenced ~

the 29 july 2009 deal between microsoft and yahoo signed away the search index. under the agreement, bing's crawler would power yahoo search and yahoo would close its own crawl. that decision had two years of runway to actually close, and site explorer was on the close list from the start. the formal shutdown landed on 21 november 2011. the migration path was bing webmaster tools, but it was not the same product. bing webmaster tools shows you backlinks to sites you have verified as owner. it does not let you read someone else's link graph.

the free-public-backlinks slot was empty between november 2011 and the rise of moz open site explorer (already running), ahrefs (2011), majestic (existing), and later semrush. all of them moved to paid subscription models within a few years. ysed's closure is the last time backlink data was widely free.

@}-->--

              )
             (_)
            .-'-.
            |   |
            |   |
            |   |
            |   |
          __|   |__   .-.
       .-'  |   |  `-:   :
      :     `---'     :-'
       `-._       _.-'
           '""""""

« previous  ·  random  ·  next »