Friday, 29. June 2007
Topic: WEB - on June 29, 2007 at 2:11:00 PM CEST
Yahoo Slurp Makes a Mess
For months we’ve been carefully watching how the various bots consume Urbanspoon. We enticed them inside with fresh content, well constructed pages, and sitemaps. Despite our efforts, until quite recently Yahoo Slurp didn’t have much of an appetite for Urbanspoon. Instead of digging in and indexing the whole site, Yahoo Slurp preferred to nibble around the edges.
... Comment
