[invisit](https://invisit.dev) · [Docs](https://invisit.dev/docs) · [llms.txt](https://invisit.dev/llms.txt) · [llms-full.txt](https://invisit.dev/llms-full.txt)

# Yahoo! Slurp

> Yahoo! Slurp is a search engine crawler run by Yahoo. Yahoo Search's robot for crawling and indexing pages. It also collects content from partner sites for Yahoo News, Finance and Sports.

- Operator: Yahoo
- Kind: Search engine crawler
- robots.txt token: Slurp
- Follows robots.txt: yes
- Source: https://help.yahoo.com/kb/SLN22600.html (checked 2026-11-05)
- Page: https://invisit.dev/bots/yahoo-slurp

## What is Yahoo! Slurp?

Yahoo Search's robot for crawling and indexing pages. It also collects content from partner sites for Yahoo News, Finance and Sports.

Crawls pages for a classic search index. Blocking it removes you from that search engine.

Yahoo says some of its search results are powered by partners, but sites should allow Slurp to appear in Yahoo Mobile Search. Slurp supports Crawl-delay.

- [Yahoo’s documentation](https://help.yahoo.com/kb/SLN22600.html)

## Yahoo! Slurp user agent

Yahoo documents this user agent for Yahoo! Slurp. Version numbers in it change over time, so match on the name, not the whole string.

```
Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
```

## Should you block Yahoo! Slurp?

Allow it unless you want out of that search engine. Blocking a major search crawler removes your pages from its results.

## How to block Yahoo! Slurp in robots.txt

Add a group for its token to robots.txt at the root of your site.

A bot follows only the group that names it, so it ignores your `User-agent: *` rules once it has a group of its own. Repeat any paths you also want kept from it there.

```
User-agent: Slurp
Disallow: /
```

- [Build a robots.txt for AI bots](https://invisit.dev/tools/robots-txt-generator)

## How to verify a request is really Yahoo! Slurp

Anyone can send any user agent, so the string alone proves nothing.

Yahoo publishes no IP ranges or DNS names for Yahoo! Slurp that we could find, so there is no reliable way to tell a real Yahoo! Slurp from a scraper using its user agent.

## See when Yahoo! Slurp reads your site

Bots don’t run JavaScript analytics, so a script tag never sees them. invisit records crawler reads on the server instead, through its server SDK or a Cloudflare Worker, and shows which bots read which pages, next to your visitors.

- [Track crawlers with invisit](https://invisit.dev/docs/server/sdk#crawler-reads)

## Common questions

### What is Yahoo! Slurp?

Yahoo! Slurp is a search engine crawler run by Yahoo. Yahoo Search's robot for crawling and indexing pages. It also collects content from partner sites for Yahoo News, Finance and Sports.

### Is Yahoo! Slurp safe to block?

Allow it unless you want out of that search engine. Blocking a major search crawler removes your pages from its results.

### How do I block Yahoo! Slurp?

Add “User-agent: Slurp” followed by “Disallow: /” to your robots.txt.