What is Sogou spider?
Sogou's search engine program, which visits pages, stores them and follows new links so they can be found in Sogou search.
Crawls pages for a classic search index. Blocking it removes you from that search engine.
Sogou says its spider supports robots.txt but names no token and publishes no user agent string. It says robots.txt changes may take weeks to take effect.
Should you block Sogou spider?
Allow it unless you want out of that search engine. Blocking a major search crawler removes your pages from its results.
How to block Sogou spider in robots.txt
Sogou documents no robots.txt token for Sogou spider that we could confirm, so we don’t suggest one here. Block it at your server or firewall by user agent instead.
How to verify a request is really Sogou spider
Anyone can send any user agent, so the string alone proves nothing.
Sogou publishes no IP ranges or DNS names for Sogou spider that we could find, so there is no reliable way to tell a real Sogou spider from a scraper using its user agent.
See when Sogou spider reads your site
Bots don’t run JavaScript analytics, so a script tag never sees them. invisit records crawler reads on the server instead, through its server SDK or a Cloudflare Worker, and shows which bots read which pages, next to your visitors.
Checked against Sogou’s own documentation on . Something changed? Write to help@invisit.dev.