What is Webz.io?
It crawls websites for Webz.io, which structures news, blog, discussion and review content into data for software companies.
Collects pages to train language models. Blocking it keeps your pages out of future training data, and does not remove you from AI search answers.
Webz.io presents Webzio as the successor to its older Omgilibot crawler. It publishes no user agent string or IP list.
Should you block Webz.io?
Block it if you don’t want your pages used to train models; nothing else changes. Allow it if you’d rather future models know your product, docs or writing.
How to block Webz.io in robots.txt
Add a group for its token to robots.txt at the root of your site.
A bot follows only the group that names it, so it ignores your User-agent: * rules once it has a group of its own. Repeat any paths you also want kept from it there.
Webz.io describes a second bot, Webzio-extended, that tags collected data as usable or not for AI training, but does not say how a site addresses it.
User-agent: Webzio
Disallow: /How to verify a request is really Webz.io
Anyone can send any user agent, so the string alone proves nothing.
Webz.io publishes no IP ranges or DNS names for Webz.io that we could find, so there is no reliable way to tell a real Webz.io from a scraper using its user agent.
See when Webz.io reads your site
Bots don’t run JavaScript analytics, so a script tag never sees them. invisit records crawler reads on the server instead, through its server SDK or a Cloudflare Worker, and shows which bots read which pages, next to your visitors.
Checked against Webz.io’s own documentation on . Something changed? Write to help@invisit.dev.