| Spider | Engine | User-Agent (click to copy) | Known IPs / Verification |
|---|
Search engine crawlers (spiders) fetch your pages so they can be indexed. This page lists the most common crawlers — Googlebot, Bingbot, Baiduspider, YandexBot, DuckDuckBot, 360Spider, Sogou web spider, Bytespider (Toutiao) and Yisou/Shenma — with the User-Agent string they send, the IP ranges each search engine publishes, and how to tell a real bot from a faked one.
Because any script can put "Googlebot" in its User-Agent, the reliable way to verify a crawler is a forward-confirmed reverse DNS lookup: run a reverse DNS on the visitor IP, confirm the hostname belongs to the engine's official domain (like googlebot.com or crawl.baidu.com), then run a forward DNS on that hostname and check it resolves back to the same IP. Click any User-Agent to copy it. Type in the search box to filter by spider name, engine or verification domain. Everything runs locally in your browser.