Bot signals — Search & SEO crawler

DataForSEO Bot IP addresses

Backlink crawler subnets. Normalize IPv6 host bits only because the operator explicitly publishes subnet identifiers.

risk.is_crawler Page parser Reviewed

Check an IP

Is this IP really DataForSEO Bot?

Checks the address against what DataForSEO Bot publishes, the same evidence behind risk.is_crawler.

01 — Verification

How IPAPI.GR verifies DataForSEO Bot.

Only from what DataForSEO Bot publishes about itself. No third-party blocklists, no behavioural guesses. Live address counts change with every publication, so check the official file for the current list.

DataForSEO Bot

risk.is_crawler
Method
Page parser Published ranges, parsed from a documentation page
Format
Documentation page, parsed. A parser reads only the scoped address section; if the page structure changes, the update is rejected rather than guessed.
Refresh
Every hour. If a refresh fails, entries expire after 24 hours instead of being trusted forever.

02 — In the response

What a match looks like.

A lookup of a DataForSEO Bot address sets risk.is_crawler. The flags come with geolocation and network data in the same response, for Pro API keys.

The response says which kind of bot an address belongs to, not which operator. Pair it with the user agent: a request that claims to be DataForSEO Bot but doesn't match is unverified.

GET /api/lookup/{ip}?key=PRO_KEY
{
  // … location and network fields …
  "risk": {
    "is_ai": false,
    "is_crawler": true,
    "is_scanner": false
  }
}

03 — Questions

About DataForSEO Bot.

Where does DataForSEO Bot publish its IP addresses?

DataForSEO Bot publishes its addresses at https://dataforseo.com/dataforseo-bot. IPAPI.GR reads that publication directly, not a third-party copy.

How often is the DataForSEO Bot list refreshed?

IPAPI.GR re-fetches it every hour. If a refresh fails, the previous entries expire after at most 24 hours instead of being trusted forever.

Which risk flag does DataForSEO Bot set?

A matching address sets risk.is_crawler in the lookup response. The risk flags are returned for Pro API keys.

Verify DataForSEO Bot on every request.

Pro: 40,000,000 requests a day with is_ai, is_crawler and is_scanner in every lookup.