ProRata Gist crawler
risk.is_airisk.is_crawler
- Method
- Ranges Published IP ranges
- Format
- Documentation page, parsed
- Refresh
- Every hour. If a refresh fails, entries expire after 24 hours instead of being trusted forever.
Bot signals — AI crawler & agent
Published production and testing crawler egress for Gist RAG retrieval.
01 — Verification
Only from what ProRata Gist crawler publishes about itself. No third-party blocklists, no behavioural guesses. Live address counts change with every publication, so check the official file for the current list.
risk.is_airisk.is_crawler
02 — In the response
A lookup of a ProRata Gist crawler address sets risk.is_ai and risk.is_crawler. The flags come with geolocation and network data in the same response, for Pro API keys.
This publication is AI crawling or retrieval traffic, so it counts as both an AI source and a crawler.
The response says which kind of bot an address belongs to, not which operator. Pair it with the user agent: a request that claims to be ProRata Gist crawler but doesn't match is unverified.
{
// … location and network fields …
"risk": {
"is_ai": true,
"is_crawler": true,
"is_scanner": false
}
}
03 — Questions
ProRata Gist crawler publishes its addresses at https://platform.gist.ai/docs/prorata-ai-crawler-bot. IPAPI.GR reads that publication directly, not a third-party copy.
IPAPI.GR re-fetches it every hour. If a refresh fails, the previous entries expire after at most 24 hours instead of being trusted forever.
A matching address sets risk.is_ai and risk.is_crawler in the lookup response. The risk flags are returned for Pro API keys.
Pro: 40,000,000 requests a day with is_ai, is_crawler and is_scanner in every lookup.