LIVE OBSERVATORY TELEMETRY FEED

Transparent AI Crawler Observatory & Behavioral Benchmark

Empirically measuring how autonomous AI crawlers (GPTBot, ClaudeBot, PerplexityBot) and search bots navigate, evaluate links, execute JavaScript, and reason across the open web.

Explore AI Behavioral Insights Enter Benchmark Lab Download Open Dataset →
Total Telemetry Requests
122
Aggregated across all crawler families
Verified AI / Search Bots
1
1% confirmed with official IP CIDRs
First-Link Selection Bias
48%
Agents favor position 1 over lower links
Benchmark Runs Completed
0
Deterministic & semantic solvers

24-Hour Telemetry Volume

Verified Bots vs. Claimed vs. Human Sessions
Rolling 24h
Verified Vendor Bots Claimed / Suspected Likely Human

Classification Distribution

Strict evidence-based categorization
Methodology →
Verified Vendor Bot (Official IP) 1
Claimed Bot (Unverified IP) 0
Goal-Directed Automation (Lab Solver) 8
Suspected Crawler (Scraper / Headless) 9
Likely Human (Browser + Beacon) 51
INTERACTIVE TOOL

Bot Traffic Simulator & Classifier Tester

Test how different crawlers, AI agents, scrapers, and IP blocks get classified in real time

Real-Time Telemetry Stream

Latest 30 requests processed by the observatory edge
Timestamp Path Crawler / Family Classification Status JS Beacon Latency
22:56:26 / unknown Unknown 200 ○ NO 397ms
22:56:26 / unknown Unknown 200 ○ NO 404ms
22:54:32 / unknown Unknown 200 ○ NO 422ms
22:35:57 /beacon browser-human Likely Human 204 ● YES 86ms
22:35:55 / browser-human Likely Human 200 ○ NO 241ms
22:35:48 /beacon browser-human Likely Human 204 ● YES 93ms
22:35:47 / browser-human Likely Human 200 ○ NO 427ms
22:31:38 /data/latest.json generic-scraper Suspected Crawler 200 ○ NO 57ms
22:31:21 /beacon browser-human Likely Human 204 ● YES 37ms
22:31:21 / unknown Unknown 200 ○ NO 67ms
22:31:20 /beacon browser-human Likely Human 204 ● YES 63ms
22:31:19 / browser-human Likely Human 200 ○ NO 359ms
22:05:56 /beacon browser-human Likely Human 204 ● YES 11ms
22:05:56 / browser-human Likely Human 200 ○ NO 49ms
22:05:45 /beacon browser-human Likely Human 204 ● YES 10ms
22:05:45 /experiments/navigation-v1 browser-human Likely Human 200 ○ NO 12ms
22:05:40 / generic-scraper Suspected Crawler 200 ○ NO 264ms
22:05:05 /beacon browser-human Likely Human 204 ● YES 44ms
22:05:05 /insights browser-human Likely Human 200 ○ NO 243ms
22:03:50 /beacon browser-human Likely Human 204 ● YES 8ms
22:03:50 / browser-human Likely Human 200 ○ NO 249ms
21:59:10 / unknown Unknown 200 ○ NO 375ms
21:59:10 / unknown Unknown 200 ○ NO 375ms
21:48:17 / browser-human Likely Human 200 ○ NO 472ms
21:37:34 / generic-scraper Suspected Crawler 200 ○ NO 33ms
21:37:31 / generic-scraper Suspected Crawler 200 ○ NO 260ms
21:35:24 / unknown Unknown 200 ○ NO 401ms
21:29:37 / unknown Unknown 200 ○ NO 639ms
21:23:43 /beacon browser-human Likely Human 204 ● YES 32ms
21:23:43 /beacon browser-human Likely Human 204 ● YES 14ms