LIVE OBSERVATORY TELEMETRY FEED

Transparent AI Crawler Observatory & Behavioral Benchmark

Empirically measuring how autonomous AI crawlers (GPTBot, ClaudeBot, PerplexityBot) and search bots navigate, evaluate links, execute JavaScript, and reason across the open web.

Explore AI Behavioral Insights Enter Benchmark Lab Download Open Dataset →
Total Telemetry Requests
920
Aggregated across all crawler families
Verified AI / Search Bots
22
2% confirmed with official IP CIDRs
First-Link Selection Bias
48%
Agents favor position 1 over lower links
Benchmark Runs Completed
2
Deterministic & semantic solvers

24-Hour Telemetry Volume

Verified Bots vs. Claimed vs. Human Sessions
Rolling 24h
Verified Vendor Bots Claimed / Suspected Likely Human

Classification Distribution

Strict evidence-based categorization
Methodology →
Verified Vendor Bot (Official IP) 22
Claimed Bot (Unverified IP) 183
Goal-Directed Automation (Lab Solver) 38
Suspected Crawler (Scraper / Headless) 102
Likely Human (Browser + Beacon) 254
INTERACTIVE TOOL

Bot Traffic Simulator & Classifier Tester

Test how different crawlers, AI agents, scrapers, and IP blocks get classified in real time

Real-Time Telemetry Stream

Latest 30 requests processed by the observatory edge
Timestamp Path Crawler / Family Classification Status JS Beacon Latency
19:18:38 /experiments/navigation-v1 claudebot Claimed Bot 200 ○ NO 378ms
13:10:27 / unknown Unknown 200 ○ NO 248ms
12:10:34 /lab/reasoning/01586a57a5e6b070.1791535999779.3349592942b91198/4/ethernet-frame claudebot Claimed Bot 200 ○ NO 36ms
12:09:42 /lab/reasoning/01586a57a5e6b070.1791535999779.3349592942b91198/4/tcp-protocol claudebot Claimed Bot 200 ○ NO 25ms
12:09:42 /lab/reasoning/01586a57a5e6b070.1791535999779.3349592942b91198/4/http-protocol claudebot Claimed Bot 200 ○ NO 63ms
11:28:56 /lab/reasoning/01586a57a5e6b070.1791535999779.3349592942b91198/3/betelgeuse-star claudebot Claimed Bot 200 ○ NO 32ms
11:28:24 /lab/reasoning/01586a57a5e6b070.1791535999779.3349592942b91198/3/jupiter-gas-giant claudebot Claimed Bot 200 ○ NO 63ms
11:27:10 /lab/reasoning/01586a57a5e6b070.1791535999779.3349592942b91198/3/pluto-dwarf-planet claudebot Claimed Bot 200 ○ NO 68ms
10:41:02 /lab/reasoning/01586a57a5e6b070.1791535999779.3349592942b91198/2/rust-compiler claudebot Claimed Bot 200 ○ NO 32ms
10:40:37 /lab/reasoning/01586a57a5e6b070.1791535999779.3349592942b91198/2/cpython-runtime claudebot Claimed Bot 200 ○ NO 35ms
10:39:48 /lab/reasoning/01586a57a5e6b070.1791535999779.3349592942b91198/2/nodejs-runtime claudebot Claimed Bot 200 ○ NO 72ms
09:49:04 /lab/reasoning/01586a57a5e6b070.1791535999779.3349592942b91198/1/anthracite-coal claudebot Claimed Bot 200 ○ NO 28ms
09:48:09 /lab/reasoning/01586a57a5e6b070.1791535999779.3349592942b91198/1/solar-photovoltaic claudebot Claimed Bot 200 ○ NO 33ms
09:47:22 /lab/reasoning/01586a57a5e6b070.1791535999779.3349592942b91198/1/petroleum-fraction claudebot Claimed Bot 200 ○ NO 266ms
08:53:19 /lab/reasoning/start claudebot Claimed Bot 200 ○ NO 67ms
08:07:22 /privacy claudebot Claimed Bot 200 ○ NO 25ms
08:07:07 /experiments/reasoning-v1 claudebot Claimed Bot 200 ○ NO 310ms
03:39:32 /insights claudebot Claimed Bot 200 ○ NO 134ms
03:37:26 /experiments/js-render-v1 claudebot Claimed Bot 200 ○ NO 97ms
01:16:47 /methodology claudebot Claimed Bot 200 ○ NO 32ms
01:16:17 /field-guide claudebot Claimed Bot 200 ○ NO 343ms
14:56:31 / unknown Unknown 200 ○ NO 175ms
13:49:24 / unknown Unknown 200 ○ NO 82ms
13:48:47 / unknown Unknown 200 ○ NO 71ms
13:48:46 / unknown Unknown 200 ○ NO 148ms
13:23:18 / unknown Unknown 200 ○ NO 545ms
14:37:01 / unknown Unknown 200 ○ NO 398ms
08:03:07 /honeypot/archive/03-crawl-manifests bingbot Claimed Bot 200 ○ NO 182ms
15:37:49 / gptbot Claimed Bot 200 ○ NO 144ms
15:07:02 / unknown Unknown 200 ○ NO 232ms