User-Agent

CCBot/2.0 (https://commoncrawl.org/faq/)

first seen 2026-07-03 10:44 · last seen 2026-10-22 22:03 · JSON

Bot verification

This User-Agent declares a bot or user-triggered fetcher. Each connection's IP is checked at ingest against the verification channels the operator publishes — its crawler IP ranges and, where documented, forward-confirmed reverse DNS. A claim either channel confirms is verified; one confirmed by neither — outside the ranges, inside a different operator's, or failing the DNS check — is unverified. Meta publishes its network rather than crawler ranges, so its verified claims are network-confirmed and its unconfirmed misses are unverified claims, not proven spoofs. Telegram publishes network ranges rather than fetcher ranges, and its misses are treated the same way. bot-claim anomalies →

claims	verified	unverified	unverified rate
CCBot	0	53	100.0%

Distinct clients per day (last 30 days, peak 1/day)

Distinct clients are counted by IP-hash per complete UTC day — unlike observation counts this is insensitive to one chatty client, but NAT merges clients and address rotation splits them.

Decomposed attributes

Browser / client	`CCBot 2.0`
Device class	`bot`
Declared URL	`https://commoncrawl.org/faq/`
Note	`inferred from the self-declared string — a claim, not a measurement; compare with the wire fingerprints above`

Co-observed signals

Signals from other families seen in the same observation. A fingerprint spread thinly across many lower-layer signatures is a classic inconsistency signal.

TLS ClientHello (JA4)

fingerprint	co-occurrences
`t13d1516h2_8daaf6152771_d8a2da3f94cd` Match?Exact match in Thumbprint's published controlled catalog captures: chromium 149.0.7827.102, chrome 149.0.7827.102, chrome 149.0.7827.156, +25 more.The fingerprint page shows the full measured match list. More on the catalog.	29
`t13d1011h1_61a7ad8aa9b6_3a8073edd8ef`	19
`t13d131000_f57a46bbacb6_e7c285222651` Match?Exact match in Thumbprint's published controlled catalog captures: go-net/http 1.23.12.The fingerprint page shows the full measured match list. More on the catalog.	3
`t13d141000_cbb2034c60b8_e7c285222651` Match?Exact match in Thumbprint's published controlled catalog captures: go-net/http 1.22.12.The fingerprint page shows the full measured match list. More on the catalog.	1
`t13d131300_f57a46bbacb6_1bd98dace775`	1

HTTP request (JA4H)

fingerprint	co-occurrences
`ge11nn040000_8b1ed2202073_000000000000_000000000000`	10
`ge11nr040000_8b1ed2202073_000000000000_000000000000`	9
`ge20nr050000_7e80a5f53adf_000000000000_000000000000`	7
`ge20nr050000_277e78b0d503_000000000000_000000000000`	6
`ge20nr050000_857b5fa3405d_000000000000_000000000000`	4
`ge20nn050000_857b5fa3405d_000000000000_000000000000`	3
`ge20nr050000_bb384e635ab6_000000000000_000000000000`	3
`ge11nr030000_cd680697de12_000000000000_000000000000`	2
`ge11nn030000_cd680697de12_000000000000_000000000000` Match?Exact match in Thumbprint's published controlled catalog captures: powershell 7.6.6, powershell 7.6.5, powershell 7.6.4, +11 more.The fingerprint page shows the full measured match list. More on the catalog.	2
`ge20nn020000_fb4f949fd323_000000000000_000000000000` Match?Exact match in Thumbprint's published controlled catalog captures: powershell 7.6.6, powershell 7.6.8.The fingerprint page shows the full measured match list. More on the catalog.	2

HTTP/2 frames (Akamai)

fingerprint	co-occurrences
`2:0;4:4194304;5:16384;6:262144;1:65536\|1073741824\|0\|a,m,p,s`	27
`2:0;4:4194304;5:16384;6:10485760\|1073741824\|0\|a,m,p,s` Match?Exact match in Thumbprint's published controlled catalog captures: go-net/http 1.26.6, go-net/http 1.26.10, go-net/http 1.26.9, +8 more.The fingerprint page shows the full measured match list. More on the catalog.	2

TCP SYN (p0f)

fingerprint	co-occurrences
`4:58+6:0:1420:mss*46,10:mss,sok,ts,nop,ws:df,id+:0`	28
`4:54+10:0:1460:mss*44,7:mss,sok,ts,nop,ws:df,id+:0`	6
`4:48+16:0:1460:mss*44,7:mss,sok,ts,nop,ws:df,id+:0`	3
`4:51+13:0:1460:mss*44,7:mss,sok,ts,nop,ws:df,id+:0`	2
`4:47+17:0:1460:mss*44,7:mss,sok,ts,nop,ws:df,id+:0`	2
`4:52+12:0:1460:mss*44,7:mss,sok,ts,nop,ws:df,id+:0`	2
`4:49+15:0:1460:mss*44,7:mss,sok,ts,nop,ws:df,id+:0`	2
`4:54+10:0:1460:mss*29,10:mss,sok,ts,nop,ws:df,id+:0`	2
`4:52+12:0:1460:mss*29,10:mss,sok,ts,nop,ws:df,id+:0`	2
`4:55+9:0:1460:mss*44,7:mss,sok,ts,nop,ws:df,id+:0`	1

TCP SYN (JA4T)

fingerprint	co-occurrences
`65320_2-4-8-1-3_1420_10`	28
`64240_2-4-8-1-3_1460_7`	18
`42340_2-4-8-1-3_1460_10`	4
`64620_2-4-8-1-3_1436_7`	1
`65535_2-4-8-1-3_1380_13`	1
`42600_2-4-8-1-3_1420_9`	1

Country

fingerprint	co-occurrences
`US` · United States	19
`TW` · Taiwan	18
`NL` · Netherlands	9
`SG` · Singapore	5
`CH` · Switzerland	2

Network (ASN)

fingerprint	co-occurrences
`AS396982` · Google LLC	29
`AS41608` · NextGenWebs, S.L.	7
`AS36352` · HostPapa	5
`AS399804` · Hostodo	5
`AS14061` · DigitalOcean, LLC	2
`AS53667` · FranTech Solutions	2
`AS13335` · Cloudflare, Inc.	1
`AS46475` · Limestone Networks, Inc.	1
`AS400529` · Infraly, LLC	1

TLS supported groups

fingerprint	co-occurrences
`0a0a,11ec,001d,0017,0018` Match?Exact match in Thumbprint's published controlled catalog captures: chrome 155.0.8059.40, chrome 156.0.8078.73, chromium 156.0.8078.47, +8 more.The fingerprint page shows the full measured match list. More on the catalog.	19