Skip to main content

How AI assistants use dividends.co.nz

In the 30 days to 16 November 2026, AI assistants fetched a page from this site 1,328 times while answering someone’s question, out of 33,665 requests from AI crawlers of every kind.

These are counts from our own request log, by the name each crawler gives itself. Most AI traffic is not a reader: the groups below separate a live look-up for a person from indexing, training and bulk crawling.

Looking something up for a person, live: 1,328 (3.9%)

An assistant fetches a page while it answers someone's question. This is the closest thing to a reader.

CrawlerOperatorRequests
ChatGPT-UserChatGPT1,098
Claude-UserClaude179
Perplexity-UserPerplexity51

Indexing for AI search: 12,729 (37.8%)

Crawlers that build the index an assistant searches and cites from.

CrawlerOperatorRequests
OAI-SearchBotOpenAI search11,092
PerplexityBotPerplexity1,293
DuckAssistBotDuckDuckGo202
YouBotYou.com142

Collecting text to train models: 586 (1.7%)

No reader is involved and nothing is cited.

CrawlerOperatorRequests
ClaudeBotAnthropic251
GPTBotOpenAI223
CCBotCommon Crawl63
cohereCohere49

Bulk crawling: 19,022 (56.5%)

High-volume crawlers. The largest share of requests, and the least meaningful.

CrawlerOperatorRequests
meta-externalagentMeta15,485
AmazonbotAmazon2,204
BytespiderByteDance1,333

People who clicked through from an assistant: 9

Visits that arrived from a link inside an assistant’s answer. This number is usually small: an assistant answers in place, and the reader rarely visits the source.

  • Gemini: 7
  • ChatGPT: 2

How to read these figures

  • Counted from our own log. A request is counted when its user-agent names one of the crawlers above. A crawler that does not identify itself is not counted, and a name can be imitated.
  • A fetch is not a citation. A live look-up shows an assistant read the page. It does not show that the answer quoted or linked to it.
  • Not included: calls to the MCP server, which arrive from client software without a recognisable name, and Google’s AI Overviews, which use Google’s ordinary crawler.
  • Updated hourly from the last 30 days of requests.