GeoItIs
Browse the library

AI crawler and indexing guides

Trace crawler policy, response status, canonicals, rendered content and index controls before diagnosing an AI search visibility problem.

Category in Markdown

Guides in this topic

2 articles
Crawl & indexing 7 min

Crawler & Index Eligibility

A field guide to the five eligibility gates that decide whether search and AI retrieval systems can process the page you intended to publish.

Read guide
Crawl & indexing 6 min

AI Crawler Access Checker

A diagnostic guide to testing named AI agents, reading the result without overclaiming, and leaving evidence another operator can reproduce.

Read guide