CONTROLCRAWL

Take control of how AI agents, web crawlers, and LLMs index your site. Build visual llms.txt files, scan local directory JSON-LD schemas, and check AI readiness—all directly in your browser.

account_tree Tool A: Visual llms.txt Generator & Mapper

INTERACTIVE

Scan your website or sitemap XML. Build a drag-and-drop block tree, toggle page visibility for AI crawlers, and export standard llms.txt & llms-full.txt files.

/ sitemap.xml parsed

├── llms.txt (Generated)

├── /docs [Visible to AI]

└── /private [Hidden from AI]

folder_zip

Tool B: Client-Side Directory Optimizer

Scan local folders via File System Access API. Validate JSON-LD schemas and optimize markdown without uploading files anywhere.

100% PRIVATE & LOCAL

fact_check Tool C: "AI Readiness" Validator & Link Checker

Validate existing llms.txt files against v1.1.0 standards, detect broken links, and measure context window token limits.

CONTROLCRAWL

account_tree Tool A: Visual llms.txt Generator & Mapper

Tool B: Client-Side Directory Optimizer

fact_check Tool C: "AI Readiness" Validator & Link Checker

account_tree Tool A: Visual llms.txt Generator & Tree Mapper

Interactive Page Nodes

folder_managed Tool B: Client-Side Directory Optimizer

Validation Output Console

fact_check Tool C: "AI Readiness" Validator & Link Checker

Audit Report