BotAccess Lab turns crawler policy decisions into files you can inspect.

Why it exists

AI providers now document separate agents for model development, search, and user-requested page fetches. Old blocklists often treat them as one category. BotAccess Lab keeps those choices visible and generates plain-text output that a site owner can review before publishing.

The tools do not crawl a private site, change a server, or claim that a user-agent string proves identity. They help prepare a policy, test pasted rules, and create a site summary. The live server and provider documentation remain the source of truth.

Maintenance

Provider source links were reviewed on September 9, 2026. Tool checks cover generation, copy, download, analyzer results, internal links, and narrow-screen layout. Corrections can be sent to guos4727@gmail.com.