crawl-census
Search & Web
Remote
Provides preflight checks and domain intelligence so agents can skip domains that will refuse them or charge a fee, covering robots.txt, edge refusals, and HTTP 402 paywalls.
How to connect
1
Glama registry
View https://glama.ai/mcp/servers/iy0zyrn645 for deploy options, or install from https://github.com/taylorsmithgg/crawl-census-client (see README for MCP config).
2
GitHub
Install from https://github.com/taylorsmithgg/crawl-census-client and add the server to your MCP client configuration (see repository README).
Tools
Tool names are not listed in our registry for this server. Connect it in your MCP client to see the live tool list.