Legal
Bot and Crawler Information
Information for site owners about shoulu.co URL checks, fetch behavior, and abuse controls.
Last updated: May 29, 2026
Why we fetch URLs
shoulu.co may fetch submitted URLs to validate syntax, redirects, status codes, indexing eligibility signals, and final results requested by a user who submitted the URL.
Fetch behavior
Requests are designed to be limited, purpose-bound, and tied to submitted URLs. We do not attempt to crawl an entire site from a single submission.
Robots and policy signals
We use URL checks to help customers understand eligibility signals, including status codes, redirects, and robots-related hints. Site owners remain responsible for their own robots.txt, meta robots, and access policies.
Blocking or reporting issues
If you believe shoulu.co traffic is unwanted or abusive, contact support with sample URLs, timestamps, IPs, and request headers so we can investigate and apply limits where appropriate.