Robots.txt & Crawl Budget Analyser
Parse and validate robots.txt with crawl budget analysis.
SEO ToolsRuns on our server · input is not storedNo account · No API key
Try it
Result
Call it from an agent
The same endpoint powers the form above. Send JSON, get JSON — no key, no signup.
curl -sX POST 'https://itsfully.online/backend/connector-api.php?action=execute' \
-H 'Content-Type: application/json' \
-d '{"tool":"robots-txt-analyser","data":{ /* see input fields above */ }}'
Input schema
Parameters accepted by this tool:
[
{
"type": "text",
"name": "url",
"label": "Site URL",
"placeholder": "https://example.com",
"hint": "Will fetch /robots.txt automatically."
},
{
"type": "textarea",
"name": "content",
"label": "Or paste robots.txt content",
"rows": 10,
"hint": "If URL is provided, this field is ignored."
}
]