Interactive robots.txt inspector
Run the live browser demo
The interactive controls load with JavaScript. The package guide and maintenance facts remain available in the HTML response.
Package guide
What is robots-txt-kit?
robots-txt-kit is a focused TypeScript utility for developer tooling. Parse and evaluate robots.txt crawl rules with structured diagnostics. The browser demo lets you inspect representative input and output before adding the package to a project. Preview evaluates crawler access with group merging, wildcards and percent-encoded paths.
Complete implementation record
What this page can verify
This page documents the current independent implementation and its public artifacts. Starting from zero without reusing abandoned source is a maintainer-declared project constraint, not an independently audited historical claim.
- Implementation
- New public TypeScript source
- Current proof
- Runnable demo, repository and npm v0.1.0
- Maintainer
- Recoveredd
- Evidence checked
- Historical mapping
- Earlier package identities not retained
- Claim boundary
- No one-to-one lineage or predecessor compatibility claimed
Install and evaluate
npm install robots-txt-kit- Run the interactive demo with representative input.
- Review the structured output and diagnostics.
- Check the README and changelog before adopting or upgrading.
Key capabilities
- User-agent group parsing with wildcard fallback rules
- Allow/Disallow matching with longest-rule and allow-tie behavior
- sitemap extraction and stable diagnostics for malformed directives
When to use it
Use robots-txt-kit when a workflow needs robots.txt inspector behavior with typed, inspectable results. The demo is designed for evaluation; the repository remains the authoritative source for exact APIs, supported runtimes and release-specific behavior.
Compatibility and limits
The package targets TypeScript projects and browser- or Node.js-based developer tools. Validate edge cases against your own data, pin the version used in production, and review diagnostics rather than silently accepting malformed input.
Package facts and maintenance
- Current version
- 0.1.0
- License
- MPL-2.0
- Maintainer
- Recoveredd
- npm downloads
- 0 in the last recorded week
- Signals updated
For usage questions or reproducible defects, review the source repository and open an issue. Package activity data comes from npm and GitHub and is dated above.