Googlebot and AI crawlers
Compare search-engine crawling with GPTBot, ClaudeBot, PerplexityBot and other known AI agents.
Native macOS SEO analysis
Turn raw access logs into actionable evidence about Googlebot, AI crawlers, crawl budget, technical errors and index coverage—without uploading sensitive files.
SEO server log analysis
Nirengi turns sensitive infrastructure data into evidence without sending it to the cloud.
Compare search-engine crawling with GPTBot, ClaudeBot, PerplexityBot and other known AI agents.
Find 404, 5xx, redirects, soft-404 candidates, parameter waste, asset crawling and robots.txt violations.
Compare sitemap URLs with observed traffic to discover uncrawled, orphaned or neglected pages.
Use reverse and forward DNS checks to distinguish supported verified crawlers from spoofed user agents.
Process millions of lines in parallel and move aggregation to disk when the working set may exceed safe memory.
Export individual CSV files or a self-contained HTML report without a cloud account.
Nirengi capabilities
Crawler identity: 5 reports
AI crawlers: 2 reports
Crawl budget: 7 reports
Technical errors: 8 reports
Coverage and freshness: 6 reports
Visitor traffic: 8 reports
Optional category analysis: 5 reports
Nirengi capabilities
Apache and Nginx combined, CLF and vhost formats
IIS W3C
AWS CloudFront and ALB
Cloudflare Logpush
Nginx, Caddy and Traefik JSON/NDJSON
Nirengi capabilities
A Release build processed a 15.4 GB, 50.9-million-line production log in 40 seconds on an Apple M4 Mac with 16 GB memory. Results vary by hardware, storage, format and enabled features.
Nirengi capabilities
Select one log file or a rotated group with the macOS file picker.
Add an optional site URL, sitemap, category list and DNS verification.
Follow progress and warnings while the parallel local engine runs.
Review dashboards and filters, then export CSV or a self-contained HTML report.
Nirengi capabilities