Crawl Log Analyzer
Analyze uploaded Apache, Nginx, IIS-compatible, or JSON access logs locally.
Account preview
How it works
The parser counts valid and malformed lines, methods, status families, requested paths, and crawler user agents. Optional forward-confirmed reverse DNS validates that a crawler hostname resolves back to the logged address.
Limitations
Interactive uploads accept UTF-8, gzip, or safe ZIP data up to 5 MB compressed and expanded. User-agent names alone are never treated as verified crawler identity.
Example
An upload may reveal repeated crawler requests to redirecting parameter URLs, a high 5xx share, and sitemap pages that received no observed crawler request.