Log analyzer
Upload your Apache or Nginx access log and it tells you who crawls your site, how much, when and what they take: AI bots, search engines, referrers and HTTP status codes, kept apart.
About the tool
Log Analyzer is a free online server log analyser built for technical SEO and GEO: upload your Apache or Nginx access log and it tells you who crawls your site, how much, when and what they take. I wrote it myself and publish it for free, for the SEO community.
What it gets from your logs
It accepts several files at once, as plain text, .gz or .csv, and from them it separates:
- 🤖AI bots (GPTBot, ClaudeBot, PerplexityBot…) and their sub-crawlers
- 🔍Search engine bots, with Googlebot and Bingbot verified against their official IP ranges
- 🔗Referrers from search engines and LLMs (ChatGPT, Perplexity…)
- 🗐Most crawled pages, per bot and per search engine
- 📊HTTP status codes, split between bots and referrers
- 📅Crawl frequency of every bot and bytes transferred
- 🕰️Hourly traffic distribution
- 🌍IP geolocation and how trustworthy the IPs claiming to be AI bots are
What happens to your data
- 🗑️The log is not stored. It is processed and discarded.
- 🔑15 days of aggregated results, only with the token in the URL.
- 🌍Geolocation, if you enable it, works with the IPs alone.
The log is not stored: it is processed and discarded. What stays on the server is the aggregated result, for 15 days, and it only opens with the token in the URL. Geolocation, if you enable it, works with the IPs alone.
With that URL you can pick the analysis up on another device, hand it to a colleague or add the next batch of logs without re-uploading the previous ones. If you want to keep it, download the HTML report. And if you want context on what to look for in a log, there is an article on log analysis for SEO.
If you find a bug or miss something, write to me.