Redirect mapping for hallucinated URLs.
AI models hallucinate URLs to your domain — creating broken links that waste traffic. This tool analyzes your server logs and site structure to recommend strategic redirects. Input your 404s, run the script, and get implementation-ready redirect mappings with relevancy scores and priority rankings.
- +Server logs showing 404 visits (ideally from Screaming Frog with AI bot breakdowns)
- +A full Screaming Frog crawl of your site
- +An API key (setup instructions included in the template)
Make a copy of the template to your own Google Drive before beginning.
Step-by-step guide
Add your server logs
Navigate to the Server Logs tab and paste your 404 data. This should include visits from AI bots (Claude, Gemini, ChatGPT, etc.).
Don't worry about filtering — paste everything. The script automatically focuses only on 404 status codes and ignores the rest.
Add your site structure
Go to the All URLs tab and paste your complete Screaming Frog crawl.
Pro tip: If your Screaming Frog crawl includes vector embeddings, the tool will use semantic relevance matching for even better redirect suggestions.
Configure your API key
Set up your API key following the instructions in the template. This powers the matching algorithm.
Need help with API setup? Instructions are included in the sheet.
Run the analysis
Click “Analyse Hallucinated URLs” in the menu.
The script will process your data and generate redirect recommendations.
Review your results
You'll get a new sheet with:
- +Hallucinated URL – The broken URL AI models are creating
- +Best Match URL – Your recommended redirect target
- +Relevancy Score – How confident the match is
- +Priority – Implementation priority ranking
- +Number of Events – How many times AI bots hit this 404
- +Intent – The likely user intent behind the hallucinated URL
- +Reasoning – Why this redirect was recommended
Implement
Export the mappings and work with your dev team to implement the redirects. Prioritize by the Number of Events and Priority columns.
Review the recommendations strategically before implementing. The tool provides smart suggestions, but you know your site best — adjust as needed.
Run this monthly to catch new hallucinations as AI models evolve and train on updated data. Set up 404 monitoring to feed fresh URLs directly into your next analysis.
More tools
View all tools →
Get better visibility.
Find what's working and fix what's not. We're here to help you navigate the changing landscape of search.