You could go down that route if you want to. I'm sure there's already enough detailed information on how to use a robots.txt file around that we don't need to repeat it all here.
Announcement
Collapse
No announcement yet.
Redirecting from a deleted page
Collapse
X
-
-----------------------------------------
First Tackle - Fly Fishing and Game Angling
-----------------------------------------
-
Originally posted by Mike Hughes View PostYou could go down that route if you want to. I'm sure there's already enough detailed information on how to use a robots.txt file around that we don't need to repeat it all here.
https://support.google.com/webmaster.../6062596?hl=en
This enabled me to set up a robots.txt file to disallow the 404.html from indexing using the code below:
Code:# Soft 404 error : Block all but AdsBot crawlers User-agent: * Disallow: /acatalog/404.html
Martin
Mantra Audio
Comment
Comment