Here's a partial list of what maybe shouldn't be crawled that I put in my robots.txt.
Is there any thing else that should be added that shouldn't be crawled?
We generally like to put blogs in a
Disregard the last line: "We generally like to put blogs in a.."
Any chance on any help with this?
You must be logged in to reply to this topic.
Subscribe to get early access to new themes, discounts and brief updates about what's new with StudioPress!