Skip to main content
GoogleHints & TipsSearch Engine Optimisation (SEO)

Blocking the Wayback Machine – Internet Archive

By January 17, 2014No Comments

Blocking the Wayback Machine - Internet Archive - Mahoney Web MarketingHave you come across the Wayback Machine?

It’s been around for some years, and aims to be an archive of the internet—forever.

I do enjoy having a brose and seeing how far some sites have come, as well as looking back at sites I made years ago.

However, just because it’s fun to browse doesn’t mean you always want your site on it. Now, once a cached version is there there’s not a lot to be done, however you can stop it indexing your site in the first place.

Just add this to your site’s robots.txt file:

User-agent: ia_archiver
Disallow: /

That tells the Internet Archive to ignore your site when it’s indexing the internet.



Author Peter

More posts by Peter

Leave a Reply