hoangvu
New member
- Joined
- Jun 6, 2012
- Messages
- 1,835
- Points
- 0
Hi everyone,
I have 2 ways to control Google robots crawl some web pages that I didn't want to cache
Method 1:
Disallow: / your page.php
Disallow: / folder name
....
in robots.txt file
Method 2:
<meta name="robots" content="noindex,nofollow" />
embed in meta tag of your website to avoid google cache your pages.
According to you, which way I should use and it's best effective and why ?
which case we should robots.txt for our website ?
any shares ?
I have 2 ways to control Google robots crawl some web pages that I didn't want to cache
Method 1:
Disallow: / your page.php
Disallow: / folder name
....
in robots.txt file
Method 2:
<meta name="robots" content="noindex,nofollow" />
embed in meta tag of your website to avoid google cache your pages.
According to you, which way I should use and it's best effective and why ?
which case we should robots.txt for our website ?
any shares ?