Jack London
New member
- Joined
- Jul 9, 2012
- Messages
- 386
- Points
- 0
Hi webmasters,
As I knew if we want Google crawl all our website then use this code in robots.txt file putted in website root directory
but I checked some sites and they didn't put robots.txt file for their websites. Thus I want to know that it's necessary to have a robots file for my website or not ? and why ?
please share your suggestions ?
As I knew if we want Google crawl all our website then use this code in robots.txt file putted in website root directory
Code:
User-agent: *
Allow: /
please share your suggestions ?