Stop Indexing during website under construction phase

[ruwaidmalik]

I am creating my blog. I need to know if i should stop crawler before finalizing my layout, pages and uploading of a minimum set of content?

 

[Hostens]

If the current content is not saying "under maintenance", but has valuable information on it, I would not avoid indexing it.

 

[Marc van Leeuwen]

Marc van Leeuwen

Agreed with you, if you only make your homepage as "under maintenance" and internal pages are still running then no need to block search engine bots on your site, just make that for homepage if wanted.

 

[paul1129]

It looks like that you are changing the theme of your blog. So, my suggestion will be, why stop crawlers?!! Let them have at it.

 

[Hugo E.]

I am creating my blog. I need to know if i should stop crawler before finalizing my layout, pages and uploading of a minimum set of content?

If that was a new blog and not yet have content on it, you should always blocks spiders from crawling your sites. If it was an existed site that content was cached by search engines, you should not stop crawlers

 

[juliaann]

Yes, you can stop it and can restart again when your website is complete.

 

[BountySite]

Use robots.txt to disable crawling.

User-agent: *
Disallow: /

When done, remove content or delete robots.txt

 

[haleakua]

haleakua

Exactly, I always do this for a new website but not complete

 

[qweiop1029]

I am creating my blog. I need to know if i should stop crawler before finalizing my layout, pages and uploading of a minimum set of content?

I think using robots.txt is your best option