Forums: Discussions for entrepreneurs and small business.

User-agent: *
Disallow: /

=================

This is how my current robots.txt file looks like. I want to block a subdomain (i.e http://subdomain.mywebsite.com) using robots.txt, I don't want even a single page of my subdomain to be indexed in Google.

I added the above text to prevent my Subdomain from indexing... but it still got indexed into Google. What should I do to entirely prevent my Subdomain from Indexing.

If you use special layout in your subdomain you could use this code --> in case the robot.txt doesn't work

Subdomains are treated as a different sites. You can use the same code (Disallow: / ) but make sure it works with "subdomain . mywebsite . com/robots.txt" only and not with "www . mywebsite . com/robots.txt" etc., else you main site pages will also gets blocked.

 Where is the code?

 I have update the robots with the method you have suggested. I can see the number of index pages are decreasing... but not too many. For instance out of 24000 after 3 week it now went down to 22000. Does it take so long to for Google to remove disallowed pages from index?

User-Agent: *

Disallow: /http://xyz.subdomain.com

Go to webmasters tools, where you can do simply by submitting url. You could also remove url from there if you have deleted from your website.

Some of the website create virtual sub domain even if website with sub domain considered as different website. WIth last implementation of GOogle, It shows inner links from sub domain just like internal links of main website. If the sub domains are created virtually, everything you would upload in root, it would get visible to other sub domain as well. So make sure that google considered the restriction the way you want and test it with crawler access tools in webmaster.

the information you provided block subdomain in robot.txt file is really helpful, thanks for the sharing this great information

You can use this following code for blocking sub domain:

User-agent: *

Disallow: /subdomainurl

You mean this code <meta name="robots" content="noindex"> prevents the website from indexing? from all search engines?