16530

How may i prevent search engines from crawling a subdomain on my website?

Question:

I have cPanel installed on my website.

<ol><li>

I went to the Domains section on cPanel

</li> <li>

I clicked on subdomains.

</li> <li>

I assigned the subdomain name (e.g : personal.mywebsite.com )

</li> <li>

It wanted me to assign document root folder also. I assigned mywebsite.com/personal

if i create robots.txt in my website root(e.g : website.com)

User-agent:

Disallow: /personal/

</li> </ol>

Can it also block personal.mywebsite.com?

what should i do?

thanks

Answer1:

When you want to block URLs on personal.example.com, visit http://personal.example.com/robots.txt (resp. https instead of http).

It doesn’t matter how your server organizes folders in the backend, it only matters which robots.txt is available when accessing this URL.

Recommend

  • htaccess mod_rewrite - Trailing Slash and loop of redirects
  • Wordpress “Post name” permalinks not working
  • How to hide spring mvc web app name in the browser url?
  • Parser Error Message: The file '/Site.master' does not exist
  • Can you trust mysql_insert_id? [duplicate]
  • Reactjs require not defined
  • Associate git repo with existing fork network
  • UIBarButtonItem's action is not called when in a view with a UIGestureRecognizer
  • C++/CLI Thread synchronization including managed and unmanaged code
  • Zend Framework + Doctrine1.2 project structure with more modules
  • Iterate through permissions on a file in the windows file system in C#
  • How do I change the kernel/python version for iPython?
  • Mocha throws unexpected token error for ES6 object spread operator
  • Relative paths. baseUrl and paths not working on ionic2 - angular2
  • Getting unread count in Sent Folder using Google Apps Script - GMail
  • Criterion causing memory consumption to explode, no CAFs in sight
  • using System.Speech.Synthesis with Windows10 universal app (XAML-C#)
  • How to install node-mysql?
  • Best way to dynamically load an xml configuration file into a Flex4/Flash movie at runtime?
  • Android Studio Can't Find tools.jar
  • msbuild create itemgroup from property group
  • How do I include a SWC in an AS2 Flash project?
  • cygwin cannot exec 'git-add--interactive' permission denied
  • Assign variable to the value in HTML
  • Alternative to overridePendingTransition() - Android
  • How do I get HTML corresponding to current DOM tree?
  • JQuery Internet Explorer and ajaxstop
  • JSON response opens as a file, but I can't access it with JavaScript
  • Setting up SourceTree to merge unity3d scenes with UnityYAMLMerge
  • Change Inet root folder for iis 7
  • Paperclip, set path outside of rails root folder
  • Jenkins: How To Build multiple projects from a TFS repository?
  • Change an a tag attribute in JavaScript based on screen width
  • Redux, normalised entities and lodash merge
  • Proper folder structure for lots of source files
  • Load html files in TinyMce
  • Hits per day in Google Big Query
  • how does django model after text[] in postgresql [duplicate]
  • Append folder name and increment by 1 using batch script
  • How can i traverse a binary tree from right to left in java?