Robots meta tag and X-Robots-Tag HTTP header specifications - Webmasters — Google Developers

Add a description of Robots meta tag and X-Robots-Tag HTTP header specifications - Webmasters — Google Developers