Documentation Center

Preventing Search Engines From Indexing Content

As a web search engine indexes your publication, there may be certain topics that you do not want indexed. This procedure describes how to exclude topics from being indexed.

About this task

By default, SDL LiveContent Reach disallows indexing of LiveContent_home/webapp/lib/ and LiveContent_home/webapp/admin/.

Publications and language versions that are not visible are not indexed.

Procedure

  1. Edit the robots.txt file.
    • In a third-party web application installation, modify LiveContent_home/robots.txt
    • In a bundled web application installation, modify LiveContent_home/webapp/robots.txt
  2. Include statements that disallow the directories you do not want indexed.

    The robots.txt syntax is described at http://www.robotstxt.org/orig.html