If your server allows public access, you may wish to customize how external search engines crawl and index your site. Usually this is done through robots.txt and sitemap files.
You can place robots.txt and sitemap files (or other site-specific, static content) into the extraWebapp
directory. This directory is located inside the <LabKey_Root>\build\deploy
directory. It is a peer to the labkeyWebapp
Files in the extraWebapp
directory will not be deleted when your site is upgraded to a new version of LabKey Server.