View our GitHub

Please visit sails-docs on GitHub to view documentation on your mobile device.

Edit Page

myApp/assets/robots.txt

Purpose

This file tells search engines and roving packs of robot spiders about whether or not the content in your app should be indexed.

You can read more about robots.txt here, or about how it is parsed by Google here.

# The robots.txt file is used to control how search engines index your live URLs.
# See http://sailsjs.org/documentation/anatomy/my-app/assets/robots-txt for more information.



# To prevent search engines from seeing the site altogether, uncomment the next two lines:
# User-Agent: *
# Disallow: /

Is something missing?

If you notice something we've missed or could be improved on, please follow this link and submit a pull request to the sails-docs repo. Once we merge it, the changes will be immediately reflected on the website.