Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.
Generate effective robots.txt files that help ensure Google and other search engines are crawling and indexing your site properly.