{"id":1892,"date":"2009-06-29T20:57:01","date_gmt":"2009-06-30T04:57:01","guid":{"rendered":"http:\/\/blog.ubertor.com\/?p=1892"},"modified":"2009-06-29T20:57:01","modified_gmt":"2009-06-30T04:57:01","slug":"yes-you-can-specify-additional-rules-to-add-to-your-sites-robotstxt-file","status":"publish","type":"post","link":"https:\/\/www.ubertor.com\/blog\/2009\/06\/29\/yes-you-can-specify-additional-rules-to-add-to-your-sites-robotstxt-file\/","title":{"rendered":"Yes, You Can Specify Additional Rules To Add To Your Site&#8217;s Robots.txt file"},"content":{"rendered":"<p>I was emailed by a clients &#8220;tech guy&#8221; today asking if there was a way to update the robots.txt for his clients website.  The answer, YES, you can specify additional rules to add to your site&#8217;s robots.txt file below. <\/p>\n<p>How?<\/p>\n<p>Within the &#8220;Marketing&#8221; tab in your control panel, click &#8220;robots&#8221;.<br \/>\nFrom there you can make the adjustments you want.  <\/p>\n<a href=\"http:\/\/blog.ubertor.com\/2009\/06\/29\/yes-you-can-specify-additional-rules-to-add-to-your-sites-robotstxt-file\/robots-4\/\" rel=\"attachment wp-att-1893\"><img src=\"http:\/\/blog.ubertor.com\/wp-content\/uploads\/2009\/06\/robots-4.png\" alt=\"robots-4\" title=\"robots-4\" width=\"764\" class=\"aligncenter size-full wp-image-1893\" srcset=\"https:\/\/www.ubertor.com\/blog\/wp-content\/uploads\/2009\/06\/robots-4.png 764w, https:\/\/www.ubertor.com\/blog\/wp-content\/uploads\/2009\/06\/robots-4-300x156.png 300w\" sizes=\"(max-width: 764px) 100vw, 764px\" \/><\/a>\n<div data-counters='1' data-style='square' data-size='regular' data-url='https:\/\/www.ubertor.com\/blog\/2009\/06\/29\/yes-you-can-specify-additional-rules-to-add-to-your-sites-robotstxt-file\/' data-title='Yes, You Can Specify Additional Rules To Add To Your Site&#8217;s Robots.txt file' class='linksalpha_container linksalpha_app_3'><a href='\/\/www.linksalpha.com\/share?network='facebook' class='linksalpha_icon_facebook'><\/a><a href='\/\/www.linksalpha.com\/share?network='twitter' class='linksalpha_icon_twitter'><\/a><a href='\/\/www.linksalpha.com\/share?network='googleplus' class='linksalpha_icon_googleplus'><\/a><a href='\/\/www.linksalpha.com\/share?network='mail' class='linksalpha_icon_mail'><\/a><\/div><div data-position='' data-url='https:\/\/www.ubertor.com\/blog\/2009\/06\/29\/yes-you-can-specify-additional-rules-to-add-to-your-sites-robotstxt-file\/' data-title='Yes, You Can Specify Additional Rules To Add To Your Site&#8217;s Robots.txt file' class='linksalpha_container linksalpha_app_7'><a href='\/\/www.linksalpha.com\/share?network='facebook' class='linksalpha_icon_facebook'><\/a><a href='\/\/www.linksalpha.com\/share?network='twitter' class='linksalpha_icon_twitter'><\/a><a href='\/\/www.linksalpha.com\/share?network='googleplus' class='linksalpha_icon_googleplus'><\/a><a href='\/\/www.linksalpha.com\/share?network='mail' class='linksalpha_icon_mail'><\/a><\/div>","protected":false},"excerpt":{"rendered":"<p>I was emailed by a clients &#8220;tech guy&#8221; today asking if there was a way to update the robots.txt for his clients website. The answer, YES, you can specify additional rules to add to your site&#8217;s robots.txt file below. How? Within the &#8220;Marketing&#8221; tab in your control panel, click &#8220;robots&#8221;. From there you can make [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[25,10],"tags":[],"_links":{"self":[{"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/posts\/1892"}],"collection":[{"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/comments?post=1892"}],"version-history":[{"count":2,"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/posts\/1892\/revisions"}],"predecessor-version":[{"id":1895,"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/posts\/1892\/revisions\/1895"}],"wp:attachment":[{"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/media?parent=1892"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/categories?post=1892"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/tags?post=1892"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}