{"id":901,"date":"2007-12-21T08:59:42","date_gmt":"2007-12-21T16:59:42","guid":{"rendered":"http:\/\/blog.ubertor.com\/2007\/12\/21\/control-your-robotstxt-file\/"},"modified":"2007-12-21T08:59:42","modified_gmt":"2007-12-21T16:59:42","slug":"control-your-robotstxt-file","status":"publish","type":"post","link":"https:\/\/www.ubertor.com\/blog\/2007\/12\/21\/control-your-robotstxt-file\/","title":{"rendered":"Control Your Robots.txt file"},"content":{"rendered":"<p>As an <strong>advanced<\/strong> feature of the <a href=\"http:\/\/www.ubertor.com\">Ubertor<\/a> system and another part of the SEO Enhancement you can control your Robots.txt file.  &#8220;The robots exclusion standard, also known as the Robots Exclusion Protocol or robots.txt protocol, is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website which is, otherwise, publicly viewable. Robots are often used by search engines to categorize and archive web sites, or by webmasters to proofread source code.&#8221; (<a href=\"http:\/\/en.wikipedia.org\/wiki\/Robots_Exclusion_Standard\">from Wikipedia.org<\/a>)  Click on the marketing tab within your control panel for more details.  The is a feature that your search engine optimization person would take advantage of.  <\/p>\n<p>The SEO Enhancement feature not only gives you control of your title tags, meta tags and robots.txt file but it also gives you the ability to <a href=\"http:\/\/blog.ubertor.com\/2007\/12\/19\/now-you-can-create-landing-pages-quickly-and-easily\/\">create landing pages<\/a>.  Click on the live help button for more information.<br \/>\n<img src='http:\/\/blog.ubertor.com\/wp-content\/uploads\/2007\/12\/picture-3344333de1.png' alt='robots' \/><\/p>\n<div data-counters='1' data-style='square' data-size='regular' data-url='https:\/\/www.ubertor.com\/blog\/2007\/12\/21\/control-your-robotstxt-file\/' data-title='Control Your Robots.txt file' class='linksalpha_container linksalpha_app_3'><a href='\/\/www.linksalpha.com\/share?network='facebook' class='linksalpha_icon_facebook'><\/a><a href='\/\/www.linksalpha.com\/share?network='twitter' class='linksalpha_icon_twitter'><\/a><a href='\/\/www.linksalpha.com\/share?network='googleplus' class='linksalpha_icon_googleplus'><\/a><a href='\/\/www.linksalpha.com\/share?network='mail' class='linksalpha_icon_mail'><\/a><\/div><div data-position='' data-url='https:\/\/www.ubertor.com\/blog\/2007\/12\/21\/control-your-robotstxt-file\/' data-title='Control Your Robots.txt file' class='linksalpha_container linksalpha_app_7'><a href='\/\/www.linksalpha.com\/share?network='facebook' class='linksalpha_icon_facebook'><\/a><a href='\/\/www.linksalpha.com\/share?network='twitter' class='linksalpha_icon_twitter'><\/a><a href='\/\/www.linksalpha.com\/share?network='googleplus' class='linksalpha_icon_googleplus'><\/a><a href='\/\/www.linksalpha.com\/share?network='mail' class='linksalpha_icon_mail'><\/a><\/div>","protected":false},"excerpt":{"rendered":"<p>As an advanced feature of the Ubertor system and another part of the SEO Enhancement you can control your Robots.txt file. &#8220;The robots exclusion standard, also known as the Robots Exclusion Protocol or robots.txt protocol, is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[25,10],"tags":[],"_links":{"self":[{"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/posts\/901"}],"collection":[{"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/comments?post=901"}],"version-history":[{"count":0,"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/posts\/901\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/media?parent=901"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/categories?post=901"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ubertor.com\/blog\/wp-json\/wp\/v2\/tags?post=901"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}