{"id":2611,"date":"2021-04-28T11:58:16","date_gmt":"2021-04-28T11:58:16","guid":{"rendered":"https:\/\/craighordlow.com\/index.php\/2021\/04\/28\/google-adds-more-details-to-robots-txt-specifications-help-document\/"},"modified":"2021-04-28T11:58:16","modified_gmt":"2021-04-28T11:58:16","slug":"google-adds-more-details-to-robots-txt-specifications-help-document","status":"publish","type":"post","link":"https:\/\/craighordlow.com\/index.php\/2021\/04\/28\/google-adds-more-details-to-robots-txt-specifications-help-document\/","title":{"rendered":"Google Adds More Details To Robots.txt Specifications Help Document"},"content":{"rendered":"<p>Google has added a bunch of new supporting details to the robots.txt specification document.  Jamie Indigo noticed these changes and explained what was added include &#8220;explicit details on the files for IDNs, IP-addresses, and port numbered hostnames.&#8221;<\/p>\n<div class=\"feedflare\">\n<a href=\"http:\/\/feeds.seroundtable.com\/~ff\/SearchEngineRoundtable1?a=NjXVVmAmBC0:nZ7nM_FG2oE:UCg8P_nGCaA\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/SearchEngineRoundtable1?d=UCg8P_nGCaA\" border=\"0\" alt=\"| Craig Hordlow\" title=\"| Craig Hordlow\"><\/a> <a href=\"http:\/\/feeds.seroundtable.com\/~ff\/SearchEngineRoundtable1?a=NjXVVmAmBC0:nZ7nM_FG2oE:yIl2AUoC8zA\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/SearchEngineRoundtable1?d=yIl2AUoC8zA\" border=\"0\" alt=\"| Craig Hordlow\" title=\"| Craig Hordlow\"><\/a> <a href=\"http:\/\/feeds.seroundtable.com\/~ff\/SearchEngineRoundtable1?a=NjXVVmAmBC0:nZ7nM_FG2oE:hl8ANDcrVaY\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/SearchEngineRoundtable1?d=hl8ANDcrVaY\" border=\"0\" alt=\"| Craig Hordlow\" title=\"| Craig Hordlow\"><\/a> <a href=\"http:\/\/feeds.seroundtable.com\/~ff\/SearchEngineRoundtable1?a=NjXVVmAmBC0:nZ7nM_FG2oE:V-t1I-SPZMU\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/SearchEngineRoundtable1?d=V-t1I-SPZMU\" border=\"0\" alt=\"| Craig Hordlow\" title=\"| Craig Hordlow\"><\/a> <a href=\"http:\/\/feeds.seroundtable.com\/~ff\/SearchEngineRoundtable1?a=NjXVVmAmBC0:nZ7nM_FG2oE:Gu391qSwH_A\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/SearchEngineRoundtable1?d=Gu391qSwH_A\" border=\"0\" alt=\"| Craig Hordlow\" title=\"| Craig Hordlow\"><\/a> <a href=\"http:\/\/feeds.seroundtable.com\/~ff\/SearchEngineRoundtable1?a=NjXVVmAmBC0:nZ7nM_FG2oE:cGdyc7Q-1BI\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/SearchEngineRoundtable1?d=cGdyc7Q-1BI\" border=\"0\" alt=\"| Craig Hordlow\" title=\"| Craig Hordlow\"><\/a> <a href=\"http:\/\/feeds.seroundtable.com\/~ff\/SearchEngineRoundtable1?a=NjXVVmAmBC0:nZ7nM_FG2oE:V_sGLiPBpWU\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/SearchEngineRoundtable1?i=NjXVVmAmBC0:nZ7nM_FG2oE:V_sGLiPBpWU\" border=\"0\" alt=\"| Craig Hordlow\" title=\"| Craig Hordlow\"><\/a> <a href=\"http:\/\/feeds.seroundtable.com\/~ff\/SearchEngineRoundtable1?a=NjXVVmAmBC0:nZ7nM_FG2oE:F7zBnMyn0Lo\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/SearchEngineRoundtable1?i=NjXVVmAmBC0:nZ7nM_FG2oE:F7zBnMyn0Lo\" border=\"0\" alt=\"| Craig Hordlow\" title=\"| Craig Hordlow\"><\/a> <a href=\"http:\/\/feeds.seroundtable.com\/~ff\/SearchEngineRoundtable1?a=NjXVVmAmBC0:nZ7nM_FG2oE:MbsSfiz-sEw\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/SearchEngineRoundtable1?d=MbsSfiz-sEw\" border=\"0\" alt=\"| Craig Hordlow\" title=\"| Craig Hordlow\"><\/a> <a href=\"http:\/\/feeds.seroundtable.com\/~ff\/SearchEngineRoundtable1?a=NjXVVmAmBC0:nZ7nM_FG2oE:qj6IDK7rITs\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~ff\/SearchEngineRoundtable1?d=qj6IDK7rITs\" border=\"0\" alt=\"| Craig Hordlow\" title=\"| Craig Hordlow\"><\/a>\n<\/div>\n<p><img decoding=\"async\" src=\"http:\/\/feeds.feedburner.com\/~r\/SearchEngineRoundtable1\/~4\/NjXVVmAmBC0\" height=\"1\" width=\"1\" alt=\"| Craig Hordlow\" title=\"| Craig Hordlow\"><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Google has added a bunch of new supporting details to the robots.txt specification document. Jamie Indigo noticed these changes and explained what was added include &#8220;explicit details on the files for IDNs, IP-addresses, and port numbered hostnames.&#8221;<\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"h5ap_radio_sources":[],"cybocfi_hide_featured_image":"","footnotes":""},"categories":[1],"tags":[],"class_list":["post-2611","post","type-post","status-publish","format-standard","hentry","category-best-seo-blogs"],"featured_image_src":null,"featured_image_src_square":null,"author_info":{"display_name":false,"author_link":"https:\/\/craighordlow.com\/author\/"},"_links":{"self":[{"href":"https:\/\/craighordlow.com\/index.php\/wp-json\/wp\/v2\/posts\/2611","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/craighordlow.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/craighordlow.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/craighordlow.com\/index.php\/wp-json\/wp\/v2\/comments?post=2611"}],"version-history":[{"count":0,"href":"https:\/\/craighordlow.com\/index.php\/wp-json\/wp\/v2\/posts\/2611\/revisions"}],"wp:attachment":[{"href":"https:\/\/craighordlow.com\/index.php\/wp-json\/wp\/v2\/media?parent=2611"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/craighordlow.com\/index.php\/wp-json\/wp\/v2\/categories?post=2611"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/craighordlow.com\/index.php\/wp-json\/wp\/v2\/tags?post=2611"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}