{"id":7976,"date":"2023-02-01T18:45:41","date_gmt":"2023-02-01T18:45:41","guid":{"rendered":"https:\/\/craighordlow.com\/index.php\/2023\/02\/01\/microsoft-bing-to-rely-more-on-lastmod-date-in-xml-sitemap-files-for-crawling\/"},"modified":"2023-02-01T18:45:41","modified_gmt":"2023-02-01T18:45:41","slug":"microsoft-bing-to-rely-more-on-lastmod-date-in-xml-sitemap-files-for-crawling","status":"publish","type":"post","link":"https:\/\/craighordlow.com\/index.php\/2023\/02\/01\/microsoft-bing-to-rely-more-on-lastmod-date-in-xml-sitemap-files-for-crawling\/","title":{"rendered":"Microsoft Bing to rely more on lastmod date in XML sitemap files for crawling"},"content":{"rendered":"

Microsoft Bing will soon rely a lot more on the date you specify in the lastmod field within your XML sitemap for crawling. Fabrice Canel, Principal Product Manager at Microsoft Bing said<\/a> that starting in June 2023, Bing will revamp its \u201ccrawl scheduling stack to better utilize the information provided by the \u201clastmod\u201d tag in sitemaps.\u201d<\/p>\n

What is lastmod.<\/strong> The lastmod field is the date of last modification of the page as specified in your XML sitemap file. It is not necessarily the date the URL was created but the date the last time that page was modified.<\/p>\n

Bing says lastmod is critical. <\/strong>Microsoft Bing said the lastmod date is \u201cone of the most critical tags that you can include in your sitemap.\u201d It helps Bing crawl more efficiently today and will help Bing crawl a lot more in the future, the company said. \u201cThis will enhance our crawl efficiency by reducing unnecessary crawling of unchanged content and prioritizing recently updated content,\u201d Fabrice Canel wrote.<\/p>\n

Again, the lastmod crawl changes should be fully live by June 2023.<\/p>\n

How Bing uses lastmod. <\/strong>Bing wrote, \u201cthe \u201clastmod\u201d tag is used to indicate the last time the web pages linked by the sitemaps were modified. This information is used by search engines to determine how frequently to crawl your site, and to decide which pages to index and which to leave out. The inclusion of the \u201clastmod\u201d tag in your sitemap is crucial as it allows search engines to easily determine when a page was last updated. Without it, search engines may delay crawling updated content or may over-crawl your website as they cannot accurately determine if the content has been modified.\u201d<\/p>\n

Lastmod usage statistics<\/strong>. Microsoft Bing also conducted a study showing how the lastmod field was used across the web in XML sitemap files. Here are the highlights of that date, note this is based on Bing\u2019s crawling data.<\/p>\n

58% of hosts have at least one XML sitemap.<\/p>\n

84% of these sitemaps have a lastmod attribute set.<\/span><\/p>\n

79% have lastmod values correct.<\/span><\/p>\n

18% have lastmod values not correctly set.<\/span><\/p>\n

3% has lastmod values for only some of the URLs.<\/span><\/p>\n

16% of these sitemaps don\u2019t have a lastmod attribute set.<\/p>\n

42% of hosts don\u2019t have one XML sitemap<\/p>\n

The biggest issue they see is that the lastmod dates in XML sitemaps are identical to all the URLs listed in the file. Meaning, Bing is noticing the the date of the lastmod field is being set to the date of generation of the sitemap, rather than the date of content modification. This is of course possible but highly unlike for every URL listed in the XML sitemap file.<\/p>\n

changefreq field. <\/strong>Bing also mostly ignores the changefreq field in XML sitemaps, like Google. Google has said in the past it ignores the lastmod date in XML sitemap<\/a> files but later said they do read it but may not trust it fully<\/a>. The current documentation<\/a> says Google \u201cuses the value if it\u2019s consistently and verifiably (for example by comparing to the last modification of the page) accurate.\u201d<\/p>\n

IndexNow. <\/strong>This advice is not to replace Microsoft\u2019s IndexNow initiative<\/a>, Fabrice Canel wrote that they \u201chighly recommended to adopt IndexNow<\/a> to instantly inform search engines about latest content changes on your websites.\u201d<\/p>\n

Why we care. <\/strong>Going forward, if you have not taken the lastmod date in your XML sitemap file seriously, you probably now should. By doing so, you should be able to improve crawl efficiency of search engines, especially Bing. That should improve speed of crawl and potentially indexing and ranking and also your server resources.<\/p>\n

The post Microsoft Bing to rely more on lastmod date in XML sitemap files for crawling<\/a> appeared first on Search Engine Land<\/a>.<\/p>","protected":false},"excerpt":{"rendered":"

Microsoft Bing will soon rely a lot more on the date you specify in the lastmod field within your XML sitemap for crawling. Fabrice Canel, Principal Product Manager at Microsoft Bing said that starting in June 2023, Bing will revamp its \u201ccrawl scheduling stack to better utilize the information provided by the \u201clastmod\u201d tag in sitemaps.\u201d What is lastmod. The lastmod field is the date of last modification of the page as specified in your XML sitemap file. It is not necessarily the date the URL […]<\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"h5ap_radio_sources":[],"cybocfi_hide_featured_image":"","footnotes":""},"categories":[1],"tags":[],"class_list":["post-7976","post","type-post","status-publish","format-standard","hentry","category-best-seo-blogs"],"featured_image_src":null,"featured_image_src_square":null,"author_info":{"display_name":false,"author_link":"https:\/\/craighordlow.com\/author\/"},"_links":{"self":[{"href":"https:\/\/craighordlow.com\/index.php\/wp-json\/wp\/v2\/posts\/7976","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/craighordlow.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/craighordlow.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/craighordlow.com\/index.php\/wp-json\/wp\/v2\/comments?post=7976"}],"version-history":[{"count":0,"href":"https:\/\/craighordlow.com\/index.php\/wp-json\/wp\/v2\/posts\/7976\/revisions"}],"wp:attachment":[{"href":"https:\/\/craighordlow.com\/index.php\/wp-json\/wp\/v2\/media?parent=7976"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/craighordlow.com\/index.php\/wp-json\/wp\/v2\/categories?post=7976"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/craighordlow.com\/index.php\/wp-json\/wp\/v2\/tags?post=7976"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}