Google Explains Why Google Does Not Crawl & Index Every URL

John Mueller of Google wrote a very detailed and honest explanation on why Google (and third party SEO tools) do not crawl and index every URL or link on the web. He explained that crawling is not objective, it is expensive, it can be inefficient, the web changes a lot, there is spam and junk and all of that has to be taken into account.

SearchEngineRoundtable1?d=UCg8P nGCaA | Craig Hordlow SearchEngineRoundtable1?d=yIl2AUoC8zA | Craig Hordlow SearchEngineRoundtable1?d=hl8ANDcrVaY | Craig Hordlow SearchEngineRoundtable1?d=V t1I SPZMU | Craig Hordlow SearchEngineRoundtable1?d=Gu391qSwH A | Craig Hordlow SearchEngineRoundtable1?d=cGdyc7Q 1BI | Craig Hordlow | Craig Hordlow | Craig Hordlow SearchEngineRoundtable1?d=MbsSfiz sEw | Craig Hordlow SearchEngineRoundtable1?d=qj6IDK7rITs | Craig Hordlow