“By default, Google’s crawlers and fetchers only crawl the first 15MB of a file. Any content beyond this limit is ignored. Individual projects may set different limits for their crawlers and fetchers, ...
We have known for a long time that Google can crawl web pages up to the first 15MB but now Google updated some of its help ...