We have known for a long time that Google can crawl web pages up to the first 15MB but now Google updated some of its help ...
Google updated two of its help documents to clarify how much Googlebot can crawl.
Some results have been hidden because they may be inaccessible to you
Show inaccessible results