Path: csiph.com!eternal-september.org!feeder.eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail From: Martin Gregorie Newsgroups: comp.lang.java.programmer Subject: Re: Q) Why is URLConnection not downloading all the renderable content for me? Date: Tue, 2 Aug 2016 10:19:08 -0000 (UTC) Organization: A noiseless patient Spider Lines: 19 Message-ID: References: <925a87d0-661e-4670-84e4-a9d2b9f9ea89@googlegroups.com> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Injection-Date: Tue, 2 Aug 2016 10:19:08 -0000 (UTC) Injection-Info: mx02.eternal-september.org; posting-host="e5160e2be48f1ea550cf61512446f525"; logging-data="11767"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/igQ26M8D9xFfTr6iN79BnfqirtUsAJHg=" User-Agent: Pan/0.140 (Chocolate Salty Balls; GIT 3663720 git://git.gnome.org/pan2) Cancel-Lock: sha1:RPK/aRNCh3kGOsd8guOVCEOlRBc= Xref: csiph.com comp.lang.java.programmer:35165 On Sun, 31 Jul 2016 09:29:44 -0700, sandeep6699 wrote: > However, I am finding that URLConnection does not download the content > that I can see if I save the contents of the browser (Chrome in my > case). > For example, if I save the browser contents, I see the following > content, which I don’t see when I use URLConnection: > Your code makes a single request, i.e. it gets just the page identified by the URL you opened as a Stream. If you also want material referenced by that page (images, content from other linked pages, etc), which seems likely since the page you referenced is an index, you need to find all the links in the page you've just read and retrieve their content as well. -- martin@ | Martin Gregorie gregorie. | Essex, UK org |