Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.java.programmer > #36123 > unrolled thread

Recovering HTML rendered in browser using JSoup

Back to article view | Back to comp.lang.java.programmer

Contents

  Recovering HTML rendered in browser using JSoup sandeep6699@yahoo.com - 2016-12-17 20:26 -0800
    Re: Recovering HTML rendered in browser using JSoup sebastian.millies@softwareag.com - 2016-12-18 10:36 -0800

#36123 — Recovering HTML rendered in browser using JSoup

First of all apologies if this is OT.  My question is about the Java Library JSoup, not about the Java language itself.

Can somebody kindly suggest the proper way to use JSoup on a website like "https://network.axial.net/a/company/business-team-san-francisco/"?

This website has a lot of Javascripting, and no matter what I do {documentObj.body().data(), documentObj.html(), connectionObj.response().body(), Jsoup.connect(urlStr).userAgent("Mozilla").data("name", "jsoup") etc.}, I am not able to recover the html that is rendered in a browser.

--SS

[toc] | [next] | [standalone]

#36124

Am Sonntag, 18. Dezember 2016 05:27:17 UTC+1 schrieb sande...@yahoo.com:
> First of all apologies if this is OT.  My question is about the Java Library JSoup, not about the Java language itself.
> 
> Can somebody kindly suggest the proper way to use JSoup on a website like "https://network.axial.net/a/company/business-team-san-francisco/"?
> 
> This website has a lot of Javascripting, and no matter what I do {documentObj.body().data(), documentObj.html(), connectionObj.response().body(), Jsoup.connect(urlStr).userAgent("Mozilla").data("name", "jsoup") etc.}, I am not able to recover the html that is rendered in a browser.
> 
> --SS

JSoup is an HTML parser, not a Javascript library, so I would think it cannot do what you want from it. Have you tried googling this? There are some relevant discussions and suggestions on Stackoverflow, e. g.
http://stackoverflow.com/questions/7488872/page-content-is-loaded-with-javascript-and-jsoup-doesnt-see-it or http://stackoverflow.com/questions/14904776/parse-javascript-with-jsoup

-- Sebastian

[toc] | [prev] | [standalone]

Back to top | Article view | comp.lang.java.programmer

csiph-web