Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > comp.os.linux.advocacy > #318892
| From | owl <owl@rooftop.invalid> |
|---|---|
| Newsgroups | comp.os.linux.advocacy |
| Subject | Re: Three more weeks of UNIX |
| Date | 2015-09-04 02:50 +0000 |
| Organization | ok by me, so long as it doesn't get out of hand |
| Message-ID | <fsa.vjcxzi3@rooftop.invalid> (permalink) |
| References | (8 earlier) <D20E1DF3.59E00%usenet@gallopinginsanity.com> <adfmvu84jfr.o@rooftop.invalid> <D20E3705.59E2C%usenet@gallopinginsanity.com> <fasmnvc93.jdif@rooftop.invalid> <D20E4615.59E55%usenet@gallopinginsanity.com> |
Snit <usenet@gallopinginsanity.com> wrote: > On 9/3/15, 6:38 PM, in article fasmnvc93.jdif@rooftop.invalid, "owl" > <owl@rooftop.invalid> wrote: > ... >>>>> But your first thought was I *had* to be cheating... shows your >>>>> assumptions. >>>> >>>> Not my fault your video look suspicious. >> >>> LOL! It shows me doing the task you asked about... run a script to download >>> the recipes. >> >>> You are the one who assumed this was not likely to be true... you assumed >>> the task could not be done on a Mac or, perhaps, on a Mac by someone who is >>> not a programmer. >> >> I already explained to you the oddities I noticed in your video, as well >> as the sparse information you displayed. > Nothing odd about the video at all. Not a thing. Heck, it is showing me > directly working on the system. But whatever: you made a mistake and jumped > to a poor conclusion. To me it is just funny to see the reaction. The title bar was odd. >>> As I said, not as easy for me as a programmer and if we keep playing this >>> game we might get to my limits - as it is I have tried briefly to get the >>> full list of recipes and failed... tried scrolling down and getting the list >>> of URLs. No dice. >> >> Watch the URL bar while you're scrolling. > Right, it moves to page 2 and 3. Is it cheating to hard code that? Do you > keep searching until you add no more links? If we can just hardcode those > URLs in, or add the added bit to the end of the URL it becomes pretty > trivial. I grab all three. Originally I just got the first twenty on page 1, but you mentioned that there were more, so I just get them all. > ... >>>>>> I checked into the conversion utility I use. It has *as an option* >>>>>> what I assumed would be standard: don't process javascript. I turned >>>>>> off javascript and got an immediate speed increase. I fiddled with >>>>>> various options to GNU parallel and now have it processing 58 files in >>>>>> 102 seconds. (Not sure why it's 58 now instead of 59) >>>> >>>>> So still more than a second per file, vs. my 0.8. :) >>>> >>>> My PDFs are in the 300-800KB range vs your <100KB files. That probably >>>> accounts for some of the sluggishness here. (Down to 98 sec now). >> >>> Why would yours be so much bigger? >> >> Higher quality? Who knows. > Yours are actual PDFs with actual text in them, right, not just images. anon@sandpit:~/Recipes$ file worlds-best-lasagna.pdf worlds-best-lasagna.pdf: PDF document, version 1.4 anon@sandpit:~/Recipes$ cp worlds-best-lasagna.pdf foo anon@sandpit:~/Recipes$ file foo foo: PDF document, version 1.4 anon@sandpit:~/Recipes$ >>> Seems we have another place where the Mac >>> is "ahead". Are the links in yours active and working? In mine they are, >>> though I could change that so they would not be. >> >> Mine don't have any links after I strip the javascript. It's not that >> there are dead links -- all the crap from the html version is stripped >> off. It's nice and clean. >> >> http://i.imgur.com/gLtDoVP.png > But I assume that is PDF text and not just an image saved in a PDF, right? It's possibly just an image on these pages. I tested the utility on another site and it produced a pdf that had text that is at least selectable for copy/paste. Links don't work. I'll have to play with this some more and find out. Images would explain the huge file size. > ... >>>> While debugging, I had the html files sitting already downloaded and it >>>> was actually slower for some reason. >> >>> Odd. For me I would just need the URLs... having trouble getting all of >>> them. Did not really put much effort into it, though. Already put too much >>> time into something that has no real value for me. I did, though, try and >>> failed. Not denying that. >> >> See above. > Did you hardcode the URLs? If so that is sorta cheating I think... but wrote > about it elsewhere that I see gray areas here. This is designed in a way > that would work only with that site. For the three site pages, yeah. That's the only way to get them all. Doesn't matter to me if we limit it to just the 20 on page 1. > Right now my workflow would take modification to grab multiple URLs, but I > could do it with saving the things to a file then reading the file. Would > add a fraction of a second to the processing.
Back to comp.os.linux.advocacy | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread
Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-02 15:43 +0000
Re: Three more weeks of UNIX Melzzzzz <mel@zzzzz.com> - 2015-09-02 17:45 +0200
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-02 15:52 +0000
Re: Three more weeks of UNIX Steve Carroll <fretwizzer@gmail.com> - 2015-09-02 08:54 -0700
Re: Three more weeks of UNIX dunno <dunno@dunno.dunno> - 2015-09-03 00:12 +0000
Re: Three more weeks of UNIX Melzzzzz <mel@zzzzz.com> - 2015-09-02 18:00 +0200
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-02 16:07 +0000
Re: Three more weeks of UNIX Peter Köhlmann <peter-koehlmann@t-online.de> - 2015-09-02 18:40 +0200
Re: Three more weeks of UNIX chrisv <chrisv@nospam.invalid> - 2015-09-02 12:09 -0500
Re: Three more weeks of UNIX Peter Köhlmann <peter-koehlmann@t-online.de> - 2015-09-02 20:43 +0200
Re: Three more weeks of UNIX Peter Köhlmann <peter-koehlmann@t-online.de> - 2015-09-02 21:19 +0200
Re: Three more weeks of UNIX ronb <ronbNOSPAM@gmail.com> - 2015-09-02 23:31 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-02 20:36 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-03 09:17 +0000
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-03 10:06 -0700
Re: Three more weeks of UNIX "A.M" <.m@nsn.s> - 2015-09-03 08:47 -0400
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-03 13:22 +0000
Re: Three more weeks of UNIX "A.M" <.m@nsn.s> - 2015-09-03 10:10 -0400
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-03 09:31 -0700
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-03 16:47 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-03 22:29 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-03 23:48 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-04 01:38 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-04 02:50 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-04 04:34 +0000
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-03 23:35 -0700
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-04 07:39 +0000
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-04 01:00 -0700
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-05 16:59 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-05 17:15 +0000
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-05 10:40 -0700
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-05 18:51 +0000
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-05 13:09 -0700
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-05 10:39 -0700
Re: Three more weeks of UNIX Melzzzzz <mel@zzzzz.com> - 2015-09-05 20:03 +0200
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-05 18:50 +0000
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-05 13:16 -0700
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-05 20:52 +0000
Re: Three more weeks of UNIX Melzzzzz <mel@zzzzz.com> - 2015-09-05 19:58 +0200
Re: Three more weeks of UNIX Melzzzzz <mel@zzzzz.com> - 2015-09-05 20:39 +0200
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-05 19:13 +0000
Re: Three more weeks of UNIX Melzzzzz <mel@zzzzz.com> - 2015-09-05 21:26 +0200
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-05 19:43 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-05 19:50 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-05 19:55 +0000
Re: Three more weeks of UNIX Steve Carroll <fretwizzer@gmail.com> - 2015-09-05 13:39 -0700
Re: Three more weeks of UNIX Melzzzzz <mel@zzzzz.com> - 2015-09-05 23:14 +0200
Re: Three more weeks of UNIX Melzzzzz <mel@zzzzz.com> - 2015-09-05 23:28 +0200
Re: Three more weeks of UNIX Melzzzzz <mel@zzzzz.com> - 2015-09-06 00:02 +0200
Re: Three more weeks of UNIX Melzzzzz <mel@zzzzz.com> - 2015-09-06 01:24 +0200
Re: Three more weeks of UNIX Melzzzzz <mel@zzzzz.com> - 2015-09-06 02:12 +0200
Re: Three more weeks of UNIX Melzzzzz <mel@zzzzz.com> - 2015-09-06 02:33 +0200
Re: Three more weeks of UNIX ronb <ronbNOSPAM@gmail.com> - 2015-09-06 01:03 +0000
Re: Three more weeks of UNIX Melzzzzz <mel@zzzzz.com> - 2015-09-06 03:24 +0200
Re: Three more weeks of UNIX Peter Köhlmann <peter-koehlmann@t-online.de> - 2015-09-06 09:45 +0200
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-06 06:40 +0000
Re: Three more weeks of UNIX Nobody <nobody@invalid.com> - 2015-09-06 09:58 -0500
Re: Three more weeks of UNIX Melzzzzz <mel@zzzzz.com> - 2015-09-06 03:40 +0200
Re: Three more weeks of UNIX dunno <dunno@dunno.dunno> - 2015-09-06 03:04 +0000
Re: Three more weeks of UNIX dunno <dunno@dunno.dunno> - 2015-09-06 04:48 +0000
Re: Three more weeks of UNIX dunno <dunno@dunno.dunno> - 2015-09-06 06:46 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-06 06:14 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-06 07:21 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-06 08:12 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-06 10:09 +0000
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-06 10:24 -0700
Re: Three more weeks of UNIX Nobody <nobody@invalid.com> - 2015-09-06 09:00 -0500
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-06 10:55 -0700
Re: Three more weeks of UNIX Nobody <nobody@invalid.com> - 2015-09-06 18:44 -0500
Re: Three more weeks of UNIX ronb <ronbNOSPAM@gmail.com> - 2015-09-06 19:24 +0000
Re: Three more weeks of UNIX Peter Köhlmann <peter-koehlmann@t-online.de> - 2015-09-06 21:47 +0200
Re: Three more weeks of UNIX Nobody <nobody@invalid.com> - 2015-09-06 09:35 -0500
Re: Three more weeks of UNIX Melzzzzz <mel@zzzzz.com> - 2015-09-06 12:03 +0200
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-06 21:04 +0000
Re: Three more weeks of UNIX Peter Köhlmann <peter-koehlmann@t-online.de> - 2015-09-06 23:18 +0200
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-06 21:51 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-06 22:37 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-06 23:08 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-06 23:38 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-07 00:10 +0000
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-08 09:15 -0700
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-08 09:18 -0700
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-08 10:04 -0700
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-09 01:44 +0000
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-09 02:00 +0000
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-08 19:05 -0700
Re: Three more weeks of UNIX "A.M" <.m@nsn.s> - 2015-09-09 09:23 -0400
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-09 09:44 -0700
Re: Three more weeks of UNIX "A.M" <.m@nsn.s> - 2015-09-09 12:47 -0400
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-09 10:04 -0700
Re: Three more weeks of UNIX "A.M" <.m@nsn.s> - 2015-09-09 13:15 -0400
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-09 10:28 -0700
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-08 19:00 -0700
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-09 02:12 +0000
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-08 19:18 -0700
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-09 02:30 +0000
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-08 19:33 -0700
Re: Three more weeks of UNIX chrisv <chrisv@nospam.invalid> - 2015-09-08 07:42 -0500
Re: Three more weeks of UNIX Melzzzzz <mel@zzzzz.com> - 2015-09-08 15:30 +0200
Re: Three more weeks of UNIX chrisv <chrisv@nospam.invalid> - 2015-09-08 09:05 -0500
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-08 08:02 -0700
Re: Three more weeks of UNIX "A.M" <.m@nsn.s> - 2015-09-08 12:10 -0400
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-08 09:17 -0700
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-05 22:53 +0000
Re: Three more weeks of UNIX Melzzzzz <mel@zzzzz.com> - 2015-09-06 01:00 +0200
Re: Three more weeks of UNIX vallor <vallor@cultnix.org> - 2015-09-07 00:10 +0000
Re: Three more weeks of UNIX Melzzzzz <melz@zzzzz.com> - 2015-09-07 02:12 +0200
Re: Three more weeks of UNIX Peter Köhlmann <peter-koehlmann@t-online.de> - 2015-09-06 01:04 +0200
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-05 12:45 -0700
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-05 19:48 +0000
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-05 13:20 -0700
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-05 13:38 -0700
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-05 19:10 +0000
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-05 12:48 -0700
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-05 19:53 +0000
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-05 13:26 -0700
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-04 09:28 -0700
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-04 04:52 +0000
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-03 23:48 -0700
Re: Three more weeks of UNIX dunno <dunno@dunno.dunno> - 2015-09-04 05:13 +0000
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-03 23:49 -0700
Re: Three more weeks of UNIX dunno <dunno@dunno.dunno> - 2015-09-04 07:34 +0000
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-04 00:48 -0700
Re: Three more weeks of UNIX Peter Köhlmann <peter-koehlmann@t-online.de> - 2015-09-05 10:09 +0200
Re: Three more weeks of UNIX Peter Köhlmann <peter-koehlmann@t-online.de> - 2015-09-06 09:42 +0200
Re: Three more weeks of UNIX Nobody <nobody@invalid.com> - 2015-09-06 07:49 +0000
Re: Three more weeks of UNIX ronb <ronbNOSPAM@gmail.com> - 2015-09-06 19:26 +0000
Re: Three more weeks of UNIX chrisv <chrisv@nospam.invalid> - 2015-09-08 07:34 -0500
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-08 08:31 -0700
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-03 09:33 -0700
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-03 16:48 +0000
Re: Three more weeks of UNIX Peter Köhlmann <peter-koehlmann@t-online.de> - 2015-09-05 10:08 +0200
Re: Three more weeks of UNIX Snit <usenet@gallopinginsanity.com> - 2015-09-05 13:36 -0700
Re: Three more weeks of UNIX Steve Carroll <fretwizzer@gmail.com> - 2015-09-03 11:45 -0700
Re: Three more weeks of UNIX Nobody <nobody@invalid.com> - 2015-09-05 01:26 -0500
Re: Three more weeks of UNIX Nobody <nobody@invalid.com> - 2015-09-05 02:27 -0500
Re: Three more weeks of UNIX ronb <ronbNOSPAM@gmail.com> - 2015-09-02 23:30 +0000
Re: Three more weeks of UNIX Nobody <nobody@invalid.com> - 2015-09-05 02:15 -0500
Re: Three more weeks of UNIX ronb <ronbNOSPAM@gmail.com> - 2015-09-05 21:19 +0000
Re: Three more weeks of UNIX Nobody <nobody@invalid.com> - 2015-09-07 04:39 -0500
Re: Three more weeks of UNIX Nobody <nobody@invalid.com> - 2015-09-05 01:15 -0500
Re: Three more weeks of UNIX Nobody <nobody@invalid.com> - 2015-09-05 02:12 -0500
Re: Three more weeks of UNIX Nobody <nobody@invalid.com> - 2015-09-05 02:26 -0500
Re: Three more weeks of UNIX ronb <ronbNOSPAM@gmail.com> - 2015-09-05 21:21 +0000
Re: Three more weeks of UNIX Nobody <nobody@invalid.com> - 2015-09-07 04:46 -0500
Re: Three more weeks of UNIX DFS <nospam@dfs.com> - 2015-09-07 10:18 -0400
Re: Three more weeks of UNIX cc <scatnubbs@hotmail.com> - 2015-09-03 04:27 -0700
Re: Three more weeks of UNIX DFS <nospam@dfs.com> - 2015-09-03 09:26 -0400
Re: Three more weeks of UNIX "A.M" <.m@nsn.s> - 2015-09-03 10:37 -0400
Re: Three more weeks of UNIX Peter Köhlmann <peter-koehlmann@t-online.de> - 2015-09-02 20:40 +0200
Re: Three more weeks of UNIX Peter Köhlmann <peter-koehlmann@t-online.de> - 2015-09-02 21:17 +0200
Snit Michael Glasser unable to do simple search Peter Köhlmann <peter-koehlmann@t-online.de> - 2015-09-02 23:02 +0200
Re: Snit Michael Glasser unable to do simple search hifye <hifye@humanoid.net> - 2015-09-02 17:10 -0400
Re: Snit Michael Glasser unable to do simple search Peter Köhlmann <peter-koehlmann@t-online.de> - 2015-09-03 01:09 +0200
Re: Peter Köhlmann admits he has no clue what he is talking about "A.M" <.m@nsn.s> - 2015-09-02 17:50 -0400
Re: Peter Köhlmann admits he has no clue what he is talking about Nobody <nobody@invalid.com> - 2015-09-05 01:17 -0500
Re: Three more weeks of UNIX JEDIDIAH <jedi@nomad.mishnet> - 2015-09-03 12:02 -0500
Re: Three more weeks of UNIX chrisv <chrisv@nospam.invalid> - 2015-09-03 13:02 -0500
Re: Three more weeks of UNIX JEDIDIAH <jedi@nomad.mishnet> - 2015-09-03 13:16 -0500
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-02 20:42 +0000
Re: Three more weeks of UNIX John Gohde <john.h.gohde@gmail.com> - 2015-09-02 09:08 -0700
Re: Three more weeks of UNIX Peter Köhlmann <peter-koehlmann@t-online.de> - 2015-09-02 20:35 +0200
Re: Three more weeks of UNIX dunno <dunno@dunno.dunno> - 2015-09-03 00:12 +0000
Re: Three more weeks of UNIX dunno <dunno@dunno.dunno> - 2015-09-03 01:07 +0000
Re: Three more weeks of UNIX dunno <dunno@dunno.dunno> - 2015-09-03 01:39 +0000
Re: Three more weeks of UNIX cc <scatnubbs@hotmail.com> - 2015-09-03 04:28 -0700
Re: Three more weeks of UNIX Debbie Ballard <rex.ballard@gmail.com> - 2015-09-03 21:10 -0700
Re: Three more weeks of UNIX owl <owl@rooftop.invalid> - 2015-09-04 04:55 +0000
csiph-web