Path: csiph.com!xmission!news.alt.net!not-for-mail
From: owl <owl@rooftop.invalid>
Newsgroups: comp.os.linux.advocacy
Subject: Re: Three more weeks of UNIX
Date: Sat, 5 Sep 2015 16:59:50 +0000 (UTC)
Organization: ok by me, so long as it doesn't get out of hand
Lines: 69
Message-ID: <famn83.ap3@rooftop.invalid>
References: <390avmv9.jiida@rooftop.invalid>   <adfm93l.afu@rooftop.invalid> <D20E1DF3.59E00%usenet@gallopinginsanity.com> <adfmvu84jfr.o@rooftop.invalid> <D20E3705.59E2C%usenet@gallopinginsanity.com> <fasmnvc93.jdif@rooftop.invalid> <D20E4615.59E55%usenet@gallopinginsanity.com> <fsa.vjcxzi3@rooftop.invalid> <D20E5B6D.59E5E%usenet@gallopinginsanity.com> <afdsmv8.kdi@rooftop.invalid> <D20E89BD.59E79%usenet@gallopinginsanity.com> <fad.viz0@rooftop.invalid> <D20E9D9C.59EA0%usenet@gallopinginsanity.com>
NNTP-Posting-Host: boom.rooftop.invalid
Xref: csiph.com comp.os.linux.advocacy:319120

Snit <usenet@gallopinginsanity.com> wrote:
> On 9/4/15, 12:39 AM, in article fad.viz0@rooftop.invalid, "owl"
> <owl@rooftop.invalid> wrote:

> ... 
>>> I am responsible only for my actions, and my actions are honest. If you wish
>>> to believe my weird "fan" club about my "unquotable lies" then so be it.
>> 
>>> And you have still not shared your script. Why not?
>> 
>> I may post it tomorrow.  I need to try a few things first.

> You are spending a LOT more time on yours than I did mine...

Because there's apparently a bug in wkhtmltopdf.  (Huge file sizes).

> but yours will
> likely also be a lot "cleaner". Mine is a bit of a mess, but as we saw it
> works well.

> Once you share yours I will make my video public:
> <https://youtu.be/TH3rKDAAvsc>

> Looking at my script again I could have made it a LOT easier. Might test
> that tomorrow and then have a MUCH better script. But whatever... it works.
> :)

The code should work on OS X with the zenity stuff commented out.
Curious if the wkhtmltopdf bug is still present in the OS X
version.  At the time it was mentioned, the thing apparently
worked fine for Linux.  Now I'm seeing what appears to be
that same situation that was described for the OS X version,
but on Linux.

#!/bin/sh

date=`date`
#zenity --notification --text="starting... ${date}"
stime=`date +%s`

if [ ! -e ~/Recipes ];then
mkdir ~/Recipes
fi

html="$(parallel --no-notice -P 3 -N 3 wget -q {1} {2} {3} ::: \
allrecipes.com -O - \
allrecipes.com/?page=2 -O - \
allrecipes.com/?page=3 -O -)"

recipelines=$( echo "${html}" |grep /recipe/ \
|perl -e 'while(<>){ $x=$_;$x=~s/^.*<a href=\"//g; $x=~s/\".*//g;print $x;}' \
|uniq) 

filenames=$(echo "${recipelines}" |cut -f4 -d'/')

parallel --no-notice -P 8 -N 1 --xapply \
wkhtmltopdf -q -n \
http://allrecipes.com/{1}/print/ /home/anon/Recipes/{2}.pdf \
::: ${recipelines} ::: ${filenames}

count="$(ls /home/anon/Recipes |wc -l)"
etime=`date +%s`
elapsed=$((${etime}-${stime}))
rate=$(echo "scale=3; ${elapsed}/${count}" |bc)
echo "${count} files in ${elapsed} seconds"
echo "${rate} seconds per file"
#zenity --info --text="${count} files in ${elapsed} seconds\n\
#${rate} seconds per file"