Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > microsoft.public.excel.programming > #109296
| From | Robert Baer <robertbaer@localnet.com> |
|---|---|
| Newsgroups | microsoft.public.excel.programming, microsoft.public.excel |
| Subject | Re: Read (and parse) file on the web CORRECTION#2 |
| References | (9 earlier) <nqjuc4$7j8$1@dont-email.me> <JNqzz.334$OT5.113@fx19.iad> <XnsA67BC7911E470auricauricauricauric@213.239.209.88> <8ONzz.56531$M27.26468@fx33.iad> <XnsA67CE831F3B1Cauricauricauricauric@213.239.209.88> |
| Message-ID | <8%8Az.103752$PM.41042@fx08.iad> (permalink) |
| Date | 2016-09-08 01:07 -0800 |
Cross-posted to 2 groups.
Auric__ wrote:
> Robert Baer wrote:
>
>> Auric__ wrote:
>>> Robert Baer wrote:
>>>
>>>> PS: i found WGET to be non-useful (a) it truncates the filename (b) it
>>>> buggers it to partial gibberish.
>>>
>>> Then you must be using a bad version, or perhaps have something wrong
>>> with your .wgetrc. I've been using wget for around 10 years, and never
>>> had anything like those issues unless I pass bad options.
>>>
>> Know nothing about .wgetrc;
>
> Don't worry about it. It can be used to set default behaviors but every entry
> can be replicated via switches.
>
>> am in Win2K cmd line, and the batch file
>> used is:
>> H:
>> CD\Win2K_WORK\OIL4LESS\LLCDOCS\FED app\FBA stuff
>>
>> wget --no-check-certificate --output-document=5960_002.TXT
>> --output-file=log002.TXT
>> https://www.nsncenter.com/NSNSearch?q=5960%20regulator%20and%20%22ELECTRO
>> N%20TUBE%22&PageNumber=2
>
> That wget line performs as expected for me: 5960_002.TXT contains valid HTML
> (although I haven't made any attempt to check the data; it looks like most of
> the page is CSS) and log002.TXT is a typical wget log of a successful
> transfer.
>
> As for truncating the filenames, if I remove the --output-document switch,
> the filename I get is
>
> NSNSearch@q=5960%20regulator%20and%20%22ELECTRON%20TUBE%22&PageNumber=2
>
>> PAUSE
>>
>> The SourceForge site offered a Zip which was supposed to be complete,
>
> If you're talking about GNUwin32, that version is years out of date.
>
>> but none of the created folders had an EXE (tried Win2K, WinXP, Win7).
>> Found SofTonic offering only a plain jane wget.exe, which i am using,
>> so that may be a buggered version.
>
> Never even heard of them.
>
>> Suggestions?
>
> I'm using 1.16.3. No idea where I got it.
>
> The batch file that I use for downloading looks like this:
>
> call wget --no-check-certificate -x -c -e robots=off -i new.txt %*
>
> -x Always create directories (e.g. http://a.b.c/1/2.txt -> .\a.b.c\1\2.txt).
> -c Continue interrupted downloads.
> -e Do this .wgetrc thing (in this case, ignore the robots.txt file).
> -i Read list of filenames from the following file ("new.txt" because that's
> the default name for a new file in my file manager).
>
> I use the -i switch so I don't have to worry about escaping characters or %
> vs %%. Whatever's in the text file is exactly what it looks for. (If you go
> this route, it's one file per line.)
>
You must have a different version of Wget; whatever i do on the
command line,including the "trick" of restrict-file-names=nocontrol, i
get a buggered path name plus the response &PageNumber not recognized.
Exactly same results in Win2K, WinXP or in Win7.
Yes, i used GNUwin32 as SourceForge "complete" of Wget had no EXE.
Is there some other (compiled, complete) source i should get?
Back to microsoft.public.excel.programming | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread
Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-08-26 10:57 -0800
Re: Read (and parse) file on the web "Auric__" <not.my.real@email.address> - 2016-08-26 15:21 +0000
Re: Read (and parse) file on the web "Auric__" <not.my.real@email.address> - 2016-08-26 15:22 +0000
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-08-27 13:04 -0800
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-08-27 13:00 -0800
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-08-27 23:14 -0800
Re: Read (and parse) file on the web CORRECTION Robert Baer <robertbaer@localnet.com> - 2016-08-28 09:42 -0800
Re: Read (and parse) file on the web CORRECTION#2 Robert Baer <robertbaer@localnet.com> - 2016-08-28 10:08 -0800
Re: Read (and parse) file on the web CORRECTION#2 "Auric__" <not.my.real@email.address> - 2016-08-29 01:51 +0000
Re: Read (and parse) file on the web CORRECTION#2 Robert Baer <robertbaer@localnet.com> - 2016-08-28 21:32 -0800
Re: Read (and parse) file on the web CORRECTION#2 "Auric__" <not.my.real@email.address> - 2016-08-29 19:41 +0000
Re: Read (and parse) file on the web CORRECTION#2 Robert Baer <robertbaer@localnet.com> - 2016-08-30 00:21 -0800
Re: Read (and parse) file on the web CORRECTION#2 GS <gs@v.invalid> - 2016-08-30 06:06 -0400
Re: Read (and parse) file on the web CORRECTION#2 Robert Baer <robertbaer@localnet.com> - 2016-08-30 14:20 -0800
Re: Read (and parse) file on the web CORRECTION#2 GS <gs@v.invalid> - 2016-08-30 18:43 -0400
Re: Read (and parse) file on the web CORRECTION#2 GS <gs@v.invalid> - 2016-08-31 16:47 -0400
Re: Read (and parse) file on the web CORRECTION#2 Robert Baer <robertbaer@localnet.com> - 2016-09-01 04:37 -0800
Re: Read (and parse) file on the web CORRECTION#2 GS <gs@v.invalid> - 2016-09-01 13:13 -0400
Re: Read (and parse) file on the web CORRECTION#2 Robert Baer <robertbaer@localnet.com> - 2016-09-01 16:32 -0800
Re: Read (and parse) file on the web CORRECTION#2 GS <gs@v.invalid> - 2016-09-01 19:43 -0400
Re: Read (and parse) file on the web CORRECTION#2 Robert Baer <robertbaer@localnet.com> - 2016-09-01 04:23 -0800
Re: Read (and parse) file on the web CORRECTION#2 GS <gs@v.invalid> - 2016-09-05 10:10 -0400
Re: Read (and parse) file on the web CORRECTION#2 GS <gs@v.invalid> - 2016-09-05 10:17 -0400
Re: Read (and parse) file on the web CORRECTION#3 Robert Baer <robertbaer@localnet.com> - 2016-09-05 20:50 -0800
Re: Read (and parse) file on the web CORRECTION#2 Robert Baer <robertbaer@localnet.com> - 2016-09-05 20:32 -0800
Re: Read (and parse) file on the web CORRECTION#2 GS <gs@v.invalid> - 2016-09-06 10:49 -0400
Re: Read (and parse) file on the web CORRECTION#2 Robert Baer <robertbaer@localnet.com> - 2016-09-06 12:05 -0800
Re: Read (and parse) file on the web CORRECTION#2 GS <gs@v.invalid> - 2016-09-06 15:15 -0400
Re: Read (and parse) file on the web CORRECTION#2 Robert Baer <robertbaer@localnet.com> - 2016-09-06 22:32 -0800
Re: Read (and parse) file on the web CORRECTION#2 GS <gs@v.invalid> - 2016-09-07 11:44 -0400
Re: Read (and parse) file on the web CORRECTION#2 Robert Baer <robertbaer@localnet.com> - 2016-09-07 09:33 -0800
Re: Read (and parse) file on the web CORRECTION#2 Robert Baer <robertbaer@localnet.com> - 2016-09-08 20:18 -0800
Re: Read (and parse) file on the web CORRECTION#2 GS <gs@v.invalid> - 2016-09-09 06:07 -0400
Re: Read (and parse) file on the web CORRECTION#2 GS <gs@v.invalid> - 2016-09-09 22:05 -0400
Re: Read (and parse) file on the web CORRECTION#2 Robert Baer <robertbaer@localnet.com> - 2016-09-14 17:16 -0800
Re: Read (and parse) file on the web CORRECTION#2 GS <gs@v.invalid> - 2016-09-14 20:23 -0400
Re: Read (and parse) file on the web CORRECTION#2 "Auric__" <not.my.real@email.address> - 2016-09-07 02:37 +0000
Re: Read (and parse) file on the web CORRECTION#2 Robert Baer <robertbaer@localnet.com> - 2016-09-06 22:43 -0800
Re: Read (and parse) file on the web CORRECTION#2 "Auric__" <not.my.real@email.address> - 2016-09-08 05:49 +0000
Re: Read (and parse) file on the web CORRECTION#2 Robert Baer <robertbaer@localnet.com> - 2016-09-08 01:07 -0800
Re: Read (and parse) file on the web CORRECTION#2 "Auric__" <not.my.real@email.address> - 2016-09-09 06:40 +0000
Re: Read (and parse) file on the web WGET versions Robert Baer <robertbaer@localnet.com> - 2016-09-08 01:19 -0800
Re: Read (and parse) file on the web WGET versions Robert Baer <robertbaer@localnet.com> - 2016-09-08 20:09 -0800
Re: Read (and parse) file on the web CORRECTION#2 Robert Baer <robertbaer@localnet.com> - 2016-09-06 23:49 -0800
Re: Read (and parse) file on the web GS <gs@v.invalid> - 2016-08-28 15:51 -0400
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-08-28 21:37 -0800
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-09-02 19:09 -0800
Re: Read (and parse) file on the web GS <gs@v.invalid> - 2016-08-29 01:56 -0400
Re: Read (and parse) file on the web GS <gs@v.invalid> - 2016-08-29 02:21 -0400
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-08-29 19:55 -0800
Re: Read (and parse) file on the web GS <gs@v.invalid> - 2016-08-29 23:35 -0400
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-08-29 22:25 -0800
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-08-29 19:21 -0800
Re: Read (and parse) file on the web GS <gs@v.invalid> - 2016-08-29 23:21 -0400
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-08-29 22:10 -0800
Re: Read (and parse) file on the web GS <gs@v.invalid> - 2016-08-30 04:04 -0400
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-08-30 13:48 -0800
Re: Read (and parse) file on the web GS <gs@v.invalid> - 2016-08-29 23:37 -0400
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-08-29 22:25 -0800
Re: Read (and parse) file on the web lovexes17816 <lovexes17816@gmail.com> - 2016-08-28 14:00 +0100
Re: Read (and parse) file on the web lovexes17816 <lovexes17816@gmail.com> - 2016-08-29 02:17 +0100
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-09-02 19:11 -0800
Re: Read (and parse) file on the web "Auric__" <not.my.real@email.address> - 2016-09-03 04:12 +0000
Re: Read (and parse) file on the web Tikivn23143 <Tikivn23143@gmail.com> - 2016-08-30 02:28 +0100
Re: Read (and parse) file on the web everonvietnam2016 <everonvietnam2016@gmail.com> - 2016-09-07 15:03 +0100
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-09-07 08:43 -0800
Re: Read (and parse) file on the web "Auric__" <not.my.real@email.address> - 2016-09-08 05:43 +0000
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-09-08 01:09 -0800
Re: Read (and parse) file on the web "Auric__" <not.my.real@email.address> - 2016-09-09 06:49 +0000
Re: Read (and parse) file on the web everonvietnam2016 <everonvietnam2016@gmail.com> - 2016-09-08 11:11 +0100
Re: Read (and parse) file on the web GS <gs@v.invalid> - 2016-09-14 17:14 -0400
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-09-14 17:19 -0800
Re: Read (and parse) file on the web GS <gs@v.invalid> - 2016-09-14 20:26 -0400
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-09-15 09:59 -0800
Re: Read (and parse) file on the web GS <gs@v.invalid> - 2016-09-15 14:33 -0400
Re: Read (and parse) file on the web GS <gs@v.invalid> - 2016-09-14 21:28 -0400
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-09-15 10:05 -0800
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-09-14 18:48 -0800
Re: Read (and parse) file on the web GS <gs@v.invalid> - 2016-09-14 21:59 -0400
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-09-15 10:15 -0800
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-09-15 22:10 -0800
Re: Read (and parse) file on the web GS <gs@v.invalid> - 2016-09-16 11:50 -0400
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-09-16 23:54 -0800
Re: Read (and parse) file on the web GS <gs@v.invalid> - 2016-09-17 11:06 -0400
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-09-17 23:59 -0800
Re: Read (and parse) file on the web GS <gs@v.invalid> - 2016-09-18 03:22 -0400
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-09-20 00:20 -0800
Re: Read (and parse) file on the web GS <gs@v.invalid> - 2016-09-17 11:14 -0400
Re: Read (and parse) file on the web Robert Baer <robertbaer@localnet.com> - 2016-09-18 00:18 -0800
Re: Read (and parse) file on the web GS <gs@v.invalid> - 2016-09-18 03:30 -0400
Re: Read (and parse) file on the web GS <gs@v.invalid> - 2016-09-15 05:02 -0400
Re: Read (and parse) file on the web - revised GS <gs@v.invalid> - 2016-09-17 17:15 -0400
csiph-web