[bigdb]

turdflinger, on 19 April 2011 - 07:28 PM, said:

bigdb, on 19 April 2011 - 06:40 PM, said:

Yeah.. I PM Muppet Hunter the problems I was having too.. He responded that he would try to get a fix for those problems. I told him about the endless retry errors.. If you put the direct link in there it will work. And I noticed that wget was choking on the REM at the end of the line also. I copied the direct lines from that site you posted .... in the reg.bat file removed the REM and it works butit still will not put the files in the HF dir. Hopefully he will get around and do a fix on it.

yea, the '-P' command will work with the http://win-x.co.cc/f...DC-04.12.11.zip list.
it's just a matter of figuring out what is/isn't in the list compared to the hf-fl_xxx.zip files above as well as what directory (HF, HFCABS, etc) they each need to go.
here's to hoping...

Here is my test reg bat file.. the lines that start with small case "rem" is not on that list. This works but will not put the files where they go just in the hfslip root dir.

[bigdb]

bigdb, on 20 April 2011 - 07:16 AM, said:

turdflinger, on 19 April 2011 - 07:28 PM, said:

bigdb, on 19 April 2011 - 06:40 PM, said:

Yeah.. I PM Muppet Hunter the problems I was having too.. He responded that he would try to get a fix for those problems. I told him about the endless retry errors.. If you put the direct link in there it will work. And I noticed that wget was choking on the REM at the end of the line also. I copied the direct lines from that site you posted .... in the reg.bat file removed the REM and it works butit still will not put the files in the HF dir. Hopefully he will get around and do a fix on it.

yea, the '-P' command will work with the http://win-x.co.cc/f...DC-04.12.11.zip list.
it's just a matter of figuring out what is/isn't in the list compared to the hf-fl_xxx.zip files above as well as what directory (HF, HFCABS, etc) they each need to go.
here's to hoping...

Here is my test reg bat file.. the lines that start with small case "rem" is not on that list. This works but will not put the files where they go just in the hfslip root dir.

Oops.. forgot to attach file...

Attached File(s)

•  hf-dl_reg_test.rar (6.17K)
  Number of downloads: 9

[submix8c]

It appears that both of you are correct. The REM's at the end should precede the WGET lines (just descriptives). The lines with ECHO (comments lines) also have some errors that makes the BAT think they are variables, etc.

Interestingly enough, the "chase" sequence isn't being carried out and within the downloaded files (the ones that do download) have the actual location of the given file (they are all the download "confirmation" screens with the embedded "click here if failure" addresses). Not sure why it isn't working (the "chase").

Guess they must have thought this was more convenient than manually adding the true filename paths?

BTW, thx for the investigation and "corrected" BAT file. It supplies some info that I need.

(why are we downloading SP3 by default??? what if SP3 is already integrated?)

This post has been edited by submix8c: 22 April 2011 - 11:20 AM

[Muppet Hunter]

New batches posted. Thanks for the feedback, I'll reply in more detail later on.

Just a few points, I think the echo comments in the previous batch might have had problems because they weren't enclosed in double quotes. If the new ones show the same error then please open the bat in notepad and put quotes around the words eg echo "blah blah blah". If it still doesn't work then just delete the echo lines.

I've put a line in to change to the right drive and directory cd /d %~dp0, this was somehow missed from before when I think using a directory of \HFSLIP was a pre-requisite.

I've tested the main aria2 command under linux and it downloads everything into the right directory, the Regular batch took 15mins to download everything (I'm on an 8Mbit ADSL connection). aria2 does parallel downloading (wget is serial), so this works well for any HFSLIP newbies!

All filelists come from the same spreadsheet that I use for my XP update list so (in theory) should be as accurate as that, plus I'm using a nix program called sed to format the lists.

Bigdb, thanks for your help on this. I'll look into tidying up the del commands with the 2> nul later on.

It might be possible at some stage to resurrect using a spreadsheet so people can 'roll their own' update lists.

This post has been edited by Muppet Hunter: 23 April 2011 - 03:34 PM

[bigdb]

Muppet Hunter, on 23 April 2011 - 03:29 PM, said:

New batches posted. Thanks for the feedback, I'll reply in more detail later on.

Just a few points, I think the echo comments in the previous batch might have had problems because they weren't enclosed in double quotes. If the new ones show the same error then please open the bat in notepad and put quotes around the words eg echo "blah blah blah". If it still doesn't work then just delete the echo lines.

I've put a line in to change to the right drive and directory cd /d %~dp0, this was somehow missed from before when I think using a directory of \HFSLIP was a pre-requisite.

I've tested the main aria2 command under linux and it downloads everything into the right directory, the Regular batch took 15mins to download everything (I'm on an 8Mbit ADSL connection). aria2 does parallel downloading (wget is serial), so this works well for any HFSLIP newbies!

All filelists come from the same spreadsheet that I use for my XP update list so (in theory) should be as accurate as that, plus I'm using a nix program called sed to format the lists.

Bigdb, thanks for your help on this. I'll look into tidying up the del commands with the 2> nul later on.

It might be possible at some stage to resurrect using a spreadsheet so people can 'roll their own' update lists.

Sounds Great!!! I'll give it try.. thanks for your efforts for sure!

[bigdb]

bigdb, on 23 April 2011 - 04:28 PM, said:

Muppet Hunter, on 23 April 2011 - 03:29 PM, said:

New batches posted. Thanks for the feedback, I'll reply in more detail later on.

Just a few points, I think the echo comments in the previous batch might have had problems because they weren't enclosed in double quotes. If the new ones show the same error then please open the bat in notepad and put quotes around the words eg echo "blah blah blah". If it still doesn't work then just delete the echo lines.

I've put a line in to change to the right drive and directory cd /d %~dp0, this was somehow missed from before when I think using a directory of \HFSLIP was a pre-requisite.

I've tested the main aria2 command under linux and it downloads everything into the right directory, the Regular batch took 15mins to download everything (I'm on an 8Mbit ADSL connection). aria2 does parallel downloading (wget is serial), so this works well for any HFSLIP newbies!

All filelists come from the same spreadsheet that I use for my XP update list so (in theory) should be as accurate as that, plus I'm using a nix program called sed to format the lists.

Bigdb, thanks for your help on this. I'll look into tidying up the del commands with the 2> nul later on.

It might be possible at some stage to resurrect using a spreadsheet so people can 'roll their own' update lists.

Sounds Great!!! I'll give it try.. thanks for your efforts for sure!

That appears to work ok ... right off hand I don't see anything wrong with that one.. I was using the regular.bat

Thanks!

[submix8c]

Admittedly, aria2 (good find!) appears to be a better option for downloading BUT... I notice that the direct link (within the control file) is now used (as in the aforementioned links method) instead of a "chase" (as was in the previous BAT files).

So far, the major improvement (over "the other one") is download speed.

Noting also this list is for HFSlip usage as opposed to nLite usage (in "the other").
Just pointing this out to prevent any confusion for "newbies"...

This post has been edited by submix8c: 24 April 2011 - 01:07 PM

[Muppet Hunter]

bigdb, on 23 April 2011 - 04:50 PM, said:

That appears to work ok ... right off hand I don't see anything wrong with that one.. I was using the regular.bat

Glad it works!

submix8c, on 24 April 2011 - 01:06 PM, said:

Admittedly, aria2 (good find!) appears to be a better option for downloading BUT... I notice that the direct link (within the control file) is now used (as in the aforementioned links method) instead of a "chase" (as was in the previous BAT files).

I'm still using the wget chase method to get the direct links, so it still has its uses.

submix8c, on 24 April 2011 - 01:06 PM, said:

So far, the major improvement (over "the other one") is download speed.

The summary at the end is better too. Also, I think aria2 would beat wget even if wget was using direct links as wget gets one file after the other rather than getting several at once. Aria2 also splits up the larger files (40MB+) into separate d/load threads, which is good if you're getting everything from scratch (ie directx redist + SP3).

submix8c, on 24 April 2011 - 01:06 PM, said:

Noting also this list is for HFSlip usage as opposed to nLite usage (in "the other").
Just pointing this out to prevent any confusion for "newbies"...

You could use the batches for downloading into a single directory, you'd just need to remove all the ' dir=' lines from the filelist. A sed script would be best for this.

[dusty]

I'm trying to do the batch downloading via aria2 but I think it needs the complete link to the file.

I switched to wget but I can't get it to work when I try to download de Spanish locale version of this file (just trying it as an example):

wget -o wget.log -d --referer=http://www.microsoft.com "http://www.microsoft.com/downloads/ES-ES/confirmation.aspx?familyid=5b33b5a8-5e76-401f-be08-1e1555d4f3d4&displaylang=ES-ES"

<wget output>

Deciding whether to enqueue "http://www.microsoft.com/downloads/info.aspx?na=41&SrcFamilyId=5B33B5A8-5E76-401F-BE08-1E1555D4F3D4&SrcDisplayLang=es&u=http%3a%2f%2fdownload.microsoft.com%2fdownload%2f9%2f4%2f2%2f942080a4-ba69-496b-a379-d3b26d37b647%2fWindowsXP-KB936929-SP3-x86-ESN.exe".
Going to "downloads" would escape "downloads/ES-ES" with no_parent on.
Decided NOT to load it.

</wget output>

Attached the complete log.

It reads the correct link, but it decides NOT to download it, but don't know exactly why..., could any switch do the job?

Thank you!

Edit: uploaded log
Edit2: can't upload log... but that's the important part I think

This post has been edited by dusty: 03 May 2011 - 12:41 PM

[Muppet Hunter]

I spent hours recently playing with the wget options and the best I could get was for the files to download with 1/2 the url attached to the front of the filename. Everything worked about a year ago but doesn't now for some reason, either the MS webstite or a wget bug I suspect. I think the crucial settings are for the no_parent and robots to be off and the accept options to be just right.

The batch downloading now uses aria2 instead of wget, but I've managed to use wget to get the direct link (see the attached wget.ini for the options I've used). Using direct links is the best option but the problem for multilanguage support is I'd have to get every link for every file and that will take time. The problematic files are the ones marked ENU on my update list (I'm on linux and can't validate!).

Attached File(s)

•  wget.zip (601bytes)
  Number of downloads: 9

[Squeeto]

Muppet Hunter
I have been using your update list for XP from Fred's site for a while now.
Thank you for the continued efforts. I know that this takes a lot of your time.

Your batch method just saved me a few hours of work too. Again, thank you.