Internet install download for LAN install

fudokai · June 23, 2010, 9:02am

Since the DVD is only 4.7GB and missing some stuff (e.g. pvm) I decided to
download the network install /oss folder for openSUSE 11.2 so that I can
install multiple copies locally and keep my bandwidth usage down.

I’ve downloaded the full /oss folder using wget -r and wget -cr during my
ISP’s free bandwidth slot (12-8am - and it took 2 sessions to get it all).

When I check the properties of the downloaded version against the source I
see …

size files sub-folders
download 13.5GB 14697 33
source 13.5GB 15287 74

Wget didn’t throw up any errors so why the difference?
Is there any (simple) way I can check the integrity of the download?

FYI the host was ftp://ftp.gwdg.de.

Alan

ken_yap · June 23, 2010, 9:57am

Why would you expect the source and binary folders bear much resemblance to each other? In fact it’s a fluke that their disk consumptions are so close. Firstly a source RPM can be used to generate binary RPMs for multiple architectures. Secondly one source RPM can result in more than one binary RPM.

Each RPM has a signature inside which can be used to detect corruption. You could run rpm with the verify option to check each package, but I wouldn’t bother. The installer will throw an error if a RPM is faulty.

DenverD · June 23, 2010, 11:37am

ken yap wrote:
> Why would you expect the source and binary folders bear much resemblance
> to each other?

i think you miss understood what he wrote…i think he meant that the
distant machine

reported 13.5GB 15287 files and 74 folders
locally he sees 13.5GB 14697 files and 33 folders

i do wonder what was the entire wget command used (that is, exactly
which parent folder was targeted for downloaded)

fudokai · June 23, 2010, 4:23pm

DenverD wrote:

> ken yap wrote:
>> Why would you expect the source and binary folders bear much resemblance
>> to each other?
>
> i think you miss understood what he wrote…i think he meant that the
> distant machine
>

> reported 13.5GB 15287 files and 74 folders
> locally he sees 13.5GB 14697 files and 33 folders
>

>
> i do wonder what was the entire wget command used (that is, exactly
> which parent folder was targeted for downloaded)
>

Thanks for understanding - the wget was (IIRC as it was in an at command)

wget -r ftp://ftp5.gwdg.de/pub/opensuse/distribution/11.2/repo/oss
followed by
wget -rc ftp://ftp5.gwdg.de/pub/opensuse/distribution/11.2/repo/oss

Cheers,
Alan

DenverD · June 23, 2010, 11:29pm

Fudokai wrote:
> wget -r ftp://ftp5.gwdg.de/pub/opensuse/distribution/11.2/repo/oss
> followed by
> wget -rc ftp://ftp5.gwdg.de/pub/opensuse/distribution/11.2/repo/oss

i think would’a used something like

wget --mirror ftp://ftp5.gwdg.[whatever]

BUT, look for yourself in man wget…wget is kinda tricky, you may
wanna get google to find you some expanded hints/how-to…

at the very least i think you should work on file clobber…that is,
read how it can (by using r and without -N or -nc to) download (say)
filename and then download it again and name it filename1, and again
and name it filename2 and and and

when you get it like you want/need it, you put it in a cron and run it
once a week and thereby keep your local set updated…

BUT, i wonder if you really need all these different versions: i586,
i686, noarch, x86_64, that is see:

ftp://ftp5.gwdg.de/pub/opensuse/distribution/11.2/repo/oss/suse/

fudokai · June 24, 2010, 2:43pm

DenverD wrote:

> Fudokai wrote:
>> wget -r ftp://ftp5.gwdg.de/pub/opensuse/distribution/11.2/repo/oss
>> followed by
>> wget -rc ftp://ftp5.gwdg.de/pub/opensuse/distribution/11.2/repo/oss
>
> i think would’a used something like
>
> wget --mirror ftp://ftp5.gwdg.[whatever]
>
> BUT, look for yourself in man wget…wget is kinda tricky, you may
> wanna get google to find you some expanded hints/how-to…
>
> at the very least i think you should work on file clobber…that is,
> read how it can (by using r and without -N or -nc to) download (say)
> filename and then download it again and name it filename1, and again
> and name it filename2 and and and
>
> when you get it like you want/need it, you put it in a cron and run it
> once a week and thereby keep your local set updated…
>
> BUT, i wonder if you really need all these different versions: i586,
> i686, noarch, x86_64, that is see:
>
> ftp://ftp5.gwdg.de/pub/opensuse/distribution/11.2/repo/oss/suse/
>

I use rsync to keep local copies of openSUSE & KDE updates, I just wanted to
run a quickie download of the network install stuff after I found that pvm
(for instance) was in that set but not in the DVD iso.
If I’d stopped to think for a while I probably would have used rsync rather
than wget but I did run wget and, since I get a different number of files
locally compared to the source, I just wondered if anyone could explain it.
I’ve used the download to upgrade a machine sine and it seems Ok - just
curious is all.

Alan

DenverD · June 24, 2010, 4:45pm

Fudokai wrote:
> I just wondered if anyone could explain it.
> I’ve used the download to upgrade a machine sine and it seems Ok - just
> curious is all.

think about this: because you didn’t use -N or -nc or --mirror, wget
downloaded some of the files on the distant server two or three times,
placing each into your local store like

file.rpm
file.rpm1
file.rpm2
anotherfile.rpm
anotherfile.rpm1

but, when you upgrade a machine the script looks for and fetches
file.rpm and anotherfile.rpm, and all is good…that is, it just
ignores the two extra files caused by using the wrong wget switches…

isn’t that explanation enough to fill your wondering?

and yes, i’d use rsync also–but that was not your question.

fudokai · June 27, 2010, 10:22pm

DenverD wrote:

> Fudokai wrote:
>> I just wondered if anyone could explain it.
>> I’ve used the download to upgrade a machine sine and it seems Ok - just
>> curious is all.
>
> think about this: because you didn’t use -N or -nc or --mirror, wget
> downloaded some of the files on the distant server two or three times,
> placing each into your local store like
>
> file.rpm
> file.rpm1
> file.rpm2
> anotherfile.rpm
> anotherfile.rpm1
>
> but, when you upgrade a machine the script looks for and fetches
> file.rpm and anotherfile.rpm, and all is good…that is, it just
> ignores the two extra files caused by using the wrong wget switches…
>
> isn’t that explanation enough to fill your wondering?
>
> and yes, i’d use rsync also–but that was not your question.
>
Thanks - that would explain things

Alan