Does anyone know of a tool to find the fastest mirrors for the repos? I know some distros have something called “fastest mirrors” or something equivalent. The fastest I can get updates is around 238 kB/s and normally, on other distros I get 10 times that speed.
thanks
btw, like all the other distros, speedtest.net gives me an avg download speed of 43Mbs
loukingjr wrote:
> Does anyone know of a tool to find the fastest mirrors for the repos?
i have no idea how the other distros you are used to distribute their
software, but i guess you know that most openSUSE mirrors are on
donated resources…like (maybe) a university network…and, many
(if not “most” or “all”) monitor their network traffic and throttle
off site activity in order to maintain a high level of support
(speed/throughput) for their own, local, on campus users…
therefore the fastest right now might be the slowest five minutes from
now as the different mirrors go into or out of peak use times…
sometimes i can download fastest from a neighboring country, sometimes
inside my country…but, sometimes i can get a faster download by
choosing a distant country…think about this: at noon here the
nearby university campus computer is probably BUSY, while the one on
the other side of the earth (at midnight) is not busy and the
throttling at both may make it faster to fetch from a distant time zone…
not to mention that the network named Internet is not a constant…
the solution: patience
–
DenverD
CAVEAT: http://is.gd/bpoMD [posted via NNTP w/openSUSE 10.3]
Have you tried a bit more modern ways of downloading?
I think Metalink will choose the mirror automatically.
Example given:
I am now downloading openSUSE 11.4 Milestone 3 with Metalink, DownThemAll! and MozillaFirefox
(the tool said it is using http:…mirror/opensuse/distribution/11.4-Milestone3/iso/openSUSE-GNOME-LiveCD-Build0845-i686.iso and gets 1.5-1.6 MBit per second).
And the best thing:
I will test automatically the downloaded data based on the modern checksum-system SHA256 - and I assume knowing if I got probably not corrupted data or probably corrupted data will save me much more time than I needed for the hole download (the download needs about 7 minutes).
See also:
SDB:Metalink - openSUSE
Have a lot of fun!
pistazienfresser
Oh sorry, you were referring to get (security, …) updates with YOU, zypper, Software Manager etc.
I do understand that but I have never had an openSuse repo send anything at better than 300 kB/s. I guess since you mentioned sometimes you can get things faster from one location than the other, it would be nice if I knew how to choose. I’m in the US and just for the sake of argument, let’s say I really wanted to use a repository in Italy. I don’t know how to switch the location of the repository I am downloading from to see if it’s faster or not.
yes, zypper, Software Manager, etc 
I think loukingjr is asking for something like ‘yum-plugin-fastestmirror’ isn’t it? However there aren’t many openSUSE repository’s clones. At least up to date.
At my University we have mounted an openSUSE repository 
(updates/oss/non-oss)
yum-plugin-fastestmirror sounds exactly like what I am looking for. I will look to see if it’s installed and if not, I will try it… thanks
> I do understand that but I have never had an openSuse repo send
> anything at better than 300 kB/s. I guess since you mentioned sometimes
> you can get things faster from one location than the other, it would be
> nice if I knew how to choose. I’m in the US and just for the sake of
> argument, let’s say I really wanted to use a repository in Italy. I
> don’t know how to switch the location of the repository I am downloading
> from to see if it’s faster or not.
open up YaST, click on Software Repositories and you will see (if your
YaST is the same as mine [it may not be, they do change over time]
check marks next to the repos you have enabled (if you have more than
four you need to read more here: http://tinyurl.com/33qc9vu)…
click on the repos you need (one at a time) and then on Edit and you
will see oss, non-oss and update all (probably) are address as
download.opensuse.org (and then a directory directory on the
server)…that “download.opensuse.org” is actually an address to a
“mirror brain” which routes your request to a server near you…
and, if the one selected by “mirror brain” near you is a dog, you are
outta luck…
so, just put in a different mirror and give it a whirl…a complete
list of mirrors with their specific addresses is in the wiki…
you can change the addresses in YaST or with zypper…
–
DenverD
CAVEAT: http://is.gd/bpoMD [posted via NNTP w/openSUSE 10.3]
thanks. I will try that
faco84 wrote:
> However there aren’t many openSUSE repository’s clones. At least up
> to date.
how did you determine that? or, what do you mean by “many”?
i count over 150 mirrors in over 45 countries of all continents…
each updated continuously…but, not all mirrors carry all possible
software, see: http://mirrors.opensuse.org/
–
DenverD
CAVEAT: http://is.gd/bpoMD [posted via NNTP w/openSUSE 10.3]
On 2010-11-12 00:06, loukingjr wrote:
>
> Does anyone know of a tool to find the fastest mirrors for the repos? I
> know some distros have something called “fastest mirrors” or something
> equivalent. The fastest I can get updates is around 238 kB/s and
> normally, on other distros I get 10 times that speed.
Unless you have changed things, the default is to choose mirrors
automatically, and download from several mirrors simultaneously up to the
maximum bandwidth.
That is using the automated redirector and integrated metalink support.
However, if you are in the USA… I heard that the most important mirror we
had was removed.
–
Cheers / Saludos,
Carlos E. R.
(from 11.2 x86_64 “Emerald” at Telcontar)
On 2010-11-12 14:36, faco84 wrote:
>
> I think loukingjr is asking for something like
> ‘yum-plugin-fastestmirror’ isn’t it?
No, we don’t need it. We have a system that is better - when it works.
–
Cheers / Saludos,
Carlos E. R.
(from 11.2 x86_64 “Emerald” at Telcontar)
On 2010-11-12 14:32, DenverD wrote:
> and, if the one selected by “mirror brain” near you is a dog, you are
> outta luck…
Not really. In metalink mode, you are not given a single mirror, but a list
of mirrors for each package. The downloader chooses one, or chooses five,
simultaneously. It doesn’t matter if one is dog, all five have to be a dog.
It also matters if there are no more mirrors in your part of the world, of
if metalink doesn’t trigger for that package.
You do not notice this because details from aria2c are hidden.
–
Cheers / Saludos,
Carlos E. R.
(from 11.2 x86_64 “Emerald” at Telcontar)
Seems there also an inprovement on openSUSE 11.4 Milestone 3 :
openSUSE News
So just a reason more to test 11.4 M3 …
Have a lot of fun
pistazienfresser
On 2010-11-13 20:36, pistazienfresser wrote:
>
> robin_listas;2251901 Wrote:
>>
>> You do not notice this because details from aria2c are hidden.
>>
>
> Seems there also an inprovement on openSUSE 11.4 Milestone 3 :
> ‘openSUSE News’ (http://tinyurl.com/3xd26g5)
Which section? I do not see anything about mirror or metalink handling :-?
> Eliasse Diaite Wrote:
>> …]You missed to comment in this post the new behavior of the YaST
>> package management module. I noticed that the installation process of
>> the packages is divided in two sequences. First all packages are
>> downloaded, then in a second step installed. The process is speed up
>> thanks to the wonderful download back-end aria2…]
> So just a reason more to test 11.4 M3 …
No, aria2c usage was introduced in 11.1.
–
Cheers / Saludos,
Carlos E. R.
(from 11.2 x86_64 “Emerald” at Telcontar)
Well even with my old laptop and
running my system from a GNOME live CD
I got about 1 MBit per second
(up to 1.3 while downloading the bigger files)
in the Software Manager of the
openSUSE 11.4 (Caladon) Milestone 3
with Kernel Linux 2.6.36-18-default and GNOME 2.32.0 .
Have a lot of fun
pistazienfresser
Well therefore I named the one who has written that comment and also cited that part of the comment form Eliasse Diaite (of the November 13, 2010 at 13:09).
That means not the behavior of aria2c or the aria2c implementation may not be changed (I do not know if it is or if it is not - therefore “it seems …”).
I have not made research. The version in 11.4 M3 I am writing from is:
aria2 1.10.3-3.3 (i586) and there is also aria2 1.10.6-2.1 (i586) to update to.
And the first part of the changelog of that aria2 1.10.6-2.1 (i586) is:
02 November 2010 (pascal.bleser@opensuse.org):
- update to 1.10.6:
* fixes the bug that prevented downloading files larger than 4GB on 32-bit systems
* fixes the bug that prevented the dht.dat file from being saved
* improper use of the return value of vsnprintf was fixed, which caused segmentation fault when formatting strings more than 1024 characters long
22 Oktober 2010 (pascal.bleser@opensuse.org):
- update 1.10.5:
* fixes the bug in which file allocation is enabled in HTTP even if --file-allocation=none is specified
12 Oktober 2010 (pascal.bleser@opensuse.org):
- update to 1.10.4:
* fixes the bug in which aria2 hangs when the FTP server does not send the "226 Transfer Complete" message
* fixes the bug in which the time used in file allocation is taken into account when calculating download speed
* non UTF-8 filenames are now percent-encoded
* the comments and name in the .torrent file in an XML-RPC response are also percent-encoded if they are not UTF-8
* a warning message when CA certificates are not imported is not printed in the console; instead, it is shown when a certificate verification error actually occurs
19 September 2010 (jengelh@medozas.de):
- use %_smp_mflags for build
15 September 2010 (pascal.bleser@opensuse.org):
- update to 1.10.3:
* adds the short option -x for the --max-connection-per-server option and -k for the --min-split-size option
* adds the --max-download-result=NUM option: this option sets the maximum number of download results kept in memory, and the default value is 1000
* --max-connection-per-server now accepts values up to 16
* the "@" character is now allowed in a username embedded in a URI
* fixes the bug in which aria2 reports an error and exits with non-zero status when a file is already downloaded and a checksum is available
- changes from 1.10.2:
* fixes the bug that prevented HTTP redirect from working when multiple files were downloaded from the same host at the same time
* for netrc, aria2 now performs a domain match if the machine name defined in .netrc starts with "."
29 August 2010 (pascal.bleser@opensuse.org):
- update to 1.10.1:
* adds IPv6 support for FTP, BitTorrent, and BitTorrent DHT
* for FTP, EPSV and EPRT command support was added
* enabling IPv6 DHT requires several new options
* aria2 now listens on both IPv4 and IPv6 sockets for BitTorrent, its DHT and XML-RPC; aria2 uses the same port for both IPv4 and IPv6
* the ability to add and remove BitTorrent tracker announce URIs was added
* the link error for FallocFileAllocationIterator was fixed
19 Juli 2010 (pascal.bleser@opensuse.org):
- update to 1.10.0:
* adds an option to limit the number of connections to the same host in each download
* aria2 now chooses the server which is least used in the aria2c instance
* adds Chromium cookie support
* adds HTTP only conditional download support in which a file is downloaded only when the local file is older than the remote file
* aria2 now can handle %2F in FTP URI properly
* the HTTP/1.1 chunked decoder was fixed
* aria2 uses fallocate by default if it is usable
28 Juni 2010 (pascal.bleser@opensuse.org):
- update to 1.9.5:
...]
Regards
pistazienfresser
I guess the change that Eliasse Diaite had been referring to/meaning may have come with
“libzypp - Package, Patch, Pattern, and Product Management”.
The first part of the changelog of
libzypp 8.7.0-1.1 in openSUSE 11.4 Milestone 3
is following:
Changelog applies only to the installed version.
13 Oktober 2010 (dheidler@suse.de):
- Make MetaLinkParser accept InputStreams
- Make MetaLinkParser accept Pathnames insted of strings
- Fix MetaLinkv4 hash parsing
- Add MetaLinkParser test
- version 8.7.0 (7)
11 Oktober 2010 (ma@suse.de):
- Use timeouts in plugin script communication.
- Fix ExternalProgram to correctly remember exit status.
- version 8.6.0 (5)
10 Oktober 2010 (ma@suse.de):
- Update zypp-po.tar.bz2
08 Oktober 2010 (dmacvicar@novell.com):
- fix services not being linked to their file after being
saved
07 Oktober 2010 (jkupec@suse.cz):
- Don't use aria2c for FTP (bnc #641328)
06 Oktober 2010 (dmacvicar@novell.com):
- implementation for url resolver plugins
- version 8.5.0 (5)
06 Oktober 2010 (dheidler@suse.de):
- Use DownloadInHeaps as default, when there is nothing configured
and when the target root is set to "/". (bnc#591476)
- version 8.4.0 (4)
28 September 2010 (dheidler@suse.de):
- fixed replacing releasever (for fedora systems) - (bnc#637470)
- version 8.3.0 (0)
24 September 2010 (mls@suse.de):
- fix metalink4 parsing [bnc#641484]
23 September 2010 (ma@suse.de):
- Update zypp-po.tar.bz2
20 September 2010 (dmacvicar@novell.com):
- Allow per repository proxy settings like yum does.
Including setting it to _none_ overriding the
system proxy.
Patch from Zhang, Qiang <qiang.z.zhang@intel.com>
- version 8.2.1 (0)
10 September 2010 (dheidler@suse.de):
- fixed replacing basearch (for fedora systems) - (bnc#637473)
- version 8.2.0 (0)
10 September 2010 (ma@suse.de):
- Report download failures in commit result (bnc#431854)
- Fix Solvable::onSystemByUser returning true for uninstalled solvables.
- version 8.1.3 (0)
31 August 2010 (ma@suse.de):
- Fix download-only not to omit source packages (bnc#635596)
- version 8.1.2 (0)
26 August 2010 (ma@suse.de):
- Update zypp-po.tar.bz2
13 August 2010 (dmacvicar@novell.com):
- fix basearch url variable
- use the right release package name on fedora
10 August 2010 (ma@suse.de):
- MediaDISK: Use blkid to verify disk volumes. (bnc#623226)
- version 8.1.1 (0)
08 August 2010 (ma@suse.de):
- Update zypp-po.tar.bz2
05 August 2010 (ma@suse.de):
- Update zypp-po.tar.bz2
03 August 2010 (ma@suse.de):
- Fix memory leaks.
02 August 2010 (ma@suse.de):
- Enhance PoolItem interface to assist patch classification. (bnc#627316)
- version 8.1.0 (0)
27 Juli 2010 (ma@suse.de):
- Fix bug in PoolQuery::addDependency
- Disable MediaAria and enable MultiCurl as default http/ftp backend.
MultiCurl implements MetaLink and Zsync support using libcurl. In
case of trouble set ZYPP_MULTICURL=0 in the envirionment to disable
the new backend.
- version 8.0.1 (0)
26 Juli 2010 (ma@suse.de):
- Bump heads major version after 11.3 branched away.
- version 8.0.0 (0)
22 Juli 2010 (ma@suse.de):
- Update zypp-po.tar.bz2
...]
But if someone would like to teach me the ‘right’ status of the download optimization in openSUSE during updating - I would love to lean more about that…
Regards
pistazienfresser
On 2010-11-14 01:06, pistazienfresser wrote:
>
> I guess the change that Eliasse Diaite had been referring to/meaning may
> have come with
> “libzypp - Package, Patch, Pattern, and Product Management”.
>
> The first part of the changelog of
> libzypp 8.7.0-1.1 in openSUSE 11.4 Milestone 3
> is following:
Yes, in 11.4 they are testing a new downloader. Not aria2c. I haven’t read
why yet.
> But if someone would like to teach me the ‘right’ status of the
> download optimization in openSUSE during updating - I would love to lean
> more about that…
You can get a glimpse by tracking Peter Pöml messages in the mail list
He is the chap that made or cares for Mirror Brain, and replies in the mail
list when somebody has a problem related to that; thus he sees when aria2c
is not behaving as expected.
–
Cheers / Saludos,
Carlos E. R.
(from 11.2 x86_64 “Emerald” at Telcontar)