FTP network speed using 11.4 falls down to 15 MiB/s afer 30 seconds at 90 MiB/s

Hello all, this is my first post here.

Sorry for my English, but my native language is Spanish.:wink:

THE FACTS

I’m facing an odd problem with a fresh install of OpenSuse 11.4 on a Dell PE-2950, using NIC Broadcom BCM5708C (rev 12) NetXtream II. Driver’s are up to date.

I’d installed vsftpd and configure it.

I can connect from anywhere in the network where I setup this Server.

The odd problem is that when I’m sending a big file (5.5 GiB for example), from another PE-2950 server (Windows Server 2003 64 bits R2) with another BCM5708C nic, the speed of the transfer starts at 90 MiB/s approx. but after 30 seconds , it drops to 15 MiB/s and never raise again. Driver’s are up to date too.

However, from another Server in the network, a Dell R710 with SLES 10 SP3, the transfer speed is at 90-100-110 MiB/s all the time.

The switch is a HP Procurve 2910al-24G, with all ports at gigabit speed.

I’d tried with different FTP clients in Windows: WinSCP and the Windows’s ftp client, but the result is the same: speed falls down after 30 seconds approx. using the Windows-Box.

Any help will be appreciated.

Thanks in advance.

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Wildly guessing I’d consider blaming caching for the good performance.
How quickly can you write a 5 GiB file if written locally? For example:

time dd if=/dev/zero of=/tmp/bigfile.tmp bs=1048576 count=5500

Good luck.

On 06/08/2011 10:06 AM, angel c wrote:
>
> Hello all, this is my first post here.
>
> Sorry for my English, but my native language is Spanish.:wink:
>
> THE_FACTS
>
> I’m facing an odd problem with a fresh install of OpenSuse 11.4 on a
> Dell PE-2950, using NIC Broadcom BCM5708C (rev 12) NetXtream II.
> Driver’s are up to date.
>
> I’d installed vsftpd and configure it.
>
> I can connect from anywhere in the network where I setup this Server.
>
> The odd problem is that when I’m sending a big file (5.5 GiB for
> example), from another PE-2950 server (Windows Server 2003 64 bits R2)
> with another BCM5708C nic, the speed of the transfer starts at 90 MiB/s
> approx. but after 30 seconds , it drops to 15 MiB/s and never raise
> again. Driver’s are up to date too.
>
> However, from another Server in the network, a Dell R710 with SLES 10
> SP3, the transfer speed is at 90-100-110 MiB/s all the time.
>
> The switch is a HP Procurve 2910al-24G, with all ports at gigabit
> speed.
>
> I’d tried with different FTP clients in Windows: WinSCP and the
> Windows’s ftp client, but the result is the same: speed falls down after
> 30 seconds approx. using the Windows-Box.
>
> Any help will be appreciated.
>
> Thanks in advance.
>
>
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.15 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQIcBAEBAgAGBQJN76lkAAoJEF+XTK08PnB5gsQP/jh29b0rpQd9f3NcxgMSUs5Z
GSTFLWRgjsKrN35hmmq2/pARGhd1bdR+dmtlMKP/ibWFsXwyJjzgqxvstCWB6XUw
z4g2VameYd08HXY7sI6Cu9kfT6wzV4LObpCBsf5w2I+pzmUIcj11qXVxo/Q/XD8r
UX4cbxmA8JQN3qWlg3sOVUn1yYDlxza2Bv+A2/VwdruFPBCuE+3t3Of/UZux/26N
t0YIuoTxRrOCKwWF/2M7YTb0wSjcLYj2NTDCCcmhgkBZa/dhw6bq/hJ/w96ni815
2l8/qsM5N09iPwwZBcptADFyVPIFrRCUteXifuGsE4AS5HvtTErA/i9Sb6LoF5T4
4C39/POhHdWYKoB/mt+SfcE32Z+uO1pYTBAFJks1zewRuUDLRpbQfzgS+csAwLsy
xxCHaLhCsERF6qV86WNyg/2yAU349hvtIH3ySWy6lE+n7SVQK8Ut/so50wGP8292
AcncsiLbbwKxKPkMYNIR9EofQjfem+2/jbMVBEwlno/qOnQKqsIy1R8SxAClrAtm
70aHx4o61DkZcc0Tz7nnbq48e+U7d37r09n6+RssbH7ym4p4KRg8vl5j8oJ3n7dm
JWt+24SqEWMZBVuyhOWf4Mn222UMZoQMrqV4Oq/HPrELja4wvrqIllDlnGnqsy3D
2nu2hWX/iVyjC5FrSuyb
=VeBH
-----END PGP SIGNATURE-----

Hello ab, thanks for the help.

Here’s the output of dd command:

time dd if=/dev/zero of=/disk001/mybigfile bs=1048576 count=5500
5500+0 registros leídos
5500+0 registros escritos
5767168000 bytes (5,8 GB) copiados, 15,8768 s, 363 MB/s

real 0m15.899s
user 0m0.003s
sys 0m6.153s

I guess it could be a OS related problem. FTP-ing a file from SLES 10 SP3 to OpenSUSE 11.4 (vsftpd), gets a very good rate speed (from 90 to 110 MiB/S) , while sending the same file from Windows 2003 Server R2 64 bits to the same server (OpenSUSE 11.4) starts at 90 MiB/s and after 30-40 seconds , the speed falls down to 15 MiB/S.

Please, someone could bring a ray of life , any clue will be appreciated.

Thanks in advance.

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

I should have mentioned adding a ‘sync’ in there to really flush the cache
but oh well… that’s pretty fast and big enough it was hopefully not
overly affected by caching. It appears, based on that number, that your
disks are quick which is nice.

Your other test with SLES/OpenSUSE copying looks to have ruled out
performance on this machine. Perhaps your windows box is incapable of
reading the file fast enough to keep the connection full for one reason or
another (disk read speed, NIC transfer throughput, etc.). Can you test
your windows box sending to another system to see if it can keep speed up
going somewhere else? Tried other protocols besides FTP?

Good luck.

On 06/09/2011 01:36 AM, angel c wrote:
>
> Hello ab, thanks for the help.
>
> Here’s the output of dd command:
>
> time dd if=/dev/zero of=/disk001/mybigfile bs=1048576 count=5500
> 5500+0 registros leídos
> 5500+0 registros escritos
> 5767168000 bytes (5,8 GB) copiados, 15,8768 s, 363 MB/s
>
> real 0m15.899s
> user 0m0.003s
> sys 0m6.153s
>
>
> I guess it could be a OS related problem. FTP-ing a file from SLES 10
> SP3 to OpenSUSE 11.4 (vsftpd), gets a very good rate speed (from 90 to
> 110 MiB/S) , while sending the same file from Windows 2003 Server R2 64
> bits to the same server (OpenSUSE 11.4) starts at 90 MiB/s and after
> 30-40 seconds , the speed falls down to 15 MiB/S.
>
> Please, someone could bring a ray of life , any clue will be
> appreciated.
>
> Thanks in advance.
>
>
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.15 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQIcBAEBAgAGBQJN8MqZAAoJEF+XTK08PnB5EXkP/jDu34QdcMRRU6bnf0WMlR7O
VZb/jVjWOeyuyWkmB8zDULjkxYjhmyag6UKs6n2Xx9rwBsr6dmIihJ4DhPSEOH2C
D/566UTfWDJdPmcxHd7I2rKX03JdrEZm1aYk7VriOFwp62M41iGkSMzJg/ZyeVgR
z86xeAuo8M9B6RYqnOvPb1ZSRM2LqEo+8vSXkJ7ZGnI3snLb/NShR+0nK+5vHFDI
SKKa+dHgF49MiKDZzuJGWqwGZxF4ePoXKEd7yRbJMrEFfrzOM7nRZdLKqCsGX5IC
wS/3Hpmgo34QFA4rR1tGfD+JETgHCxKX2bFpYZ2EoBjmkRtvOSwi5tKnKs+fJZ/N
xB58RlbKEPXFaE6UlcJ+3ErOagxOP98xnwJ+h5e5aza/1b3G+dcYS9m8RxcSTujQ
UtyrykBdcsbT/GCNZRE5LuffYb40TtbWdUg7aZ4qG3FWHmWUtYdinE/hGLwQF15t
i6ed/Q+JY779At8Q9aKMNgwqxp/dTl9mxj4/4TGcGuCpUN/j+WZ7oU/Bn5ytZ3p2
7g6Qem90xf22qAAmj92Q8yDcWBV1BgO+8VG98JMSAKTOTP5XoTxOe4rMQUZNObQI
lvMxNYloF6+zmvFBWAHizAgrsGcAHVIGPRs35ns16R9FBuwH6Clp71oWAhtbec4a
1xyuvbSkgo/6GXlCJys7
=5y7r
-----END PGP SIGNATURE-----