Bandwidth testing: Difference between revisions

From genomewiki
Jump to navigationJump to search
m (mitzie upload speed)
Line 17: Line 17:
<TR><TH ALIGN=LEFT>kolossus</TH><TD>Intel<BR>2261 Mhz</TD><TD>1 Tb</TD><TD>1 gB</TD><TD>6700 mB/s<BR>10X dd</TD><TD>192 mB/s</TD><TD>41 mB/s</TD><TD>120 mB/s<BR>4X rsync</TD><TD>115 mB/s</TD><TD>1135 mB/s</TD></TR>
<TR><TH ALIGN=LEFT>kolossus</TH><TD>Intel<BR>2261 Mhz</TD><TD>1 Tb</TD><TD>1 gB</TD><TD>6700 mB/s<BR>10X dd</TD><TD>192 mB/s</TD><TD>41 mB/s</TD><TD>120 mB/s<BR>4X rsync</TD><TD>115 mB/s</TD><TD>1135 mB/s</TD></TR>
<TR><TH ALIGN=LEFT>okazaki</TH><TD>Intel<BR>1600 Mhz</TD><TD>2 Gb</TD><TD>75 mB</TD><TD>700 mB/s</TD><TD>90 mB/s</TD><TD>11.3 mB/s</TD><TD>11.5 mB/s</TD><TD>11.6 mB/s</TD><TD>10.7 mB/s<BR>4X send</TD></TR>
<TR><TH ALIGN=LEFT>okazaki</TH><TD>Intel<BR>1600 Mhz</TD><TD>2 Gb</TD><TD>75 mB</TD><TD>700 mB/s</TD><TD>90 mB/s</TD><TD>11.3 mB/s</TD><TD>11.5 mB/s</TD><TD>11.6 mB/s</TD><TD>10.7 mB/s<BR>4X send</TD></TR>
<TR><TH ALIGN=LEFT>mitzie</TH><TD>Intel<BR>400 Mhz</TD><TD>512 Kb</TD><TD>18 mB</TD><TD>113 mB/s</TD><TD>25 mB/s</TD><TD>n/a</TD><TD> 37 kB/s up<BR>down</TD><TD>n/a</TD></TR>
<TR><TH ALIGN=LEFT>mitzie</TH><TD>Intel<BR>400 Mhz</TD><TD>512 Kb</TD><TD>18 mB</TD><TD>113 mB/s</TD><TD>25 mB/s</TD><TD>n/a</TD><TD>54.4 kB/s up<BR>down</TD><TD>n/a</TD></TR>
<TR><TH ALIGN=LEFT>cloud0</TH><TD>Opteron<BR>2000 Mhz</TD><TD>7.5 Gb</TD><TD>288 mB</TD><TD>940 mB/s<BR>4X dd</TD><TD>78 mB/s</TD><TD>n/a</TD><TD>16 mB/s<BR>2X rsync</TD><TD>43 mB/s<BR>3X rsync</TD><TD>46 mB/s<BR>3X send</TD></TR>
<TR><TH ALIGN=LEFT>cloud0</TH><TD>Opteron<BR>2000 Mhz</TD><TD>7.5 Gb</TD><TD>288 mB</TD><TD>940 mB/s<BR>4X dd</TD><TD>78 mB/s</TD><TD>n/a</TD><TD>16 mB/s<BR>2X rsync</TD><TD>43 mB/s<BR>3X rsync</TD><TD>46 mB/s<BR>3X send</TD></TR>
</TABLE>
</TABLE>

Revision as of 01:40, 14 May 2010

Units

For these measurements:

  • 1 kB/s = 1,000 bytes per second
  • 1 mB/s = 1,000,000 bytes per second
  • 1 gB/s = 1,000,000,000 bytes per second

Memory:

  • 1 Gb == 1024^3 bytes = 1,073,741,824 bytes

Machines tested

machine
name
processor
speed
memSize10 files
of size
dd /dev/zero
to /dev/shm
cp /dev/shm
to /tmp
cp /dev/shm
to hive
rsync /dev/shm
to /dev/shm
rsync /dev/shm
via rsh
UDT via
UPD
hgwdevOpteron
1150 Mhz
32 Gb1 gB5278 mB/s
10X dd
287 mB/s54 mB/s1638 mB/s
20X rsync
n/a4070 mB/s
10X send
kolossusIntel
2261 Mhz
1 Tb1 gB6700 mB/s
10X dd
192 mB/s41 mB/s120 mB/s
4X rsync
115 mB/s1135 mB/s
okazakiIntel
1600 Mhz
2 Gb75 mB700 mB/s90 mB/s11.3 mB/s11.5 mB/s11.6 mB/s10.7 mB/s
4X send
mitzieIntel
400 Mhz
512 Kb18 mB113 mB/s25 mB/sn/a54.4 kB/s up
down
n/a
cloud0Opteron
2000 Mhz
7.5 Gb288 mB940 mB/s
4X dd
78 mB/sn/a16 mB/s
2X rsync
43 mB/s
3X rsync
46 mB/s
3X send

Procedure

Sizing files based on available /dev/shm space. Largest file size limited to 1 gB.

The /dev/zero to /dev/shm write is done ten times with a dd command:

 dd if=/dev/zero of=/dev/shm/memToMem.$I.zero bs=200000 count=$ddCount

The /dev/shm copy to /tmp is done ten times with the cp command:

cp -p /dev/shm/memToMem.$I.zero ./memToFile.$I.zero

These 10X copies were repeated three times. The slowest measurement of the three times was recorded.

The rsync /dev/shm to /dev/shm was to and from hgwdev. Multiple instances of rsync from kolossus to hgwdev seemed to add together for a total bandwidth higher than a single instance of rsync.

The machine mitzie is at the end of a Santa Cruz DSL line and over a WiFi network connection across the driveway to the garage.