Bandwidth testing: Difference between revisions

From genomewiki
Jump to navigationJump to search
m (fixup memory units)
m (shm to file copy)
Line 16: Line 16:


<TABLE BORDER=1><TR><TH>machine<BR>name</TH><TH>processor<BR>speed</TH><TH>memSize</TH><TH>10 files<BR>of size</TH><TH>dd /dev/zero<BR>to /dev/shm</TH><TH>cp /dev/shm<BR>to /tmp</TH><TH>cp /dev/shm<BR>to hive</TH><TH>rsync /dev/shm<BR>to /dev/shm</TH><TH>rsync /dev/shm<BR>via rsh</TH><TH>UDT via<BR>UPD</TH></TR>
<TABLE BORDER=1><TR><TH>machine<BR>name</TH><TH>processor<BR>speed</TH><TH>memSize</TH><TH>10 files<BR>of size</TH><TH>dd /dev/zero<BR>to /dev/shm</TH><TH>cp /dev/shm<BR>to /tmp</TH><TH>cp /dev/shm<BR>to hive</TH><TH>rsync /dev/shm<BR>to /dev/shm</TH><TH>rsync /dev/shm<BR>via rsh</TH><TH>UDT via<BR>UPD</TH></TR>
<TR><TH ALIGN=LEFT>hgwdev</TH><TD>Opteron<BR>1150 Mhz</TD><TD>32 Gb</TD><TD>1 gB</TD><TD>5278 mB/s<BR>10X dd</TD><TD>287 mB/s</TD><TD>54 mB/s</TD><TD>1638 mB/s<BR>20X rsync</TD><TD>n/a</TD><TD>4070 mB/s<BR>10X send</TD></TR>
<TR><TH ALIGN=LEFT>hgwdev</TH><TD>Opteron<BR>1150 Mhz</TD><TD>32 Gb</TD><TD>1 gB</TD><TD>5278 mB/s<BR>10X dd</TD><TD>287 mB/s</TD><TD>58 mB/s</TD><TD>1638 mB/s<BR>20X rsync</TD><TD>n/a</TD><TD>4070 mB/s<BR>10X send</TD></TR>
<TR><TH ALIGN=LEFT>kolossus</TH><TD>Intel<BR>2261 Mhz</TD><TD>1 Tb</TD><TD>1 gB</TD><TD>6700 mB/s<BR>10X dd</TD><TD>192 mB/s</TD><TD>41 mB/s</TD><TD>120 mB/s<BR>4X rsync</TD><TD>115 mB/s</TD><TD>1135 mB/s</TD></TR>
<TR><TH ALIGN=LEFT>kolossus</TH><TD>Intel<BR>2261 Mhz</TD><TD>1 Tb</TD><TD>1 gB</TD><TD>6700 mB/s<BR>10X dd</TD><TD>192 mB/s</TD><TD>58 mB/s</TD><TD>120 mB/s<BR>4X rsync</TD><TD>115 mB/s</TD><TD>1135 mB/s</TD></TR>
<TR><TH ALIGN=LEFT>okazaki</TH><TD>Intel<BR>1600 Mhz</TD><TD>2 Gb</TD><TD>75 mB</TD><TD>700 mB/s</TD><TD>90 mB/s</TD><TD>11.3 mB/s</TD><TD>11.5 mB/s</TD><TD>11.6 mB/s</TD><TD>10.7 mB/s<BR>4X send</TD></TR>
<TR><TH ALIGN=LEFT>okazaki</TH><TD>Intel<BR>1600 Mhz</TD><TD>2 Gb</TD><TD>75 mB</TD><TD>700 mB/s</TD><TD>90 mB/s</TD><TD>11.3 mB/s</TD><TD>11.5 mB/s</TD><TD>11.6 mB/s</TD><TD>10.7 mB/s<BR>4X send</TD></TR>
<TR><TH ALIGN=LEFT>mitzie</TH><TD>Intel<BR>400 Mhz</TD><TD>512 Kb</TD><TD>18 mB</TD><TD>113 mB/s</TD><TD>25 mB/s</TD><TD>n/a</TD><TD>54.4 kB/s up<BR>316 kB/s down</TD><TD>n/a</TD></TR>
<TR><TH ALIGN=LEFT>mitzie</TH><TD>Intel<BR>400 Mhz</TD><TD>512 Kb</TD><TD>18 mB</TD><TD>113 mB/s</TD><TD>25 mB/s</TD><TD>n/a</TD><TD>54.4 kB/s up<BR>316 kB/s down</TD><TD>n/a</TD></TR>

Revision as of 18:21, 14 May 2010

Units

For these measurements:

  • 1 kB/s = 1,000 bytes per second
  • 1 mB/s = 1,000,000 bytes per second
  • 1 gB/s = 1,000,000,000 bytes per second

Memory:

  • 1 Kb = 1024^2 bytes = 1,048,576 bytes
  • 1 Gb = 1024^3 bytes = 1,073,741,824 bytes
  • 1 Tb = 1024^4 bytes = 1,099,511,627,776 bytes

Machines tested

machine
name
processor
speed
memSize10 files
of size
dd /dev/zero
to /dev/shm
cp /dev/shm
to /tmp
cp /dev/shm
to hive
rsync /dev/shm
to /dev/shm
rsync /dev/shm
via rsh
UDT via
UPD
hgwdevOpteron
1150 Mhz
32 Gb1 gB5278 mB/s
10X dd
287 mB/s58 mB/s1638 mB/s
20X rsync
n/a4070 mB/s
10X send
kolossusIntel
2261 Mhz
1 Tb1 gB6700 mB/s
10X dd
192 mB/s58 mB/s120 mB/s
4X rsync
115 mB/s1135 mB/s
okazakiIntel
1600 Mhz
2 Gb75 mB700 mB/s90 mB/s11.3 mB/s11.5 mB/s11.6 mB/s10.7 mB/s
4X send
mitzieIntel
400 Mhz
512 Kb18 mB113 mB/s25 mB/sn/a54.4 kB/s up
316 kB/s down
n/a
cloud0Opteron
2000 Mhz
7.5 Gb288 mB940 mB/s
4X dd
78 mB/sn/a16 mB/s
2X rsync
43 mB/s
3X rsync
46 mB/s
3X send

Procedure

Sizing files based on available /dev/shm space. Largest file size limited to 1 gB.

The /dev/zero to /dev/shm write is done ten times with a dd command:

 dd if=/dev/zero of=/dev/shm/memToMem.$I.zero bs=200000 count=$ddCount

The /dev/shm copy to /tmp is done ten times with the cp command:

cp -p /dev/shm/memToMem.$I.zero ./memToFile.$I.zero

These 10X copies were repeated three times. The slowest measurement of the three times was recorded.

The rsync /dev/shm to /dev/shm was to and from hgwdev. Multiple instances of rsync from kolossus to hgwdev seemed to add together for a total bandwidth higher than a single instance of rsync.

The machine mitzie is at the end of a Santa Cruz DSL line and over a WiFi network connection across the driveway to the garage.