Bandwidth testing: Difference between revisions
From genomewiki
Jump to navigationJump to search
(adding UDT UDP) |
m (more udp results) |
||
| Line 12: | Line 12: | ||
<TR><TH ALIGN=LEFT>hgwdev</TH><TD>Opteron<BR>1150 Mhz</TD><TD>32 Gb</TD><TD>1 gB</TD><TD>800 mB/s</TD><TD>287 mB/s</TD><TD>54 mB/s</TD><TD>1638 mB/s<BR>20X rsync</TD><TD>n/a</TD><TD>4070 MB/s<BR>10X send</TD></TR> | <TR><TH ALIGN=LEFT>hgwdev</TH><TD>Opteron<BR>1150 Mhz</TD><TD>32 Gb</TD><TD>1 gB</TD><TD>800 mB/s</TD><TD>287 mB/s</TD><TD>54 mB/s</TD><TD>1638 mB/s<BR>20X rsync</TD><TD>n/a</TD><TD>4070 MB/s<BR>10X send</TD></TR> | ||
<TR><TH ALIGN=LEFT>kolossus</TH><TD>Intel<BR>2261 Mhz</TD><TD>1 Tb</TD><TD>1 gB</TD><TD>1980 mB/s</TD><TD>192 mB/s</TD><TD>41 mB/s</TD><TD>120 mB/s<BR>4X rsync</TD><TD>115 mB/s</TD><TD>1135 mB/s</TD></TR> | <TR><TH ALIGN=LEFT>kolossus</TH><TD>Intel<BR>2261 Mhz</TD><TD>1 Tb</TD><TD>1 gB</TD><TD>1980 mB/s</TD><TD>192 mB/s</TD><TD>41 mB/s</TD><TD>120 mB/s<BR>4X rsync</TD><TD>115 mB/s</TD><TD>1135 mB/s</TD></TR> | ||
<TR><TH ALIGN=LEFT>okazaki</TH><TD>Intel<BR>1600 Mhz</TD><TD>2 Gb</TD><TD>75 mB</TD><TD>700 mB/s</TD><TD>90 mB/s</TD><TD>11.3 mB/s</TD><TD>11.5 mB/s</TD><TD>11.6 mB/s</TD></TR> | <TR><TH ALIGN=LEFT>okazaki</TH><TD>Intel<BR>1600 Mhz</TD><TD>2 Gb</TD><TD>75 mB</TD><TD>700 mB/s</TD><TD>90 mB/s</TD><TD>11.3 mB/s</TD><TD>11.5 mB/s</TD><TD>11.6 mB/s</TD><TD>10.7 mB/s<BR>4X send</TD></TR> | ||
<TR><TH ALIGN=LEFT>mitzie</TH><TD>Intel<BR>400 Mhz</TD><TD>512 Kb</TD><TD>18 mB</TD><TD>113 mB/s</TD><TD>25 mB/s</TD><TD>n/a</TD><TD> 37 kB/s up<BR>down</TD><TD>n/a</TD></TR> | <TR><TH ALIGN=LEFT>mitzie</TH><TD>Intel<BR>400 Mhz</TD><TD>512 Kb</TD><TD>18 mB</TD><TD>113 mB/s</TD><TD>25 mB/s</TD><TD>n/a</TD><TD> 37 kB/s up<BR>down</TD><TD>n/a</TD></TR> | ||
</TABLE> | </TABLE> | ||
Revision as of 21:57, 13 May 2010
Units
For these measurements:
- 1 kB/s = 1,000 bytes per second
- 1 mB/s = 1,000,000 bytes per second
- 1 gB/s = 1,000,000,000 bytes per second
Machines tested
| machine name | processor speed | memSize | 10 files of size | dd /dev/zero to /dev/shm | cp /dev/shm to /tmp | cp /dev/shm to hive | rsync /dev/shm to /dev/shm | rsync /dev/shm via rsh | UDT via UPD |
|---|---|---|---|---|---|---|---|---|---|
| hgwdev | Opteron 1150 Mhz | 32 Gb | 1 gB | 800 mB/s | 287 mB/s | 54 mB/s | 1638 mB/s 20X rsync | n/a | 4070 MB/s 10X send |
| kolossus | Intel 2261 Mhz | 1 Tb | 1 gB | 1980 mB/s | 192 mB/s | 41 mB/s | 120 mB/s 4X rsync | 115 mB/s | 1135 mB/s |
| okazaki | Intel 1600 Mhz | 2 Gb | 75 mB | 700 mB/s | 90 mB/s | 11.3 mB/s | 11.5 mB/s | 11.6 mB/s | 10.7 mB/s 4X send |
| mitzie | Intel 400 Mhz | 512 Kb | 18 mB | 113 mB/s | 25 mB/s | n/a | 37 kB/s up down | n/a |
Procedure
Sizing files based on available /dev/shm space. Largest file size limited to 1 gB.
The /dev/zero to /dev/shm write is done ten times with a dd command:
dd if=/dev/zero of=/dev/shm/memToMem.$I.zero bs=200000 count=$ddCount
The /dev/shm copy to /tmp is done ten times with the cp command:
cp -p /dev/shm/memToMem.$I.zero ./memToFile.$I.zero
These 10X copies were repeated three times. The slowest measurement of the three times was recorded.
The rsync /dev/shm to /dev/shm was to and from hgwdev. Multiple instances of rsync from kolossus to hgwdev seemed to add together for a total bandwidth higher than a single instance of rsync.
The machine mitzie is at the end of a Santa Cruz DSL line and over a WiFi network connection across the driveway to the garage.
