Bandwidth testing: Difference between revisions
From genomewiki
Jump to navigationJump to search
(initial contents) |
(adding copy to hive and rsync) |
||
| Line 1: | Line 1: | ||
==Machines tested== | ==Machines tested== | ||
<TABLE BORDER=1><TR><TH>machine<BR>name</TH><TH>processor<BR>speed</TH><TH>memSize</TH><TH>10 files<BR>of size</TH><TH>dd /dev/zero<BR>to /dev/shm</TH><TH>cp /dev/shm<BR>to /tmp</TH></TR> | <TABLE BORDER=1><TR><TH>machine<BR>name</TH><TH>processor<BR>speed</TH><TH>memSize</TH><TH>10 files<BR>of size</TH><TH>dd /dev/zero<BR>to /dev/shm</TH><TH>cp /dev/shm<BR>to /tmp</TH><TH>cp /dev/shm<BR>to hive</TH><TH>rsync /dev/shm<BR>to /dev/shm</TH></TR> | ||
<TR><TH ALIGN=LEFT>hgwdev</TH><TD>Opteron<BR>1150 Mhz</TD><TD>32 Gb</TD><TD>1 gB</TD><TD>800 mB/s</TD><TD>287 mB/s</TD></TR> | <TR><TH ALIGN=LEFT>hgwdev</TH><TD>Opteron<BR>1150 Mhz</TD><TD>32 Gb</TD><TD>1 gB</TD><TD>800 mB/s</TD><TD>287 mB/s</TD><TD>54 mB/s</TD><TD>144 mB/s</TD></TR> | ||
<TR><TH ALIGN=LEFT>kolossus</TH><TD>Intel<BR>2261 Mhz</TD><TD>1 Tb</TD><TD>1 gB</TD><TD>1980 mB/s</TD><TD>192 mB/s</TD></TR> | <TR><TH ALIGN=LEFT>kolossus</TH><TD>Intel<BR>2261 Mhz</TD><TD>1 Tb</TD><TD>1 gB</TD><TD>1980 mB/s</TD><TD>192 mB/s</TD><TD>41 mB/s</TD><TD>120 mB/s<BR>4X rsync</TD></TR> | ||
<TR><TH ALIGN=LEFT>okazaki</TH><TD>Intel<BR>1600 Mhz</TD><TD>2 Gb</TD><TD>76 mB</TD><TD>700 mB/s</TD><TD>90 mB/s</TD></TR> | <TR><TH ALIGN=LEFT>okazaki</TH><TD>Intel<BR>1600 Mhz</TD><TD>2 Gb</TD><TD>76 mB</TD><TD>700 mB/s</TD><TD>90 mB/s</TD><TD>11.3 mB/s</TD><TD>11.5 mB/s</TD></TR> | ||
<TR><TH ALIGN=LEFT>mitzie</TH><TD>Intel<BR>400 Mhz</TD><TD>512 Kb</TD><TD>18 mB</TD><TD>113 mB/s</TD><TD>25 mB/s</TD></TR> | <TR><TH ALIGN=LEFT>mitzie</TH><TD>Intel<BR>400 Mhz</TD><TD>512 Kb</TD><TD>18 mB</TD><TD>113 mB/s</TD><TD>25 mB/s</TD><TD>n/a</TD><TD> 37 kB/s up<BR>down</TD></TR> | ||
</TABLE> | </TABLE> | ||
Revision as of 23:42, 12 May 2010
Machines tested
| machine name | processor speed | memSize | 10 files of size | dd /dev/zero to /dev/shm | cp /dev/shm to /tmp | cp /dev/shm to hive | rsync /dev/shm to /dev/shm |
|---|---|---|---|---|---|---|---|
| hgwdev | Opteron 1150 Mhz | 32 Gb | 1 gB | 800 mB/s | 287 mB/s | 54 mB/s | 144 mB/s |
| kolossus | Intel 2261 Mhz | 1 Tb | 1 gB | 1980 mB/s | 192 mB/s | 41 mB/s | 120 mB/s 4X rsync |
| okazaki | Intel 1600 Mhz | 2 Gb | 76 mB | 700 mB/s | 90 mB/s | 11.3 mB/s | 11.5 mB/s |
| mitzie | Intel 400 Mhz | 512 Kb | 18 mB | 113 mB/s | 25 mB/s | n/a | 37 kB/s up down |
Procedure
Sizing files based on available /dev/shm space. Largest file size limited to 1 gB.
The /dev/zero to /dev/shm write is done ten times with a dd command:
dd if=/dev/zero of=/dev/shm/memToMem.$I.zero bs=200000 count=$ddCount
The /dev/shm copy to /tmp is done ten times with the cp command:
cp -p /dev/shm/memToMem.$I.zero ./memToFile.$I.zero
