Rsync transfer rates: Difference between revisions

From genomewiki
Jump to navigationJump to search
(initial contents)
 
(fixup list)
Line 2: Line 2:
measuring actual disk space consumed on the destination filesystem per minute:
measuring actual disk space consumed on the destination filesystem per minute:


<PRE>
1. pull from hgwdev to hgdownload: 39 Mb/sec = 2360 Mb/min = 141,600 Mb/hour = 3,398,400 Mb/day (single rsync)
1. pull from hgwdev to hgdownload: 39 Mb/sec = 2360 Mb/min = 141,600 Mb/hour = 3,398,400 Mb/day (single rsync)
2.  pull from hgdownload to cloud: 18 Mb/sec = 1080 Mb/min =  64,800 Mb/hour = 1,555,200 Mb/day (single rsync)
2.  pull from hgdownload to cloud: 18 Mb/sec = 1080 Mb/min =  64,800 Mb/hour = 1,555,200 Mb/day (single rsync)
Line 8: Line 9:
5.  internal cloud to cloud copy: 35 Mb/sec = 2150 Mb/min = 129,000 Mb/hour = 3,096,000 Mb/day (volume to volume)
5.  internal cloud to cloud copy: 35 Mb/sec = 2150 Mb/min = 129,000 Mb/hour = 3,096,000 Mb/day (volume to volume)
6.  second example cloud to cloud: 12 Mb/sec =  770 Mb/min =  46,200 Mb/hour = 1,108,800 Mb/day (volume to volume)
6.  second example cloud to cloud: 12 Mb/sec =  770 Mb/min =  46,200 Mb/hour = 1,108,800 Mb/day (volume to volume)
</PRE>

Revision as of 16:37, 22 April 2009

Testing rsync transfer rates, using the rsync command: 'rsync -azP --stats', measuring actual disk space consumed on the destination filesystem per minute:

1. pull from hgwdev to hgdownload: 39 Mb/sec = 2360 Mb/min = 141,600 Mb/hour = 3,398,400 Mb/day (single rsync)
2.  pull from hgdownload to cloud: 18 Mb/sec = 1080 Mb/min =  64,800 Mb/hour = 1,555,200 Mb/day (single rsync)
3.  pull from hgdownload to cloud: 37 Mb/sec = 2230 Mb/min = 133,800 Mb/hour = 3,211,200 Mb/day (two rsync)
4. pull from hgwdev to cloud:     768 Kb/sec =   45 Mb/min =   2,700 Mb/hour =    64,800 Mb/day (via ssh, not rsh)
5.   internal cloud to cloud copy: 35 Mb/sec = 2150 Mb/min = 129,000 Mb/hour = 3,096,000 Mb/day (volume to volume)
6.  second example cloud to cloud: 12 Mb/sec =  770 Mb/min =  46,200 Mb/hour = 1,108,800 Mb/day (volume to volume)