Posts Tagged ‘rsync’
Top 12 referrers over the past 3 months
Here are the Top 12 referrers to our blog over the past 3 months, the numbers of referrals are in parentheses.
- http://pro-linux.de/berichte/ext4/ext4.html (546)
- http://dabcc.com/article.aspx?id=9653 (342)
- http://networksecuritytoolkit.org/nst/index.html (110)
- http://polishlinux.org/apps/cli/ext4-defragmentation-with-e4defrag/ (59)
- http://communities.vmware.com/thread/189804?tstart=0 (49)
- http://techblog.41concepts.com/2008/03/31/shrink-your-windows-disk-image-on-wmware-fusion-mac/ (42)
- http://blog.rightscale.com/2009/01/09/amazon-launches-ec2-console/ (37)
- http://wordpress.com/tag/vhd/ (33)
- http://wordpress.com/tag/vmdk/ (32)
- http://virtualgeek.typepad.com/virtual_geek/2009/01/updated-homebrew-esx-hardware-list.html (32)
- http://blogs.msdn.com/heaths/archive/2005/07/30/445621.aspx (32)
- http://kakku.wordpress.com/2008/06/23/virtualbox-shrink-your-vdi-images-space-occupied-disk-size/ (31)
Thank you for the referrals. Hope the content is meaningful for our readers.
Top 10 Posts and Searches for Q4 2008
Top Ten Posts for Q4 2008
- Defragment Ubuntu, Fedora, ext3, ext4
- How to convert a VMWare VMDK to a Microsoft, Xen VHD
- VirtualBox – setup, share, shrink, convert
- How does shrink with vmware disk manager work?
- Virtual Machine Disk Image Compression
- Compressing Virtual Images
- rsync vm, vhd for backup, disaster recovery, ec2
- How to launch first AMI on Amazon EC2?
- Steve Herrod’s Top 10 Predictions for Virtulaization for 2009
- scp, VSS for Windows VHD backup, disaster recovery
Top Ten Search Terms for Q4 2008
- ubuntu ext4
- vhd on usb
- convert vmdk to vhd
- ext4 defrag
- amazon ec2 “virtual server” vhd
- ext3 defragmentation
- rsync vhd
- convert vdi to vhd
- shrink vmdk esxi
- compress vmdk
- compress virtual image
scp, VSS for Windows VHD backup, disaster recovery
How to replicate Hyper-V VHDs for DR?
The author is looking for a block-level transfer tool like rsync on Windows. A respondent has suggested using Volume Shadow Copy Services (VSS). However, VSS needs space for shadow copy data and this becomes an issue if you have large VM’s to transfer and are short of space.
scp is a secure transfer tool like rsync that is used for performing remote copies of files, including vhd mages across the LAN or the Internet.
Mircosoft recommends that customers can implement a backup or a disater recovery solution within their WAN using the File Replication Services (FRS2) of the Distributed File System (DFS) of Windows 2003 server R2, or later. This solution will perform well over the WAN, if WAN acceleration is in use. However, if WAN acceleration is not in use, then they should enable the Remote Differential Compression (RDC) protocol available in Windows 2003 Server R2, which Optimizes File Replication over Limited-Bandwidth Networks
Read about the use of rsync for vmdk, vhd backup and disaster recovery.
rsync vm, vhd for backup, disaster recovery, ec2
I use ftp to transfer large VM image of my code to a remote development team based in India and rsync for copying and backing up code, configuration and data from ec2. I researched the web for best practices that have evolved for speeding up large VM transfers. It seems there are none today, unless you are transferring VM’s on your company’s WAN and they are using WAN accleration to improve the transfer rate. However, I have found two models for using rsync with vmdk’s and vhd’s. Here’s a sample of use cases:
Cloud-centric usage
rsync is used for copying and backing up code, configuration and data from cloud-based services like Amazon ec2.
- Here is an excellent guide to Backup with rsync and ec2
- rsync, s3 and backups
- Migrate to aws/ec2
Traditional usage
rsync is used for backing up large VM’s to a remote store or for disaster recovery
Read about Backup, Disaster Recovery for Windows VM’s
Virtual Machine Disk Image Compression
Experience with running out of storage
Background about sparse files, Windows NTFS and VHD
- NTFS Compression, sparse files and operations on them
- UNIX sparse files
- Be Careful with VHDs and Windows XP Compressed Folders
- Why do VHD’s grow?
- What is a VHD file, what is a disk image?
VHD Pre-Compactor & Compactor
When you create a new VM you can pre-allocate all the storage in one shot or let the storage grow on demand. In the latter case, the VM uses a sparse file
- Compact your Microsoft Virtual PC 2004 VHD Files
- Compressing Microsoft Virtual Server 2005 VHD files
- Virtualization with Microsoft Virtual Server 2005 by Roger Dittner, David Rule, Jr., Ken Majors
- How to compress Microsoft Virtual PC 2007 hard disks
- Compressing Microsoft Virtual PC 2007 Images
- Compressing Microsoft Windows Server 2008 Hyper-V disk images
VMDK Wipe & Shrink
- Wipe & Shrink
- Enable compression on individual .vmdk files
- Issues
3rd Party (Not from MSFT & VMW)
- Raxco Software
- Parallels Compressor
- Desktop Version
- Server Version
Rsync: for transferring files between machines
Research
Compressing Virtual Images
Experience with running out of storage
Background about sparse files, Windows NTFS and VHD
- NTFS Compression, sparse files and operations on them
- UNIX sparse files
- Be Careful with VHDs and Windows XP Compressed Folders
- Why do VHD’s grow?
- What is a VHD file, what is a disk image?
VHD Pre-Compactor & Compactor
When you create a new VM you can pre-allocate all the storage in one shot or let the storage grow on demand. In the latter case, the VM uses a sparse file
- Compact your Microsoft Virtual PC 2004 VHD Files
- Compressing Microsoft Virtual Server 2005 VHD files
- Virtualization with Microsoft Virtual Server 2005 by Roger Dittner, David Rule, Jr., Ken Majors
- How to compress Microsoft Virtual PC 2007 hard disks
- Compressing Microsoft Virtual PC 2007 Images
- Compressing Microsoft Windows Server 2008 Hyper-V disk images
VMDK Wipe & Shrink
- Wipe & Shrink
- Enable compression on individual .vmdk files
- Issues
3rd Party (Not from MSFT & VMW)
- Raxco Software
- Parallels Compressor
- Desktop Version
- Server Version
Rsync: for transferring files between machines
Research
