| Author |
Topic |
|
rockmoose
SQL Natt Alfen
3279 Posts |
 Posted - 2005-12-19 : 17:24:16
|
| Hi,Does anyone have any suggestions for a good utility to zip large backup files and split them into smaller chunks for ftp:ing?We would like to do this on a regular basis, and are currently looking at various zip programs with command-line support. (winzip,7zip...)rockmoose |
|
|
MichaelP
Jedi Yak
2489 Posts |
Posted - 2005-12-19 : 17:33:07
|
| I'm pretty sure WinRAR can do this, but I'm not 100% sure if it can do it command line. I've used WinRAR to backup SQL database backups into smallers files for CD burning or Internet transfer. You specify chuck size etc. It will compress to ZIP/RAR/and several other formats. RAR tends to be much smaller than Zips at highest compression, but it will take quite some time at 100% CPU for big files. Depending on your need though, you can tweak things from "I just need mild fast compression vs I need a super small file and I don't care how long it takes.I also use a .net Zip component from XCeed that can do mulit-file zipping. I think if you buy their data manipulation suite you get a .net Zip and FTP component, so you could write one program to do both.http://www.xceedsoft.com/products/ZipNet/index.aspxMichael<Yoda>Use the Search page you must. Find the answer you will. Cursors, path to the Dark Side they are. Avoid them, you must. Use Order By NewID() to get a random record you will.</Yoda> |
 |
|
|
SamC
White Water Yakist
3467 Posts |
Posted - 2005-12-19 : 18:08:16
|
| I'm pretty sure both Idera and Red Gate's SQL backup do both compression and splitting across multiple files or physical volumes. They'll encrypt too.If encryption doesn't sound important to you, here's an interesting side note... There have been several (and very recent) reported cases of backup tapes being stolen in transit which belong to BIG financial firms and contain millions of personal and financial records.Wouldn't be much of a problem if those stolen backup tapes were encrypted. I haven't seen a news report yet which mentioned if the backup tapes were encrypted or not. |
|
|
|
robvolk
Most Valuable Yak
15732 Posts |
Posted - 2005-12-19 : 18:16:32
|
| WinRar's command line utility can do both multi-part archives and encryption. |
|
|
|
rockmoose
SQL Natt Alfen
3279 Posts |
Posted - 2005-12-19 : 18:33:55
|
Thank you Michael, rar looks just like what I'm after. Created multivolume rar archives from the command line easily.Sam, encryption has been an issue, seems though that rar supports encrypted archives to  // Archive file "D:\DB.BAK\LAB.BAK" to "D:\rarchive2.rar" in 100kb chunksizes with password "PASSWORD"C:\Program Files\WinRAR>rar a -hpPASSWORD -v100k D:\rarchive2.rar D:\DB.BAK\LAB.BAK // Restore split rar archive "D:\rarchive2.part01.rar" to path "D:\RESTOREDIR\", providing the passwordC:\Program Files\WinRAR>rar e -hpPASSWORD -v100k D:\rarchive2.part01.rar D:\RESTOREDIR\ Edit:Thanx rob too!rockmoose |
|
|
|
aiken
Aged Yak Warrior
525 Posts |
Posted - 2005-12-20 : 20:43:55
|
| You might consider compressing the backups at runtime; if they're still too large, you'd still need a tool to split them up, but we've been very happy with that SQL Litespeed product. Smaller, faster backups, easier to move around, etc. (Generic not-affilaited-with disclaimers apply)Cheers-b |
|
|
|
khtan
In (Som, Ni, Yak)
17689 Posts |
Posted - 2005-12-20 : 20:59:38
|
| I am using rar to compress my DB Backup however the speed is rather slow considering the backup size is several GB. Anyone can comments the performance (speed and compressed size) of std backup software like Litespeed against rar ?-----------------[KH]Learn something new everyday |
|
|
|
aiken
Aged Yak Warrior
525 Posts |
Posted - 2005-12-20 : 22:12:28
|
| Well, backups we run with Litespeed take less time to execute than the uncompressed version, and of course once they're done there's no additional lag. It's been a couple of years, so I don't remember specifics, but I believe backups (both full and tx log) started taking about 1/3 of the time they used to.Cheers-b |
|
|
|
robvolk
Most Valuable Yak
15732 Posts |
Posted - 2005-12-21 : 09:39:39
|
| Aiken is dead on. I did some pretty involved tests last year when the new version of LiteSpeed was released. It is MUCH MUCH faster than regular backups and using Rar or WinZip afterward. You really pay for the maximum compression that Rar/WinZip give you, it can take 10x or longer to get an extra 10% compression out of it. And LiteSpeed compresses it on the fly, so you gain even more speed.Seriously, if you're gonna be shuffling gigabyte backups around, you need LiteSpeed. |
|
|
|
khtan
In (Som, Ni, Yak)
17689 Posts |
Posted - 2005-12-21 : 09:47:00
|
| thanks for the info-----------------[KH]Learn something new everyday |
|
|
|
MichaelP
Jedi Yak
2489 Posts |
Posted - 2005-12-21 : 11:48:02
|
| Well, to get the desired chunks, you could use LiteSpeed to do the small and fast backup, and then a tool like WinRAR to split that file into smaller chucks with little or no compression. The WinRAR chunking should be really fast since it doesn't need to compress.Michael<Yoda>Use the Search page you must. Find the answer you will. Cursors, path to the Dark Side they are. Avoid them, you must. Use Order By NewID() to get a random record you will.</Yoda> |
|
|
|
|
zip 'n split