move terrabytes of data to new data center

How does one go about moving terrabyes of data to new data center to say
establish log shipping across a WAN with huge latency ? I can manage moving
the logs , but I am concerned about the first time transfer of all the data
to the new data center to be used for disaster recovery. The first time
transfer would be all the backup files. We have a lot of databases and
cannot wish to move all the backup files one at a time that would take us a
month to get all the data across, but want to push say around 50TB of data
in a couple of days. We are already compressing our backups and still have a
lot of data.
Does anyone use any tools,etc to push the files faster ? Please let me know
There is no free ride here. You will have to take the full backups and get
them to the other site, even if you copy to tape and drive them over.
Meanwhile, you keep taking your regular log backups at the origin. Ship
your logs until you are in synch.
Tom
Thomas A. Moreau, BSc, PhD, MCSE, MCDBA, MCITP, MCTS
SQL Server MVP
Toronto, ON Canada
https://mvp.support.microsoft.com/profile/Tom.Moreau
"Hassan" <hassan@.hotmail.com> wrote in message
news:%23vAmMstfHHA.4872@.TK2MSFTNGP03.phx.gbl...
How does one go about moving terrabyes of data to new data center to say
establish log shipping across a WAN with huge latency ? I can manage moving
the logs , but I am concerned about the first time transfer of all the data
to the new data center to be used for disaster recovery. The first time
transfer would be all the backup files. We have a lot of databases and
cannot wish to move all the backup files one at a time that would take us a
month to get all the data across, but want to push say around 50TB of data
in a couple of days. We are already compressing our backups and still have a
lot of data.
Does anyone use any tools,etc to push the files faster ? Please let me know
|||Jim Gray used to do this with his astronomy databases and he said by far the
best bandwidth was putting the data on a hard drive and shipping it to the
destination. He used to say FedEx was the best high-bandwidth carrier. You
can get a terabyte of cheap disk for under $500 these days.
This posting is provided "AS IS" with no warranties, and confers no rights.
Use of included script samples are subject to the terms specified at
http://www.microsoft.com/info/cpyright.htm
"Tom Moreau" <tom@.dont.spam.me.cips.ca> wrote in message
news:unAG8ztfHHA.4032@.TK2MSFTNGP02.phx.gbl...
> There is no free ride here. You will have to take the full backups and
> get
> them to the other site, even if you copy to tape and drive them over.
> Meanwhile, you keep taking your regular log backups at the origin. Ship
> your logs until you are in synch.
> --
> Tom
> ----
> Thomas A. Moreau, BSc, PhD, MCSE, MCDBA, MCITP, MCTS
> SQL Server MVP
> Toronto, ON Canada
> https://mvp.support.microsoft.com/profile/Tom.Moreau
>
> "Hassan" <hassan@.hotmail.com> wrote in message
> news:%23vAmMstfHHA.4872@.TK2MSFTNGP03.phx.gbl...
> How does one go about moving terrabyes of data to new data center to say
> establish log shipping across a WAN with huge latency ? I can manage
> moving
> the logs , but I am concerned about the first time transfer of all the
> data
> to the new data center to be used for disaster recovery. The first time
> transfer would be all the backup files. We have a lot of databases and
> cannot wish to move all the backup files one at a time that would take us
> a
> month to get all the data across, but want to push say around 50TB of data
> in a couple of days. We are already compressing our backups and still have
> a
> lot of data.
> Does anyone use any tools,etc to push the files faster ? Please let me
> know
>
|||Y'know, I think he said that at PASS in Dallas in 2005. We'll miss him.
Tom
Thomas A. Moreau, BSc, PhD, MCSE, MCDBA, MCITP, MCTS
SQL Server MVP
Toronto, ON Canada
https://mvp.support.microsoft.com/profile/Tom.Moreau
"Roger Wolter[MSFT]" <rwolter@.online.microsoft.com> wrote in message
news:1B33E8DD-E88C-41A0-8123-629A2E50266D@.microsoft.com...
Jim Gray used to do this with his astronomy databases and he said by far the
best bandwidth was putting the data on a hard drive and shipping it to the
destination. He used to say FedEx was the best high-bandwidth carrier. You
can get a terabyte of cheap disk for under $500 these days.
This posting is provided "AS IS" with no warranties, and confers no rights.
Use of included script samples are subject to the terms specified at
http://www.microsoft.com/info/cpyright.htm
"Tom Moreau" <tom@.dont.spam.me.cips.ca> wrote in message
news:unAG8ztfHHA.4032@.TK2MSFTNGP02.phx.gbl...
> There is no free ride here. You will have to take the full backups and
> get
> them to the other site, even if you copy to tape and drive them over.
> Meanwhile, you keep taking your regular log backups at the origin. Ship
> your logs until you are in synch.
> --
> Tom
> ----
> Thomas A. Moreau, BSc, PhD, MCSE, MCDBA, MCITP, MCTS
> SQL Server MVP
> Toronto, ON Canada
> https://mvp.support.microsoft.com/profile/Tom.Moreau
>
> "Hassan" <hassan@.hotmail.com> wrote in message
> news:%23vAmMstfHHA.4872@.TK2MSFTNGP03.phx.gbl...
> How does one go about moving terrabyes of data to new data center to say
> establish log shipping across a WAN with huge latency ? I can manage
> moving
> the logs , but I am concerned about the first time transfer of all the
> data
> to the new data center to be used for disaster recovery. The first time
> transfer would be all the backup files. We have a lot of databases and
> cannot wish to move all the backup files one at a time that would take us
> a
> month to get all the data across, but want to push say around 50TB of data
> in a couple of days. We are already compressing our backups and still have
> a
> lot of data.
> Does anyone use any tools,etc to push the files faster ? Please let me
> know
>
|||On Sat, 14 Apr 2007 16:00:41 -0700, "Roger Wolter[MSFT]"
<rwolter@.online.microsoft.com> wrote:

>Jim Gray used to do this with his astronomy databases and he said by far the
>best bandwidth was putting the data on a hard drive and shipping it to the
>destination. He used to say FedEx was the best high-bandwidth carrier. You
>can get a terabyte of cheap disk for under $500 these days.
Maybe the best thing is (a) move the new SAN to the source network,
(b) detach and copy all files direct to SAN over local gigabit
backbone, (c) ship entire SAN to new site.
If I compute correctly that's 100 hours to copy even at gigabit, with
no backup/restore, no compress/decompress - and no encrypt/decrypt.
Fun for all!
Here's hoping there's a clear division between current and historical
data, or you're in real trouble!
J.
|||"Hassan" <hassan@.hotmail.com> wrote in message
news:%23vAmMstfHHA.4872@.TK2MSFTNGP03.phx.gbl...
> How does one go about moving terrabyes of data to new data center to say
> establish log shipping across a WAN with huge latency ? I can manage
> moving the logs , but I am concerned about the first time transfer of all
> the data to the new data center to be used for disaster recovery. The
> first time transfer would be all the backup files. We have a lot of
> databases and cannot wish to move all the backup files one at a time that
> would take us a month to get all the data across, but want to push say
> around 50TB of data in a couple of days. We are already compressing our
> backups and still have a lot of data.
> Does anyone use any tools,etc to push the files faster ? Please let me
> know
>
A truck full of harddrives has high latency, but low bandwidth.
Quite seriously, you made find it easiest to buy, borrow, rent a disk array
of some sort, copy stuff to it, drive to the new datacenter, load it up and
copy over.
Greg Moore
SQL Server DBA Consulting Remote and Onsite available!
Email: sql (at) greenms.com http://www.greenms.com/sqlserver.html