Data Validation Challenge

We have data migration process that transfers around 450 million records from
one DB to Another DB. There is a validation that takes place for the migrated
data that is time consuming (few days). The following validations takes place
on migrated data
NULL check
Length Check
Numeric Precision Check
So its looping through 450(rows) million * 30 (columns) times. so it takes
forever to complete the validation process and moreover the space
requirements also growing exponentially :-(. I would like to know is there a
better approach for validation of this kind. we are planning to try partition
approach. If there is any better way please help with your recommendations.
Regards,
Murali
Which tool are you using?
"Murali" wrote:

> We have data migration process that transfers around 450 million records from
> one DB to Another DB. There is a validation that takes place for the migrated
> data that is time consuming (few days). The following validations takes place
> on migrated data
> NULL check
> Length Check
> Numeric Precision Check
> So its looping through 450(rows) million * 30 (columns) times. so it takes
> forever to complete the validation process and moreover the space
> requirements also growing exponentially :-(. I would like to know is there a
> better approach for validation of this kind. we are planning to try partition
> approach. If there is any better way please help with your recommendations.
> Regards,
> Murali
>

Data Validation Challenge

We have data migration process that transfers around 450 million records fro
m
one DB to Another DB. There is a validation that takes place for the migrate
d
data that is time consuming (few days). The following validations takes plac
e
on migrated data
NULL check
Length Check
Numeric Precision Check
So its looping through 450(rows) million * 30 (columns) times. so it takes
forever to complete the validation process and moreover the space
requirements also growing exponentially :-(. I would like to know is there a
better approach for validation of this kind. we are planning to try partitio
n
approach. If there is any better way please help with your recommendations.
Regards,
MuraliWhich tool are you using?
"Murali" wrote:

> We have data migration process that transfers around 450 million records f
rom
> one DB to Another DB. There is a validation that takes place for the migra
ted
> data that is time consuming (few days). The following validations takes pl
ace
> on migrated data
> NULL check
> Length Check
> Numeric Precision Check
> So its looping through 450(rows) million * 30 (columns) times. so it takes
> forever to complete the validation process and moreover the space
> requirements also growing exponentially :-(. I would like to know is there
a
> better approach for validation of this kind. we are planning to try partit
ion
> approach. If there is any better way please help with your recommendations
.
> Regards,
> Murali
>

data transformation

hi,
My problem is I am creating a new database. I need to all the tables
and procedures from
one databse to another database in sql server 2000, both in same
server.
Kalaivanan.Hi,
Create those objects in Model database (Template for new databases). New
database will be created based on the Model database size and contents.
So what ever objects available in model willbe copied to new database
created.
Thanks
Hari
SQL Server MVP
"kalaivanan" <mail2kalai@.gmail.com> wrote in message
news:1156250185.220361.249720@.i3g2000cwc.googlegroups.com...
> hi,
> My problem is I am creating a new database. I need to all the tables
> and procedures from
> one databse to another database in sql server 2000, both in same
> server.
> Kalaivanan.
>|||1) BACKUP/RESTORE
2) DETACH/ATTACH
3)DTS
"kalaivanan" <mail2kalai@.gmail.com> wrote in message
news:1156250185.220361.249720@.i3g2000cwc.googlegroups.com...
> hi,
> My problem is I am creating a new database. I need to all the tables
> and procedures from
> one databse to another database in sql server 2000, both in same
> server.
> Kalaivanan.
>|||Just take a backup and restore it to a database with a different name.
You'll also need to pick different file locations. Check out BACKUP
DATABASE and RESTORE DATABASE in the BOL.
This will also "copy" all other objects in the DB.
Tom
----
Thomas A. Moreau, BSc, PhD, MCSE, MCDBA
SQL Server MVP
Toronto, ON Canada
.
"kalaivanan" <mail2kalai@.gmail.com> wrote in message
news:1156250185.220361.249720@.i3g2000cwc.googlegroups.com...
hi,
My problem is I am creating a new database. I need to all the tables
and procedures from
one databse to another database in sql server 2000, both in same
server.
Kalaivanan.|||I am sorry; I mis assume the question. The solution for you is:-
1. Backup the source database [ See Backup Database command in books onl
ine]
2. Restore the database with new name in same server [See Restore Databa
se
<new Dbname> with MOVE options in books online]
Thanks
Hari
SQL Server MVP
"Hari Prasad" <hari_prasad_k@.hotmail.com> wrote in message
news:OOJKNhexGHA.4412@.TK2MSFTNGP05.phx.gbl...
> Hi,
> Create those objects in Model database (Template for new databases). New
> database will be created based on the Model database size and contents.
> So what ever objects available in model willbe copied to new database
> created.
> Thanks
> Hari
> SQL Server MVP
> "kalaivanan" <mail2kalai@.gmail.com> wrote in message
> news:1156250185.220361.249720@.i3g2000cwc.googlegroups.com...
>