Showing posts with label advice. Show all posts
Showing posts with label advice. Show all posts

Thursday, March 8, 2012

Database advice

Hi,

I recently contacted my hosting company's customer support about my databases not working - saying that I use sql express (which they support).

The guy recommended:

"I would suggest you to upgrade the db's to use mssql 2005."

"Thisis because, sql express is built for development environment. When youare in development environment, you are accessing everything withadministrator permission. However, in live hosting environment (whenthere are differnet kind of permission restrictions), sql express oftenfailed on attaching database."

Does anyone have any opinion on that? Would it be best to change db's to use mssql 2005? How complicated/time consuming will it be to upgrade?

Thanks!

Jon

Hi jbear123

Here is a link from microsoft showing you the difference between all of the SQL Server Products.

http://www.microsoft.com/sql/prodinfo/features/compare-features.mspx

The only major difference express has over the other versions is that it is limited to 4 GB is size and will only use one process if you are running it on a multiprocessor machine. Other than that they are the same, and permissions are set up the same.

This is my understanding.

Hope this helps

Regards

ScottyB

Friday, February 24, 2012

Data Validation

Being relatively new to SSIS, I'm looking for advice, or a best practice, regarding data validation before extracting the data for a transformation.

One of my project's require that certain data be validated in staging tables before it is loaded. The validations include checking for null values, verifying that a field is populated with apropriate values etc... The entire batch of data (good records and bad records) may be rejected depending on the validations.

I have a couple of different thoughts on how this could be handled...

    Run a series of validation queries on the data before executing an SSIS package Run some kind of validation transformation (does one exist or should I write a custom transformation?) Place contraints on the target tables so that bad records error out on the load Something else... I could be missing the completely obvious

#3 doesn't seem to viable as the entire load may be rejected if some of the data is bad...

Any thoughts?

You could filter out the bad data very easily using a Conditional Split transform. Better still, you can pipe that bad data somewhere for later analysis.

Does that help?

-Jamie

|||I like both of thoses suggestions. With the conditional split transform, could I then update the original record with a status flag?|||

Once you pipe the data off elsewhere from the Conditional Split you can do what you want with it so yes, you should be able to do this! You would use an OLE DB Command transform.

You may have a problem (i.e. blocking) when trying to update a table that you are selecting from in the source - but this can be easily alleviated by dropping the update dataset into a raw file and then doing the update in a seperate data-flow.

-Jamie

|||

Thank you!

I was just testing an update using the OLE DB Command Transform. The raw file seems like good work around if the row is locked!