All Questions
Tagged with data-profiling sql-server
6 questions
0
votes
1
answer
696
views
Data profiling of columns for big table (SQL Server)
I have table with over 40 million records. I need to make data profiling, including Nulls count, Distinct Values, Zeros and Blancs, %Numeric, %Date, Needs to be Trimmed, etc.
The examples that I was ...
- 975
0
votes
2
answers
212
views
Validation for columns work very slow (SQL Server)
I want to perform data profiling on the columns of a table. In this particular case - what percentage of data is date/integer/numeric/bit. The query that I am using:
SELECT
CAST(SUM(CASE WHEN ...
- 975
2
votes
2
answers
839
views
How to loop through all tables and fields in each table to get percentage of missing values
I am trying to, using SSIS, obtain a table to get the percentage of missing values of every field in every table of a SQL Server database.
Ideally I would like to create a new table in another ...
- 4,284
1
vote
1
answer
189
views
Profiling the empty string in SSIS Data Profiling
I've just started using the Data Profiling Task in SSIS to profile some data on our databases. I've found the option for profiling the column null ratios ("Column Null Ratio Profiles") but I'm ...
- 1,260
0
votes
2
answers
447
views
Find Multi-Column Primary key
I have about 30 tables from an old ERP which have multi-column primary keys. Unfortunately I don't know what those keys are. I've used the SSIS profiling task to determine primary key candidates for ...
- 43
10
votes
2
answers
1k
views
Data profiling Task - custom Profile Request
Is there any option to create a custom Profile Request for SSIS Data Profiling Task?
At the moment there are 5 standard profile requests under SSIS Data Profiling task:
Column Null Ratio Profile ...
- 769