MS SQL Server :: How To Split The Data Into Training And Validation Sets When Doing Data Mining?

Join Three Data Sets From Different Data Flows Into One Txt File
Hi, I was wondering how it is posible to join three data sets from different data flows into one txt file.
Let's explain a little more:

I have 3 dataflows. Each of them connect to sql server and and by a SQL command, they bring data into SSIS.

Each SQL command differ between them. So each data set have different columns (they dont have the same format). Also the amount of columns differ between each one.

What I need is to join the three data sets into one txt file. How can I do this? It is posible to join them with different data set formats into a txt file?

Is this the best way to join different data? It is better to use as many OLE DB Sources are needed instead of different data flows?
Thanks for your help!

View Replies !

Excel 2007 Data Mining Add-in Advance Create Mining Model Question
Hi,

I am trying to model data in analysis services with the Advance Create Mining Model function in the excel addin. I am having trouble creating an association model that works like the Associate button above the Advanced button.

The format of my data is like this

OrderID                  Product

100                          Bike

100                          Helmet

100                          Shoes

200                          Helmet

200                          basketball

200                          Bat

300                          Shoes

300                          Socks

The associate button works perfectly since it asks me which column is the transaction id (orderid) and which column I am trying to predict (product). The advanced create mining model asks me to determine what the columns are...

OrderID=key Product=Input+Predict?

When I run the advance create mining model associate, I get a browser that gives me no rules and the support for only one item itemset (each product but no combination of products).

Does anyone know what I have to do to get it to work like the associate button?

View Replies !

How Is The 'Score' Value Derived In The Lift Chart/Mining Legend For Data Mining Models?
Hi,
I have just run a simple data set through a model to predict a simple true or false value (i.e. binary output)
The Lift Chart/Mining Legend in Analysis Services shows three results €“ Score, Population Correct (%), and Predict Probability (%)

Population Correct I beleive is the percentage of predictions it got right out of the total number of predictions it tried to make. Is this correct?

However, I can€™t work out how the other two are derived in particular the 'SCORE'. To give a live example the scores were as follows:

Model                           Score                Pop Correct                   Pred Probability
Decision Trees               0.83                  76.59%                         54.28%
Neural Network             0.75                  67.63%                         50.05%
Ideal Model                                            100.00%

Can anyone help with this and give a detailed explanation?

Many thanks,
S Rajput

View Replies !

Web Data Mining - Building A Mining Structure Using Cube
Hello,

i finally managed to create my web data mining project using sql server programmability (C# .Net),

i still have one problem, I do not know how to create a mining structure using the cube i created rather

than using the data source. If anyone knows how to do it it would be very helpful

Thanks.

View Replies !

Can I Filter The Data On Mining Structure, Mining Model?
I perform data mining on all products and a specific product category.
Do I need to create 2 data source views, one for all products and the other one for the specific product category?
Afterward, I run the Data Mining Wizard 2 times to create 2 mining structures.
I also need to add the same mining model (e.g. Bayes, Cluster) to each of these mining structures.
Is there any simple way to do it?

Thanks.
Joe.

View Replies !

US - Los Angeles - Sr Business/Data Analyst (SQL Data Mining Exp Required)
JOB SUMMARY:The Business Analyst will be responsible for much of the modeling,tracking, reporting, analysis, and forecasting. The successfulcandidate will work with Business Managers to develop relevantreporting and conduct critical data analysis pertient to theunderstanding and improvement of customer behavior. The BusinessAnalyst will provide analytic support in determining the factorsaffecting website visit behavior, registration, conversion to paidmemberships and customer retention rates along with developing andmaintaing key business metric reports for Senior Management.The company seeks an energetic, intellectually curious, intrinsicallydriven individual who can get things done both individually andthrough others. The successful applicant will have proven analyticbackground (ideally with a consumer-based company).ESSENTIAL FUNCTIONS:Collaborate with Technical Resources and Business Managers to gatherand analyze data.Conduct periodic and ad hoc analysis of data pertinent to theoperation and performance of the company's website and subscriptionservices.Conduct SQL quereis and work with other data extraction, reporting andanalytic tools to develop management reporting in order to gauge,monitor and pinpoint areas for improvement with the company'ssubscription services.Build reports based on needs analysis derived from Business Managers.Develop and maintain multi-department reporting based on keyperformance indicators and a clear understanding of operationalobjectives.Diagnose and communicate to Business Managers operational trends thatenhance or impede conversion of website traffic to paying customers.Support companies effort Develop methodology to segement customerdatabase for the purpose of implementing more successful one-to-onemarketing campaigns based on user demographic, psychographic andsuccess profiles.JOB QUALIFICATIONS:3-5 years experience in a Business Analytics positionB.A. or advanced degree in Economics, Business or closely relatedstudyAble to translate strategic business logic into technical reportrequirementsKnowledge and experience in SQL, MSQL or Oracle database queriesKnowledge and experience with WebTrends, Crystal Reports and otherenterprise level business analytic and OLAP reporting tools isstrongly preferred.Superior knowledge of relational databases.Able to communicate clearly and professionally with all levels of anorganization.Strong interpersonal, written and verbalcommunication skills with demonstrated ability to work in a teamenvironment.

View Replies !

Learning Data Warehouse/analysis Service/data Mining
hi
I am new at MSSQL 2000 DBA thing. and trying to learn more about analysis service/data warehouse/data mining. so is any expert out there can Recommend some good books or web link article to read? Thanks

View Replies !

How To Access The Data From A Custom Data Mining Plugin ?
I'm stucked in a problem and I thought if you would be so kind as to helping me to resolve it.

I'm implementing a clustering algorithm plugin for text mining. I've already read the tutorials and sample codes provided by the MSDN Library.

Well... My problem is: I can't go through the data when the Predict method is called. I've read that this method implements the "core" of the custom algorithms. Here is a small snippet of my code for you to understand my doubt:

STDMETHODIMP ALGORITHM::Predict(/* [in] */ IDMContextServices* in_pContext,/* [in] */ DM_PREDICTION_FLAGS in_Flags,/* [in] */ IDMAttributeGroup* in_pPredAttGroup,/* [in] */ DM_CaseID in_CaseID, /* [in] */ ULONG in_ulCaseValues,/* [in] */ DM_ATTRIBUTE_VALUE* in_rgValues,/* [in] */ ULONG in_ulMaxPredictions,/* [in] */ ULONG in_ulMaxStates, /* [out] */ DM_ATTRIBUTE_STAT** io_prgPredictions,/* [out] */ ULONG* out_pulPredictions) {

for(UINT i=0;i<in_ulCaseValues;i++) {
DM_ATTRIBUTE_VALUE& dmattributevalue = in_rgValues;
ULONG iAttribute = dmattributevalue.Attribute;
if (iAttribute == DM_UNSPECIFIED)
continue;
double dblValue = ::DblContinuous(dmattributevalue.Value);
char buffer[129];
sprintf(buffer,"%f ",dblValue);
RENAN_Log::log(buffer);
}
return S_OK;
}

As you can see, I'm going through in_rgValues to get its values, but i'm only obtaining the first register of the table on the database. I need to roll over a kind of resultset so I could access all the registers I need. Is there any way to do so ?

I expected Predict() received a matrix containing all my data, but the only thing I noticed that could represent the data is that in_rgValues vector. So I can go through this vector, but it holds only the first register of the table in the database (that's what's being saved on my log). I need all of the registers in order to pre-process the data and implement my clustering algorithm.

Well... That's it... I would be very pleased if you could help me.

View Replies !

Errors From Training Mining Models In SSIS
I am in the process of creating an Integration Services package to automate the process of training mining models and getting predictions. Until recently, I have been processing the models directly from Business Intelligence Studio without any problems. However, when I try to use the exact same training set as an input to the Data Mining Model Training destination, I get several errors. Here is the output:

[Mining Models [1]] Error: Parser: An error occurred during pipeline processing.
[Mining Models [1]] Error: Errors in the OLAP storage engine: The process operation ended because the number of errors encountered during processing reached the defined limit of allowable errors for the operation.
[Mining Models [1]] Error: Errors in the OLAP storage engine: An error occurred while the 'CPT MODIFIER' attribute of the 'BCCA DMS ~MC-CLAIM LIN~5' dimension from the 'BCCA LRG DMS TEST' database was being processed.
[Mining Models [1]] Error: File system error: The record ID is incorrect. Physical file: . Logical file: .
[Mining Models [1]] Error: Errors in the OLAP storage engine: The process operation ended because the number of errors encountered during processing reached the defined limit of allowable errors for the operation.
[Mining Models [1]] Error: Errors in the OLAP storage engine: An error occurred while the 'BILL TYPE' attribute of the 'BCCA DMS ~MC-CLAIM LIN~5' dimension from the 'BCCA LRG DMS TEST' database was being processed.
[Mining Models [1]] Error: File system error: The record ID is incorrect. Physical file: . Logical file: .
[DTS.Pipeline] Error: The ProcessInput method on component "Mining Models" (1) failed with error code 0x80004005. The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.

I have not been able to find an answer as to why this is happening. I found a post regarding a similar problem with processing an OLAP cube in SSIS, but it seems that the author of that post never found an answer. Has anyone else here seen similar errors when processing mining models from Integration Services?

Also, if I process the mining models manually then try to run only predictions in SSIS, I get many of the same errors. I'll keep looking into the problem myself, but I would be very grateful if someone in this forum could shed some light on this issue.

View Replies !

How To Split A Transaction Table To Create Training And Testing Set For AR
Hi all,

I have a transaction table that has a composite key made up of transaction id and product id. where multiple products were purchased under same transaction, transaction ids got repeated.

I would like to split the table randomly into 70%, 30% ratio to create training and testing set respectively in such a way that it does not split a same transaction under which multiple products were purchased (rows with same transaction id should not get split).

is it possible? if possible what is the idea?
It would be of great help.

Thanks.

Fakhrul

View Replies !

Error When Training Mining Model. Column Name Seems Can't Be Recognized

Dear All, I have a simple mining structure created by the DMX statement below. Then I tried to insert some data with MDX language by extracting data in OLAP. But I got the following error when I execute the insert statement.

Errors in the high-level relational engine. The 'Customer ID' column in the RELATES clause was not found in the results of the OPENROWSET query.

It seems that the append statement can't really recognize the name of the column which should be Customer ID.

How can I fix this problem?

Thanks

Tony Chun Tung Siu

The source code for create and insert is as below.

create mining model customerMiner
(
customerID long key ,
age long continuous,
orders table
(
  orderID long key,
  goodsID long discrete predict_only
)
)using [Microsoft_decision_trees] with drillthrough;

insert into mining model customerMiner
(
customerID,
age,
orders
(
  skip,
  orderID,
  goodsID
)
)
shape
{
openQuery([Simple SSAS],
'
  select {[Measures].[Customer ID], [Measures].[Age]} on columns,
  {[Customer].[Customer].[Customer].members} on rows
  from fi
')
}
append
(
{
  openQuery([Simple SSAS],
  '
   select {[Measures].[Customer ID],[Measures].[Order ID2],[Measures].[Goods ID]} on columns,
   [Goods].[Order ID2].[Order ID2].members on rows
   from fi
  ')
}
relate [Customer ID] to [Customer ID]
)as orders

View Replies !

Excel Data Mining Add-in For Categorical Data
Thank you very much for your previous answers conserning clustering algorithm.

I change a bit my data and now I can get two and three clusters as I wish.
But now I have a different question. I wish to keep my Structure and Model for further trials with different algorithm values, like cardinality. I tried the following
I selected in excel Data Mining and then the option cluster button.
Then in the cluster wizard I chose analysis service data source and I reform the query as I need adding only at the end
where "STAFF_YES" = 1. Then I choose the needed columns and target value. Finally I select browse model, enable drill through only and I finish the wizard and get some results, rather good. But i need to try again with different parameters.
I tried Business intelligent Studio to check my Analysis service. The structure were here but when I changed any parameter and I tried to reprocess I got the following messages

Processing Mining Structure 'try Structure_1' completed successfully.
  Start time: 5/8/2007 4:55:08 Î¼Î¼; End time: 5/8/2007 4:55:08 Î¼Î¼; Duration: 0:00:00
Processing Dimension 'try Structure_1 ~MC-__RowIndex' completed successfully.
  Start time: 5/8/2007 4:55:08 Î¼Î¼; End time: 5/8/2007 4:55:08 Î¼Î¼; Duration: 0:00:00
  Processing Dimension Attribute '(All)' completed successfully.
   Start time: 5/8/2007 4:55:08 Î¼Î¼; End time: 5/8/2007 4:55:08 Î¼Î¼; Duration: 0:00:00
  Processing Dimension Attribute 'EPI_CELL_SINO_GOOD' completed successfully.
   Start time: 5/8/2007 4:55:08 Î¼Î¼; End time: 5/8/2007 4:55:08 Î¼Î¼; Duration: 0:00:00
  Processing Dimension Attribute 'EPI_CELL_SINO_LOOSE' completed successfully.
   Start time: 5/8/2007 4:55:08 Î¼Î¼; End time: 5/8/2007 4:55:08 Î¼Î¼; Duration: 0:00:00
Errors and Warnings from Response
Internal error: The operation terminated unsuccessfully.
Internal error: The operation terminated unsuccessfully.
Internal error: An unexpected error occurred (file 'pcprocbinding.cpp', line 6645, function 'PCDBProcBinding:electOrChangeCartridge').
Errors in the OLAP storage engine: An error occurred while the dimension, with the ID of 'try Structure_1 ~MC-__RowIndex', Name of 'try Structure_1 ~MC-__RowIndex' was being processed.
Errors in the OLAP storage engine: An error occurred while the 'EPI_CELL_SINO_LOOSE' attribute of the 'try Structure_1 ~MC-__RowIndex' dimension from the 'DMAddinsDB2' database was being processed.
Internal error: The operation terminated unsuccessfully.
Internal error: The operation terminated unsuccessfully.
Internal error: An unexpected error occurred (file 'pcprocbinding.cpp', line 6645, function 'PCDBProcBinding:electOrChangeCartridge').
Errors in the OLAP storage engine: An error occurred while the dimension, with the ID of 'try Structure_1 ~MC-__RowIndex', Name of 'try Structure_1 ~MC-__RowIndex' was being processed.
Errors in the OLAP storage engine: An error occurred while the 'EPI_CELL_SINO_GOOD' attribute of the 'try Structure_1 ~MC-__RowIndex' dimension from the 'DMAddinsDB2' database was being processed.

And no change to the structure take place.

Please help me if you can
Thank you in advnce
Best regards.
Manolis

View Replies !

Excel Data Mining Add-in For Categorical Data
Hi my friends,

I do have a problem with results of clustering algorithm with my categorical data.
In reality I have a big table with one's and zero's and I try to cluster according to 60 attributes.
I tries to cluster to two categories many times but I get only one cluster. What do you suggest. Which values can I change to the algorithm? Is there anything particular for categorical data ?

Thank for your help in advance.

Manolis

View Replies !

How To Deal With Missing_value In The Training Data?
Hi, all experts here,

Thanks for your kind attention.

I have a question on missing_value substitution. As we know in the algorithm parametres setting, there is an option for us to select the method to deal with the missing_value: None, Previous, or Mean. My question is: to numeric data column, we can select Mean method to deal with its missing value. But how about discrete type of data column? What is the best practice to deal with this kind of data? I do think it to a great extent matters the quality of the models being trained?

Can please any of you guys here give me any advices and suggestions on this based on what best practices you have got?

I am looking forward to hearing from you shortly and thanks a lot in advance.

With best regards,

Yours sincerely,

View Replies !

Question On Validation Of Mining Models
Hi, guys,

Thanks for your kind attention.

Just want to make things perfectly work and make the most of our fantastic SQL Server 2005 Data Mining Engine. Can any of you here give me some super advices on the validation of the mining models. As we always see, the 3 aspects of a mining model are: Score, Population correct, and Predict Probability. So the question is: How can we combine these three aspects to best judge the mining models by being able to tell which model is the best one? And to what extent can we really trust these mining models?

These are very important before we can actually bring the models into work to convince other people who have no ideas what are going on with these models. Yes, we just want to convince them with the results of these models and make the most of them and best help them getting the most from their business operations etc.

By the way please can you explain a bit details on each of these aspects? Thanks again.

I am looking forward to hearing from you shortly and thanks bunch for your help.

With best regards,

Yours sincerely,

View Replies !

Query With 2 Sets Of Data
I am trying to query one table and get two different timeperiods of data, I am summing monthly totals to provide a running year total, but I also need last month's total in a seperate column. This is what I have so far but the subquery makes me group it which provides duplicate grouping.DECLARE @LASTPD AS INT
SET @LASTPD = (SELECT MAX(LASTPERIOD) FROM TABLE)
SELECT NAME,
POST_PD AS [MONTH],SUM(CHARGE_AMOUNT) AS MONTHLY_$,
LASTMONTH.LAST_MONTH,(SELECT SUM(CHARGE_AMOUNT) AS LAST_MONTH
FROM TABLE INNER JOIN TABLE2
ON TABLE2.NAME = TABLE.NAME
WHERE POST_PD = @LASTPD
AND TABLE2.NUM= 539
GROUP BY NAME) AS LASTMONTH
INTO #TEMP_SAFROM TABLE
INNER JOIN TABLE2
ON TABLE2.NAME = TABLE.NAME,(SELECT SUM(CHARGE_AMOUNT) AS LAST_MONTH
FROM TABLEWHERE TABLE2.NUM = 539
GROUP BY NAME, POST_PDORDER BY NAME, POST_PD
SELECT NAME,
LAST_MONTH,
CAST(SUM(MONTHLY_$)AS DECIMAL(20,2)) AS YEARLY_$
FROM #TEMP_SA
GROUP BY NAME
ORDER BY NAME

View Replies !

Large Data Sets
Hi,
I'm currently trying to retrieve results from a large dataset, there are over 45000 records and I need to use them all to peform counts etc. I have set up views, but my page is still being returned slowly, is there anything I can do to speed this up?
Thanks
Gemma

View Replies !

Comparing Two Sets Of Data
I have the following situation. One set of data has 274 rows (set2)and anther has 264 (set1). Both data sets are similar in structure aswell as values for both of them were extracts from the same parenttable. Hope the info would substitute DDL. I need to find the "gap"rows between these two sets.Attempted to run a query likeselect count(*)from set2where not exists(select *from set1)did not yield what I desired. What else to try?TIA.

View Replies !

Two Data Sets In A Matrix
Hi

I have a matrix whos colunm group is filed by Dataset1,
now i want to add naother colunm group,but using the Dataset2

can I use two different dataset for a matrix,
for differnt colunm group

please help me in this regards

thanks

View Replies !

Matching Two Sets Of Data
Hi All,

I would like to match two sets of data. I have setup a view of data that contains a group of customers and their details. I want to view this data, but also find these customers in another table based on matching their surname and date of birth, then retreive the information stored on these customers from the second table.

Does anyone have any suggestions how i would go about doing this?

Thanks in advance
Humate

quote:Originally posted by Michael Valentine Jones

It takes real skill to produce something good out of a giant mess.

View Replies !

No Data In Data Mining Cube.
Hi,

I've created a Cluster data mining model and seems to correctly return data. However I've created a data mining dimension and cube but when I go to query the cube it doesn't return any data if I select any members on the data mining dimension. Any suggestions to where I can look to resolve this?

Thanks

Sanjay

View Replies !

Dynamic Data Sets In Reports

Hi,

I'm using a matrix report where in i want to use two datasets in the same report. How can i make the dataset dynamic for a single report.

Regards

View Replies !

Way To Set The Order That Seperate Data Sets Run In?
I have three subreports that i want to run in one report.

However, the order in which these reports runs does matter.

Is there a way to set the order in which subreports run. Or if i make three seperate datasets as subreports, is there a way to set th order in which those datasets populate?

View Replies !

Train And Test Data Sets
I've seen that sometimes is better to split the table into a test dataset and a training dataset, and I'll appreciate if anyone can explain why is this...

thanks

Santiago AceÃ±olaza
Argentina

View Replies !

Calculated Field Using Two Data Sets
Hi,

I'm trying to created a report.
Final report looks like this.

Total Loans/Lines (#)
13,283

Total Commitments ($ MM)
$1,703

Total Outstandings ($ MM)
$1,175

A
B
C
D
F

Bankruptcy
0
$0
$0
0.00%
0.00%

Charge Off
0
$0
$0
0.00%
0.00%

Source table looks like this;

Bankruptcy

0

Charge Off

0

CLTV
131

DSR
102

Exc Total
265

FICO
7

Foreclosure/Repossession

Grand Total
13283

Loan Amount
32

Column D = A Bankrupcy(0) / Total Loans/Lines #(13283)

But it does not let me to use report expression as its not in the same scope.

Can anyone tell me how to do this calculation ?I was trying to use a report expression but it seems like not working.

Thanks

View Replies !

Multiple Data Sets In One List
Is there a way to put more then one data set in a list.
I have a report that has three data sets with three tables. Now i want to show each report by Region, per page. So you can view the same stuff for each region seperately, instead of all together. Is there a way to do this. Where i dont have to go back in my code, and find a way to link everything together, so its in one data set .

View Replies !

Are Data Sets Memory Efficient?

Hi,

I have designed a contact manager with Data Grid Control bound to a Data Set.

When the application closes, data from Data Set is written to XML file and when application opens, data from XML file is loded into Data Set and is show in Data Grid control.

Contacts in my application can exceed over 1,000
So, Is Data Set capable of handling lot of data very efficiently in memory?

Please advise

View Replies !

Problems With Data Sets In SQL Server 2005
Hello,
I am using existing code, which I am trying to convert from using MS Access to SQL Server 2005...
The data set works fine with MS Access database, however when executing with SQL Server 2005 as data source, it generates the following error:
"..The data types ntext and nvarchar are incompatible in the equal to operator..."
in this line:
count = adapter.Update(dataset);
Not sure what should I look for since data sets are new to me.. Where should I check to fix this problem? I have noticed that the table has two columns with nvarchar...

View Replies !

Copying Large Sets Of Data In Same Database
I need to copy data from TableA to TableB (>5 millions rows). The two are in the same database.

What is the best way of doing this?

I was thinking about using a simple INSERT INTO ... SELECT statement. Is there a faster way to do it with SSIS?

Thanks

View Replies !

Making A Chart Run With Multiple Data Sets.
Hello and thanks in advance.

I was wondering if anyone has ever written a chart with multiple datasets.

I need to be able to show sales dollars inflow by order date on one line and on the other needs to be sales dollars delivered by delivery date. So the all sections Values, Category groups, and Series Groups in the chart will be from 2 different datasets.

I have tried but it will not allow aggreates in the series groups.

Any Ideas would be greatly appreciated.

Thanks, Leo

View Replies !

Data Validation
Being relatively new to SSIS, I'm looking for advice, or a best practice, regarding data validation before extracting the data for a transformation.

One of my project's require that certain data be validated in staging tables before it is loaded. The validations include checking for null values, verifying that a field is populated with apropriate values etc... The entire batch of data (good records and bad records) may be rejected depending on the validations.

I have a couple of different thoughts on how this could be handled...

Run a series of validation queries on the data before executing an SSIS package
Run some kind of validation transformation (does one exist or should I write a custom transformation?)
Place contraints on the target tables so that bad records error out on the load
Something else... I could be missing the completely obvious

#3 doesn't seem to viable as the entire load may be rejected if some of the data is bad...

Any thoughts?

View Replies !

Data Validation
Hi guys I am fairly new to t-sql. I am sure there are SPs or scripts that I can use to create a procedure that will do the data validation in the staging table...

Client send us data and often some of the records have bad values... what i have to create is a process that will check for those values and update a flag in the staging table for each column if the data is not valid....

Please help me out if you have something that can be used for this.

Thanks a lot help in advance.

View Replies !

Adding A Calculated Field By Using Two Fields From Different Data Sets

Can I make a calculated field by using two fields from different data sets?(I'm talking about SSRS data sets)

I tried to do that. But I got a error message.

"Report item expressions can only refer to other report items within the same grouping scope or a containing grouping scope."

Please can some one help me out?

View Replies !

Data Values Validation
Hello all...I am trying to validate that the new work date that is being imported from the text file does not exist in the table. So in other words I do not want duplicate data. This is what I haveSqlDataReader dr = new SqlDataReader(); SqlParameter sp = new SqlParameter("@WorkDate", Data.SqlDbType.datetime, 8, Data.ParameterDirection.Input); if (dr.HasRows) sp = "@WorkDate"; else *How does that look? Am I in the ball partâ€¦

View Replies !

Data Validation Check

I new here so hopefully I'm asking this question in the correct forum. I'm have a flat file that contains numbers that I need to verify that they begin with certain prefixes so they load to the correct client. For example in the flat file if I'm loading data for client A and their account numbers begin with 045XXXXXXX then it loads the data. But if there is a record that begins with 037XXXXXXX it should be loaded to client B instead and that records gets written to a error file.

So to summarize what I need , I'm looking for a check to kick out records if I'm loading client A's data versus if I'm loading client B's data.

Can this be done in a Conditional Split ?

Shanon

View Replies !

Data Type Validation

Hi all,

I want to make a conditional split based on the data type provided by the input.
For example : If the comming (Column x) is of data type (numeric) then pass , else do not pass.

(pass = Case 1
Do not pass = Case 2).

Is there any way for doing so ?

View Replies !

Data Type Validation In SRS
Hello everyone,
I have spent hours trying to figure out the validation issue with SQL Server Reporting Services with no luck.I am hoping someone can help me with the issue.
Basically I am looking for a way to validate the data entered by the user in the parameterized Reports.
say, the field is defined as int datatype. If user enter String, it should display the message saying string cannot be entered. Currently, My report does not check the user entered datatype, runs the underlying query and displays the error thrown by the DB ( oracle in my case).
I get :
An error has occured during report processing
Cannot read the next data row....
ORA-01722: invalid number

Instead of this, validation even before query is executed would have been perfect. Is there a way to do that?

Thanks in advance for the help

Phewa Taal

View Replies !

SQL Server Data Validation
Hi.

I have one question regarding SQL Server replication.

I have setup SQLServer merge replication at my work, one of our subscriptions has unreliable connection to the publisher, after setting up the replication to this subscriber, it happened once that the connection was really bad so the merge agent for this subscription was failing before synchronizing data changes, and after that , the connection went good & the merge agent completed the synchronization successfully.

After a while I decided to validate all subscriptions, I discovered that this subscription has different row count for many articles although the merge agent was finishing all synchronizations successfully!!

so my question is:

how could this happen? I mean finishing the sync with success and still have different records!!

I thought that SQL Server will keep make the sync fail just because it can't do it!!

Is it right or there is something I misunderstood here?

How can I prevent this from happening again? at least I want SQL Server to inform me by failing the merge agent synchronizations.

View Replies !

Data Binding To A Stored Procedure That Returns Two Result Sets
Hi there everyone. I have a stored procedure called â€œPagingTableâ€? that I use for performing searches and specifying how many results to show per â€˜pageâ€™ and which page I want to see. This allows me to do my paging on the server-side (the database tier) and only the results that actually get shown on the webpage fly across from my database server to my web server. The code might look something like this:

strSQL = "EXECUTE PagingTable " & _
"@ItemsPerPage = 10, " & _
"@CurrentPage = " & CStr(intCurrentPage) & ", " & _
"@TableName = 'Products', " & _
"@UniqueColumn = 'ItemNumber', " & _
"@Columns = 'ItemNumber, Description, ListPrice, QtyOnHand', " & _
"@WhereClause = '" & strSQLWhere & "'"

The problem is the stored procedure actually returns two result sets. The first result set contains information regarding the total number of results founds, the number of pages and the current page. The second result set contains the data to be shown (the columns specified). In â€˜classicâ€™ ASP I did this like this.

'Open the recordset
rsItems.Open strSQL, conn, 0, 1

'Get the values required for drawing the paging table
intCurrentPage = rsItems.Fields("CurrentPage").Value
intTotalPages = rsItems.Fields("TotalPages").Value
intTotalRows = rsItems.Fields("TotalRows").Value

'Advance to the next recordset
Set rsItems = rsItems.NextRecordset

I am trying to do this now in ASP.NET 2.0 using the datasource control and the repeater control. Any idea how I can accomplish two things:

A) Bind the repeater control to the second resultset
B) Build a â€œpagerâ€? of some sort using the values from the first resultset

View Replies !

How To Split The Data Into Training And Validation Sets When Doing Data Mining?

Could I ask how to spit the data into training and validation sets when doing data mining? Thanks

Could I ask how to spit the data into training and validation sets when doing data mining?

Thanks