Tracking Forums, Newsgroups, Maling Lists
Home Scripts Tutorials Tracker Forums
  Advanced Search
  HOME    TRACKER    MS SQL Server






SuperbHosting.net have generously sponsored dedicated servers to ensure a reliable and scalable dedicated hosting solution for BigResource.com.





How Can I Initialize Runtimeconnection For My SSIS Dataflow Component From My IDtsComponentUI Correctly?


I am developing SSIS dataflow component.
Extended user interface is based on class IDtsComponentUI. Connection properties are created in both standart and my extended editor (Extended user interface). To set up designtime connection I use standart and my extended editor.
 

A main PipelineComponent component have two runtime connection:
 

IDTSRuntimeConnection90 adoConnection1 = ComponentMetaData.RuntimeConnectionCollection.New();

adoConnection1.Name = "Connection 1";

IDTSRuntimeConnection90 adoConnection2 = ComponentMetaData.RuntimeConnectionCollection.New();

adoConnection2.Name = "Connection 2";
----------------------------------------------------------------------
 

IDTSComponentMetaData90 dtsComponentMetaData; // current designtime component
....
In IDtsComponentUI I use follow fragment of code (for example):
 

_dtsComponentMetaData.RuntimeConnectionCollection[0].ConnectionManager =

Microsoft.SqlServer.Dts.Runtime.DtsConvert.ToConnectionManager90(_connections[0]);
 
to set up IDTSRuntimeConnection90[0] connection using connections from a current package. After this operation
the RuntimeConnectionCollection[0] is not null within the method PipelineComponent.AcquireConnections((object transaction)). ! But during next launching of Extended user interface the RuntimeConnectionCollection[0] is null within the method PipelineComponent.AcquireConnections((object transaction)). 
Why do I lose the connection? And why the connections which set up in my Advanced editor do not save in standart editor?

 
Thanks in advance.




View Complete Forum Thread with Replies
Sponsored Links:

Related Messages:
Enabling Expression Builder For Custom SSIS DataFlow Source Component
Hi,

I have implemented a custom source component that can be used as the data source in the Data Flow task.

I have also created a custom UI for this component by using the IDtsComponentUI .

But my component does not have the capability of setting the custom properties via the DTS Variables using the Expression Builder.

I have looked around for samples on how to do this, but I can only find samples of how to do this for custom Control Tasks, i.e. IDtsTaskUI.  

My question is, How can implement the Expression Builder in my custom Source component + custom Source UI. Or do you know of any samples which I can look at.

Thank you,

Jameel.

View Replies !   View Related
How Can I Bind Assemblies Of DEFINITE Version Of SSIS Dataflow Component To A Package.
I have several versions of one SSIS Dataflow component. I need to bind some of them( definite version) to my SSIS package. How can I do that?
 
Thanks in advance.

View Replies !   View Related
Why Dataflow Component Doesn't Appear In The List Of SSIS Data Flow Items?
Hi,
I developed SSIS Data Flow Component and placed dll file into the DTSPipelinecomponents. Then I registered the component in the GAC.
 
But when I try to add the required component into toolbox that there is not this one in the list of SSIS Data Flow Items. What does it mean?
 
Thanks in advance.
 
 

View Replies !   View Related
Reference To Preceeding Component From Custom Dataflow Transformation Component
I am writing a custom dataflow transformation component and I need to get the name of the preceeding component.

I have been trying to find a way to get a reference to the Package object, MainPipe object or IDTSPath90 object (connecting to the IDTSInput90 of my component) from my component because I think from there I can get to the information I want.

Does anyone have any suggestions?

TIA . . . Ed

View Replies !   View Related
Icon Not Displayed Correctly For Custom Component
So i finally figured out how to create custom transform and add an icon to it. However - when i added the component to toolbox it appears as a file icon (when i didnt have icon it appeared as a blue box) - in the data flow designer it appears as the correct image.
 From BOL wrote:"The Data Flow toolbox uses the 16x16, 16-color image type, while
the design surface of the data flow tab uses the 32x32, 16-color image
type. Both are default image types for icons created using Microsoft
Visual Studio 2005."
I assume this has something to do with it - my ico is default 32x32 - however, what would be the way to fix it?

View Replies !   View Related
Global Variables And The Script Component In DataFlow
I can't find anything on how to get to a global variable in a script component in the dataflow.  I can get to it in a script task with no problem by using dts.variables but i doesn't appear you can do the dts variables in the script component. 

I did add it to the readwrite variable list but I haven't been able to access it.

View Replies !   View Related
Custom Dataflow Component---add New Column To Buffer
This is trivial I'm sure but I'll be dogged if I can find someone who mentions how to do it. I am attempting to develop a Data Flow Transformation that appends a new column (a string value) into the current stream.

I have found plenty of references on how to replace an existing column but I'd really like to just add my new column in there. It doesn't need to be configurable, it can be a static column name. I'll take a solution that allows the column name to be set at design time, don't get me wrong but the magic I'm looking for is how to implement a new column in a stream.

Yes, I am well aware of the derived column task but I will be replacing a few hundred instances and I'd much rather just drag an item onto the designer than to drag a derived column, double click it, type in the column name, set the expression and then set the datatype, etc.

Anyone spare a moment to enlighten me?

Pardon the lack of formatting, this BB doesn't play with Opera (I know, I'm a heretic)


using System;
using System.Collections;
using System.Runtime.InteropServices;
using Microsoft.SqlServer.Dts.Pipeline;
using Microsoft.SqlServer.Dts.Pipeline.Wrapper;
using Microsoft.SqlServer.Dts.Runtime.Wrapper;
using Microsoft.SqlServer.Dts.Runtime;

namespace Microsoft.Samples.SqlServer.Dts
{
[
DtsPipelineComponent
(
DisplayName = "Nii",
Description = "This is the component that says Nii.",
ComponentType = ComponentType.Transform
)
]
public class Nii : PipelineComponent
{


public override void ProcessInput(int inputID, PipelineBuffer buffer)
{
if (!buffer.EndOfRowset)
{
while (buffer.NextRow())
{
try
{
// do something here to
}
catch (Exception e)
{
ComponentMetaData.FireInformation(0, ComponentMetaData.Name, "There was an error on row " + buffer.CurrentRow.ToString() + ". The error is: " + e.Message + " : " + e.Source + " : " + e.StackTrace, "", 0, ref fireEventAgain);
}
}
}
}
}

View Replies !   View Related
Custom Dataflow Component: How Do You Make Properties Editable?
I have a custom component that takes in unicode stream and converts it to ascii text.  However I would like to make my default string length and code page editable in the standard GUI editor.  Right now I can set the default to 1000 characters, but when I try to change it, it says "Property value is not valid"

Any ideas?

Thanks!

View Replies !   View Related
Access Read Only Variables In Script Component In A Dataflow
I have a set of comma separated variables in a Script Component list. I want to access them in Script code and use them to build string in the code.

View Replies !   View Related
Stand Alone Custom Dataflow Component Trying To Access MainPipe...
Hi,
 
I've created a stand alone custom dataflow component in VB and I need to set up the connection to the Input and Output components and instantiate it. The only way I've seen this done is to create an entire package and Task then use the TaskHost wrapper object to instantiate the Mainpipe (IDTSPipline90 interface) so that you can create the IDTSPath90 interface and setup the connection to the input and output components...
 
After all that, all that I would like to know is whether it is possible to instantiate the mainpipe interface without creating a package programmatically? I've seen something Darren Green put in an answer to a thread, about accessing the Mainpipe interface in the UI, to the effect that you can access it through IServiceProvider using the interface IDTSPipelineEnvironmentService - I think that's it... But I'd like to know if there is a more straightforward route to instantiating and accessing the Task or data flow directly?
 
Thanks in advance,
Will.

View Replies !   View Related
My Own Dataflow Component. How Make A Property With List Of Predefined Values?
I am creating of may of dataflow component.

How make  a property with list of predefined values?

Thanks in advance.

View Replies !   View Related
Dates In Slow Changing Dimension Dataflow Transformations Component
I€™m trying to populate a table with fields of date type [DT_DATE] using the Slow Changing Dimension Transformation component. When I add the date fields to the component it would not build the stream. The wizard fails and tells me the date fields are not of the same type.  The fields in the destination table are of type €œdate€? and the input columns are of type [DT_DATE]. Am I missing something?

View Replies !   View Related
Initialize Counter In &&"script Component&&" From Package Variaable
i need to initialize my variable

in the "script component" from a package variable.

how can i do that?

i'm referring to the script component in the dataflow

 

thanks..

View Replies !   View Related
Use Of A SSIS Variable Of Type “Object� Inside Script Component And Task Component
In a Data Flow, I have the necessity to use a SSIS variable of type €œObject€? inside Script Component and assign to it the content of 'n'  variables  of string type.
On exiting from the script the variable of type object should contain something like in the following lines:
AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
BBBBBBBBBBBBBBBBBBBBBBBBBBBBB
CCCCCCCCCCCCCCCCCCCCCCCCCCCCC
DDDDDDDDDDDDDDDDDDDDDDDDDDDDD
€¦€¦€¦€¦€¦€¦€¦.
€¦€¦€¦€¦€¦€¦€¦.
On exiting from the data flow I will use the variable of type Object in a Script Task, by reading each element in a cyclic fashion.
Is there anyone who have experienced something like this? Could anyone provide any example of that?
Thanks in advance!

View Replies !   View Related
A Custom Component For Use As A VIEW In SSIS- Is It Possible To Create One MERGE Like Component With More Than 2 Inputs
Hi all
I'm into a project which uses a lot of views for joining 2 or more tables. Using the MERGE component in SSIS will be a huge effort coz it only has 2 inputs and I gotta SORT the input too.
Isnt it possible to have a VIEW like component that joins more than 2 tables and DOESNT need sorting??
(I've thought about creating views in database engine but it breaks my data floe in SSIS and is'nt a practical solution)

View Replies !   View Related
SSIS Not Pulling Data Correctly
Ok I wrote a SSIS package that will pull down data from my AS/400 and populate a SQL Server table with the data.

1)The data is being pulled from my China configured AS/400. It is configured to handle DBCS
2)The SQL Server tables are configured to handle DBCS by using the nvarchar datatype.
3)When I run this package on my machine against the production server, it works perfectly.
4)When I run this package on my test SQL Server against the production server,it works perfectly.
5)When I run this package on my production SQL Server it brings down all the records, but does not bring down all the fields. Most of the character fields are left blank.(not all)

I do not understand why this is doing this. Can anyone shed any light on this problem? Thank you.

View Replies !   View Related
SSIS Not Pulling Data Correctly.
 Ok I wrote a SSIS package that will pull down data from my AS/400 and populate a SQL Server table with the data.  

1)The data is being pulled from my China configured AS/400.  It is configured to handle DBCS
2)The SQL Server tables are configured to handle DBCS by using the nvarchar datatype.
3)When I run this package on my machine against the production server, it works perfectly.
4)When I run this package on my test SQL Server against the production server,it works perfectly.
5)When I run this package on my production SQL Server it brings down all the records, but does not bring down all the fields.  Most of the character fields are left blank.(not all)

I do not understand why this is doing this.  Can anyone shed any light on this problem?  Thank you.
 

View Replies !   View Related
SSIS Not Pulling Data Correctly
Ok I wrote a SSIS package that will pull down data from my AS/400 and populate a SQL Server table with the data.

1)The data is being pulled from my China configured AS/400. It is configured to handle DBCS
2)The SQL Server tables are configured to handle DBCS by using the nvarchar datatype.
3)When I run this package on my machine against the production server, it works perfectly.
4)When I run this package on my test SQL Server against the production server,it works perfectly.
5)When I run this package on my production SQL Server it brings down all the records, but does not bring down all the fields. Most of the character fields are left blank.(not all)

I do not understand why this is doing this. Can anyone shed any light on this problem? Thank you.

View Replies !   View Related
HELP--SSIS Dataflow Task
Need help regarding ssis dataflow task

I need to create a ssis package. I want to import the data from a flat file to a table.

Lets say, the table has 5 columns -- col1, col2, col3, col4 , col5.(Assume that all columns can be NULLABLE)  The datafile contains the data related to only three columns say col1, col2, col3. So when I use dataflow task  to import the data from the file to the table, I will only get three columns, col1, col2, col3. Columns col4, col5 will be NULL.
However, I want to populate columns col4, col5 with some values which are stored in the variable.

IS there any way to do this??

Any help would be appreciated.

Thanks

View Replies !   View Related
SSIS Dataflow Designer Bug
When I drop a new component onto the design surface, it appears with dotted lines around it, as it is selected.

But, the F2 key (the hotkey for rename) does not work.

I have to click on some other component, and then back on the new component, and then the F2 key works.

I remember reporting this bug back in the beta cycle, but it is still present even in the release -- I actually think Ã?'m using the SP1 version of 2005, but see version info below to be sure:


Remote terminal services broke my copy buffer again, as is so often does, so pasting in the version info failed -- falling back to manual typing -- SSIS 9.00.2047.00.

View Replies !   View Related
SSIS Dataflow Problem
It just occurs to me that it might not be a bad idea to post again the problems in SSIS that I found back in the beta cycle which do not seem to have been fixed, to increase the chance that someone will notice them.

(During the beta cycle, I spent hours trying to get bugs posted into the beta bug system, but the beta web bug site had so many problems that I could never get it to work, unfortunately, so I fell back to just posting my bugs and hoping some developers would notice them. Kirk had a thread for bugs and RFEs at one point, where I posted some of the important ones.)

Here is another fairly bad one:


The dialog that pops up to show fields in the dataflow which have been orphaned, after some fields have been removed earlier in the dataflow, and which allows the user to rename them or delete them, has a very bad display problem:

It shows the box names before the field names, so if the box names are descriptive, the field names are far off-screeen, and it is very difficult to get them to display on screen.

So the user starts off with all the items in the drop-down being indistinguishable, as they all start with the box names, and the important part of the strings are far off-screen at the right -- the actual field names.


I don't recall if I actually ever posted this one; I may not have.

View Replies !   View Related
SSIS Dataflow Vs SQL2K DDQ
I am trying to recode a SQL2K DDQ into an SSIS Dataflow. I have no issue recoding it in SSIS except I am not sure that I am doing it correct way.

My DDQ has source,destination, update/delete/insert statements and few lookups. I have used activex script for the transformation because I have atleasst 10 If conditions. For every "if condition" the destination columns are popuated with different lookups/source columns and constant values.

Now When I start doing it with SSIS I have to use at least 10 Conditional split. and then at least one lookup,one OLEDBCommand and one OLEDB Destination  for each of them . that brings my count of DF objects to 30-40

It makes my data flow to complex with two many objects. Earleir I could do whole of this in one sngle DDQ. It makes me think if I am doing it the correct way. should I be using Activex Script Task to these kind of activity. 

 

Any advice would be appreciated.

 

Cheers,

siaj

View Replies !   View Related
Help With CustomComponent In SSIS-DataFlow
Hello
Trying to figure out a clever solution for splitting multivalued columns out into n-columns.
For that I've build a custom component in SSIS using

ms-help://MS.VSCC.v80/MS.VSIPCC.v80/MS.SQLSVR.v9.en/dtsref9/html/4dc0f631-8fd6-4007-b573-ca67f58ca068.htm as an example.

I need to be able to add columns to the OutputCollection in designtime, but the designer returns an error:
Error at Data Flow Task [Uppercase [5910]]: The component "Uppercase" (5910)
does not allow setting output column datatype properties.

How do I enable the designer to accept designtime changes in the
columncollection?

Kind regards

View Replies !   View Related
SSIS Dataflow Performance
 

I created a dataflow that transferred about 1 million records from a SQL database on one server to a differend SQL database on the same server.  The processing took about 30 minutes. I used the Fast Load option.
 
I then created a "Execute SQL Task" and wrote a "SELECT * INTO TABLE" and this processing took about 30 - 60 seconds. 
 
Can someone tell me why creating a Data Flow Tak would take so much longer or give differences between the two options above?  Can someone give some pointers on how to make a Data Flow task more efficient?
 
Thanks.

View Replies !   View Related
SSIS Dataflow Help! Job Succes Without Doing Anything
Okay I 'm not sure what to do next
(S2K5 64 bit SP2)
Migrated across simple DTS  which picks data up from MSaccess and ships it into a database table!
 
I switched the 64bit run time to false and happy days  it shipped the information across.
 
I then decided I wanted to deploy the package    so I created a deployconfig.xml with all properties ticked against my two connections in connection manager.    ( the MSacessdb and the S2k5 database )
 
after that I switched the deployment util to true.
 
then I fired the deployment manifest
 
 
Then created a job to schedule   it fails with








Executed as user: SEA-SRV-00009SYSTEM. ...00.3042.00 for 64-bit  Copyright (C) Microsoft Corp 1984-2005. All rights reserved.    Started:  4:09:33 PM  Error: 2007-09-10 16:09:38.70     Code: 0xC0202009     Source: Trackitnew Connection manager "TRACKIT"     Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040154.  An OLE DB record is available.  Source: "Microsoft OLE DB Service Components"  Hresult: 0x80040154  Description: "Class not registered".  End Error  Error: 2007-09-10 16:09:38.72     Code: 0xC020801C     Source: Data Flow Task Task Collection [22]     Description: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "TRACKIT" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.  End Error  Error: 2007-09-10 16:09:38.72     Code: ...  The package execution fa...  The step failed.
 
SO firstly I changed the surface area config to enable xp_cmdshell   
 
created another job but ran TSQL
xp_cmdshell 'dtexec /FILE "D:DTSTrackit.dtsx"  /MAXCONCURRENT " -1 " /CHECKPOINTING OFF /REPORTING EW'
 
I ran the job and it says succesful but when I do a query on the table there is no data  could anyone please point me in the right direction?   Thanks
 
 
 
 
 
 
 

View Replies !   View Related
How To Create An SSIS Package Correctly By Programming?
     Recently I try to create a package completely by c# code,not the ETL tool.

View Replies !   View Related
SSIS DataFlow Task Out Of Memmory
I have a problem whit loading XML-files into SQL server.

I iterate over the XML-files with the "for each file" component and use the XML source within a Data flow task. This works great until the file count got bigger. After say 1000 files the XML source returns error 0x8007000E. I think this means out of memory. Does anyone have an idea how to solv this. The load must be able to handle up to 5000 files in one batch.  

View Replies !   View Related
SSIS DataFlow Truncate While Processing
 

Hi,
 
 I was using SSIS for our ETL Process , one of the my DATA Flow have to truncate based on the data , suppose for example
 
i am have the following data
 
Filename : Employee
Columns
Empid , Employee

1            XXXXX
2            YYYY
3            ZZZZ
 
 
i am using flatfilesource for reading data . for example for a condition if empid='2' means i have to truncate the dataflow , it is possible or not ?
 
Please help me
 
Thanks in Advance
Raja Ragothaman
 
 
 
 
 
 

View Replies !   View Related
SSIS DataFlow Performance Issues
My apologies if this is a very basic question, but I am having a very difficult time finding the answer.

My very, very simple dataflow task is PAINSTAKINGLY slow.  (It took over an hour to transwer @300,000 records).  I'm doing no transformations whatsoever.  In fact, the only reason I'm using the Data Flow component here is for its error tracking capabilities.

Here's a brief description-

1) The source is an OleDB datasource object that uses an OLEDB connection to access a SQL Server 2000 database.

2) The output from the source is dumped directly (no data transformations) into an OLEDB Destination Object (uses an OLEDB connection to access a View on a SQL Server 2005 database).  Individual row errors are pushed to a seperate logging table.

Based on the advice of an article I read, I removed the "OleDB Destination" object and used the records from the OLEDB source as the input to a RowCount Transformation.  This still took a SIGNIFICANT amount of time.  I'm guessing that my problem is with using an OleDB Source component????   That seems really strange though... wouldn't it be optimized?  What are my workaround options?

Any help is _much_ appreciated.

Thanks,

Jess

View Replies !   View Related
SSIS Dataflow Task Error
Hello,  to give you a background on where I'm coming from:

I have an SSIS Package with a global String variable that has an sql statement.  so it says something like:  "Select * from MyTable "
 
I than have a SQL Script Task where I append a WHERE Statement to my string. 
 
Than in the Dataflow Task when I select the source database, I run command from Variable. 
 
When I run the package I get an error that my string is too long.  My string is about 750 characters that I'm trying to pass through.
 
Is there some limitation to this?

I have ran the raw SQL Command in the SQL manager and it runs fine.  I have built a million of these packages, just not one with such a large string.
 
If it is the case that it is just too long, is there a work around to that?

Thanks,
Rusty.

View Replies !   View Related
How To Pass Parameters In SSIS Dataflow
I am  using a parameterized select query as displayed below to fetch values from source. 

SELECT     A.Account_GUID,
   M.Merchant_GUID,
   H.Household_GUID,
   B.BankAU_GUID,
   SR.SalesRep_GUID,
   E.Entitlement_GUID,  
   I.Income_GUID,
   Exp.Expense_GUID,
   SP.Sales_Product_GUID,
   P.Product_cd,
   SUM(S.Sales) AS Monthly_gross_MC_VI_amt,
   SUM(S.Sales) - SUM(S.[Returns]) AS Monthly_net_MC_VI_amt,
   SUM(S.SaleTxns) AS Monthly_gross_MC_VI_tran_cnt,
   SUM(S.SaleTxns) - SUM(S.ReturnTxns) AS Monthly_net_MC_VI_tran_cnt
FROM         Account AS A
   LEFT OUTER JOIN dbKAIExtract.dbo.tblSales_STG  AS S
    ON A.Account_No = S.AccountNo
    And S.BucketNo = ?    And S.ProductCode in ('01','02')
   LEFT OUTER JOIN Merchant AS M
    ON A.Account_No = M.Account_no
   INNER JOIN SalesRep AS SR
    ON SR.Rep_SSN = isnull(A.rep_SSN,'000000000')
   INNER JOIN Household AS H
    ON A.Account_No = H.Account_no
   LEFT OUTER JOIN BankAU AS B
    ON A.Assigned_AU = B.AU_No
   LEFT OUTER JOIN SalesProduct AS SP
    ON A.Account_No = SP.Account_no
    And SP.Reporting_Interval_Id = ?
   LEFT OUTER JOIN Entitlement AS E
    ON E.Account_no = A.Account_No
    AND SP.Product_Cd = E.Entitlement_Card_Type
   LEFT OUTER JOIN Income AS I
    ON I.Account_no = A.Account_No
    And I.Reporting_Interval_Id = ?
   LEFT OUTER JOIN Expense AS Exp
    ON Exp.Account_no = A.Account_No
    And EXP.Reporting_Interval_Id = ?
   LEFT OUTER JOIN Product AS P
    ON P.Product_cd = SP.Product_cd
WHERE     (A.current_ind = 1)
   AND (SR.current_ind = 1)
GROUP BY A.Account_GUID,
   M.Merchant_GUID,
   H.Household_GUID,
   B.BankAU_GUID,
   SR.SalesRep_GUID,
   E.Entitlement_GUID,
   I.Income_GUID,
                 Exp.Expense_GUID,
   SP.Sales_Product_GUID,
   P.Product_cd

My problem is, I am not able to assign any variables to parameterized query.  Can any body guide how to assign respective variables to the parameterized query.   I have the above query as a part of OLE DB Source step within Data flow task.

 

 

Thank you

Jatin

View Replies !   View Related
SSIS - DataFlow Performance (need Opinion)
Dear friends,

I need your feedback, tips and opinions to improve my dataflow described in my blog.

http://pedrocgd.blogspot.com/2007/07/ssis-dataflow-performance-i.html

Thanks!!

View Replies !   View Related
BIG SSIS PACKAGE (200 DATAFLOW TASKS)
Thanks in advance in reading this thread.



I have developed a big SSIS package to extract data from flat-files ( + 200 Dataflows ).

The situation is the following, inside de SSIS package, there are a lot of validations before extracting & loading the flat-files, i'm running this validations in paralell, so that when a file arrives, it enters the "validation process" and start extracting the file.

When i run the SSIS package from BIDS it works the way i have concepted it... but when i run the ssis in the server, the tables that are loaded through the process are only "available" when the SSIS PACKAGE ends, it is imperative that trough the process, when a table receives new data, it becomes ready, and don't just be available when the SSIS package finishes...

I have attached the an lousing .jpeg.

It is importart for the tables to be available, so the stored procedures(OUTSIDE SSIS PACKAGE) that are dependent of some tables, start working before the SSIS package Ends.


Thanks in Advance.

View Replies !   View Related
Matrix Subtotal Not Working Correctly - All Subtotals Except One Showing Correctly
this is driving me up the wall

source dataset columns
sales centre - sales person - dealid - deal amount - revenue type - revenue amount



one row represents a revenue type
one deal has one or more revenue types, but only 1 deal id and 1 deal amount
NULL sales centres and sales persons are being mapped to "UNASSIGNED" using ISNULL in the stored procthe groupings are as follows:
row groupings on: sales centre, sales person, dealid
column groupings on: revenue type

ALL sales centre/person groupings are showing the correct subtotal values for 'deal amount' except for the one called 'UNASSIGNED'

I have exported the report to xls and added up the individual 'deal amounts' for a row grouping and my figure is correct!

Every other group shows the correct subtotal!

Why is one grouping not coming out correctly? The COUNT of deals comes out correctly for all groups even UNASSIGNED so why is the deal amount failing?

This suuuuuuuuucks

View Replies !   View Related
SSIS Dataflow From Flat File To Excel
New to SSIS and dts. Stumbling along on this one, really looking for resources and help.

I have a flat file, i defined through connection manager

and (for now) a fixed destination excel file I defined in connection manager.

My dataflow, is pretty simple, mapping two fields to each other an amount field and a phone field in a flat file source and excel destinatinon.

the amount column is formated as a number in the excel, and a currency in the connection and both input output properies.

A few questions,

1. why do cells on the excel show up with that green wedge on the upper left? appears to be a formating issue.

2. in the flat file, my amount field does not have the decimal, what would be the best way to apply that? it's should be implied.

3.Everytime I test the SSIS package, it keeps appending to the excel (it actually does not even work right on the second run). What's the best way to have it write to a fresh file? have an ssis script task copy the file from an empty template?

4. Id like to remove the last row? what's the best way to do that?

Thanks for any help or information!

View Replies !   View Related
SSIS Dataflow Object Not Installed Properly... Help.
Hi Folks,

When I try to drag and drop the Multicast dataflow item onto the Data Flow design surface I get the error below.  I have uninstalled and reinstalled SQL Server 2005 to no avail.  By experimentation I have discovered that the following Data Flow Transformations raise this error as well:

DTSTransform.Aggregate.1
DTSTransform.Multicast.1
DTSTransform.Sort.1

Any thoughts, comments, or pointers?  I would really like this to work!

Thanks for your help,

D ;-)

 

ERROR MESSAGE BEGINS HERE:

===================================

The component could not be added to the Data Flow task.
Please verify that this component is properly installed. (Microsoft Visual Studio)

===================================

The data flow object "DTSTransform.Multicast.1" is not installed correctly on this computer. (Microsoft.DataTransformationServices.Design)

------------------------------
For help, click: http://go.microsoft.com/fwlink?ProdName=Microsoft%u00ae+Visual+Studio%u00ae+2005&ProdVer=8.0.50727.42&EvtSrc=Microsoft.DataTransformationServices.Design.SR&EvtID=PipelineObjectNotInstalled&LinkId=20476

------------------------------
Program Location:

   at Microsoft.DataTransformationServices.Design.DtsBasePackageDesigner.GetPipelineInfo(String creationName, IServiceProvider serviceProvider)
   at Microsoft.DataTransformationServices.Design.DesignUtils.GetNewPipelineComponentObjectName(IDTSComponentMetaDataCollection90 parentCollection, String clsid, IDTSComponentMetaData90 componentMetadata, PipelineComponentInfo& pipelineComponentInfo)
   at Microsoft.DataTransformationServices.Design.PipelineTaskDesigner.AddNewComponent(String clsid, Boolean throwOnError)

 

View Replies !   View Related
SSIS PACKAGE + 200 DataFlow Tasks && T-SQL Validations
Thanks in advance in reading this thread.

 

I have developed a big SSIS package to extract data from flat-files ( + 200 Dataflows ).

The situation is the following, inside de SSIS package, there are a lot of validations before extracting & loading the flat-files, i'm running this validations in paralell, so that when a file arrives, it enters the "validation process" and start extracting the file.

When i run the SSIS package from BIDS it works the way i have concepted it... but when i run the ssis in the server, the tables that are loaded through the process are only "available" when the SSIS PACKAGE ends, it is imperative that trough the process, when a table receives new data, it becomes ready, and don't just be available when the SSIS package finishes...

I have attached the an lousing .jpeg.

It is importart for the tables to be available, so the stored procedures(OUTSIDE SSIS PACKAGE) that are dependent of some tables, start working before the SSIS package Ends.


Thanks in Advance.

View Replies !   View Related
SQL 2k5 64bit SP2 SSIS MSaccess Dataflow Issue
 Hi All

This works fine in 2000 but not 2005

I was wondering if anyone had some ideas on the following issue I have with an SSIS package.

Have a very simple database which I want to pump information from a MSaccess db.   

task one truncate table
task two load info from MSaccess db

under connection manager
connection one to the database in question
connection two Native OLE DB Microsoft Jet 4.0 OLE DB provider  ( this goes to the MSaccess) test connection is fine.

dataflow task  
OLE DB Source  ( MSaccess connection can also preview table)
OLE DB Destination  ( database table )

upon execute of the SSIS

task one is fine
task two fails

when you read the execution results

[OLE DB Source [22]] Error: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "TRACKIT" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.

[DTS.Pipeline] Error: component "OLE DB Source" (22) failed validation and returned error code 0xC020801C.

[DTS.Pipeline] Error: One or more component failed validation.

[Connection manager "TRACKIT"] Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040154. An OLE DB record is available.  Source: "Microsoft OLE DB Service Components"  Hresult: 0x80040154  Description: "Class not registered".


Any ideas???

View Replies !   View Related
Which SSIS Dataflow Transformations Will Accomplish This Select Statement?
I'm trying to find if there is a combination of dataflow transformations that will produce the following result

 

SELECT 

   period,

   project,

   task,

   employee = CASE

      when empid in (SELECT DISTINCT empid FROM EmpTable) then empid

      else 'Deleted Employee'

   end

FROM ProjectTable

 

I know I can create a dataflow task with this query as a data source and then send it to a destination, but I was wondering if that is the best way to do it or if there was a better way to do this using the data transformations available in SSIS.

 

Any insight would be most appreciated.

 

Regards,

Bill Webster

 

View Replies !   View Related
SSIS Dataflow OLEDB Source Issue With DB2 Connection.
Hi,

I have problem to extract data from DB2 table using SSIS dataflow task with OLEDB source selecting the data access mode with command. Here is the scenario.(Note:If I select the data access mode as a table then it works fine.)

If I use the data access mode as SQL Command then it is not working. i.e. the flow stays yellow in controlflow nothing happens in dataflow and I noticed the SQL dumper and proc completes. I couldn't find any log to verify the issue including the package execution results.Any of your thoughts will help me to resolve this issue.

Thanks..Mako

View Replies !   View Related
SSIS DataFlow Task To Generate Custom Columns
Hi All,
 
I am using a Data Flow task which copies data from an Excel Source to a SQL Database Table Destination. From 15 columns I require only 10 columns to be imported to the DB Table. So I have mapped those colums. In SQL DB there is a colum called say X, whose value should be the "Remedy" for all the columns which are imported. Is there any task that can achieve it.
 
Please Help.

View Replies !   View Related
Execute A Query Inside Dataflow And Use The Fields Returned To Continue Dataflow... How?
Dear Friends,

I need to execute a SQL query, inside a dataflow (not in controlFlow) and need the records returned to continue the dataflow... In my case I cant use lookup and OLE DB COmmand and nothing else...

I need to execute a query and need the records for dataflow... with OLE DB command I cant see the fields returned... :-(

How can I do it? Using a script? Can I use a Script Component? That receive 2 parameters for input and give me the fields returned from query as output?

Thanks!!

View Replies !   View Related
How Should I Change The Source File Name Every Time During Dataflow Task Using Ssis
Hi,
    I am using SQL Server2005 for SSIS. I want to change the source connection dynamicaly evertime.
Let me clear, I have to extract some column from excel to MS-Access. I am using Data Flow Task and able to successfully complete the job. But problem is that, whenever a new file comes , i must have to reconfigure my Excel Source.
All the time column in file are same, so no need to worry about mapping but how can my package select a file automatically.
I have a directory, suppose "C:dpak". I should able to pick the filename and sheet name from this directory every time when my package will execute.

View Replies !   View Related
The Version Of Component &&"****&&" (11773) Is Not Compatible With This Version Of The DataFlow.
 

I started this thread as the last attempt to sort the issue out.
 
I have an SSIS package that loads data from a .csv file into my database. It works fine on my developer machine. I start it programmatically or from Management Studio or from Visual Studio, and it works. Then I deploy it to the MSDB database on the computer on which it will have its final place. There again I can start it from Management Studio or from Visual Studio (using the source file), and it works. But when I start it programmatically, it just fails telling me:
 
Package Warnings:
    Package Errors:
        The version of component "****" (11773) is not compatible with this version of the DataFlow.
        Component "component "Derived Column" (13627)" could not be created and returned error code 0x80070005. Make sure that the component is registered correctly.
        The component is missing, not registered, not upgradeable, or missing required interfaces. The contact information for this component is "Flat File Source;Microsoft Corporation;Microsoft SqlServer v9; (C) 2005 Microsoft Corporation; All Rights Reserved; http://www.microsoft.com/sql/support;1".
        component "Agreement File" (11773) failed validation and returned error code 0xC0048021.
        One or more component failed validation.
        There were errors during task validation.

Maybe the source of the problem is that this machine is a 64-bit one, while the developer machine is 32-bit one. But why does the package run fine when I start it from Management Studio?
 
Any help would be appreciated.
 
FMikee

View Replies !   View Related
Problems With The Query, &&"ResultSet&&" Property Not Set Correctly, Parameters Not Set Correctly, Or Connection Not Established Cor
 

I have the following query in an ExecuteSQL Task:
 
Insert Into Table2
Select * From Table1 Where Column1Val = '4'
 
 
As you can see, I don't need any parameters so I havent configured any. Also, there should not be any result set so I shouldnt need to configure a resultset parameter.
 
Why is the above query failing with
 
Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly

View Replies !   View Related
If-then-else-component In SSIS
Hi all,

i am not very experienced with the SSIS. I am just wondering if there is something like a "if-then-else"-componente like the foreach-component in SSIS.

I want to delete the values of all tables in one database. So I took a foreach-component and selected the smo-enumeration with all tables. I store the tablename in a variable and execute a sql-task with "delete table.." with the variable tablename as parameter. Now I want to delete all except one certain table. I would like to add a selection where the variable tablename is checked. If the tablename is this certain table, I don't want to execute the sql-command, else I want to excecute the delete-command.

Are there any suggestions?

Thank you very much

Joachim

View Replies !   View Related
SSIS SCRIPT COMPONENT
Hello,

My SSIS design: Source OLE DB -> Script Component -> Destination OLE DB

I have a script component that reads and proceeds each row in input. But I have no rows in output. How can you explain that ? with the viewer, I see the rows in input but in output, I have nothing after the script.
The script function: read the value of the ROW.column and flag like this :
ROW.columnout = TRUE (columnout is added in output columns)

What should I define at the component to retrieve the rows after the script component ?

Thanks !

View Replies !   View Related
XML Parser Component For SSIS?
Informatica has an XML parser component that allows me to read an xml file from a data source (Oracle Clob attribute in table in this case), parse it out in our mapping, and then transform the parsed date. 

Does anyone know if SSIS has similar functionality?


Flow:

DataSource --> XML Parser --> Expression Component (Transform) --> DataTarget

Thanks
Scott

View Replies !   View Related
SSIS Script Component
Dear all,
 
Such a pain, I know. Yesterday I did a couple of questions regarding transformation rows and very kindly I obtained answer (Thanks Jamie and Michael)
But now I face another stupid issue and is how to map source with destination columns inside Script Component Task.
On my Flat File Source I€™ve got defined thirteen columms (from Column0 till Column13); that€™s fine. And then, I€™ve got a sql table as destination with another names, of course€¦
 
Inputs and Outputs option from Script Component Editor leaf has been commited both (Input 0 and Output 0) but I wonder how the hell I€™m refer to them here:
 
Public Overrides Sub Input0_ProcessInputRow(ByVal Row As Input0Buffer)
 
**     snippet of old code sql2 to migrate€¦
 
        'If DTSSource("Col010") = "N" Then
        '       DTSDestination("ImpBase") = -1 * CDbl(DTSSource("Col011") / 100)
        'Else
        '       DTSDestination("ImpBase") = CDbl(DTSSource("Col011") / 100)
        'End I
 
 
 
        .Net Script
 
        If Row.Column10 = "N" Then
                  ¿??????????????
        End If
 
End Sub
 
Thanks a lot for your comments and thoughts,
Enric

View Replies !   View Related
SSIS Script Component
I have just migrated a DTS 2000 package
as an SSIS package.
one of the features that failed to migrate, was a transformation
that , selected 2 colums of data with a stored procedure,
file name, and full path of filename,
Then the file name only was written to a txt file,
Then there was an ActiveX transformation task that used the other
column (full file path) to copy said file to another location (specified as a global str variable eg \127.0.0.1directory..etc)

Now my question is this, with SSIS script task
can i save the path name (2nd column) to a variable and then
using this variable copy the file to another location (global str variable) ?
Is there a CopyFilefunction like there is in ActiveX ?

And can i add this script task along with the DATA FLOW ?
because if i add it outside the DF , it will only (im assuming) copy the last line (path) into the variable...

View Replies !   View Related

Copyright © 2005-08 www.BigResource.com, All rights reserved