SSIS Advantages

Jan 3, 2007

This may be too general a question but I'm going to ask it anyway.

I'm moving data from a source DB (say A) to a target DB (say B). On A I need to join 3 tables and, after some lookups etc., I need to populate several tables in B. Inserting into B's tables involves sequential operations because in many cases I have to get back the value of an Identity column to use as in input value in a another table 'downstream'. Additionally, the tables in B are populated as a group i.e. if the insert on any one fails the entire group's insertion needs to be rolled back.

I set up a set of stored procedures to do this. The master Stored Proc opens a read-only cursor and for each row of the cursor executes the other SPs in proper sequence. Some of the SPs are 'enclosed' within a transaction to enable a Rollback on the group.

My major concern with this approach was the 'known' inefficiency of the cursor and the huge memory requirement it's use would entail (the cursor would pull about 15 million rows).

So I began looking into SSIS thinking it would be able manage the system resources aspect effectively and offer better performance overall. I've realized, however, that even in SSIS I would essentially need to first pull the 14 mil rows into a memory-resident object (or a temp table - whose benefit I'm not convinced of or haven't fully understood) before looping through each row to perform the data inserts into B.

So, is there any real advantage to this over the first approach ? Perhaps I haven't looked deep enough or wide enough. Any constructive suggestions / feedback would be highly appreciated.

Thanks.

View 5 Replies


ADVERTISEMENT

What R The Advantages Of SQL 2k Over Sql 7

May 3, 2002

Hi,

I was looking for some information / papers giving the advantages of Sql 2k over sql7.

Thanks!

View 1 Replies View Related

Advantages Of SQL Server

Apr 20, 2004

hi ! my boss is thinking of redoing our accounting system which is currently running on FOXPRO - we are planning on a VB/SQL SERVER platform.but he isn't convinced that the benefits of SQL server outweigh those offered by FOXPRO especially since everyone in the office is very comfortable with Foxpro.Can anyone give me some solid advantages of SQL SErver or any other RDBMS over Foxpro ?

View 14 Replies View Related

Advantages Of SQL Express

Oct 4, 2006

Hi,

If I have an application that has at most 20 users with an average of 3-4 concurrent requests to the server and the databases size is 1 gig probably to grow to at most 1.5 gigs in the next 5 years why would I choose Express over MSDE?

MSDE can take advantage of more than 1 gig of memory and can use 2 CPUs. I really don't see any benefit whatsoever in my case to go to SQL Express, in fact all I see is drawbacks.

I hear about upgrading all over the place but I just don't see any good reason in my situation. Am I missing something here?

View 7 Replies View Related

Advantages Of Database Diagram

Jun 22, 2007

What is the advantages/disadvantages of using Database Diagram and link all the tables in MS SQL Server Management Studio versus letting the application check and link the different tables at run time? Currently, I do not have all my tables linked in a Database Diagram. I do everything at run time in my application code behind. What are the best practices? Which is easier or perhaps more secure?

View 4 Replies View Related

Advantages Of Sql Server 2005

Jun 20, 2008

Hi to all,                Can anybody tell me what are the main advantage's of sql server 2005 ? 

View 1 Replies View Related

Advantages Of Stored Procedures?

Aug 3, 2004

Hi,
Generally I write all my SQL in Stored Procedures instead of using adhoc queries. But I dont feel good about stored procedures when I come across situations like this.

Lets say that I have a stored procedure something like this

CREATE PROCEDURE dbo.proc_MYSP
@CaseID char(10)
AS
SELECT * FROM TABLE1WHERE CASEID = @CASEID

Suppose in future if the field CASEID is changed to char(20) then I need to change the declaration of CaseID in all my stored procedures that take CaseID as input parameter. If I write adhoc queries then I need not worry about this. Is there any effective solution for a situation like this.

Thank you.

View 5 Replies View Related

Article On Advantages Of Sql Server Over VFP

Oct 9, 2007

hi guys,

im new to sql server...

i am currently studying sql server 2000

i know this subject has been asked before...

i would just like to ask if you know some related articles regarding advantages of using sqlserver over vfp dbf/dbc?

i am going to discuss it to my class.

thanks very much!

any help is very much appreciated!

Joel

View 4 Replies View Related

Advantages And Disadvantages Of The Replication Ty

Feb 13, 2008

hi,
Can any body help me in knowing what are the advantages and disadvantages of all the three replication types?

View 1 Replies View Related

Advantages/Disadvantages To Using More Than One Database

Dec 18, 2006

I have a content site where everything is currently in one SQL ServerDB. As I add features to the site, for example message boards andblogging, does it make sense to put those features in a separatedatabase? What would I lose and gain in doing so? Thanks so much.Erik

View 3 Replies View Related

What Are Advantages Of Using Null Values In SQL?

Mar 11, 2008



Can I get answer of this ? with some of examples if it is possible.

View 2 Replies View Related

Advantages/Disadvantages B/w Being Consultant Vs Employee

Jul 12, 2000

Hi, I would appreicate your opinion/ feed back about Being consultant vs Being employee.

What are the advantages/disadvantages.
Does consultant makes more money than an employee and why so


Thanks for your response
Ali

View 2 Replies View Related

Advantages&&Disadvantages Logical Drives

Aug 5, 2005

Are they're any real disadvantages or advantages in having 1 massive disk partioned to create 2 logical drives (not including the C drive) and separating the SQL Database File & Transaction Log so that it doesnt reside on the same logical drive?

After all, it is still a single disk.

thanks.

View 3 Replies View Related

Multiple Devices For A Database - Advantages?

Nov 6, 1999

Just wondering - on a straight RAID 5 system is there any advantage, performance or otherwise, to splitting a SQL 6.5 database over multiple database devices? Or for simplicity's sake am I just further off creating a single device and manually extending it as the database grows?

Thanks
RM

View 1 Replies View Related

Advantages Of Changing Compatibility Level

Jun 12, 2008

Dear All,
what are the advantages of changing compatibility level from 80 to 90? are there any disadvantages doing this on production machine? will it take any downtime?
i've searched the google but i didnt get the correct info.

Arnav
Even you learn 1%, Learn it with 100% confidence.

View 2 Replies View Related

I Want To Know About Advantages And Disadvantages Of SQL Server 2005.

Nov 23, 2007

Please reply me as soon as possible.

View 4 Replies View Related

Advantages Of Reporting Services 2005

Sep 27, 2007



Hello,

I am working on the Reporting Services 2005, I don' know anything about Business Object.

Please let me know what are the advantages of Reporting Services 2005 over the Business Object.

Any specific link will be useful for me.

Thanks in advance.
Bye.

View 5 Replies View Related

SQL 2012 :: Advantages Over SERVER AlwaysOn Over Clustering

May 14, 2015

Give the Advantages Over SQL SERVER Always on over Clustering....

View 4 Replies View Related

Speed SQLExpressvs Access2003 Via Oledb??? Advantages???

Mar 19, 2008

I am trying to evaluate the pros and cons of using SQL Server over oledb connection to an access database.

So far



Pros Cons
Access: Doesnt need to be installed by user. 2GB Data limit

SQLExpress:
Not sure yet - more than 2gb data User has to install SQL Server compact.

Is there anything iv missed?

Iv run a quick test to decide on speed my results seem to suggest that oledb is faster at writing data, and SQL Server is faster at reading.

The test program clears the database:

and times how long it takes to insert 10000 records, the read the 10000 records back for OLEDB, then SQL Express.




Code Snippet
using System;
using System.Collections.Generic;
using System.Linq;
using System.Text;
using System.Data.OleDb;
using System.Data.SqlClient;
using System.Timers;
namespace ConsoleApplication1
{
class Program
{
static int a = 0;
static int b = 0;
static void Main(string[] args)
{

Timer tmr0 = new Timer(1);
Timer tmr1 = new Timer(1);
tmr1.Elapsed += new ElapsedEventHandler(tmr1_Elapsed);
OleDbConnection oledbcon = new OleDbConnection("Provider=Microsoft.Jet.OLEDB.4.0;Data Source=C:\database1.mdb");
oledbcon.Open();
OleDbCommand oledbcmd = new OleDbCommand("INSERT INTO Table1 (Can) VALUES ('1')",oledbcon);
oledbcmd.CommandText = "DELETE * FROM Table1";
oledbcmd.ExecuteNonQuery();
tmr0.Elapsed += new ElapsedEventHandler(tmr0_Elapsed);
tmr0.Enabled = true;
for (int i = 0; i < 10000; i++)
{
oledbcmd.CommandText = "INSERT INTO Table1 (Can) VALUES ('" + i.ToString() + "')";
oledbcmd.ExecuteNonQuery();
}
int aa = a;
a = 0;

oledbcmd.CommandText = "SELECT * FROM Table1";
OleDbDataReader oledbreader;
oledbreader = oledbcmd.ExecuteReader();
while (oledbreader.Read())
{
oledbreader.GetInt32(0);
}
tmr0.Enabled = false;
SqlConnection sqlcon = new SqlConnection("Data Source=localhost\SQLEXPRESS;Initial Catalog=;Integrated Security = SSPI");
sqlcon.Open();
SqlCommand sqlcmd = new SqlCommand("CREATE DATABASE Test",sqlcon);
try
{
sqlcmd.ExecuteNonQuery();
}
catch { }
sqlcmd.CommandText = "CREATE TABLE Table1 (num INT)";
try { sqlcmd.ExecuteNonQuery(); }
catch { }
sqlcmd.CommandText = "DELETE FROM Table1";
sqlcmd.ExecuteNonQuery();
tmr1.Enabled = true;
for (int i = 0; i < 10000; i++)
{
sqlcmd.CommandText = "INSERT INTO Table1 (num) VALUES ('" + i.ToString() + "')";
sqlcmd.ExecuteNonQuery();
}
int bb = b;
b = 0;
sqlcmd.CommandText = "SELECT * FROM Table1";
SqlDataReader sqlreader = sqlcmd.ExecuteReader();

while (sqlreader.Read())
{
sqlreader.GetInt32(0);
}
tmr1.Enabled = false;
Console.WriteLine("OLEDB");
Console.WriteLine("Inserted 10000 records in "+aa.ToString()+"ms");
Console.WriteLine("Read 10000 records in " + a.ToString() + "ms");
Console.WriteLine("TOTAL: " + ((a + aa).ToString()) + "ms");
Console.WriteLine("SQL SERVER");
Console.WriteLine("Inserted 10000 records in " + bb.ToString() + "ms");
Console.WriteLine("Read 10000 records in " + b.ToString() + "ms");
Console.WriteLine("TOTAL: " + ((b + bb).ToString()) + "ms");
Console.ReadKey();


}
static void tmr1_Elapsed(object sender, ElapsedEventArgs e)
{
b++;
}
static void tmr0_Elapsed(object sender, ElapsedEventArgs e)
{
a++;
}
}
}


For the access database create a access2003 mdb file with a table "Table1" and a colomn of type integer called "Can";

save it as C:database1.mdb

Then compile and run above.

My results wereslow machine)





OLEDB
Inserted 10000 records in 1512ms
Read 10000 records in 6ms
TOTAL: 1518ms
SQL SERVER
Inserted 10000 records in 1853ms
Read 10000 records in 1ms
TOTAL: 1854ms



Does this

View 2 Replies View Related

Olap Mining - Advantages, Disadvantages And Problems

Jan 19, 2007

Dear Sirs and Madams,

it's quite hard to find informations about OLAP mining I think. So I have some questions to you:

What advantages do I have by using Olap Mining instead of "normal" mining (relational databases)?
Is it just faster or are there other advantages?

What are the disadvantages? The data can be overaggregated (no detailled results), can not? Are there other disadvantages?

What problem do I have to face?

Whats going on with empty cells?

Thank you very much in advance and have a nice weekend.

Thorsten

View 1 Replies View Related

Advantages Of Using Nonclustered Index After Using Clustered Index On One Table

Jul 3, 2006

Hi everyone,
When we create a clustered index firstly, and then is it advantageous to create another index which is nonclustered ??
In my opinion, yes it is. Because, since we use clustered index first, our rows are sorted and so while using nonclustered index on this data file, finding adress of the record on this sorted data is really easier than finding adress of the record on unsorted data, is not it ??

Thanks

View 4 Replies View Related

Advantages Of Using CRL Sprocs Over T-SQL Sprocs?

Apr 23, 2006

I am wondering what the advantages of using CRL Sprocs over T-SQL sprocs and what not.

Looking for such comparison and articles on websites resulted in only "how to create CRL sprocs" but none of them were talking about what they are used for in what situations.

I would really appreciate it if you guys can post comments, links and external articles.

Thank you in advance.

View 1 Replies View Related

Running Ssis Package With Ssis Run Time Compoenents And Sql Server 2000...

Jan 22, 2007

running ssis package with ssis run time compoenents and sql server 2000...

Is it possible to run ssis packages that point to servers on sql server 2000
without installing sql server 2005 ?

Can we just install runtime for ssis and run the packages ?

Please explian with links if possible

thanks a lot

View 18 Replies View Related

Integration Services :: Executing Child SSIS Package In Parent SSIS

Oct 9, 2015

I want to achieve the following in (SSIS/SSDT for SQL 2012) - 

I have a generic SSIS package which simply sends out email notifications using SMTP email task (this package is within its own project, and has project level input parameters).

I need to be able to call this package in the Event handler section of every package (numbering in about less than 60) that we have. These packages are within their own respective projects.

I thought I could use the "execute package task", but it turns out , using this, I cannot call a package that is part of some other project. I also cannot call a package that is stored in the CATALOG. Is there any way I can do this ?

When I call the child package , I should be able to send in parameters like - error information and package name of the Parent package.

View 8 Replies View Related

SSIS Called From Agent Job Not Calling New Child SSIS Package Addition

Oct 29, 2007

I have an SSIS package (TransAgentMaster) that I recently modified to include a call to a child package via the file system. The child package creates a text file. When I run the package in dev studio then the child package/text file is produced.

I then imported the TransAgentMaster as a stored packagesfilesystem package into SQL SSIS and executed the package. The child package produced the text file.

I then ran the SQL Server Agent to see if the child package would work and it did not generate the text file. Thus after updating a SSIS package importing the package into SSIS the job that calls the package will not call the child package. Please not that the TransAgentMaster package calls 7 children packages €¦ just not my new one.


Any thoughts why the agent will not run the child newly crated childe package?

View 3 Replies View Related

Could Not Serialize The SSIS Runtime Objects When Attempting To Copy Tasks Created By SSIS Wizard

Jul 11, 2007

Run the SSIS import/export wizard.

(xls -> sql table)

Select the tasks created.

Copy.



Here is the error that occurs.



p.s. Does anyone have any needles I can borrow? I think sticking them in my eyes would be nicer than working with SSIS.





===================================

An error occurred while objects were being copied. SSIS Designer could not serialize the SSIS runtime objects. (Microsoft Visual Studio)

===================================

Could not copy object 'Preparation SQL Task' to the clipboard.
(Microsoft.DataTransformationServices.Design)

------------------------------
For help, click: http://go.microsoft.com/fwlink?ProdName=Microsoft%u00ae+Visual+Studio%u00ae+2005&ProdVer=8.0.50727.762&EvtSrc=Microsoft.DataTransformationServices.Design.SR&EvtID=SerializeComponentsFailed&LinkId=20476

------------------------------
Program Location:

at Microsoft.DataTransformationServices.Design.DtsClipboardCommandHelper.SerializeRuntimeObjects(ICollection logicalObjects)
at Microsoft.DataTransformationServices.Design.ControlFlowClipboardCommandHelper.InternalMenuCopy(MenuCommand sender, CommandHandlingArgs args)

===================================

Invalid access to memory location. (Exception from HRESULT: 0x800703E6) (Microsoft.SqlServer.ManagedDTS)

------------------------------
Program Location:

at Microsoft.SqlServer.Dts.Runtime.PersistImpl.SaveToXML(XmlDocument& doc, XmlNode node, IDTSEvents events)
at Microsoft.SqlServer.Dts.Runtime.DtsContainer.SaveToXML(XmlDocument& doc, XmlNode node, IDTSEvents events)
at Microsoft.DataTransformationServices.Design.DtsClipboardCommandHelper.SerializeRuntimeObjects(ICollection logicalObjects)

View 14 Replies View Related

SSIS: Excel Import: SSIS Not Reading Dates

Apr 26, 2008

Hi. I need to import excel file in database. i first need to do an unpivot task. the column names are dates and SSIS seems to be unable to pick up the column name as it is replaced by F2 F3 F4etc Can you advise of a solution. thanks ken

View 1 Replies View Related

Source Code For The Standard SSIS Components That Come With SSIS?

Jun 2, 2006

Hi,

I'm finding that the standard components often just don't quite meet my
needs, but would only need some fairly minor changes to save me and my team a lot of
work (and produce more elegant solutions). So I was just wondering whether the source code was available for the standard components that come with SSIS, or if there is anyway to extend their functionality?
Or do you just have to start form scratch?

Thanks,
Lawrie

View 4 Replies View Related

Use Of SSIS In Reading And XSL File. Should I Use SSIS Or Just Straight C#

Aug 1, 2007

I need to build an asp.net/C# application to read values from an Excel spreadsheet. Once the values are read from the spreadsheet, the C# code will do some elementary statistics on the values read. Then the values read and their computations will be written to a sql server database.
My manager suggested that SSIS might be a good candidate technology for doing this type of work. Does that sound correct? My only hesitation with using SSIS is that I want to keep the application as simple as possible, so that the code can be more portable. Maybe might argument is not a good one, but maybe someone can help me out here.
Ralph

View 1 Replies View Related

Ssis Select From Ssis User Table

Apr 11, 2008

Hi,
I have two variables
1. strStatement datatype (string)
2. objTable object (user tables)

the string strStatment returns a dataset
and is assigned to objTable.

I want write the data from objTable to a sql table
and it seems not to work.

Here is what I did.
I used data flow task to either select from a a string or objectTable.
but it give me an error.

View 1 Replies View Related

SSIS - Get ServerName From A XML Or TXT File Into SSIS Package

Jan 4, 2008

Dear Friends,
I store several configurations in the main database of my SSIS packages. I need to get the servername from a xml or txt file in order to get those configurations stored in my database.
How you think is the better way to do that?
Using a FlatFileSource to read the file and a script to save the value into a SSIS variable?
Using the package configuration I cant do that... maybe I dont know, but I can save the SSIS variale in the configuration file, but what I need is to do the inverse, read the configuration file and save the value in the SSIS variable.
How the best way you suggest?!
Regards!!
Thanks.

View 18 Replies View Related

Execute SSIS Package Without SSIS Console

Jul 25, 2005

Hello,

View 13 Replies View Related

Convert SSIS 2008 To SSIS 2005

Apr 22, 2008

We have SQL 2008 in development but only SQL 2005 in production. I have an SSIS package that was created in 2008 but need to deploy it to a SQL 2005 server. The '05 server will not import the package because of its version. Is there a way to convert back or 'save as' SSIS '05?

View 6 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved