Tracking Forums, Newsgroups, Maling Lists
Home Scripts Tutorials Tracker Forums
  Advanced Search
  HOME    TRACKER    MS SQL Server






SuperbHosting.net & Arvixe.com have generously sponsored dedicated servers and web hosting to ensure a reliable and scalable dedicated hosting solution for BigResource.com.







The Flat File Parser Does Not Support Embedding Text Qualifier In Data


i am unable to use the Text Qualifer in SSIS package Flat file connection manager Editor, it says, "The flat file parser does not support embedding text qualifier in data",why is that?

it was supported nicely in DTS 2000. also I have no control on Source file TXT. so I can not eliminate the Text qualifer (") from the file.

any advices.


View Complete Forum Thread with Replies
Sponsored Links:

Related Messages:
Export To Flat File - Text Qualifier Problem
I'm exporting using a query to a flat .txt file. The problem I'm encountering is when I export the data and then open the .txt file into excel some columns cause line breaks to the next row. The columns that are breaking to a new row are varchar fields where the user has entered text into the field with double quotes ".

When I export, I'm using row delimiter {CR}{LF} column delimiter Comma and text qualifier Double Quote (")

Is there a way to prevent this from happening when I export and open the flat file into Excel?

I tried using replace, but I was getting a syntax error in my query. Here is the query without using replace:

SELECT e.session_date, l.lab_no, i.first_name + ' ' + i.last_name AS Teacher,
tt.name, d.district_name, s.school_name, t.title, a.q1 AS Question1, a.q2 AS Question2,
a.q3 AS Question3, a.q4 AS Question4, a.q5 AS Question5, a.q6 AS Question6, a.q7 AS Question7,
a.q8 AS Question8, a.q9 AS Question9, a.q10 AS Question10
FROM evaluation e
LEFT OUTER JOIN training t ON t.id = e.training
LEFT OUTER JOIN lab l ON l.id = e.lab_no
LEFT OUTER JOIN instructor i ON i.id = e.instructor
LEFT OUTER JOIN trainee tt ON tt.id = e.trainee
LEFT OUTER JOIN district d ON d.id = e.district
LEFT OUTER JOIN school s ON s.id = e.school
LEFT OUTER JOIN answers a ON a.id = e.answers
WHERE session_date >= '20070401' AND session_date < '20070501'

I would need to use the replace on columns a.q7, a.q8, a.q9, and a.q10

I tried using another delimiter...pipes (|) and that didn't work? Maybe I was attempting it incorrectly?

Thanks in advance for any help.

View Replies !   View Related
Text Qualifier In SSIS Designer For Flat File Source


Unlike SQL Server 2000 DTS, SSIS Flat File Connection Manager Editor does not provide available list of Text qualifier,

i tried

-- ""
-- double quote {"}
-- "
--{"}

but none of them worked....!
My file sample looks like this

"Col1","Col2"
"1234","3456"
"3456","1234"

what qualifier should I use then?

Many Thanks,


View Replies !   View Related
SSIS Flat File Text Qualifier Only Works On Some Machines!
I have made a package that reads a text file into a table.

The data in the file is roughly as follows.


1, "a", "b,c,ddddd", 4, "ee", 0 with the column sizes int, 1, 50, int, 2, int

On all the desktop Bids environmentsand a SQL 2005 instance on windows server 2000 the package runs fine.

on the 2 Windows server 2003/SQL 2005 machines a truncation error occurs on col 5.

What is happening is on these machines the text qualifier is being ignored and column 5 is reading as ddddd instead of ee!

I figured this out by changing all fields to text and seeing what came out of the other end.

It is very, very strange and I've hit a brick wall.

If Anyone has any ideas throw them in the mixer please?

Cheers,

Steve

View Replies !   View Related
Error With Text Qualifier In Qualified Field During Flat File Import


We have a flat file import proces which imports data from a series of unicode flat files.

The files have text qualifiers and are being imported to a table withthe following format:
CREATE TABLE [dsa].[OBS](
[Kundenummer] [nvarchar](10) NULL,
[Navn] [nvarchar](60) NULL,
[Adresse] [nvarchar](50) NULL,
[PostnrBynavn] [nvarchar](50) NULL,
[Kursusdato] [datetime] NULL,
[Varighed] [decimal](18, 2) NULL,
[Kursustype] [nvarchar](100) NULL,
[Risikokoder] [nvarchar](50) NULL
) ON [PRIMARY]

In one of our files we havetwo rows that looks like this:
"19298529";"THIS IS ROW 1";"ADDRESS 9 -13";"4200 SLAGELSE";"02-05-2006";8.00;"Kombikursus Førstehjælp - Brand 8 lek.";"37"
"19448242";"THIS IS ROW 2";"ADDRESS 50";"4140 BORUP";"04-05-2006";4.00;""Fra vil selv - til kan selv". Om børn 1 - 3 år";"22"


Both rowsare OK according to the format, but the second row actually contains the text qualifier in one of the qualified fields (""Fra vil selv - til kan selv". Om børn 1 - 3 år"). It's thetitle of a course with a comment.
The procesfails on this file, and wont even redirect the row, as it does onother erroneous rows inother files we import.

We believe this is a valid text, but apparently SSIS doesn't
Is this a bug or is this record not allowed?
Is there a work around, and why wont SSIS redirect the row?

We believe the reason is that the field before is not text quaified (which is of course specified in the connection manager).

Thanks in advance,

Lasse

View Replies !   View Related
Text Qualifier Appears Around Numeric Fields When Using Import/Export Wizard To Create Flat Files
When I select a text qualifier when creating a flat file using the Import/Export wizard in SQL server 2005, (usually "'s in a table delimited file) it puts them around all fields, including the numeric ones (floats, decimal, ect). We used to useSQL server2000 to create these text files, where it only put the text qualifiers around text fields, and the output is going to a mainframe system that is very picky about the inputs. Is there any option to force 2005 to only use the text qualifier on text fields?

View Replies !   View Related
Flat File Source Custom Property Multiple File Support Not Found Problem
Dear All,

i face a problem ,

i talk a look on a sample Package that microsoft offer as an example in SSIS(http://msdn2.microsoft.com/en-us/library/ms161558.aspx) and i face a strange thing the Flat File Source in the sample example has Custom Property named Multiplefilesupport is exist on the sample

but when i try to build that same package and drag the Flat File Source component this custom property doesn't exist



,i wonder why it doesnt appear to me and it appear in the sample example ,

can any one help



best wishes to you all

Karim Khalifa

View Replies !   View Related
SSIS Data Flow Task Fails To Load All Text From Flat File
Hi Guys,

I
have a flat file which is loaded into the database on a daily basis.
The file contains rows of strings which I load into a table,
specifically to a column of length 8000.

The string has a length of 690, but the format is like 'xxxxxx xx xx..'
and so on, where 'xxxx' represents data. So there are spaces, etc present in the middle.

Previously
I used SQL 2000 DTS to load the files in, and it was just a Column
Transformation with the Col001 from the text file loading straight to
my table column. After the load, if I select len(col) it gives me 750
for all rows.

Once I started to migrate this to SSIS, I
allocated the Control Flow Task and specified the flat file source and
the oledb destination, and gave the output column a type of String and
output column width of 8000. But when I run the data flow task it
copies only 181 or 231 characters out of the 750 required.
I feel it stops where it finds the SPACES and skips the rest.

I
specified row delimiters or CR, and LF. I checked the file under
UltraEdit and there were no special characters in the file that would
cause the problem.

Any suggestions how I can get it to load the full data?

Thanks

View Replies !   View Related
Problems Importing Text Files With Double-quotes As Text Qualifier
I have text data files from a third party and they use comma as field delimiters and enclose the text for each column in double-quotes. Not a problem for most of the data files until they start sending files where there is " within the column values. SSIS package fails with the error:

The column delimiter for column "Column 1" was not found.

Any ideas on how to resolve this issue will be greatly appreciated.Thankspcp

View Replies !   View Related
Read Text File From Flat File Connection Manager SSIS
Hello Experts,
I am createing onetask (user control) in SSIS. I have property grid in my GUI and 2 buttons (OK & Cancle).
PropertyGrid has Properties like SourceConnection, OutputConnection etc....right now I am able to populate Connections in list box next to Source and Output Property.

Now my question to you guys is depending on Source Connection it should read that text file associated with connection manager. After validation it should pick header (first line of text file bases on record type) and write it into new file when task is executed. I have following code for your reference. Please let me know I am going in right direction or not..
What should go here ?
->Under Class A

public override DTSExecResult Execute(Connections connections, VariableDispenser variableDispenser, IDTSComponentEvents componentEvents, IDTSLogging log, object transaction)

{

//Some code to read file and write it into new file

return DTSExecResult.Success;

}


public const string Property_Task = "CustomErrorControl";

public const string Property_SourceConnection = "SourceConnection";



public void LoadFromXML(XmlElement node, IDTSInfoEvents infoEvents)

{

if (node.Name != Property_Task)

{

throw new Exception(String.Format("Invalid task element '{0}' in LoadFromXML.", node.Name));

}

else

{

try

{



_sourceConnectionId = node.Attributes.GetNamedItem(Property_SourceConnection).Value;



}

catch (Exception ex)

{

infoEvents.FireError(0, "LoadFromXML", ex.Message, "", 0);

}

}

}

public void SaveToXML(XmlDocument doc, IDTSInfoEvents infoEvents)

{

try

{

// // Create Task Element

XmlElement taskElement = doc.CreateElement("", Property_Task, "");

doc.AppendChild(taskElement);

// // Save source FileConnection

XmlAttribute sourcefileAttribute = doc.CreateAttribute(Property_SourceConnection);

sourcefileAttribute.Value = _sourceConnectionId;

taskElement.Attributes.Append(sourcefileAttribute);

}

catch (Exception ex)

{

infoEvents.FireError(0, "SaveXML", ex.Message, "", 0);

}

}

In UI Class there is OK Click event.

private void btnOK_Click(object sender, EventArgs e)

{

try

{



_taskHost.Properties[CustomErrorControl.Property_SourceConnection].SetValue(_taskHost, propertyGrid1.Text);

btnOK.DialogResult = DialogResult.OK;

}

catch (Exception ex)

{

Console.WriteLine(ex);

}

#endregion

}

View Replies !   View Related
Export Stored Procedure To Flat File And Add Aggregate To End Of The Text File?
What is the easiest way to accomplish this task with SSIS?

Basically I have a stored procedure that unions multiple queries between databases. I need to be able to export this to a text file on a daily basis and add a total records: row to the end of the text file.

Thanks in advance for any help.

View Replies !   View Related
Text Qualifier
Hi,
Using SSIS, I am importing the data of a text file into a sql server table.
After the import, I Can not figure out why the texts inside the sql server have double quotes around them. This is similar to the data inside the text file. For example, the value "Simpsons" appears with the "" as you can see whereas I want it to appear without the "" inside the sql server table.
In the connection manager, the file connection has a text qualifier of <None>

Thanks

View Replies !   View Related
Import And Text Qualifier
Hi

How can I import txt files, in which data sometimes can contain
the letter that is used as text qualifier

Example txt file: 'abc',123, 'john's',12

Here the word -john's- contains the same letter as the text qualifier I have to use.

Can it be true, that this can't be done i MS SQL, when it can be done in MS Excel, Paradox etc..

Regards
Carsten H.

View Replies !   View Related
Text Qualifier Hell
Hi all,

I'm trying to use DTS to import a space delimited file. One column uses " as a text qualifier so I set this in the options. The problem arises when a " shows up between the 2 text qualifiers. It's seen as a set of qualifiers with a 2nd qualifier with no end. I obviously get an error at this point. Anyone have any good advice on how to squash this one?

View Replies !   View Related
Text Qualifier {&&"} Not Working
I have installed Standard SQL 2005. I have a problem to import text file in db because of text qualifier {"} not working.

Does anyone have the same problem? Is it a problem in my installation?

Thanks for ant comments.



Jian

View Replies !   View Related
Exportting To A Flat Text File
Hi, I need to export data from my sql server to a flat text file.

using select I only have the options of delimmited or column aligned, in either case the output file is unicode encoded. I need an ASNI encoded file.

I can create a non Unicode file if I use Import/Export but then the file does not have CR/LF or enf of record mark which I need.

Is there a way to export a flat text file without unicodes and with CR/LF or enf of record mark ?

I was looking into bcp, but I can't seem to find a good sample for this.

thank you

Alan

View Replies !   View Related
Exportting To A Flat Text File
I sql server 2005, I need to export to a fixed width text file.

I can do this using import/export wizard, but my output file does not a CR/LF or end of record marker. There is no option to add this. my main reason for using the wizard is because I need to export the file without unicodes, and I can't seam to find any other way. any options?

thanks!

Alan

View Replies !   View Related
Writing Text To A Flat File
I have a Foreach loop which scans a table, and gets names of a bunch of procedures, and then back in the foreach loop, they get executed. Im trying to figure out how I can create a sort of log file to say the name of the procedure that is getting executed currently and the current date time stamp onto a flat file. I havent been able to figure this out yet..anyone know how to do this? I grab the names of the storedprocedures from the table and store it in a variable and use the name from the variable to actually execute the stored procedure.

I guess in essence, the question is how do i directly write lines of 'text' (from say a variable) into a flat file.

View Replies !   View Related
Problem With Text Qualifier In SSIS Package
Hello there,

I have created a package which will copy rows from csv file to SQL database. I have a field into the csv file which contains numeric data. and I am keeping this into the database as numeric too. for example, a column into the csv named "amount" needs to be transfer into the data table where the corresponding column name is "amount" and its data type is numeric and the field can contain null values. I am using the double quote(")text qualifier on to the csv file. Now my problem is, some rows into the csv file contains null values for amount column. for example..lets take a look on my csv file content...

"Name", "Salary"

"Jhon Stuart", "35.66"

"Maria Gree", ""



Notice the second row of the csv where the Salary value has left as an empty string. Now my intention is to import these data into the database and the salary value for Maria should be remain as null. But the package is generating an error for this row. it says..

There was an error with input column "Salary" (61) on input "OleDB Destination Input (47)" . The column status returned was : The value could not be converted because of potential loss of data.



Can any body help me on this? What would be the solution for this? if I modify the row into csv file as following

"Maria Gree", "0.00"

then it works. But I dont want to fill the field with zero into the DB. I want it would be set with NULL value..which make sense.

Any Idea?

Thanks in advance.





View Replies !   View Related
Transfering A Flat Text File In DTS To SQL Server
How do I tranfer a flat file (text) to SQL Server using DTS? Please point me in the right direction.

View Replies !   View Related
SSIS Text Qualifier Problem With Bulk Insert - Please Help
I have created an SSIS package, in my VS2005 solution, that Bulk Inserts a CSV file (see example below) 
"100",2006-10-03 00:00:00,"HEX012",1"101",2006-10-03 00:00:00,"DS00130",1
 
I have a Bulk Insert Task that uses a Flat File Connection Manager to import my CSV file into my SQL2005 database.
My source CSV file (see example above), has double quatation marks surrounding any text fileds.
I have set the Flat File Connection Manager's 'Text Qualifier' to double quatation marks.
The Bulk Insert works ok, but ignores the Text Qualifier.
My database table is left with the original quatation marks in any text field.
Any help appreciated.
 Regards,
Paul.

View Replies !   View Related
How To Load A Flat Text File Into MSDE / SQL Server
Hi!

How do I load a comma-delimited text file into MSDE? How does it work for SQL Server 7?

Thanks,
Helmut

View Replies !   View Related
How To Load A Flat Text File Into MSDE / SQL Server
Hi!

How do I load a comma-delimited text file into MSDE? How does it work for SQL Server 7?

Thanks,
Helmut

View Replies !   View Related
Reading Past CR-LF In Flat File Text Input
Hi,



I'm wondering if there is any way to get SSIS to notice, in the Flat File Source,that a "Ragged right" text input file has a record that is too short to populate all the specified columns.



I am reading data from a file that is supposed to be fixed length records, but record 193,591 (out of approx. 500,000) is 20 bytes short of the fixed length (60 bytes). So I changed the input to "ragged right" and found that I can thereby continue to read the file, and load the data (after setting the "maximum errors" to a number greater than the initial "1"). (Without this change to "ragged right", every record after the bad one was "out of synch" with the column arrangement -- so they never made it into the database table destination.)



But the "failures" I am now getting are during the Data Conversion step, when I try to convert some columns to integers (from text, in the input stream). And by looking at the data with a "Redirect Row" setting for the Data Conversion step, I am able to see that the Flat File Source is reading "right past the end of the row."



Is there a way to get the Flat File Source to honor the CR-LF record terminator, and decide that some text columns should contain "nothing" (NULL or zero-length strings), rather than the bytes that contain the CR-LF and the initial text from the next record? Can this somehow be noticed as an error condition?



Dan

View Replies !   View Related
Dynamic Text Parser?
Hi Guys,

I have a script task that is supposed to read and parse a fixed width source file.

Basically, I want to make the FieldWidths dynamic so that I'll be able to reuse this package with different files. So Instead of hardcoding the field widths directly into my script task, I want it to be stored somewhere that the package can get when executions starts. Is there a way of doing this?

The code looks like this:



Using Reader As New TextFieldParser(mTempFilePAth)

Reader.TextFieldType = FieldType.FixedWidth

Reader.SetFieldWidths(1, 8, 8, 8, 4, 8) <-- I want to change this to handle dynamic widths.



View Replies !   View Related
Inserting A Control Record Into A Flat Text File Through SSIS
I am working on an SSIS project where I create two flat files for submission to a data contractor. This contractor requires a control record be the first line in the file. I create the control record based on the table information being exported.

What I would like to know is, is it possible to utilize the Header Section of the Flat File Destination Editor to insert the control record? And, as it is dynamic, what kind of coding must I do in order to utlise this functionality?

Thanks.



View Replies !   View Related
How To Export To A Fixed Width Flat Text File With Row Delimiters?
We're having issues exporting a set of data from SQL to a fixed width flat text file by just doing a right click on the DB, then choosing Tasks > Export Data. You can not specify a row delimiter when you choose a Fixed Width format. The only way around this that we've found is to specificy char(13) and char(10) at the end of the SQL select statement. Without row delimiters you end up with 1 giant record rather than 20,000 regular sized records. Is there any other way around this thatwe're missing?


Using Ragged Right is not an option either since the record lengths will be inconsistent if the last field doesn't contain a consistent length to the data.


Thanks,
Mike


View Replies !   View Related
Regex Parser Text Field
I have a text field that contains abstract information formated inHTML, I'd like strip the HTML and insert the data in another Textfield within a DTS package. Is this possible?any suggestions would be appreciatedMatt

View Replies !   View Related
How To Load A Flat Text File With Packed Decimal Field To A Sql Table
i have this flat text file that has a number of packed decimal
field type. How do I load that text file into a sql table.

thanks

View Replies !   View Related
Loading Flat File With Embedded Column, Text Delimiters And Newline
I have the misfortune of converting a DTS package to SSIS that loads a flat file that has a text fields that can contain embedded text delimiters ("), column delimiters (,) and even new lines (CR+LF i.e.,hex 0D 0A) in it. A sample line from the file is posted here, remember this is just one line though it shows as three lines, since the third field has embedded new line in it:



4,"Sam","EVP; MARKETING PRODUCT MANAGER ""Level I"",
Internet Sales / HELP
8005551212",100



If you open in excel it handles it perfectly showing four fields, as below, and this is what I want ( I cannot get it aligned right in the posting, just save the above line in *.csv and open to see what it should be):



4Sam"EVP; MARKETING PRODUCT MANAGER ""Level I"",100
Internet Sales / HELP
8005551212"



Now, SSIS errors on the embedded text delimiters and breaks into two or three lines based on which option I chose. I have tried few options based on postings in the forum:
a). Using undouble and undoubleout: Does not work when there are embedded column delimiters (,) in the text field
b). Modified undouble script posted by lvovg at http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=1718225&SiteID=1. Handles the embedded column delimiters (,) perfectly, but the embedded new lines (CR+LF i.e.,hex 0D 0A) are breaking it.
Since, I am using the ragged right format to read from the file then use transform script on the line by lvovg, the line is already broken by the ragged right format at the embedded new lines, hence does not work.



Right now I am stuck. Can someone please help (anyone from MS) ? I am already baffled at the amount of coding required to convert a very basic ( and working ) flat file load DTS package to SSIS. I am willing to persist bit longer to convert this to SSIS, before I give up and stick with DTS and wait for a fix / workaround.




Thanks.



View Replies !   View Related
Unable To Edit Pre-defined Flat File Connection Manager Properties In The Flat File Destination Editor
Hi,

I am testing SSIS and have created a Flat File Destination. I defined the Flat File Connection as New for the first time and it worked fine. Now, I would like to go back and modify the Flat File Connection in the Flat File Destination Editor, but it allows only to create a New connection rather allowing me to edit the existing one. For testing, I can go back and create a new connection, but if my connection had 50-100 columns then it would be an issue to re-create it from scratch.

Did someone else faced this issue?


Thanks,
AQ

View Replies !   View Related
SSIS - Data Flow To Flat File - Insert At Start Of File
Hi all,

In a foreachloop, I am inserting records into a flat file which is working fine. But the thing is that as the file grows, it takes longer for it to locate the EOF(End of File) of the flat file so as to insert the records.

I have around 70-100 lines written to the file at each loop and there are more than 20k records to be looped. wihich means that at the end I should be having 1400k - 20000k line in the text file.


One solution would be to insert the records at the start of the file itself so that it does not has to lookup the EOF each time before writting.

Another would be to generate separate files and then merge it.

Any idea how canthis canbe done?


Beside this I have to zip the file and then SFTP to a given address.

Any suggestion or help would be welcome.


Rdgs

David





View Replies !   View Related
How Do I Insert Data From A Flat File Or .csv File Into An Existing SQL Database???


How do I insert data from a flat file or .csv file into an existing SQL database???

Here what I've come up with thus far and I but it doesn't work. Can someone please help? Let me know if there is a better wway to do this... Idealy I'd like to write straight to the sql database and skip the datset all together...

strSvr = "vkrerftg"

StrDb = "Test_DB"

'connection String

strCon = "Server=" & strSvr & ";database=" & StrDb & "; integrated security=SSPI;"

Dim dbconn As New SqlConnection(strCon)

Dim da As New SqlDataAdapter()

Dim insertComm As New SqlCommand("INSERT INTO [Test_DB_RMS].[dbo].[AIR_Ouput] ([Event], [Year], [Contract Loss],[Company Loss], " & _

"[IndInsured Loss Prop],[IndInsured Loss WC],[Event Info]) " & _

"VALUES (@Event, @Year, @ConLoss, @CompLoss, @IndLossProp, @IndLossWC, @eventsInfo)", dbconn)

insertComm.Parameters.Add("@Event", SqlDbType.Int, 4, "Event")

insertComm.Parameters.Add("@Year", SqlDbType.Float, 4, "Year")

insertComm.Parameters.Add("@ConLoss", SqlDbType.Float, 4, "Contract Loss")

insertComm.Parameters.Add("@CompLoss", SqlDbType.Float, 4, "Company Loss")

insertComm.Parameters.Add("@IndLossProp", SqlDbType.Float, 4, "IndInsured Loss Prop")

insertComm.Parameters.Add("@IndLossWC", SqlDbType.Float, 4, "IndInsured Loss WC")

insertComm.Parameters.Add("@eventsInfo", SqlDbType.NVarChar, 255, "Event Info")

da.InsertCommand = insertComm

Dim upComm As New SqlCommand("UPDATE [Test_DB_RMS].[dbo].[AIR_Ouput] " & _

"SET [Event] = @Event " & _

",[Year] = @Year " & _

",[Contract Loss] = @ConLoss " & _

",[Company Loss] = @CompLoss " & _

",[IndInsured Loss Prop] = @IndLossProp " & _

",[IndInsured Loss WC] = @IndLossWC " & _

",[Event Info] = @EventInfo", dbconn)

upComm.Parameters.Add("@Event", SqlDbType.Int, 4, "Event")

upComm.Parameters.Add("@Year", SqlDbType.Float, 4, "Year")

upComm.Parameters.Add("@ConLoss", SqlDbType.Float, 4, "Contract Loss")

upComm.Parameters.Add("@CompLoss", SqlDbType.Float, 4, "Company Loss")

upComm.Parameters.Add("@IndLossProp", SqlDbType.Float, 4, "IndInsured Loss Prop")

upComm.Parameters.Add("@IndLossWC", SqlDbType.Float, 4, "IndInsured Loss WC")

upComm.Parameters.Add("@EventsInfo", SqlDbType.NVarChar, 255, "Event Info")

da.UpdateCommand = upComm

da.Update(dsAIR, "TextDB")



************* ANY HELP WOULD BE GREATLY APPRECIATED************

THANKS

View Replies !   View Related
How Do I Insert Data From A Flat File Or .csv File Into An Existing SQL Database???
How do I insert data from a flat file or .csv file into an existing SQL database???

Here what I've come up with thus far and I but it doesn't work. Can someone please help? Let me know if there is a better way to do this... Idealy I'd like to write straight to the sql database and skip the datset all together...

strSvr = "vkrerftg"

StrDb = "Test_DB"

'connection String

strCon = "Server=" & strSvr & ";database=" & StrDb & "; integrated security=SSPI;"

Dim dbconn As New SqlConnection(strCon)

Dim da As New SqlDataAdapter()

Dim insertComm As New SqlCommand("INSERT INTO [Test_DB_RMS].[dbo].[AIR_Ouput] ([Event], [Year], [Contract Loss],[Company Loss], " & _

"[IndInsured Loss Prop],[IndInsured Loss WC],[Event Info]) " & _

"VALUES (@Event, @Year, @ConLoss, @CompLoss, @IndLossProp, @IndLossWC, @eventsInfo)", dbconn)

insertComm.Parameters.Add("@Event", SqlDbType.Int, 4, "Event")

insertComm.Parameters.Add("@Year", SqlDbType.Float, 4, "Year")

insertComm.Parameters.Add("@ConLoss", SqlDbType.Float, 4, "Contract Loss")

insertComm.Parameters.Add("@CompLoss", SqlDbType.Float, 4, "Company Loss")

insertComm.Parameters.Add("@IndLossProp", SqlDbType.Float, 4, "IndInsured Loss Prop")

insertComm.Parameters.Add("@IndLossWC", SqlDbType.Float, 4, "IndInsured Loss WC")

insertComm.Parameters.Add("@eventsInfo", SqlDbType.NVarChar, 255, "Event Info")

da.InsertCommand = insertComm

Dim upComm As New SqlCommand("UPDATE [Test_DB_RMS].[dbo].[AIR_Ouput] " & _

"SET [Event] = @Event " & _

",[Year] = @Year " & _

",[Contract Loss] = @ConLoss " & _

",[Company Loss] = @CompLoss " & _

",[IndInsured Loss Prop] = @IndLossProp " & _

",[IndInsured Loss WC] = @IndLossWC " & _

",[Event Info] = @EventInfo", dbconn)

upComm.Parameters.Add("@Event", SqlDbType.Int, 4, "Event")

upComm.Parameters.Add("@Year", SqlDbType.Float, 4, "Year")

upComm.Parameters.Add("@ConLoss", SqlDbType.Float, 4, "Contract Loss")

upComm.Parameters.Add("@CompLoss", SqlDbType.Float, 4, "Company Loss")

upComm.Parameters.Add("@IndLossProp", SqlDbType.Float, 4, "IndInsured Loss Prop")

upComm.Parameters.Add("@IndLossWC", SqlDbType.Float, 4, "IndInsured Loss WC")

upComm.Parameters.Add("@EventsInfo", SqlDbType.NVarChar, 255, "Event Info")

da.UpdateCommand = upComm

da.Update(dsAIR, "TextDB")



************* ANY HELP WOULD BE GREATLY APPRECIATED************

THANKS

View Replies !   View Related
Flat File Connection Manager Throws Error When A Column Gets Added To The Flat File
Hi,

I have a situation where a tab limited text file is used to populate a sql server table.

The tab limited text file comes from a third party vendor. There are fixed number of columns we need to export to the sql server table. However the third party may add colums in the text file. Whenenver the text file has an added column (which we dont need to import) the build fails since the flat file connection manager does not create the metadata for it again. The problem goes away  where I press the button "Reset Columns" since it builds the metadata then. Since we need to build the tables everyday we cannot automate it using SSIS because the metadata does not change automatically. Is there a way out in SSIS?

View Replies !   View Related
Output Column Width Not Refected In The Flat File That Is Created Using A Flat File Destination?
I am transferring data from an OLEDB source to a Flat File Destination and I want the column width for all of the output columns to 30 (max width amongst the columns selected), but that is not refected in the Fixed Width Flat File that got created. The outputcolumnwidth seems to be the same as the inputcolumnwidth. Is there any other setting that I am possibly missing or is this a possible defect?

Any inputs will be appreciated.

M.Shah

View Replies !   View Related
How To Redirect The Error Of A Source Flat File To The Destination Flat File?
Hi all,

I m using SSIS and i am transfering the data from Flat File Source to the OLE DB destination File. The source file contain some corrupt data which i am transfering to the other Flat file destination file.

Debugging is succesful but i am not getting any error output in the Flat file destination file.

i had done exactly which is written in the msdn tutorial of SSIS.

Plz tell me why i am not getting the error output in the destination flat file?

thanx

View Replies !   View Related
Exported Flat File Data Will Not Import To Same Table Without Extensive Data-type Manipulation
I'm moving data between identical tables and have to use a flat file as an intermediary. I thought: "No problem, SSIS can do a quick export to a file, then move the file to another server, then use SSIS to import the data to the new server."



Seems simple, right?



I'm hitting all sorts of surprising data conversion errors. I used the export wizard to create the export package. This works fine. However using the same flat file definition, the import package fails -- even when I have no destination. That is I have just one data flow task that contains only one control: the Flat File source. When I run the package the flat file definition fails with data type conversion and truncation errors. One of the obvious errors is for boolean types. The SQL field is a bit, SSIS defined the column as DT_BOOL, the output of the data are literal text values "TRUE" and "FALSE". So SSIS converts a sql datatype of bit to "TRUE" and "FALSE" on export, but can't make the reverse conversion on import?



Does anyone else find this surprising?I would expectthat what SSIS exports, it can importgiven all the same table and flat file definitions. Is SSIS the wrong tool to do such simple bulk copies? I'd like to avoid using BCP because this process will need to run automatically within SQL Agent so we can leverage all the error tracking and system monitoring.





View Replies !   View Related
Flat File Data For Every Row
I am very new to SSIS. How do you parse (input source) data which is listed below? Please help. Thanks in advance!

DITR

AC=18991770

UP=U

DI=MINE 9

IF=-D*AEAAKZZAAAAAAAAAJAAAAAA*T

DP=2006-12-00

TS=ST*N

IC=100.100.60

TG=Hand-Kegelreibahlen fuer Kegelstiftbohrungen

TI=Hand taper pin reamers

FM=3

CT=Reibahle*Zerspanwerkzeug

ET=Cutting tools*Reamers

IU=Institut fuer Normung e. V.

CR=1

PQ=100,40 EUR

AV=NormCD07

EV=7240404

RZ=PIN 9(1975-06)*PIN 9(1995-03)

RX=

View Replies !   View Related
Append Data To A Flat File
Hello,

I was wondering if there was a way for me to append data to a flat file. The reason why i ask this is because i need to create a header for the report that i am exporting.

The way i imagined this working would to be create a dts that would export the header information to a flat file and the create another dts to export the report data and appensd it to the same file that the header dts created. This might not be the correct approach so i was hoping i could get some guidance of how i can accomplish this.

I am using SQL Server 2000.

Thank you!

View Replies !   View Related
Exporting SQL Data To A Flat File
SQL 6.5
NT 4.3

Can someone assist me with the following....

1. I am attempting to export data from a SQL DB (single table using a query) to a "flat file".
2. I would then like to take this "flat file" and import the data into a different SQL DB (same schema structure as first DB).

Unfortunately this has to be done in two steps.


Thank you for your help.

RPowid

View Replies !   View Related
Archiving Data To Flat File?
How do I put data into a text or excel file before I attempt a deleteion from a large table. I know how to select the necessary data, but i'm not sure about the t-sql required to put it into a file?

are there any better methods of archiving?

thanks

View Replies !   View Related
Bringing Data Into A Flat File
I am trying to bring in the result fo a query to a flat file. The source and destination connections are oK, the mapping is also correct. However I get the following error during execution:



[Flat File Destination [507]] Error: No column was specified to allow the component to advance through the file.

followed by this:

[DTS.Pipeline] Error: component "Flat File Destination" (507) failed the pre-execute phase and returned error code 0xC02020F0.



What is the fix?

View Replies !   View Related
Flat File Data Flow
any suggestions on dealing with a flat file in the format below. I only want to process the data columns in the middle of the file and want to ignore all other rows. This was a very simple task in DTS with a small amount of VBScript in the transformation but it doesn't seem as straightforward in SSIS. thanks



......... file example ......

start-of-file

header1

header2

...

start-of-data

col0|col1|col2|col3|....

col0|col1|col2|col3|....

col0|col1|col2|col3|....

end-of-data

end-of-file

View Replies !   View Related
Importing Data From A Flat File
I have a flat file data source - call it "order". Its a text file that looks something like this:

ORDERNAME| Example1

CUSTOMER|Acme Industries
COST|11611
ITEMS
B1|550S162-43(33)|35.708|1|636
T1|550S162-43(33)|20.967|1|636
T2|550S162-43(33)|20.967|1|636
W1|350S162-43(33)|1.330|2|501
W21|350S162-43(33)|1.330|1|911
W2|350S162-43(33)|3.044|2|501
W20|350S162-43(33)|3.044|1|911

I would like to write the metadata to a [order header] table and the ITEMS to a [order detail] table. Can someone direct me to a example of something similar?



View Replies !   View Related
Flat File With Nested Data
I am looking to import data into SQL Server 2005 using SSIS. I want to take data that is contained in a flat file and place it into the various appropriate tables in my system. The flat file contains nested data. For example...

Bob,Smith,555-5555,123~3.33|245~1.99,Active

So I want to build a package that brings in the records as follows

Client Table: First Name, Last Name, Phone, and Status (Bob, Smith, 555-5555, Active)

Order Table: OrderID, Amount (ID 123 @ $3.33 and another row ID 245 @ $1.99). If possible I would also like to tie the orders to the client record that was inserted.

My first question is if SSIS supports nested fields as in my example. Can it break a file by commas, then within a field by other delimiters? If so how do I do this, and if not what is the recommend way to accomplish this sort of task.

My second quesiton is if it can do that, can it tie the Client and Order data on the fly?



Thanks.

View Replies !   View Related
Exporting Data To A Flat File
the "flat file" destination is missing from the choices when attempting to

export data.

View Replies !   View Related
Flat File Data Source
Is there away to use wild card in the file name for the flat file data source?

Like //servername/directory/*.txt

View Replies !   View Related
Exporting Data To Flat File
I'm using SSIS package to export some data to a comma delimited CSV file. The problem is that some of the fields have commas in them. Is there a way to deal with this other to changing the delimiter?

View Replies !   View Related
Get Header Data Of Flat File
hi everyone!

i am currently creating a package which involves getting data from CSV files. i can successfully get the data from the files, my problem is, i need to get data from the header of the CSV files. i am currently skipping the header rows. the format of the CSV files is as follows:

-----------------------------------------------------------------------------------
Date, 20070704
Store Code, storeCode1

data row.....
data row.....
data row.....
-----------------------------------------------------------------------------------

technically, i also need the date from the header row, but since it is also indicated in the data rows, i have no problem with that. what i need is the Store Code, which is not indicated on the data rows. i need to store the data in a database in the following format:

-----------------------------------------------------------------------------------
StoreCode Date column1 column2 column3 ......
storeCode1 20070704 ...
storeCode2 20070704 ...
storeCode3 20070704 ...

-----------------------------------------------------------------------------------


any idea how SSIS can handle this? thanks a lot!

View Replies !   View Related

Copyright 2005-08 www.BigResource.com, All rights reserved