.NET Tutorials, Forums, Interview Questions And Answers
Welcome :Guest
Sign In
Win Surprise Gifts!!!

Top 5 Contributors of the Month
david stephan
Gaurav Pal
Post New Web Links

How to speed up Reading Text File line by line?

Posted By:      Posted Date: April 10, 2011    Points: 0   Category :.NET Framework

Hi all,

The following is my problem which need to be solved:


I have text file like this:

id=1, name=smith, age=22, address=London;

id=2, name=john, age=30, address=Roma;

id=3, name=Pen, age=19, weight=60, address=Paris;

id=4, name=Ajay, age=44, address=India;


using vb, I succeeded to convert it to a table format like this


id      name        age       weight      address

1      smith          22           null         London

2      john            30          null          Roma

3      pen             19           60           Paris

4      Ajay            44           null          India


I used StreamReader for that.

someone may still ask: Ok Adel so where is your problem? kindly read the following lines

In fact, my only problem is related to the time it takes if the number of rows is 70,000

View Complete Post

More Related Resource Links

Deleting Last Line of Text in a text file

Hi, I needed some help on the best way to delete the last line of  text in a text file. I have a subroutine that looks like this, but it is missing some code. Could anyone advise me on this? Dim strLogFile As String = System.Web.HttpContext.Current.Server.MapPath("~/Log.txt")         Dim fs As New FileStream(strLogFile, FileMode.Open, FileAccess.ReadWrite, FileShare.None)         Dim swLog As New StreamReader(fs)         Dim array As String()         Dim value As String = swLog.ReadToEnd ''Array that holds the lines of the text file.         array = value.Split(vbCrLf)        ''code for deleting last line: . . .  fs.Close()

How to read/write GIANT text file with no line breaks


I have to process giant XML files that are 6GB+ in size.  The problem is that there are no line breaks in the file, and the XML is improperly formatted (no root element).  Therefore I can't use the XML class to read the file, and I can't open the file in any text editor or even "Type" it in a command window because the 1 line in the file is over 6GB.

The file contains UTF8 characters.  What I want to do is first write a program just to read and display 100 characters at a time so I can look at the contents.  Next I want to be able to create a new file, write a root element, read/write the contents of the file and then write the closing root element.

Can anyone provide a code snippet of how to read and display the file contents 100 characters at a time.  I can then figure out the rest.


Random line from a text file



Im trying to pull a random line from a text file and store it into a variable.

I found this piece of code on the web which looks good but I cant seem to get it working in vs 2010, any ideas ?

Dim MyString As String
Dim MyBuffer() As Byte
Open "C:\AFile.txt" For Binary Access Read As #1
  ReDim MyBuffer(LOF(1) - 1)
  Get 1, , MyBuffer
  MyString = StrConv(MyBuffer, vbUnicode)
  ReDim MyBuffer(0) 'Free up memory
Close #1

Many thanks in advance.


How to delete a line from a text file using C#

Hello all

I am developing a little app where I need to monitor a file that is update by several machines.

I need to gather each line wrote by each machine so I need access to a specific line number and take that line, store it into a DB table and delete that line.

I really don't know how to delete the line without parse the information into a string variable and rewrite the file. This can lake the app because the file can contain up to 1000K lines... :-O...

Any suggestion will be appreciated.

I think I deleted the Internet...

Removing blank line from a text file


Hi i have a comma deliminated text file which i am using to generate a multidimensional array using the following code:

Dim DefinitiveDatabase As String(,)
    Dim strfilename As String = (Server.MapPath("~\Definitive database.txt"))
    Dim num_rows As Long
    Dim num_cols As Long
    Dim x As Integer
    Dim y As Integer
    Dim value As Integer
    Dim ConditionName As String
    Dim strlines() As String
    Dim strline() As String
    Dim tmpstream As StreamReader = File.OpenText(strfilename)

strlines = tmpstream.ReadToEnd().Split(Environment.NewLine)
        num_rows = UBound(strlines)
        strline = strlines(0).Split(",")
        num_cols = UBound(strline)
        ReDim DefinitiveDatabase(num_rows, num_cols)
        For x = 0 To num_rows
            strline = strlines(x).Split(",")
            For y = 0 To num_col

New off line application working with sdf file. Need advice


Hey Folks

I am working on a project currently where I need to get data out of a 3rd party vendor's software that uses a .sdf file I looked this up and its a SQL CE file. I was hoping to just link to with with access but thats apparently not going to happen. I need to link to the database extract data from it to a csv file for later use. I also and most important I need to get the data from it and create a report that can be printed while on a customers site that my or may not have web access so I need for this program to be on and off line. I had my webapplication that I have been working on open and was able to bring up the sdf file under the server exploere however I can't seem to get anything out of it when I try to do grid views or detail views errors out.

Can I use one of Visual Studio projects to create this sort of applicaiton if so what would be the best approach. I would love to get an access odbc driver since office is allready installed on the employee's laptop's



Mission Impossible? Use Javascript to Disable a Multi-Line Rich Text Field


Hey Community,

Here's a tough one that I have struggled with and so far have not been able to find an answer for - how do you use Javascript to disable a multi-line rich text field.  I have customized a SP Edit form by adding a CEWP.  In the CEWP I have added the Javascript below (only a partial code sample provided) to disable several fields in the form.  The code works fine for single line text fields but it does not work for multi-line rich text fields.  Any suggestions?

<script language="javascript">
//This runs the function when the form first loads

//This locks the fields the users should not modify
function lockFields()
  var theInputTFTitle = getTagFromIdentifierAndTitle("Input","TextField","Title");
  theInputTFTitle.readOnly = true;
  theInputTFTitle.style.color = 'gray';
  //alert(" Value: " + theInputTFTitle.value);//for testing

   var theInputDDLReplyStatus = getTagFromIdentifierAndTitle("select","DropDownChoice","Reply Status");
  theInputDDLReplyStatus.disabled = true;
  //alert(" Value: " + theInputDDLReplyStatus.value);//for testing

  var theInpu

Reading MultiLine TextBox line by line

If I have a list of something in a MultiLine TextBox, one item per line, how do I then in turn read this? Right now TextBox.Text reads it all as one line. Lets say we have this: TextBox txtbx; At first I thought I could split the string on Environment.Newline, this doesn't work.  Error.Next I thought I could Replace(Environment.Newline,";").Split(";"); This didn't work either, Error.  Both gave cannot convert string to char[] exceptions. What I want to be able to do is read the input line by line and do something with each item one by one. Does anyone know how to do this?Thanks.

putting carriage return/line feed in non-HTML email text

Using vb.net/asp.net 2005I am trying to create a string message for an email that I am sending out from my asp.net page like so: For Each dr In dtDataTable.Rows strMessage = strMessage & vbCrLf & vbCrLf & Environment.NewLine & dr.Item("UserName") & Environment.NewLine Next so I am looping through a datatable and getting each name from each row, that is working well but when I get the email it appears in my inbox with all the names mashed together, you see I am trying both vbcrlf and newline but looks like neither is workingdoes anyone know what I'm doing wrong?

Display each new line of a sharepoint mutliline text field as choice in drop down box.

The question pretty much says it all. I have a lot of data I need to represent, and this would be the best way to do it. I have a multiline text field in sharepoint, where each line has a choice that should be a seperate choice in a text box. How do I do this? I have the data connection set up, and I would be fine with adding some sort of tag after each line, if that would make it so infopath can somehow parse out those tags, and interpret each "chunk" as a choice. Thanks in advance for your help.

Reading each record from a text file and sending email

Hi All, I have a text file (CSV) which has only three fields (Name, Email, SendYN). I want to read each record from this text file and send email to those records where SendYN field has Y. I had created Flat File connection and a Flat File source in a data flow which uses Flat file connection. Now I stuck how to move further. Which control I need to add and where to identify whether SenderYN = Y and how to send email? I am new to SSIS. Thanks.

i require go which file which line no error and how ro remove thsi

i require go which file which line no error and how ro remove thsiSystem.NullReferenceException: Object reference not set to an instance of an object at System.Web.UI.WebControls.ListBox.SelectMultiple (System.String[] values) [0x00000] in <filename unknown>:0 at System.Web.UI.WebControls.ListBox.LoadPostData (System.String postDataKey, System.Collections.Specialized.NameValueCollection postCollection) [0x00000] in <filename unknown>:0 at System.Web.UI.WebControls.ListBox.System.Web.UI.IPostBackDataHandler.LoadPostData (System.String postDataKey, System.Collections.Specialized.NameValueCollection postCollection) [0x00000] in <filename unknown>:0 at System.Web.UI.Page.ProcessPostData (System.Collections.Specialized.NameValueCollection data, Boolean second) [0x00000] in <filename unknown>:0 at System.Web.UI.Page.ProcessPostData () [0x00000] in <filename unknown>:0 at System.Web.UI.Page.InternalProcessRequest () [0x00000] in <filename unknown>:0 at System.Web.UI.Page.ProcessRequest (System.Web.HttpContext context) [0x00000] in <filename unknown>:0

Infopath browser form - odd behaviour on auto expanding multi line text boxes




I have a browser form with a multi line text box. The height is set to be AUTO. Within the client all is fine. When opened as an administrator approved form the text box automatically adds a new line for every 20 characters you type.


So if you type 40 characters without pressing enter you get 2 blank lines appear under you text that you CANNOT remove.


I have tested this on a new form with various multi line text boxes. The width setting is unimportant, the spell check setting is unimportant.


If i fix the height then the issue goes away but this is not any good.


I cannot use rich text boxes as i have around 40 text boxes on the form and if they are rich text they take around 10 minutes to load in the browser (this is another issue i have)


Thanks in advance



Add line to existing xml file


Hello every one I have tried to add some line to existing xml file but every time that i did it previous lines was replaced by new one

i tried to use dataset,streamreader and ... but i couldnt,


please help me  

SQL Server Assertion: File: , line=913


I've found an article stating that this can occur when the table has no clustered key and you attempt to reindex. That is not my problem.

I am attempting to do a bulk-load into a table using SSIS. I have seen other people having this issue, unfortunately their issue always goes away on its own. I have restarted the service, and the machine as well as installing sp1 and the problem persists.

Here is the error, any help troubleshooting this issue is appreciated

Log Name:      Application
Source:        MSSQLSERVER
Date:          9/21/2010 1:32:07 PM
Event ID:      17066
Task Category: Server
Level:         Error
Keywords:      Classic
User:          N/A
Computer:      TESTSSADB
SQL Server Assertion: File: <pageref.cpp>, line=913 Failed Assertion = 'IS_OFF (BUF_MINLOGGED, m_buf->bstat) || pageModifyType != PageModifyType_Contents || GetPagePtr ()->IsTextPage ()'. This error may be timing-related. If the error persists after rerunning the statement, use DBCC CHECKDB to check the database for structural integrity, or rest

Reading in values in text file in a project solution to an array



I have a tab delimited text file that has 6 columns (all integers) and 500 rows (and no column headings) called ProjectData.txt that I have added to my Windows Form Application (c#) (by added I mean I have it in my project solution). 

I have declared an array in my code called ProjectDataArray which has dimensions [500, 6].

I wish to load each column of each row into the array.

All the code I have seen shows how to do this for text files that are not included in the project solution. 

Is this easy to do?

reading text file using sql server 2000 , 2008



can any one tell me how to read the data's in the text file using sql server 2000 and 2008.

i have a text file in a server and it contains one column name with the multiple column values i need to read that informations and i need to update in a table in the database.

how can we do this.



ASP.NetWindows Application  .NET Framework  C#  VB.Net  ADO.Net  
Sql Server  SharePoint  Silverlight  Others  All   

Hall of Fame    Twitter   Terms of Service    Privacy Policy    Contact Us    Archives   Tell A Friend