.NET Tutorials, Forums, Interview Questions And Answers
Welcome :Guest
Sign In
Win Surprise Gifts!!!

Top 5 Contributors of the Month
david stephan
Gaurav Pal
Post New Web Links

Reading large binary files

Posted By:      Posted Date: October 25, 2010    Points: 0   Category :WPF


I currently have a WPF app that controls a printer. The app reads very large binary files (bitmap images, larger than 1 GB) and does some bit manupilation on them.

I am currently using a FileStream to read 100MB worth of bytes into a buffer (using FileStream.Read method). After that I start my method that does the bit manupilation on the image file and sends it out to the interface on a printer. When the buffer nears the end of the 100 MB length, say when there are few 100 bytes left to read in the buffer, I call the FileStream.Read method again to read in the next 100MB worth of data from the binary file. I specify the offset to read the binary file by using FileStream.Position method.

The problem I am facing is that when it finishes reading the 100MB buffer and goes to read the next 100MB worth of data, the printer pauses for the amount of time it takes to read the next 100MB and after that there is a pause for every line it prints in the image. It is like .NET framework or the compiler looses sync of doing things a particular because I have to read the next 100MB and then never recovers. The pause is about 2-3 seconds.

Everything is working great, the bit manipulation is correct, it reads the file correctly, the printer prints the file the way it is supposed to, except I want to avoid the pause.

Any suggestions....Can I use a back

View Complete Post

More Related Resource Links

reading values from config files in NUnit tests


One of my NUnit tests has to read in some values from config files.  In my main application this process works perfectly well, however when I run the unit test, the code that reads in the values from the config files doesnt read anything in.  Ive tried putting app.config in my unit test project (I even tried web.config) but nothing seems to work.  Are there any special steps involved when reading from config files in an nunit test ?

Web Q&A: Who Called the Script?, Concatenating Binary Files, and More


This month find out which part of an HTML document has called a script, how to concatenate binary files, find a node, reference one script from another, build a GUI database front end in Access, and compare XML files.

Edited by Nancy Michell

MSDN Magazine August 2003

Document Conversion of large files



My MOSS 2007 environment fires OutOfMemory exceptions when attempt to launch a custom Document Converter on files larger then 50 MB (Video files) . Because my Document Converter is implemented by a standalone executable, I'm figuring these exceptions are fired by Sharepoint Work process, on downloading/uploading from/to temp folder, not by my custom converter.

If this is the case, can I apply any workarounds on server configuration ? I tried with /3GB switch without luck. Maybe SP1 will address this issue too ?



How to manage large .trc files?

Hello everbody,        Sir, with raid 10  with enough arrays to hold files saperately.    Is an array of raid 10 will be identified as one logical drive? such as c:, d: e.t.c.   Actually I want to store trace files on server to capture representative workload for DB Tuning with DTA. As i know that will be very large in size as my OLTP DB gets very busy at 8 a.m. to 7 p.m. and less busy at diff. time and i don't want any event to be missed out due to lack of resources. So how to manage this?   Can i attach ext. HD to the dedicated sql server to hold .trc files? Is it advisable?   Pl provide any available link for config. best practices for raid 10. Or standard config. for raid 10 to get optimum performance. Or any suggestion regarding this issue.   Thanks in advance  

Server generate frequently large mdmp files

Hi, I have running MS SQL Server 2005. Server generate frequently large mdmp files which took c: drive space. kindly tell how i stop creating these and keep the c: drive space. thx iffi

Storing large files (10gb) in MOSS.

Hello, We are planning to develop a portal with few lists in the portal. We have a requirement to store huge files of approximately 10GB in size. Can any one let me know If we can have a mechanism where in we can only save the file meta data to a MOSS list and save the actual file to a file share (Data Center)? I am looking forward to a generic service(WCF) which can perform this functionlity. If it is possible can some one provide a series of steps to achieve this. Thanks,kesari suresh

Problem importing text files with binary zeros (0x00) via SSIS(SQL2005). It is all fine when using D

Hi.   There is a "text" file generated by mainframe and it has to be uploaded to SQL Server. I've reproduced the situation with smaller sample. Let the file look like following: A17     123.17  first row          BB29    493.19  second             ZZ3     18947.1 third row is longer And in hex format: 00:  41 31 37 20 20 20 20 20 ? 31 32 33 2E 31 37 20 20  A17     123.17  10:  66 69 72 73 74 20 72 6F ? 77 0D 0A 42 42 32 39 20  first row??BB29 20:  20 00 20 34 39 33 2E 31 ? 39 20 20 73 65 63 6F 6E     493.19  secon30:  64 0D 0A 5A 5A 33 20 20 ? 20 20 20 31 38 39 34 37  d??ZZ3     1894740:  2E 31 20 74 68 69 72 64 ? 20 72 6F 77 00 69 73 20  .1 third row is 50:  6C 6F 6E 67 65 72       ?                          longer          I wrote "text" in quotes because sctrictly it is not pure text file - non-text binary zeros (0x00) happen sometimes instead of spaces (0x20).   The table is: CREATE TABLE eng ( src varchar (512) )   When i upload this file into SQL2000 using DTS or Import wizard, the table contains: select src, substring(src,9,8), len(src) from eng <               src                ><substr>             <len> A17     123.17  first row           123.17                  25BB29                                493.19                  22ZZ3     18947.1 third row           18947.1                 35   As one can see, everything was importe

What is the best Hosting model when Uploading Large Files via WCF?

I am building a WCF service where besides regular CRUD operations, it porovides methods to upload large (upto 15MB each) files. The service will serve a number of "clients" that will send data to our back-end. Now, while some of the clients are ok with sending one file at time, others would like to be sending these files in batches (i.e. several files at a time).... My questions: What is the best option for hosting this service considering the environment (see below)?  Will IIS be able to support it or will it time out? I know you can increase timeout limit in config file but how will it handle a batch of large files at a time? Is windows service a better option here? What are the dis/advantages of IIS vs Win Srvc in this scenario?  Current Environment: Win 2003 Server w/IIS 6.0 and WCF (.NET 3.5) Thanks in advance!

Missing/Required binary files on one Web-front-end after installed the CU aug 2010 hotfix?

Hi! I have installed the binary files for CU aug 2010 hotfix in a farm with two web-front-ends. In Central Administration you can see that on Web-front-end one (that also is hosting the Central Administration app) the binary files are missing but not on the second Web-Front-End. The installation went fine on both servers with the exception that I had to reboot the Web-Front-end one. When I try to run Psconfig to update my databases I get en error message like this in my command prompt. The upgrade command is invalid or a failure has been encountered. The server farm will not work with missing installs. Add "-cmd installcheck -noi nstallcheck" to the command-line to ignore this warning. The following is missing on web-front-end one: Hotfix for Office (KB2352342) Hotfix for Office (KB2352342) Hotfix for Office (KB2352342) Hotfix for Office (KB2352342) Hotfix for Office (KB2352342) Hotfix for Office (KB2352342) Hotfix for Office (KB2352342) Hotfix for Office (KB2352342) In the event log I get a lot of these errormessages too (EventID 3351): SQL database login for 'SharePoint_Config' on instance 'SqlAliasName' failed. Additional error information from SQL Server is included below. Login failed for user 'Domian\servername (one)$'. The thing is that the files is installed in the filesystems aswell as the dll files in the GAC on both servers. You can´t unistal

Reading Excel files from 64-bit ASP.Net app

I have an ASP.Net app that is running on a 64-bit server. Part of that app reads data from Excel files and loads that data into our SQL_Server database.I am using the ACE OLE driver to read the Excel files and it works great on my 32-bit development machine. When we deploy the app (from a 64-bit client machine) to our 64-bit server, I get this exception when trying to open the connection:"System.InvalidOperationException: The 'Microsoft.ACE.OLEDB.12.0' provider is not registered on the local machine."There are many posts about addressing this issue, so I think these are my options:1. Compile the app for any cpu from a 32-bit machine and deploy it to the server (making the app 32-bit) - not desirable as ideally we would like to run the app in 64-bit mode2. Convert the excel file to csv then use more base .Net libraries to get the data out3. Install Office on the server and use the Microsoft.Office.Interop.Excel library to access the data - not sure if this will work though4. Purchase a conversion library5.  Wait for the 64-bit version of Office and use the new Microsoft.ACE.OLEDB.14.0 driver. - Can I get a Beta version now?I am looking for confirmation that my options are accurate/complete and guidance on which of these (or another option) are the most viable.Thanks, Mike

Upload large files from a web page

I am trying to figure out a solution to upload large files under a web page. I know WCF + Streaming is a proper solution for large file transfers, but I am not sure how to get the WCF client implemented under ASP.NET. Here is the link: http://mark-csharp.blogspot.com/2009/01/wcf-file-transfer-streaming-chunking.html Please advice if you have any solution.   Besides, is there anyway I could implement a progress bar showing the upload progress while the file is being uploaded, and voiding page timeout?

Large transaction log files after backups

I have noticed that the size of the transaction logs on my databases have rocketed lately, I do have full and differential backups in place for the databases in question, any reason for the sudden increase in size and is there anything that I can do to mitigate it. Some of the databases have a simple recovery model on, in which case transaction logs shouldn't be maintained, but I note that the sizes are still huge and this only started when I began taking full backups and differentials. Thanks.

What is fastest way of reading large size XML in SQL Server 2005 using Select statement ?

What is fastest way of reading large size XML in SQL Server 2005 using Select statement ?

Reading binary Data from Sql Server.

 am trying to read data from a sql 2000 database.

one of the fields is defined as datatype:image, Length:16.

when I am in SQL management studio  and do a select for this one column


Upload large files


Hi all,

What is better way to large upload file.

using a web service or in application itself.

If in application, how can we check that files is to upload.

actually i dont want user to wait for complete uploading, when it starts uploading user will get response of uploaded and uploading will be done  in backgroud.

I am not sure this type of task can be done in webservice also so that user doesnot need to wait for complete uploading.

and one more query which event fires when the page redirects to another page.

Is it Page_UnLoad or Dispose

Any suggestions is appreciated.

ASP.NetWindows Application  .NET Framework  C#  VB.Net  ADO.Net  
Sql Server  SharePoint  Silverlight  Others  All   

Hall of Fame    Twitter   Terms of Service    Privacy Policy    Contact Us    Archives   Tell A Friend