.NET Tutorials, Forums, Interview Questions And Answers
Welcome :Guest
Sign In
Register
 
Win Surprise Gifts!!!
Congratulations!!!


Post New Web Links

Sending Large Dataset to Webservice

Posted By:      Posted Date: September 23, 2010    Points: 0   Category :ASP.Net
 

Dear all,

I have one problem is that when i send large dataset containing byte array.. then webservice not respond well..

it shows error like underlying connection was closed...

I mark that when dataset size goes some large then only problem occurs otherwise it works well..

Please give me solution of how to send large dataset over web service...

 

Thanks.. 




View Complete Post


More Related Resource Links

WCF webservice: HTTP/1.1 400 Bad Request while sending large input

  
I am connecting to a WCF based webservice. For certain methods, the input contains a list of objects/structures. When the number of items in this list increases beyond a certain number, the service fails with HTTP/1.1 400 Bad Request when I try to test the same using SOAPUI. I tried changing the web.config file with the following changes: <httpRuntime maxRequestLength="2097151" /> <binding name="basicHTTP" closeTimeout="00:01:00" openTimeout="00:01:00" receiveTimeout="00:01:00" sendTimeout="00:01:00" maxReceivedMessageSize="4194304" maxBufferSize="98547" maxBufferPoolSize="258547"> <readerQuotas maxDepth="2147483647" maxStringContentLength="2147483647" maxArrayLength="2147483647" maxBytesPerRead="2147483647" maxNameTableCharCount="2147483647" /> </binding>   Kangkan

Persist large dataset across ASP.NET pages. No database

  

Can anyone give me suggestions on how to implement the following requirement?

1. A online wizard (step-by step operation) processes user requests across several ASP.NET pages.  The session data is stored in memory until the user submits the request.  Once the request is submitted, a XML file is created and the data are passed to XML.

# Case Study: The parent page has a "select" button.  Click "select" will pop up a child page.  The users can select 1000+ items from a datagrid in the child page.  Once the user clicks "confirm", the selected items in the child page will be populated to the selected item gridveiw in the parent page.  The user can keep selecting more in the child page and the selected items will be appended to the gridview in the parent page.

Questions:

- What's the best way to extract strings from a text file and convert to a dataset in memory and then present it in a datagrid in UI?

- What's the best way to persist and manipulate a large dataset across pages?  Session? or ViewState? Can it be accomplished by LINQ?

The app doesn't interact with a DB.  Once the request is submitted, it will convert the in memory data to a XML file.  What technology can be used to accomplished this?&nb

WCF issues sending large data - "An existing connection was forcibly closed by the remote host"

  
Hi Guys I have posted the following on www.asp.net but thought it might be productive posting here too.I have been pulling my hair out trying to fix an issue with sending data over WCF, I have read pretty much every THREAD on this forum regarding or similar to this issue without any successful solution.  I have a simple data object which has a [DataMember] with a data type of byte[]. I use this to send binary data from my web app as follows: Asp.net MVC website --> WCF Client (Has my Service References) --> My Services (MyServices.svc) --> Business/Data Tier Everything is being executed from within VS 2008 Pro.   Now I have successfully sent data up to 2.2MB, however it fails if i try and send a file such as 2.3MB or larger i get the following exceptions: General Exception Exception rethrown at [0]:    at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)   at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)   at SoftApp.WCFClient.MyServiceReference.IMyService.Document_Save(DtoDocument dtoDocument, Int32 usercode)   at SoftApp.WCFClient.MyServiceReference.MyServiceClient.Document_Save(DtoDocument dtoDocument, Int32 usercode) in c:\dev\softapp\softapp.wcfclient\service references\myservicereference\refe

what is large and smal dataset

  
what is a large and small dataset /.. how can we say that it is large or small data set. can u xplain me clearly. and also send me some dat sets..my mail id is kalyan9029@gmail.com... thanking u .. kalyan

Webservice returns xml.xmlnode - Need help getting response into dataset

  
Forgive me I am new to webservices so there may be something obvious that I am overlooking but any help would be appreciated.  Below is my code.  The reportrequest is perfectly formatted, i've already tested that with SoupUI.  The problem is the line I highlighted.  I am getting an error saying outerXml is not a member of System.Array.  Please provide any insight on how to go about this. Dim o As New sushi.SushiService Dim xn As XmlNode() = o.Getreport(reportrequest) Dim dsXML As DataSet = New DataSet() Dim reader As XmlTextReader = New XmlTextReader(xn.outerXml, XmlNodeType.Element, Nothing) dsXML.ReadXml(reader) gvresults.DataSource = dsXML gvresults.DataBind()Thank You!!!

Upload large file via webservice problem in vb.net 1.1

  
Hi All, I am uploading large file via webservice using below my code in vb.net 1.1. Problem is vb.net 1.1 don't know Using Object loop. I would like to know any other loop similar Using loop to replace in vb.net 1.1Public Function UploadLargeFile(ByVal FileName As String, ByVal buffer As Byte(), ByVal Offset As Long) As Boolean Dim retVal As Boolean = False Try Dim FilePath As String = Path.Combine(System.AppDomain.CurrentDomain.BaseDirectory.ToString() & "\fpath\", FileName) If Offset = 0 Then File.Create(FilePath).Close() End If Using fs As New FileStream(FilePath, FileMode.Open, FileAccess.ReadWrite, FileShare.Read) fs.Seek(Offset, SeekOrigin.Begin) fs.Write(buffer, 0, buffer.Length) End Using retVal = True Catch ex As Exception Throw ex End Try Return retVal End Function  

problem in Transferring a large dataset to remote machine by using the NetTcpBinding

  
i am developing an WCF application, in which i have to transfer a large dataset to the remote machine!! for that im using nettcpbinding in WCF but i got this exception ' The socket connection was aborted. This could be caused by an error processing your message or a receive timeout being exceeded by the remote host, or an underlying network resource issue. Local socket timeout was '10:29:59.4140000'. at my sender side.   Sender/Client side code   // Object for sending to remote client using (_dpParameters = new DPParameters()) { _dpParameters.SequenceFieldName = "Sequence"; _dpParameters.Size = 10; _dpParameters.SubjectsForFiles = "S,Y,T"; _dpParameters.SubjectNames.Equals(SubjectNames); _dpParameters.FilePath = " E:\\Source\\Phospho.xml"; // this dataset can be in GBs but for testing me using jst 6.78mb DataSet ds = new DataSet(); ds.ReadXml(_dpParameters.FilePath); _dpParameters.Usd = ds.Tables[0]; } /// This is the binding settings NetTcpBinding tcpBinding = new NetTcpBinding(); tcpBinding.ReceiveTimeout = new TimeSpan(10, 30, 00); tcpBinding.SendTimeout = new TimeSpan(10, 30, 00); tcpBinding.MaxBufferSize.Equals(67108864); tcpBinding.MaxBufferPoolSize.Equals(67108864); tcpBinding.MaxReceivedMessageSize.E

Large Dataset Downloaded Before Rendering Report's First Page

  

Greetings,

I'm hoping to understand the behavior of SSRS a bit better in the following scenario (SSRS 2008).  A single matrix (tablix) exists on the report.  No other objects are on the report.  That matrix is populated with 1.1 million rows of data totaling about 200MB.  Why does SSRS download the entire dataset prior to rendering the report's first page or am I missing something here?

When previewing the report, the local .data file bloats to 200MB indicating all dataset rows are being returned.  The matrix does not contain any sorting, all cell "can grow" and "can shrink" properties are set to false, no expressions are used anywhere, and even the table's column data types from which the data is being pulled are appropriate.  In other words, I believe I've reduced storage and CPU needs while eliminating elements that add overhead when rendering a report.

The specific scenario here is a researcher previewing the first few pages of data then choosing to download the entire dataset.  MS documentation I've read refers to "soft page breaks" when rendering as HTML and left me with the impression that perhaps SSRS needs to know the entire height of the dataset before it'll slice the report into pages.  It's odd to me though that it needs to download 1.1 millions rows of data befor

Timeout while sending large amount of data with WCF client

  

Hi,

I've call to Java WebSeal Web "enveloped" by WCF Client. Sending large XML (about 60k) as a parameter cause an error and received one of these messages:

 System.ServiceModel.CommunicationException: The underlying connection was closed: A connection that was expected to be kept alive was closed by the server.

OR

System.TimeoutException: The request channel timed out while waiting for a reply after 00:01:00. Increase the timeout value passed to the call to Request or increase the SendTimeout value on the Binding. The time allotted to this operation may have been a portion of a longer timeout.

Interaction with same webseal service configured as asmx service doesn't cause any errors.

my client app.config looks like this:

<bindings>
      <basicHttpBinding>
        <binding name="WinflowSoap" closeTimeout="00:01:00" openTimeout="00:01:00"
         receiveTimeout="00:10:00" sendTimeout="00:01:00" allowCookies="false"
         bypassProxyOnLocal="false" hostNameComparisonMode="StrongWildcard"
   

Timeout while sending large amount of data with WCF client

  

Hi,

I've call to Java WebSeal Web "enveloped" by WCF Client. Sending large XML (about 60k) as a parameter cause an error and received one of these messages:

 System.ServiceModel.CommunicationException: The underlying connection was closed: A connection that was expected to be kept alive was closed by the server.

OR

System.TimeoutException: The request channel timed out while waiting for a reply after 00:01:00. Increase the timeout value passed to the call to Request or increase the SendTimeout value on the Binding. The time allotted to this operation may have been a portion of a longer timeout.

Interaction with same webseal service configured as asmx service doesn't cause any errors.

my client app.config looks like this:

<bindings>
      <basicHttpBinding>
        <binding name="WinflowSoap" closeTimeout="00:01:00" openTimeout="00:01:00"
         receiveTimeout="00:10:00" sendTimeout="00:01:00" allowCookies="false"
         bypassProxyOnLocal="false" hostNameComparisonMode="StrongWildcard"
   

ReportViewer Control large dataset timeout

  

Reporting Services 2008 R2

I have a rather large report that returns around 40,000 records. (I've tried telling the business that this is not a useable report and no one is listening.)

When I execute the report through a webservice and stream it to an excel file the response time is fine.  Trying to load the report using the report viewer control it just hangs.

When I run the report through SSRS own Report Manager, I get the following error

  • An error occurred within the report server database. This may be due to a connection failure, timeout or low disk condition within the database. (rsReportServerDatabaseError)
    • Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding.

 

 

This is on my own local dev machine at the minute and I've only just gotten the correct dataset it will be run against.

The stored proc runs in a couple of seconds.

Does anybody have any suggestions in what I can do?

Any help would be appreciated.

 

 

-----  Code

<rsweb:ReportViewer ID="WebRep

No Endpoint exception on large file sending through https

  

Hi,

 

I have a WCF webservice. I'm using https for communication between client and server. Everithyng works fine till the file I send through WCF is smaller then ~20MB.

When I want to attach a larger file I get exception. I turned on the diagnostic logging and saw this exception:

<ExceptionString>System.ServiceModel.EndpointNotFoundException: There was no endpoint listening at https://MyServer/MyWebApp/MyService.svc/ws that could accept the message. This is often caused by an incorrect address or SOAP action. See InnerException, if present, for more details. ---&gt; System.Net.WebException: The remote server returned an error: (404) Not Found.
  at System.Net.HttpWebRequest.GetResponse()
  at System.ServiceModel.Channels.HttpChannelFactory.HttpRequestChannel.HttpChannelRequest.WaitForReply(TimeSpan timeout)
  --- End of inner exception stack trace ---</ExceptionString>
<InnerException>
<

DataView external datasource filter large dataset?

  

Basically, I have combined 3 call logs from verizon (comma-delimited), t-mobile (comma-delimited), and a internal system (SQL Server) into one table.  Built a dataview to a table that right now with test data has 300,000 rows and will have lots and lots more and all fields are varchar() in database even date and time.  Since I have 300,000 rows, I paged the data at 1000 as this would take a long time for everything to load.

So building the dataview was a challenge to get working but figured that out.  Now I am trying to build searching functions so that someone can search and filter the results on date, time, and really any of the fields.  I attempted a form webpart and setup parameter for search and it kinda works when I have a few test rows. One thing I noticed was if the data was on another page it did not include those in my filter and I think if I paged over eventually I would find it.

So my ultimate question is how would I add filtering/searching into this dataview.  Could I dynamically adjust the query for the dataview like on said date range based on dates in form web part?  Is there a better method for anything I am trying todo?


Thanks, Matt


Introducing ADO.NET and the Typed DataSet

  
In reviewing the applications it seemed everything they were doing involved database reads, writes, and manipulation. The development staff had been reviewing the articles and code samples for ADO.NET. They had spent many years refining their existing ADO based infrastructure and perfecting their use of ADO

Create and Use a Typed DataSet by Using Visual C# .NET

  
This article shows you how to create and use a typed DataSet in a small Web application. Typed DataSets, which inherit from the DataSet class, create first-class members of a DataSet's DataTables and DataColumns, yielding the many benefits that come with the use of strong typing.

Get Top 1 Record from Dataset

  
Many of them in need of getting the Top 1 or Top 10 records from a Dataset without going to SQL query. It is possible to do from Code Behind. I have given the code below,
The below code is to get single record from a Dataset. Also I have given for getting 8 records at Green Color.
Categories: 
ASP.NetWindows Application  .NET Framework  C#  VB.Net  ADO.Net  
Sql Server  SharePoint  Silverlight  Others  All   

Hall of Fame    Twitter   Terms of Service    Privacy Policy    Contact Us    Archives   Tell A Friend