.NET Tutorials, Forums, Interview Questions And Answers
Welcome :Guest
Sign In
Register
 
Win Surprise Gifts!!!
Congratulations!!!


Top 5 Contributors of the Month
Imran Ghani
Post New Web Links

XML Bulk Upload performance variable

Posted By:      Posted Date: April 10, 2011    Points: 0   Category :
 

I've developed a process that uses XML bulk upload classes (SQLXMLBulkLoad4Class) to upload from a c# wcf service to a SQL server 2005 enterprise database. Performance of the upload step on my Dev and TST servers is good with 61 XML files (748MB combined size) being uploaded in 7 - 10 mins. When I release this code to the UAT and Prod environments the same set of files takes 30 - 60 mins to upload. I've looked at IO and CPU performance counters in these environments and if anything the Dev and TST counts are worse. What can I do to improve performance?




View Complete Post


More Related Resource Links

Performance Drop when switching from a #temp table to a @temp table variable

  

I am trying to convert a stored procedure to a table valued function and the performance has taken a HUGE hit and I was wondering if there was anything that can be done about it. Since a table valued function can not use #temp tables it must be converted to a @temp table variable.

Here are some steps I have already taken...

The original stored proc starts off by populating a #temp table via "Select x Into #temp ..."

Leaving it a stored proc for now, I explicitly created the #temp table and did an "Insert Into ... Select From" to more closely model how it must work when using a @temp table variable. There was no discernible performance difference.

Still leaving it as a stored proc, I then swapped out the #temp table with the @temp table variable and now, all of the sudden, the performance drops from sub-second to over a minute!!!

The temp table only has one field defined as an int and it is distinct, so I tried making the field the Primary Key to see if that would help and it did not.

The temp table is created by scanning a table with around 11,000 rows and the temp table itself has about 4400 rows in it (if it makes a difference to anyone).

Does anyone have any suggestions (or hope) for me?

Thanks,
Jim


Performance Drop when switching from a #temp table to a @temp table variable

  

I am trying to convert a stored procedure to a table valued function and the performance has taken a HUGE hit and I was wondering if there was anything that can be done about it. Since a table valued function can not use #temp tables it must be converted to a @temp table variable.

Here are some steps I have already taken...

The original stored proc starts off by populating a #temp table via "Select x Into #temp ..."

Leaving it a stored proc for now, I explicitly created the #temp table and did an "Insert Into ... Select From" to more closely model how it must work when using a @temp table variable. There was no discernible performance difference.

Still leaving it as a stored proc, I then swapped out the #temp table with the @temp table variable and now, all of the sudden, the performance drops from sub-second to over a minute!!!

The temp table only has one field defined as an int and it is distinct, so I tried making the field the Primary Key to see if that would help and it did not.

The temp table is created by scanning a table with around 11,000 rows and the temp table itself has about 4400 rows in it (if it makes a difference to anyone).

Does anyone have any suggestions (or hope) for me?

Thanks,
Jim


Read Uncommited (Bulk insert) and Performance

  

Hi all,

I have issues with Concurrency.

there has been times when updates happen on my fact table while some users read data from it at the same time, it takes a very long time and there is some blocking issues.

1.My inserts happen as Bulk inserts. I would like to know if I change my query to use NOLOCK will it still be blocked by the Bulk insert when i read? so does Bulk insert do an exclusive lock, so i cant read data?

2. changing my query to use NOLOCK is it benefical?

Please help me


Setting up a variable for a Bulk Insert Task in a For Each Loop

  

Is it possible to set up variables in a Foreach Loop for a Bulk Insert Task?

The Bulk Insert Task works fine without using a variable. But I have many file so I need to set the variable inside the Foreach Loop to read files one by one.

Everything I've tried keeps failing. I set my Destination and Source connections and then in the Bulk Insert Task Editor set up the expression with the variable that I have decalared (str_SourceFullName), and then set the bulk insert task delayValidation property to true and it keeps failing...I have tried almost changing every setting but it does not pick up the value of the variable.

I even tried to using an ActiveX Script Task by using the following script to pick up the variable, but the ActiveX Script errors out as well. Here is the ActiveX code:

Dim connmgr As ConnectionManager = Dts.Connections("Dialog2010.txt")

connmgr.ConnectionString = Dts.Variables("User::str_SourceFileName").Value.ToString()

connmgr.AcquireConnection(Nothing)





 Has anyone had this problem?

Thanks


Kajo

Adding a relationship causes an 'unspecified error' during SQL XML Bulk Upload

  

 

Hello, I am new to this bulk insertion and I've got a relationship problem that I cannot seem to solve and I have not found any answers that seem to match my predicament. Any pointers would be extremely welcome.

Basically, the relationship that sets up the customer tables works OK but when I try and add the relationship that should insert a row into the accountstatus table it all goes wrong with an unspecified error message. There's something wrong with the AccountAS relationship and how I've specified it in the element but I cannot figure out what it is.

Many thanks in advance for any help

Source XML

Code Block

<Accounts>

<Account>

<

Bizzare Performance issue when accessing a ushort variable

  
Simple situation, that I can't recreate in a test harness, but I swear to god is happening in my code in ,NET 4.0, VS2010. Release / Debug mode doesn't seem to matter.
Given the following very simplified code which is run about 20000 times during a set of calculations, having the 'if' statement commented out results in the code running in around 5 seconds. As soon as I add the 'if' statement, the time goes up over 17 minutes. I am not kidding you.  I've been looking at this for two days. Comment out one line of code that *should* reduce the number of times DoSomething() is called, and I end up multiplying the execution time by a factor of over 350.
public class Foo()
{
 private ushort _month;

 public ushort Month
 {
   get { return _month;}
   set { _month = value; }
 }
 
 public void Calculate(ushort inputMonth)
 {
   if (_month < inputMonth)
    DoSomething

ASP.NET Best Practices for High Performance Applications

  
This article lists the techniques that you can use to maximize the performance of your ASP.NET applications. It provides common issues, design guidelines, and coding tips to build optimal and robust solutions.

Upload Multiple File using JQuery in asp.net

  
In this article I have explained how to upload multiple files using file upload control. I have used jQuery plugin for uploading multiple files.

I have also explained how to check for file type, file maximum size limit using jQuery & also using server side validation code.

Top .NET Performance Problems and how to avoid them

  
Every time I work with one of our .NET customers to help them with managing their application performance I come across the same problems as seen with other clients before: lots of ADO.NET queries, many hidden exceptions in core or 3rd party .NET libraries, slow 3rd party components, inefficient custom code

High-Performance .NET Application Development & Architecture

  
It has always been a goal of project architects to plan an effective strategy from the ground up in regards to an new application. All relevant factors are taken into consideration with respect to the application, from its design and layout to a functional website infrastructure. Pre-.NET strategies and design guidelines still effective now were developed with Microsoft's DNA (Distributed interNet Application) platform. This model successfully served the purpose of architecting N(any number of)-Tier (levels) applications. In its basic sense, as in most robust, distributed applications, you'll architect 3 main layers or Tiers: presentation, business rules and data access.

How to improve the performance of ASP.NET MVC web applications

  
It is an in depth analysis of a Digg-like site and how it went from serving (on a test machine) 6 req/sec to 390 req/sec.

The biggest gain, 74 req/sec to 390 req/sec happened when he introduced data caching and another 25 req/sec where gained when he introduced the compilation of LINQ queries.

High Performance ASP.NET - Speeding Up ASP.NET Pages

  
have been writing a series of blog posts, which I have named High Performance ASP.NET Websites Made Easy! There is no rhyme or reason to the order of these posts and certainly can be read in any order:

Developing High Performance and Scalable ASP.NET Websites
Avoid Chatty Interfaces Between the Tiers in Your ASP.NET Web Application
ASP.NET Page Profiling - Page Tracing - High Performance and Scalable ASP.NET Websites Made Easy
Web Applications: N-Tier vs. N-Layer - Benefits and Trade-Offs
Query Analyzer - Sql Server Database Indexes and Execution Plans

Improving Application Performance in .Net

  
Application performance has always been a concern for Web Application developers. This article contains guidelines and tips for maximizing application performance in ASP.NET.

Tips to Improve Your ASP.NET Web site performance

  
ASP.NET has been developed with lots of features which makes developer life easy. Start from ViewState, PostBack, Server Controls , User Controls and etc. All of them can make your web development experience fun and easy, but improper use of them can cause your site performance slowdown. Most of the controls generate overhead to the client and server. Therefore in this article, I I will list out about things you can do and don't to improve your ASP.NET website performance.

10 Tips for Writing High-Performance Web Applications

  
Writing a Web application with ASP.NET is unbelievably easy. So easy, many developers don't take the time to structure their applications for great performance. In this article, I'm going to present 10 tips for writing high-performance Web apps. I'm not limiting my comments to ASP.NET applications because they are just one subset of Web applications. This article won't be the definitive guide for performance-tuning Web applications-an entire book could easily be devoted to that. Instead, think of this as a good place to start.

Local variable scoping in C#

  
In my previous post, Compiler-generated scopes for local variable declarations, I briefly touched on the issue of multiple meanings applied to the same name. In this post, I'll aim to flush out the compiler's rules with regards to binding names in their local scopes.

Compiler-generated scopes for local variable declarations

  
I was tasked with understanding and fixing a bug on error reporting with foreach iteration variables the other day, and it got me thinking about local variable scoping rules in C# in general. First, the bug.
Categories: 
ASP.NetWindows Application  .NET Framework  C#  VB.Net  ADO.Net  
Sql Server  SharePoint  Silverlight  Others  All   

Hall of Fame    Twitter   Terms of Service    Privacy Policy    Contact Us    Archives   Tell A Friend