.NET Tutorials, Forums, Interview Questions And Answers
Welcome :Guest
Sign In
Register
 
Win Surprise Gifts!!!
Congratulations!!!


Top 5 Contributors of the Month
david stephan
Asad Ali
Fauzul Azmi
Post New Web Links

Incremental Load and the source archiving problem

Posted By:      Posted Date: October 21, 2010    Points: 0   Category :Sql Server
 

Folks,

I will appreciate your feedback on the following challenge:

Context

  • A SQL Server transactional source system is being replicated to a shadow copy
  • Triggers were added on tables in the shadow copy to populate a Log Table with actions and timestamps (Added , Deleted , Updated)
  • The Log table is used for ETL to populate an Oracle DWH
Problem
  • The source system data will be archived and all rows is all tables will be deleted prior to certain date.
  • The archived data is still required to be maintained in the Oracle DWH
  • The replication between the source and shadow will populate the log table with lots of delete actions on data that in the DWH
  • The data in the DWH will be lost

How can we maintain the data in the DWH and prevent the data from being lost after the archiving ?


Essam Salah


View Complete Post


More Related Resource Links

Problem getting applicaton to run after retrieving it from source control software.

  
Hi;

I am restoring my asp 2.0 app from a source control project to my local drive.

The application was originally created on a different PC but was created with Visual Studio 2005,

ASP.net 2.0.

The source control add-in (Harvest) is not working correctly so I retrieving and saving my web app

outside of Visual Studio.

I finally put all the pieces of the web app back together but now when I compile my app I get the following message:

Build (web): Could not load the assembly 'App_Web_myApplication.master.cdcab7d2'. Make sure that it is compiled before accessing the page.

Will I have to start over ?

Thanks for your insights !


How to solve the problem " FAILED TO LOAD udRBIctrls.ocx" Your version may be outdated??

  
I am getting the error message "Failed to load control 'udspinbutton'from udRBIctrls.ocx.Your version of udRBIctrls.ocxmay be outdated.Make sure you are using version of the control was that was provided with version". I have windows server 2008 64-bit o/s. I have installed my application on it. But in the application when i click few of the tabs of my applicaiton the above error message is being shown. I have searched the internet for the file , but didnt find it on the internet. Please help me to solve the problem.   

Issue: Load {NUL} from flat file to "Flat File Source" faild.

  
Hi guys, I've met a strange issue when I was working to use SSIS to load data from flat file to database. It is a story about {NUL}. Sample Flat File: FIELD_SAMPLE|OTHERS ABC{NUL}DEFG|Any Others   I placed an Flat File Source to load these into package, and the configuration of the Connection Manager are as following: FIELD_SAMPLE: Unicode string [DT_WSTR], Length 8   Then I click the "Preview" button and I can see this data in the "Preview" window correctly (with the value "ABC{NUL}DEFG"). But when I tried to run this package, I've got an error that the "ABC{NUL}DEFG" is too long for this field. Then I changed the length to 20 and it was loaded into SSIS package. But I found the value in SSIS package is "ABC", and "{NUL}DEFG" was not there~ I have no ideal why it is ok in Preview but it is not ok when the package running~     Anyway, I hope to load the {NUL} from the flat file into target database. So that is there anybody could give me a hand?

OLEDB Source Problem?

  
Hi all, My source is oracle am loading the based on process date. I took one variable. Changed evaluate as expression=true. In expression I wrote below query. My total records 696148.only 695590 are loaded in my staging table. After 30 min also its showing yellow color with same records. I changed my process date. Same thing happened. What is the problem I didn’t find? "select member_number,tran_id,tran_dt,store_no,tran_line_id,tier_id, disc_prog_id,disc_prog_lev_id,sku_no,coupon_amt,total_qty,total_price_amt, earned_amt,stmt_amt,paid_dt,sales_stmt_status_code,process_date, orig_tran_id,stmt_num,discount_amt,master_number,order_channel_cd, category,tran_type  from sales_stmt_detail  where to_char(process_date,'MM/DD/YYYY') =" + "'" + @[User::V_SQLProcessDate] +"'" Thanks cmk..

TextBox shows binding source text when window load, so why not with the ComboBox?

  
How can I get a ComboBox to show the binding source value when my window opens?  I have been searching all day for a solution to this, but cannot find anything.  So I have created a sample project to demonstrate my problem.  Below is a Vehicle class, very simple, two members Category and Make.  Category is an enumeration, Make is a string. namespace ComboExample { public class Vehicle { // Constants and enumerations public enum eCategory { Road, Air, Sea } // Attributes public eCategory Category { get; set; } public String Make { get; set; } // Construction public Vehicle(eCategory Category, String strMake) { this.Category = Category; this.Make = strMake; } } } Here is the C# for the MainWindow.  A new Vehicle object is created as a member.  In the constructor I set a data-provider in the XAML to this Vehicle object.  There is a button event for showing the values of the controls and objects so I can check the binding. namespace ComboExample { // Interaction logic for MainWindow.xaml public partial class MainWindow : Window { // Attributes Vehicle m_Car = new Vehicle(Vehicle.eCategory.Road, "BMW"); // Construction public MainWindow() { InitializeComponent(); // link data-p

Unable to load workflow actions from the server - problem!

  
Hi, I have problem on Sharepoint 2010 RTM (new installation). I use workflows from the begining and I had no problem since yesterday. I tried to make custom workflow and the SP designer has frozen when saving it. Since than I get message "unable to load workflow actions from server. Please contact your server administrator." every time I want to customize or make new workflow. Need fast solution, Please help. Regards, Luka

Load and parse a file where the file path is located in a column of a flat file source

  
Hi, I have a situation where I have a CSV that contains a bunch of data that populates a bunch of related tables with FK constraints directly.  Thats no problem.  The problem is that one of the columns specifies a filepath to an XML file that is supposed to contain data to be populated in a table with an FK constraint.  How do I specify the file name to the XML source component at runtime? For example TableA has columns: TableAID GroupName TableB has columns TableBID TableAID (FK to Table A) MemberID (the data in question) TableA has a 1 to many relationship with Table B. The CSV has a bunch of columns including: TableAID File path to list of members for each group. I don't know how to solve this problem.  I tried using a ForEach ... but I couldn't get it to work. Thanks in advance for any assistance.

package 'Visual Web Developer HTML Source Editor Package' has failed to load

  
Hi All  I am using VS 2008 Team Edition with SP1 installed. All was fine till yesterday when i started receiving the error 'package 'Visual Web Developer HTML SourceEditor Package' has failed to load properly (GUID={xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx}}' . I am able to build the project and can do work in cs files but no support for the design view. Reinstall is not fixing this, Please HELP

Problem with AJAX - " Could not load type 'System.Web.UI.ScriptReferenceBase' from assembly 'Syst

  
Hi., I'm using Visual Studio 2008 and i downloaded the toolkit from Codeplex, I downloaded the zip file which i've marked red in the below link.. This is my code, <form id="form1" runat="server"> <asp:ToolkitScriptManager ID="ToolkitScriptManager1" runat="server"> </asp:ToolkitScriptManager> <asp:Panel ID="Panel1" runat="server"> Hi Simbu AJAX Works Fine ! </asp:Panel> <asp:RoundedCornersExtender ID="RoundedCornersExtender1" runat="server" TargetControlID = "Panel1" Radius = "6" BorderColor = "#FBB117" Corners = "All" > </asp:RoundedCornersExtender> </form> & this is the error i get, " Could not load type 'System.Web.UI.ScriptReferenceBase' from assembly 'System.Web.Extensions, Version=3.5.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35' " I saw this post, http://forums.asp.net/p/1273185/3439540.aspx and i changed my TOOLSCRIPTMANAGER into SCRIPTMANAGER & now i get this error ! and now c what this post says... http://forums.asp.net/t/1529516.aspx NOW WOT AM I SUPPOSE TO DO ??? PLZ GUIDE ME ! I'm struck up with this since 2 days....

Attempt to load Oracle client libraries threw BadImageFormatException. This problem will occur when

  
We are migrating our application from windows server 2003 32 bit to windows server 2008 64bit, after I have created the virtual folder on the new machine, I am unable to connect to the database. We have oracle 11g client installed and below is the error which I am getting - </BR></BR> System.InvalidOperationException: Attempt to load Oracle client libraries threw BadImageFormatException. This problem will occur when running in 64 bit mode with the 32 bit Oracle client components installed. ---> System.BadImageFormatException: An attempt was made to load a program with an incorrect format. (Exception from HRESULT: 0x8007000B) at System.Data.Common.UnsafeNativeMethods.OCILobCopy2(IntPtr svchp, IntPtr errhp, IntPtr dst_locp, IntPtr src_locp, UInt64 amount, UInt64 dst_offset, UInt64 src_offset) at System.Data.OracleClient.OCI.DetermineClientVersion() --- End of inner exception stack trace </BR>Any help is greatly appreciated, I have tried couple of solutions going through some threads online but no luck.

Difference between delta load and incremental load and full load

  
Difference between delta load and incremental load and full load

"Failed to load source" posting to MVC2 action with jQuery

  

Hello,

I am trying to save user feedback by using jquery to post to an action however i am getting the error message "Failed to load source for: http://www.something.com/feedback/savefeedback" this code works fine on localhost but not when put on my shared hosting, this doesnt just affect this query post but also at least one other.

below i have the route from the global.ascx, the action int the FeedBackController and the query that does the post.

routes.MapRoute(
"FeedBack",           // Route name
"FeedBack/{action}",  // URL with parameters
new { controller = "FeedBack", action = "SaveFeedBack", id = "" }  // Parameter defaults
);


[AcceptVerbs(HttpVerbs.Post)]
 public bool SaveFeedBack(string FeedBack, string SubmitName, string email)
 {....}


$.post("/FeedBack/SaveFeedBack", { FeedBack: feedbackText, SubmitName: SubmitName, email: email }, function(data) {

if (data == "True"){}

else {}

});





Incremental data load from MySQL database to SQL server 2008 using SSIS

  

I am looking for best solution to perform incremental data load from MySQL database to SQL Server 2008.  I tried to follow instructions from articles on incremental data load in SSIS  using MD5 hashes but I failed to make connection in Lookup transformation editor between MySQL Id (4 byte unsigned integer) and Id in SQl Server 2008 table which is  bigint. i tried to add  data conversion and convert MySQl Id to string. It works fine when you map this field directly to OLEDB destination but in Lookup component it failed. 

 

Any input greatly appriciated.

 

 


problem with XamlReader Load/Parse image

  

I got error with this below:

string imageCompXaml = serialized image (bitmap)

Image imgObj = XamlReader.Parse(imageCompXaml) as Image

err: Property 'UriSource' or property 'StreamSource' must be set

i can workaround the problem by

  imgObj = new Image();
  imgObj.BeginInit();
  imgObj.Source = BitmapImageObject;
  imgObj.EndInit();

problem is by doing i missed out lot of other details.

I have a string, this is the serialized of the Image object, which is BitmapImage

I missed out the Image.prop details, like the width/height.

the image size is not same as the BitmapImage object, its a scaled/sized-down bitmap.

so using the 2nd Source workaround, i can't get back the actual image sizing (b4 serialize)

is there a way i can tackle at the XamlReader.Load/Parse() to resolve the err

or how to get back the image prop/details with my workaround?


Custom Data Source Problem

  

I created a data model in BIDS, built a report from the data model in Report Builder 1.0, and saved to our report server.
When I run the report from the Report Manager it runs fine.

I am trying to modify the report for Data Driven Subscription.
When I setup a Custom Data Source and enter the same credentials that work fine in the Shared Data Source,
I get a very strange error:

An error occurred during client rendering.
An error has occurred during report processing.
Query execution failed for dataset 'dataSet'.
Incorrect syntax near '<'. The label 'xmlns' has already been declared. Label names must be unique within a query batch or stored procedure. The label 'xmlns' has already been declared. Label names must be unique within a query batch or stored procedure. The label 'xmlns' has already been declared. Label names must be unique within a query batch or stored procedure. The floating point value '6e2909' is out of the range of computer representation (8 bytes). The floating point value '6e2909' is out of the range of computer representation (8 bytes). The floating point value '22e84222201' is out of the range of computer representation (8 bytes). The floating point value '6e2909' is out of the range of computer representation (8 bytes). The label 'xsi' has already been declared. Label names must be unique within a quer

Attempt to load Oracle client libraries threw BadImageFormatException. This problem will occurwhen r

  
I'm getting this exception when I create an instance of a System.Data.OracleClient.OracleConnection.

Unhandled Exception: System.InvalidOperationException: Attempt to load Oracle client libraries threw BadImageFormatException.  This problem will occur when running in 64 bit mode with the 32 bit Oracle client components installed. ---> System.BadImageFormatException: An attempt was made to load a program with an incorrect format. (Exception from HRESULT: 0x8007000B)
   at System.Data.Common.UnsafeNativeMethods.OCILobCopy2(IntPtr svchp, IntPtr errhp, IntPtr dst_locp, IntPtr src_locp, UInt64 amount, UInt64 dst_offset, UInt64 src_offset)
   at System.Data.OracleClient.OCI.DetermineClientVersion()
   --- End of inner exception stack trace ---
   at System.Data.OracleClient.OCI.DetermineClientVersion()
   at System.Data.OracleClient.OracleInternalConnection.OpenOnLocalTransaction(String userName, String password, String serverName, Boolean integratedSecurity, Boolean unicode, Boolean omitOracleConnectionName)
   at System.Data.OracleClient.OracleInternalConnection..ctor(OracleConnectionString connectionOptions)
   at System.Data.OracleClient.OracleConnectionFactory.CreateConnection(DbConnectionOptions options, Object poolGroupProviderInfo, DbConnectionPool pool, DbConnection owningObject)
   at System.Data.ProviderBase.DbConnectionFactory.

problem with XamlReader Load/Parse image

  

I got error with this below:

string imageCompXaml = serialized image (bitmap)

Image imgObj = XamlReader.Parse(imageCompXaml) as Image

err: Property 'UriSource' or property 'StreamSource' must be set

i can workaround the problem by

  imgObj = new Image();
  imgObj.BeginInit();
  imgObj.Source = BitmapImageObject;
  imgObj.EndInit();

problem is by doing i missed out lot of other details.

I have a string, this is the serialized of the Image object, which is BitmapImage

I missed out the Image.prop details, like the width/height.

the image size is not same as the BitmapImage object, its a scaled/sized-down bitmap.

so using the 2nd Source workaround, i can't get back the actual image sizing (b4 serialize)

is there a way i can tackle at the XamlReader.Load/Parse() to resolve the err

or how to get back the image prop/details with my workaround?


Categories: 
ASP.NetWindows Application  .NET Framework  C#  VB.Net  ADO.Net  
Sql Server  SharePoint  Silverlight  Others  All   

Hall of Fame    Twitter   Terms of Service    Privacy Policy    Contact Us    Archives   Tell A Friend