.NET Tutorials, Forums, Interview Questions And Answers
Welcome :Guest
Sign In
Win Surprise Gifts!!!

Top 5 Contributors of the Month
david stephan
Gaurav Pal
Post New Web Links

Incremental processing - do I need to provide specific query?

Posted By:      Posted Date: October 07, 2010    Points: 0   Category :Sql Server


I have read a few thread on this subject but I didn't get a clear understanding on how incremental processing works.

My question is.. I have a Fact view with with TimeID,Computerid as primary keys. I would expect when I do an incremental processing that SSAS figure out for which keys the cube doesn't have data and insert the missing ones. However, it looks like you have to specify the query to determine the data that should be incremented in the cube, is that right?

How could I do then if my TimeID isn't populated sequentially? For instance, I could write a query to get only today's data but it's very possible that tomorrow or the day after there are still some late rows being inserted with todays timeID but at that time my query would miss these rows. Please let me know if the explanation is a bit confuse.


View Complete Post

More Related Resource Links

Incremental processing -> aggregations dropped, even with rigid attribute relations

Hi! Very briefly, my goal is to incrementally process the fact data for my SSAS 2005 cube, without losing aggregations. For that purpose, I have defined all attribute relationships as rigid (I don't really expect any of the relations to change) because I hear that flexible aggregations get dumped during incremental processing. BIDS Helper indeed confirms that all of my aggregations are rigid. Then I proces the cube, either via the SSMS GUI using the "Process Incremental" option, or with an XMLA command using type "ProcessAdd". The outcome is the same, no matter which method I use. Then I check the status of my aggregations. I do so first by sending a DISCOVER_PARTITION_STAT Discover XMLA query (http://geekswithblogs.net/darrengosbell/archive/2008/12/02/ssas-are-my-aggregations-processed.aspx), and, as a double check, by sending a query to the cube from which I know it normally uses an aggregation and checking in the profiler whether the aggregation is really used. The result is always the same: The aggregations are lost! The DISCOVER_PARTITION_STAT query informs me that all aggregations have size = 0. Note, that after a ProcessFull, all aggregations are there (with size > 0) and work as expected, so the problem only occurs after incremental processing. Also for the problem to occur it is enough to incrementally process the cube, the dimensions are lef

How to get one specific row to be the last row returned from a query?

 I have a table of skills.  In that table, are rows of data with various skill type.  I need to return a list of those skills in alphabetical order, with one exception.  The skills "General" can't be listed in the "G's", instead, it needs to be the last item.  (Crazy, I know, but it's to discourage users from settling on a selection of "General".  This statement returns all the skills in alphabetical order, but "General" is listed right in the middle with other "G's:SELECT SkillsID, Skill, SkillDesc FROM tSkills  ORDER BY Skill

MDX query to filter on specific dimension attributes

Ok, trying to figure out how to filter on specific dimension attributes. Are there any suggestions? I have a measure that needs to be filtered by a dimension that has numerous attributes (20 attributes in total) but I only want to show that measure against 10 of the attributes and once I get that result I need filter that result set against my time dimension (which this part I have figure out)   This is what I have so far: With member [calculated_measure_name] as ( [measures].[count_of_people], { [dimelgiblestatus].[elgible].[elgible1], [dimelgiblestatus].[elgible].[elgible2], [dimelgiblestatus].[elgible].[elgible3], [dimelgiblestatus].[elgible].[elgible4], [dimelgiblestatus].[elgible].[elgible5], [dimelgiblestatus].[elgible].[elgible6], }   )   Select [calculated_measure_name] on columns, [date].[fsicalyear].&[2008], [date].[fsicalyear].&[2009], [date].[fsicalyear].&[2010], [date].[fsicalyear].&[2011] on rows from mycube   When I run it, it gets no errors but in the result set for the numbers I get "#error"; do I need to basically create a subcube in order to get the result like I would like? If so how would I start doing that?   ThanksNetwork Analyst

Logical Query Processing Phase1 (From)

Hello All, I read this topic so many times "Logical Query Processing" , the first phase "(1) FROM The FROM phase identifi es the query’s source tables and processes table operators. Each table operator applies a series of subphases. For example, the phases involved in a join are (1-J1) Cartesian Product," http://tsql.solidq.com/books/insidetsql2008/Logical%20Query%20Processing%20Poster.pdf That's where I am confuse.. Does SQL Server engine reads all the records from table1 and table2 in memory and apply cross join and get Virtual table for us? Thanks    

dimension's incremental process generates processing on all partitions in cube


Hey eb

Have any one noticed this behavior??

Incremental process (process update) of dimension generates reprocessing of indexes on all cube's partitions,even when no change has occured in that dimension.

I am using SSAS 2005 sp2.

This is disturbing because my cube holds some 700 daily partitions so processing indexes on all of them - on an hourly basis - is very time consuming.

Also it flashes that cube's cache!


I did noticed that changing heirarchies memberskeysunique property to True + changing the toppest attribute in this heirarchy mambernamesunique to true solves this problem.

Is this a must then to prevent recalculating indexes on partitions every process update of dimension??



Map query processing time


Hi , i have a confusion , normally we use Background worker or thread for background processing, i want to map query processing time with background worker so that when query is running i want to get continuous updates that how much time elapsed and how much time remains that i can show in progress bar or percentages as on my choice , Is there any way how can we synchronize query processing time with my c#.net application. Any help will be highly appreciated, or any idea ?

How do find what query is being executed on specific session ID?



I have a SP which writes to a table all processes which are being executed when application decides to stop waiting for results of the query. It works very well but problem is that it does not dump all SPIDs but only some of them which are being executing for a long time. Common pattern that a lot of SPIDs will be blocked by single SPID which will not be part of the output which is being generated. How do I dump all SPIDs and what they are doing along with SP below?


 'blk object' = t1.resource_associated_entity_id,

 (SELECT SUBSTRING(text, t3.statement_start_offset/2 + 1,
 		(CASE WHEN t3.statement_end_offset = -1 
 			THEN LEN(CONVERT(nvarchar(

Nhibernate query ? specific field


how to pick a specific field (besides Primarykey field ) through HQL query ???

data shaping question - can this much conditional processing can be done within the linq query?



I have a scenario where I need to map the value of a field to a different value... easier explained with simple example:

when actual field data is "RED" I need to return "some other data"
when actual field data is "BLUE" I need to return "something else" 

so I've written linq to sql statements that project and shape, but I've never had to include any 'conditional' processing, can you?

Can anyone provide some help tips on SQL query select statement


Hi, everyone

Can anyone provide some help tips on SQL query select statement.

Sample :

Table1 :

fieldID     fieldvalue

01           value1

02           value2

03           value3

04          value4


Store procedure expect parameter for partition


fieldID    partitionID     fieldvalue

01            1                value1

02            1                value2

03            2                value3

04            2        &n

CAML query to check if user is member of a specific group


I've got a nested query caml which basically should check 3 things:

  1. Check if a task has been assigned directly to the ucrrent user
  2. Check if a task has been assigned to a group the user is in
  3. Check if the user is member of a specific

The first to bullet points work like a charm, but I can't figure out how to get the last one to work. Here is what I thought should work:

query += "<Where>";
query += "<Eq><Membership Type=\"CurrentUserGroups\">";
query += "<Value Type=\"String\">Name of my specific group</Value>";
query += "</Membership></Eq>";
query += "</Where>";

Somehow it doesn't seem to be the correct approach, is there somebody who can help me out on this? Thanks

How can I find from a single query that a user has which permission on a specific table


Hi All,

How can I find from a single query that a user  has which permission on a specific table. I have a Table named "Property_Address" and a User "ABC" doing update on this table. How can I revoke permissions on this table from this user and how can I find which permissions this user have on Property_Address Table.

Any help would be appreciate.

Caml Query to fetch the data from Sharepoint List for a specific date.



I have a sharepoint list with one of hte columns being Created Date of Type DateTime and value allowed is OnlyDate.

The submitted date in my column is 05/18/2011. When I perform a search using the below CAML query, it does not give any results though I have two items with this date.

<Where><Eq><FieldRef Name='Date_x0020_Created' /><Value Type='DateTime'>5/18/2011</Value></Eq></Where>

I dont understand what is wrong with this query. Someone please help

Janaki Thakur

MS SQL Server: Search All Tables, Columns & Rows For Data or Keyword Query

If you need to search your entire database for specific data, this query will come in handy.

So when a client needs a custom report or some sort of custom development using Great Plains, most of the time I will have to track down the data in the system by running this query and find the table(s) it is in.

How to Encrypt Query String Parameters in ASP.NET

Encrypt Query String Parameters in ASP.NET.u can send secure data one page another page u can also use query string to encrypt

Content Query Web Part missing in SharePoint 2010

If you don't see content query web part listed in the web parts list, this is because you have not enabled "Search Server Web Parts" feature in site collection features. Enable this feature and content query web part will show in the list of web parts.

how to impose javascript event processing?


If I have some form control like textbox and I want the event handler to be located in the html instead of at the server side, how to do that? Of course I can copy paste javascript code in the aspx file. But is it possible to do that using some object oriented approach (ie programmatically in the code behind)?


ASP.NetWindows Application  .NET Framework  C#  VB.Net  ADO.Net  
Sql Server  SharePoint  Silverlight  Others  All   

Hall of Fame    Twitter   Terms of Service    Privacy Policy    Contact Us    Archives   Tell A Friend