.NET Tutorials, Forums, Interview Questions And Answers
Welcome :Guest
Sign In
Win Surprise Gifts!!!

Top 5 Contributors of the Month
david stephan
Gaurav Pal
Post New Web Links

The incremental indexing never ends

Posted By:      Posted Date: April 10, 2011    Points: 0   Category :C#


We have a problem with the incremental indexing in our SharePoint farm.

The problem is that it sometimes takes up to 40 hours to complete. This is not the case every time, but it happens at least every other day.

The incremental indexing is set to start every 15 minutes.

When this error occur, it is no evidence of this in the indexing logs in central administration , but the SharePoint logs continues to grow.


This is a SharePoint 2007 environment with one front end machine, one indexing server and one sql server.


Have anyone seen this kind of behavior before or have an idea of what can be causing this?


View Complete Post

More Related Resource Links

Patterns in Practice: Incremental Delivery Through Continuous Design


The end goal of software projects is to deliver value to the customer. Software design is a major factor in how successfully a team can deliver that value. The best designs are a product of continuous design rather than the result of an effort that tries to get the entire design right up front. This approach lets you strive to apply lessons learned from the project to continuously improve the design, instead of becoming locked into an erroneous design developed too early in the project.

Jeremy Miller

MSDN Magazine August 2009

sharepoint 2007 indexing issue


when we do incremental crawl, the items in index start decreasing and the error count remains the same. so it is hard to find what is causing the index items to reduce. can anyone help please. i had to pause the active crawl because of this index item decrease.

I have checked the following:

1) there is no space issue

2) no credential issue

What I found a bit fishy is that:

1) in the log, i got ->

a)get REGKEY_FLTRDMN_MS_TO_IDLE, using default - _File:\office\source\search\search\gather\fltrdmn\fltrdaemon.cxx Line:323

b) Server Office Server Shared Services 6pls Medium Cache blocked for shared object '1dd1db1d-8a07-4e27-9249-b7d328818fa2' of type 'Microsoft.Office.Server.Search.Administration.SearchSharedApplication'

Please help.

Incremental Crawls take hours randomly


On occasion the incrmental crawls; which usually take under 1 minute take hours to run.

The crawl logs show a successful crawl message and the nothing til it completes, not a single log entry.

It will eventually finish and the next incrmemental will run just fine.

No errors or anything to speak of.

Index has 800K items


REGEX does not match when line ends with the characters.. also, how to negate words that contain the

\S*(ai|ie)\S*   seems to match all words with characters ai and ie in them.  However it does not match if the line ends with them, how can fix that?Also, how can I match all words that DO NOT contain those characters.. I've tried ?! and [^ to no avail.Thanks in advance for any help or information!

Indexing services on window server 2008 is not working with .net

Hi, I am useing Microsoft indexing services in windows 2008 64 bit .I am getting error like "Exception from HRESULT: 0xC0000005" while i am createing  new catlog from .net 2.0.I am using  "ciodm.dll" for adding new catlog. i am using this code for create new catelog.   Dim Admin As New CIODMLib.AdminIndexServer   Admin.AddCatalog(varContractNo, txtCatelog.Text + "\" + varContractNo) Admin.Stop() Admin.Start() AddScope(txtDocFolderPath.Text, txtSite.Text, txtCatelogname.Text)   Please help me anybody have fixed this issue on window server 2008 64 bit.  

Incremental processing -> aggregations dropped, even with rigid attribute relations

Hi! Very briefly, my goal is to incrementally process the fact data for my SSAS 2005 cube, without losing aggregations. For that purpose, I have defined all attribute relationships as rigid (I don't really expect any of the relations to change) because I hear that flexible aggregations get dumped during incremental processing. BIDS Helper indeed confirms that all of my aggregations are rigid. Then I proces the cube, either via the SSMS GUI using the "Process Incremental" option, or with an XMLA command using type "ProcessAdd". The outcome is the same, no matter which method I use. Then I check the status of my aggregations. I do so first by sending a DISCOVER_PARTITION_STAT Discover XMLA query (http://geekswithblogs.net/darrengosbell/archive/2008/12/02/ssas-are-my-aggregations-processed.aspx), and, as a double check, by sending a query to the cube from which I know it normally uses an aggregation and checking in the profiler whether the aggregation is really used. The result is always the same: The aggregations are lost! The DISCOVER_PARTITION_STAT query informs me that all aggregations have size = 0. Note, that after a ProcessFull, all aggregations are there (with size > 0) and work as expected, so the problem only occurs after incremental processing. Also for the problem to occur it is enough to incrementally process the cube, the dimensions are lef

MissingIDLog files in SharePoint 2007 indexing server

Hello, We have configured sharepoint  2007 server to crawl lotus notes databases.  The problem is huge number of MissingIDLog.txt files are generating daily in root directory(C:\) of indexing server and these files are of 0Kb. How to stop these MissingIDLog.txt files? Regards, Gireesh  

Indexing Document library which contains .RTF files

Hi All, I've just craeted a document library objects in my SharePoint site and then i imported several hundreds .RTF files into it, how and when can i perform search and compare of this files against each other ? Does MOSS 2007 SP2 Enterprise supports indexing .rtf files ? Thanks, AWT/* Infrastructure Support Engineer */

Process Data VS Incremental Process

HI All. what is the difference between Process Data VS Incremental Process.   Regards Amit

Indexing or Reindexing question

We use SQL for our product and our clients are begining to complain that the indexing or reindexing operation is locking the database until it is finished.   Two questions. Is this normal? Is there a way to index or reindex before the database performance comes to a crawl while still using the database on a 7X24 schedule?

Indexing files larger than 16 MB in SharePoint 2010

Tonight, I came across an interesting blog post by Fellow MVP, Todd Klidnt in which he explains how to work around the 16 MB limitation for file indexing in SharePoint 2010 using PowerShell. "As with previous versions of SharePoint, SharePoint 2010 will not index the contents of files larger than 16 MB. There are a couple of reasons for this such as network usage pulling large files across and the time it takes to break them apart". Click here to continue to the post.

After subsite creation all i try to do ends in an error message.

Hi all. My sp2010 generates error everytime i try to do "site settings" or "site permissions" on a subsite i just created. All i get is blank page with Correlation ID: 78b8fc9b-2a4f-4a76-8a6d-8be644767f08 Is this some commonly known bug ? im trying to find something from the logs to match the correlation id but thus far havent succeeded. Any help appreciated here thx.  

syntax problem passing parameter into Indexing Service Query

Hi everyone, I have the following query which works fine: select OriginalFileName from Document_Entries where EntryType like 'File%' and substring(entry,charindex('file_',entry),LEN(entry)) in (  SELECT filename FROM OPENQUERY(MySearchCat, 'SELECT Directory, FileName FROM SCOPE() WHERE    CONTAINS('' "green" '') ') )  It finds all documents in the document system which contain the word "green" using the index catalog.  My problem is that i need to include this query in a larger stored procedure which accepts a parameter for key words amongst others. I can't work out the syntax to get the @keywords parameter into query. The closest I've come is the following which runs but comes back with "incorrect syntax near keyword 'green'".  The @keywords parameter will contain any key words the user enters.   declare @keywords nvarchar(500) set @keywords='green'   Declare @query nvarchar(max) set @query = ' select OriginalFileName from Document_Entries where EntryType like ''File%'' and substring(entry,charindex(''file_'',entry),LEN(entry)) in (  SELECT filename FROM OPENQUERY(MySearchCat, ''SELECT Directory, FileName FROM SCOPE() WHERE    CONTAINS(''' + @keywords + ''') '')     )  )' exec(@query)   Any ideas? thanks Gus

Difference between delta load and incremental load and full load

Difference between delta load and incremental load and full load

Indexing Service problems

After days of searching for a solution on the Internet I hope someone can help, Others have had the same problem but there were no real solutions posted. My problem is that the Index Service does not return all the fields in the results of my DataGrid, for example DocTitle and Characterization are empty while Path and Url bring back entries. If I use the Indexing services default query page for that catelog it returns all the correct information. I dont believe its my code because its pretty much the same as all the examples I have found on the net. It does not matter if I use the existing 'Web' catelog or create my own. Hope someone has a suggestion. Dim strQuery As String strQuery = "Select DocTitle,Path,url,Characterization from SCOPE() where write_ > '2000/06/26' and CONTAINS(filename, '.htm')" Dim connString As String = "Provider=MSIDXS;Data Source=web" Dim cn As New System.Data.OleDb.OleDbConnection(connString) Dim cmd As New System.Data.OleDb.OleDbDataAdapter(strQuery, cn) Dim testDataSet As New DataSet("results") cmd.Fill(testDataSet) Dim source As New DataView(testDataSet.Tables(0)) DataGrid1.DataSource = source DataGrid1.DataBind()

BDC model in Search Server 2010 indexing error - Error while crawling LOB contents. ( Not a valid Wi

I have created a .NET connector assembly that pulls data from an in-house .asmx web service.  I have successfully created an external list in a search center site that displays this data without problem.   However, I've run into an error and a warning when indexing this list in search server 2010 for which I cannot find much information.  I've configure a content source with LOB data as the content source type and select my external data source from the list. After running a full crawl, I receive this error: Error while crawling LOB contents. ( Not a valid Win32 FileTime. ) And this warning: The content for this address was excluded by the crawler because this item was marked with a no-index meta-tag. To index this item, remove the meta-tag and recrawl. My .NET connector assembly looks like this:   public static WeatherEntity ReadItem(string id) { foreach (WeatherEntity entity in GetAllEntities()) { if (entity.LocationAbbreviation == id) { return entity; } } return null; } public static IEnumerable<WeatherEntity> ReadList() { return GetAllEntities().ToArray(); } public static List<WeatherEntity> GetAllEntities() { List<WeatherEntity> weatherEntities = new List<WeatherEntity>(); WeatherService.WeatherWS service = new WeatherService.WeatherWS(); WeatherService.DsWeatherDa

Simple question about indexing

Hi, Let's say I have a table that looks like this: StudentID int, PK FirstName varchar(50) not null LastName varchar(50) not null Score tinyint not null My question is this: if I'll be using the "Score" column in my SELECT statements such as MAX(Score) or SCORE > 75, etc. do I need to create an index for the Score column? Thanks, Sam
ASP.NetWindows Application  .NET Framework  C#  VB.Net  ADO.Net  
Sql Server  SharePoint  Silverlight  Others  All   

Hall of Fame    Twitter   Terms of Service    Privacy Policy    Contact Us    Archives   Tell A Friend