.NET Tutorials, Forums, Interview Questions And Answers
Welcome :Guest
Sign In
Win Surprise Gifts!!!

Top 5 Contributors of the Month
Gaurav Pal
Post New Web Links

MySite crawling warning 'Content for this url is excluded by the server because a no-index attribut

Posted By:      Posted Date: December 04, 2010    Points: 0   Category :SharePoint

Hi Team,

We have SharePoint farm consisting of 2 WFEs, 1 Application Server and SQL Cluster having 2 nodes.  We are are seeing many of the below warnings in the MySite crawling, more importantly we do not see many of document/s and personal blog not being picked up by the crawler and nothing is searchable. We do not have any Crawl rule on mysite url nor scope rule that points to personal site URL

Can some one help me with finding the reason/cause and solution if any one has come out of this situation.

Advance thank you.


Ramakrishna Pulipati SharePoint Consultant Bangalore, INDIA

View Complete Post

More Related Resource Links

"Content for this URL is excluded by the server because a no-index attribute." in crawl logs


Hi All,

I am getting following error message in Crawl Logs

" Content for this URL is excluded by the server because a no-index attribute. "

Any help in this regard will be greatly appreciated.



Content for this URL is excluded by the server because a no-index attribute.



Can't seem to find where this attribute is set:


Content for this URL is excluded by the server because a no-index attribute.


This is the warning in the crawl log for an entire subsite.



SQL Server: Build Apps that Provide Real-Time Information and Customized Content Using SQL Server No


The adoption of wireless devices continues to spread unabated, and organizations are looking for new ways to get in touch with customers through these new mobile devices. In the past, unsuccessful ideas such as push technology were used to send targeted information to customers. Now, SQL Server Notification Services uses the SQL Server 2000 database engine and the .NET Framework to promote a new breed of notification applications that will allow relevant, consensual communications to be sent to any subscriber device.Here the author provides an architectural overview of the core features that make up SQL Server Notification Services. Along the way he discusses how they can be used for pushing Web content.

Mark Brown

MSDN Magazine November 2002

How to get access to content database after server hardware failure


Sharepoint server 2007 and remote sql 2000 SP4 database, after ShraPoint server crash only content databases are available and intact. Trying to restore from backup fail, stsadm -o restore says that not valid backup is available on path. How to get access to available content database using a new installation with same server name, ip address and partitions configuration. How to recover site with content databases information.

Regards, thanks for help.

Victor Naranjo MCSE + Security MCSA + Security MCSE + Messaging MCSA + Messaging ITIL Certified Comptia Security+

Creating SharePoint Server 2010 External Content Type Associations with SharePoint Designer 2010

Learn how to use Business Connectivity Services (BCS) to create associations between external content types in SharePoint Designer 2010 without using code.

Customizing the Content Query Web Part in SharePoint Server 2007

Walk through how to customize the Content Query Web Part in SharePoint Server 2007 to query content across multiple sites in a site collection and display the results in any way that XSL can support. Learn how to get similar results when customizing the CQWP does not meet your needs.

Best Practices for Content Types in SharePoint Server 2007 and Windows SharePoint Services 3.0

Learn best practices to develop, deploy, and manage custom content types, as well as scenarios for making updates to existing content types in lists.

SQL server index

Hi All, I am trying to understand some fundamentals in SQL server, I read that indexes (Set of pages) are arranged in B-Tree structure...and if it is a clustered index then we find the row of data at the leaf node or else a pointer to the data in case of a non-clustered index. Now my doubt is clustered index have the row at leaf level that means the entire table is available at the leaf nodes of the clustered index...then where are the non-clustered indexes leaf nodes pointing to  1) Are they pointing to the clustered indexes leaf node, as the rows are there. 2) If they are pointing to some other place then is this not duplicating the records (I do not think this is the case and am understanding things wrong..) Thanks in advance.. Bala

SharePoint Server 2010 Search - not returning results but crawling without errors

I have created a Search Service Application on a SharePoint Server 2010 (RTM) Farm and used the default Content Source. I started a Full Crawl and it suceeded with no errors etc. I ran it a few times and no issues. But if I go to the Intranet Portal Web Appliaction and do a search for a document that would have been crawled it does not show up in search results...nothing does. I am not getting any errors in Event Log or ULS Logs relevant to Search. How can I troubleshoot this problem further?SharePoint Solution Architect, Perth Australia - Microsoft Virtual Technology Specialist - MCTS WSS Dev, WSS Adm, MOSS Dev, MOSS Adm - http://wss.made4the.net/ - Founder of http://www.sharepointdevwiki.com/

SP2010- Creating an Index server which will host all the Service applications

Guys, Current Environment : 1 Sql server 2008 R2 and 1 SharePoint 2010 Server OS : windows server 2008 all 64 bit (goes without saynig) For better performance i want to seperate out Service application ( expecially Search Service application) to another windows server while keeping the existing one as a WFE hosting CA as well. From the little documentation i found i am creating an Index server(with out CA on it) 2 questions here : 1. Is this the best way to optimize my farm? 2. Is there any online documentation or any knd of link that woudl describe how to set up the index server. thanks in advance. Sameer  

SQL Server 2008 bug with outer join and index

Hello! We found a problem when migrating from SQL Server 2005 to SQL Server 2008. SQL-statements like   SELECT <table1>.<fields>, <table2>.<fields>, <table3>.<fields> FROM <table1> JOIN <table2> ON <table2>.<field> = <table1>.<field> LEFT JOIN <table3> ON <table3>.<field> = <table1>.<field> WHERE (<table2>.<field> = 2 AND <table2>.<another_field> = 'some_text' OR <table3>.<field> = 2 AND <table3>.<another_field> = 'some_text')   give different results on 2005 / 2008. On 2008 I get lots of exessive rows which have NULLs instead of the values required in the WHERE-term. Changing the Compability Level does nothing. It also doesn't matter from where the query is executed (direct via ODBC, in a view or from the Enterprise Manager). 2005/2008 also use different execution plans. (Btw: how can I make an screenshot of a EP larger than the screen?)   After some hours I drilled it down to the existence of a index! By deleting or deactivating the index 2008 gives the correct results like the 2005 did, after activating the index I get these exessive NULL-rows again!   Anyone else ran into this problem? Any tips (dropping all indexes in a 25+ GB DB is NOT an option :-) ?   Thanks in advance! Holger WellenkötterMCTS SQL 2005

SQL SERVER JDBC: WARNING: Failed to load the sqljdbc_auth.dll

Getting this warning when I run my application.  I have already read the posts that repeat the 'put it in your path mantra' over and over again.  Please, do not redirect me to those posts they are useless.  I am telling you I have this DLL in my java.library.path, and I know this because I can load the DLL with java.lang.System.loadLibrary.  i even tried the directions on the MSDN sight and put the install path directly into my java.library.path.  I still get the warning.  Your driver has a bug, please fix it.

IE8, AJAX and SSL - Solution to mixed content security warning!

 Hi everyone, I've searched this forum and the web for an answer to my problem, but haven't quite found the answer. My corporate site is using Asp .Net 3.5, AJAX and SSL to secure certain pages. The problem is that IE8 throws a message about unsecure content while IE7 and Firefox do not. I know this issue has been discussed ad nauseum (remember, I've done a lot of research), however, I have specifically isolated the issue down to adding the <scriptmanager> control on an AJAX page requiring SSL. With nothing else on the page (e.g. no images or script references), just a simple .aspx page, add <scriptmanager> and IE8 will display the message and IE7 and FF will not.  Based on my reasearch, the issue is most likely related to the scriptresource and webresource handlers, however, I don't know enough about the inner workings to do any good. Here's what I tried... Manually set the scriptpath property of scriptmanager to specify where to find the AJAX scripts. The scriptmanager uses the system.web.extensions assembly (which packages all the AJAX js), so I manually downloaded the library from ajax.asp.net site, copied the js files to a scripts directory and made reference in the scriptmanager directly.  Using Fiddler2, I could see that the references now appear to be SSL, and I know it was working because

Suppress Content Approval Warning Message

When a list has Content Approval activated, the NewForm.aspx shows the following warning at the top of the page: Items on this list require content approval. Your submission will not appear in public views until approved by someone with proper rights. [More information on content approval.] How do I suppress this message?

after restoring content database getting error (HTTP/1.1 200 OK Server: Microsoft-IIS/7.5 Date: Tue,

Hi All, Problem i have taken backup of Old site content database procedure see below 1) first i changed the database to read only mode (Opened SQL Server2005-->selected DB--> properties--> Option-->Database Read-Only=True) 2) taken backup of database from the task--Backup(new.bak) 3) Copied the taken backup to new server and restored (Opened SQL Server2005 --> Right Click on Database Folder--> Restore Dataase) In To database: ihave given DB name From Device: i have selected database from the location where i have saved. click ok.  It has restored successfully 4) I have created a new webapplication and removed its content database from central admin. 5) with the help of stsadm command i restored the above db to this webapplication. then iam getting below error: HTTP/1.1 404 Connection: close Date: Tue, 14 Sep 2010 06:20:08 GMT Server: Microsoft-IIS/6.0 X-Powered-By: ASP.NET MicrosoftSharePointTeamServices: i have refered the below url for restoring http://metahat.blogspot.com/2008/11/backup-restoring-sharepoint-2007-site.html Please help. Thanks in advance.

Search Server 2010 Express Error when crawling LOB Data with BCS Error while crawling LOB contents.

Ok so search server is crawling our BCS external data source which has some columns that allow null. When it hits a null in one of these columns it dies out with: Error while crawling LOB contents. ( '.', hexadecimal value 0x00, is an invalid character. Line 94, position 11. ) This is in the crawl log Is the a Fix / Update / Work around for this (other than modifying the table, taking off allow nulls and using a "blank" default value)

MySite user profile site creation of My Content page is created as provisioned failed (unprovisioned

I've been trying to troubleshoot our User Profile Sync and have noticed the profile pages weren't getting updated with everything.  Most content was but things like memberships and the content tabs weren't.  I also saw this error in ULS: ProfSynch: Exception attempting to enumerate site 25a72070-4249-4698-ae99-c2a45d25b08e for ContentDB 23a6e3ef-6d56-4bde-825e-95c6924e2f91: Microsoft.Office.Server.UserProfiles.ProfileSynchronizationInternalException: ProfSynch: The site with ID 25a72070-4249-4698-ae99-c2a45d25b08e cannot be synchronized due to an unprovisioned root web.      at Microsoft.Office.Server.UserProfiles.SiteSynchronizerCollection.GetSynchInfoForSite(SqlDataReader dr, SynchInfo info)      at Microsoft.Office.Server.UserProfiles.SiteSynchronizerCollection.<get_Elements>d__0.MoveNext() I checked in the MySite database under the webs table and noticed all the My Content sites for all of our users had the flag column with the number 1315 in them - (meaning unprovisioned as the error above states).  Cross checking with the User Sync Profile database under the SiteSynch table I noticed all of the sites have NULL for the value under both the LastSynch and ChangeToken columns (The User Profile Service Application - User Profile to SharePoint Full Synchronization  timer job takes care of populating that).&
ASP.NetWindows Application  .NET Framework  C#  VB.Net  ADO.Net  
Sql Server  SharePoint  Silverlight  Others  All   

Hall of Fame    Twitter   Terms of Service    Privacy Policy    Contact Us    Archives   Tell A Friend