I am running into some weird behavior with how SharePoint is crawling site/list data. Let's say our main intranet site is
Most of our older sites are setup with URLs like
http://www.intranet.com/sites/sitename . Crawling is working fine on these sites and I can execute a search and find all of the results I would expect. At some point recently (before I joined this firm), they made a decision that all new sites
would have the URL http://www.intranet.com/SiteDirectory/sitename . Any sites which fall into this bucket are not being crawled, it would seem.
If I check Central Adman>Shared Services>Search Administration, I can see that the first content source being crawled is
http://www.intranet.com so I would imagine this crawl should pick up anything under /SiteDirectory/ but it is not. I also checked the Crawl Settings on this page and it is set to "Crawl everything under the hostname
for each start address". Lastly, I see that there were only 21 errors in the last full crawl but none of these errors apply to a /SiteDirectory/ site.
In short, what could be causing the crawl to apparently skip all of the sites within /SiteDirectory/ and how can this best be fixed?
View Complete Post