I'm having difficulty understanding the crawl rules. In what type of situations would you add an include rule (unless you were including a part of a website before excluding the rest)? Does it even make sense to have include rules after exclude rules at
Let's say I want to crawl Google.com and have set it up as a content source. Is there any point in adding http://www.google.com/ as an include crawl rule?
View Complete Post