.NET Tutorials, Forums, Interview Questions And Answers
Welcome :Guest
Sign In
Win Surprise Gifts!!!

Top 5 Contributors of the Month
david stephan
Gaurav Pal
Post New Web Links

Get rid of Facebook and Twitter Crawlers

Posted By:      Posted Date: September 20, 2010    Points: 0   Category :ASP.Net


My scenario is:

I have a website that shares some content and shows the number of times it has been shared. The sharing is done through facebook, twitter and e-mail.

Now, while sharing the content with facebook and twitter, the share count gets increased by some random number, sometimes 2 and sometimes upto 25-30. The reason I could find is that the bots and crawlers of facebook and twitter keeps on hitting the content being shared which increases my share count.

Is there a way to stop these bots and crawlers from hitting my website?


Thanks in advance...:)


View Complete Post

More Related Resource Links

Where can I find the code of the Twitter or Facebook or WebGrid helpers?


Just in general, where can I find the code to take a look at and learn from them? Or at least look at the functions available to me as I do get the feeling that the insufficient documentation at the moment reveals all.

Visual Studio asp C#.NEt web application publishing tweet/status on Twitter/Facebook

Hi guysIf you could give me some guidelines It would mean a lot to me. what type of authentication I use, how to do  id from localhost, how to modify web.config file etc 

Twitter/Facebook/Myspace Integration with Asp.net site


Hey guys,

     I have a site that I want to integrate twitter, facebook, and myspace.  For the past week I have been pondering how would I go about doing this. I am thinking about doing the following:

1. ( This all when the user first create an account with my app) When the user clicks on for example the twitter  button and  authorize my application before the site goes to twitter authorization page the site will create a temp user and log in the user into the membership database when they are return to my call back page I check to see if that username is already in use, if not, I then delete the temp user from the membership database and then create a new entry with their twitter username.  If the username is in use, I let the user know. Also, I will add an additinal column to distinguish between myspace, twitter, and facebook within the membership table.

This is a good way to go about doing this. Any ideas would be appreciated. Thanks

Facebook like Profile URL with HttpModule


I am trying to make URLs for users profile pages like Facebooks e.g. http://site.com/username. I had a code snippett from a book for how to do this but when it runs it says its processing a request that will never finish. Im new with HttpModules/handlers but Ive looked over like 100 pages trying to figure this out. My code is below. Any help figuring this out would be greatly appreciated..

public class URLRouter : IHttpModule
/// <summary>
/// You will need to configure this module in the web.config file of your
/// web and register it with IIS before being able to use it. For more information
/// see the following link: http://go.microsoft.com/?linkid=8101007
/// </summary>
#region IHttpModule Members
private IUserRepository _userRepository;

public URLRouter()
_userRepository = ObjectFactory.GetInstance<IUserRepository>();

public void Dispose()
//clean-up code here.

public void Init(HttpApplication context)
context.PostResolveRequestCache += (new EventHandler(this.Application_OnAfterProcess));

Facebook Connect


Does anybody have links to relevant articles on how Facebook Connect integrates with the Membership provider?

I'd like to make a .net site where you can login through the membership provider, or the Facebook Connect system.  But the big question is, how does your asp.net application know when the Facebook authentication has been successful.  Without manually entering a username and password, is there a function to authenticate users and draw the profile info from Facebook's data?

It seems like a good system, but the documentation is sparse.

how to develope a post and comments template like facebook



i want to develope desgin  like facebook .

where i have posts and comments will pick from the database that i inserted earlier.

what will be the best possible way to do in the same template.


Can any One tell me how to achive same facebook's text area "What's in your maind functionality"

Can any One tell me how to achive same facebook's "What's in your maind " textarea functionality works and  How I can do using "ASP.NET 2005"

Facebook integration with sharepoint 2010

how can I show my facebook posts in sharepoint 2010?

internet explorer closes. I can't get my e-mail to open a comment from facebook

when I try to open my internet explorer it either won't open at all or it workd for awhile then it crashes. I was able to open my yahoo mail and open facebook comments from the yahoo e-mail but it never connects 

Twitter - Simple way to show tweets using the API?

I want to display the last 4 tweets on my website.  I've done the following below which works fine but I'd like all of the urls and twitter names in the title to be hyperlinked.  Is parsing the title the best option or is there another approach I should take?Sub GetTweets() Dim xmlDoc = New System.Xml.XmlDocument xmlDoc.Load("http://search.twitter.com/search.atom?q=asp.net&rpp=4") 'create the select the nodes Dim root As System.Xml.XmlElement = xmlDoc.DocumentElement Dim nodeList As System.Xml.XmlNodeList = xmlDoc.GetElementsByTagName("entry") lblTweets.Text = "" Dim uri = "" Dim name = "" Dim title = "" For i As Integer = 0 To nodeList.Count - 1 name = nodeList.Item(i).ChildNodes(9).ChildNodes(0).InnerText name = name.Substring(0, name.IndexOf("(")) uri = nodeList.Item(i).ChildNodes(9).ChildNodes(1).InnerText title = nodeList.Item(i).ChildNodes(3).InnerText lblTweets.Text += String.Format("@<a style='color:#01a54e;' href='{0}' target='_blank'>{1}</a> {2}<br />", _ uri, name, title) Next End Sub

Adding Twitter authentication support to ASP.NET application

In my last posting I introduced my idea about common membership provider for ASP.NET that is able to support multiple authentication providers. Before writing membership provider we need support for some authentication providers to get an better idea how to use them together. In this posting I will introduce you how to use OAuth protocol with Twitter. Before we start . . let me make some important notes and give some advises so you know better what is going on: OAuth is secure open-source authentication API that is used by Twitter and many other providers. You can find out more details about OAuth from their homepage at http://oauth.net/. There is also official specification for OAuth by Internet Engineering Task Force (IETF): The OAuth 1.0 Protocol. To make our sad lives easier there is library for .NET that makes it for us easier to support OAuth and OpenID protocols in our systems. This cool library is called DotNetOpenAuth. This library is also used by stackoverflow and MySpace. We will use the same library, so go and download it before starting with code. You need to register Twitter application. Go to page Twitter's application registration page and register new application. You need consumer key and consumer secret parameters of your application later. Copy "Sign in with Twitter" to some of your web application's folders where other images are. You need

Twitter sucks and must be run by amateurs

I can't say that I've ever known any kind of Web-based service to suck as much as Twitter, yet be as simple and popular. It really boggles the mind. As just a regular user, it can be annoying enough with the constant outages and failures. As a developer, it's even worse. In my case, I put a simple hook in CoasterBuzz to publish links from our news page using our cstr.bz short URL's. At the time, you could do simple authorization, as well as OAuth. Since I wasn't dealing in nuclear secrets, and the .NET libraries for OAuth and/or Twitter were somewhere between weak and non-existent, I took the path of least resistance and did up some basic auth against a super simple RESTful URL. It took all of five minutes. And hey, all the docs said is that they'd support basic auth for a long time (or something to that effect). Then yesterday, I noticed that the publishing is failing. I look at my error logs, and it's 401'ing. I do some looking around to find that they've turned off basic auth. To add insult to injury, I see this on their blog: Fortunately, developers have known about our transition to OAuth since last December, so they've had time to update their apps." Wow, really? Everyone knew? It's news to me. I pushed out my silly stuff in February, and there was no mention anywhere of any intention to discontinue basic auth, or dates or anything else. Lame. So I'm chatt

Twitter reader

Dear all,I have writing software Twitter reader by C# and reading from this link http://twitter.com/statuses/friends_timeline.xml , in the first time my soft run very good but since Twitter to change system to authentication account then my soft not work.Code twitter reader I used:        client = new WebClient(); client.Credentials = new NetworkCredential(user, pass); stream = client.OpenRead(APILink); reader = new StreamReader(stream); xml_read = new XmlTextReader(reader); xml_Doc = new XmlDocument(); xml_Doc.Load(xml_read); Please help me this problem.Thanks a lot,My email: kieungocdung@hotmail.com

Facebook status update using C#

Hi Guys     I am trying to wirte a program so that I can do wall post/status update using my C# program  using facebook api . How to do this? please share complete code.   Thanks.

facebook notifications update with javascript

Dear all, how can i make notification counter like facebook notifications in the top left of the page , the question is how to make this counter and update a value using javascript or asp.neti want to make something like that , that is updated every 5 min. with the new counter. if anyone can help me with some code tips , it will be greatfulthanks and regards, Mina Jeffrey

Twitter API...help!!

Hi,I was trying to use Twitter API but was stuck at first step itself i.e., while requesting token. Below is the code I am usingpublic string RequestToken() { string HTTPVerb = "POST"; OAuthBase oab = new OAuthBase(); string ConsumerSecret = "***********************************"; string normalizedURL = ""; string normalizedParams = ""; string ReqUrl = "https://api.twitter.com/oauth/request_token"; Uri ReqUri = new Uri(ReqUrl); //oauth_callback string CallBackURL = "http://localhost:3335/MainWeb/CallBack.aspx"; //oauth_consumer_key string ConsumerKey = "*****************"; //oauth_nonce string UniqueId = oab.GenerateNonce(); //oauth_signature_method string SignMethod = "HMAC-SHA1"; //oauth_timestamp string TimeStamp = oab.GenerateTimeStamp(); //oauth_version string OAuthVersion = "1.0"; string Response =""; string Data = "oauth_callback=" + CallBackURL; Data += "&oauth_consumer_key=" + ConsumerKey; Data += "&oauth_nonce=" + UniqueId; Data += "&am

Photo Tagging like Facebook

Hello All,I'm trying to create an image gallery where you can create tag on the photo like on facebook.Does anyone knows any free library to do this... I have already searched on google but i don't be able to find anything :SThanks in advance
ASP.NetWindows Application  .NET Framework  C#  VB.Net  ADO.Net  
Sql Server  SharePoint  Silverlight  Others  All   

Hall of Fame    Twitter   Terms of Service    Privacy Policy    Contact Us    Archives   Tell A Friend