.NET Tutorials, Forums, Interview Questions And Answers
Welcome :Guest
Sign In
Win Surprise Gifts!!!

Top 5 Contributors of the Month
Gaurav Pal
Post New Web Links

C# - Creating web client for automating user activity on a HTTPS site

Posted By:      Posted Date: August 28, 2010    Points: 0   Category :.NET Framework
I've been wracking my brain for a couple of weeks on this.  I need to create a web client (I don't want to use the webBrowser control because I need this to be as lightweight as possible) to log in to a secure web site, and then effectively click links and fill in fields to get the data that would normally be displayed in the web browser.  I'm then going to parse the data and perform other actions with it. I have been working with HttpWebRequest and HttpWebResponse and many permutations of suggestions I have found while Googling my issue, but I can't get rid of my problem:  Sometimes when I effictively click the ultimate link that I need to click to get to my data, I get what I am looking for.  However, MOST of the timel, I get a response page that tells me my connection timed out and that I need to log in again.  I have tried messing with cookies and such, but to no avail. I know it's good form to post my code, but it is so sloppy and screwed up right now from tweaking this and trying that, that I'd rather not take the approach of fixing what's there, rather I'd like to start with solid, clean code to begin with. Your help will be greatly appreciated. Thanks, ALo

View Complete Post

More Related Resource Links

Programmatically creating a SharePoint Site based on user input


I am working on developing a “Create Website Wizard” for SharePoint 2007 that would do the following (I am simplifying a little for the sake of this post):


1.      Take user input as follows:



Product Code:

Category (I, II, III):

The category will be a choice field (radio buttons or a dropdown)

Creating and sharing new sharepoint site to internet, limiting user access

I am a new hire into an existing business as I.T. I know the networking, I know the computers. The owner now wants me to learn Sharepoint among some other things. They currently use WSS 3.0. I have been reading up on this for the last month. I think I am ready to extend the current site to make it an Internet site so the employees can login. Some other things we would like to do I have read up on and it looks like they can be done, things such as inventory tracking in collaboration with QuickBooks and creating a website / portal for clients to have a unique login on and can see the status of their jobs in custom SharePoint lists. As far as I can tell the clients need an AD account. However, apart from that I am not sure what to do. A little background.  The company has multiple clients, and we ship things out daily to those clients.  We use Sharepoint to track the status of the jobs as they progress through the stages ultimately going to delivery. There is one common page that lists all the jobs by all clients that is updated constantly. We would like to allow multiple (different) clients/logins and have a page customized for each client.  For example, you are a client and go to www.companyname.com/sharepointsite.html.  From there you would get to a portal page with a login. Once logged in you will be presented with the Shar

IIS web site server code: detecting if client browser supports TLS https encrption mode



Due to security restrictions, we must run our web site under the TLS variant of https (SSL is disabled on the server...only TLS is enabled on the server).

The problem we have is that some customers have TLS disabled in their Internet Explorer  Tools/Internet Options/Advanced settings...and they get a "page cannot be displayed" error.

I need a way to tell those users to "go enable TLS on your browser" (like display a page for this saying this).

Can you tell me how I can determine if (with the server having only TLS...not SSL...enabled) if the browser can support the https?

Some more details on the issue:

I've watched the conversation between the browser client and the server, and it appears that the conversation flow is as follows:

1.) Browser broadcasts to the server which https protocols it supports (and has enabled) (i.e. SSL 1.0, SSL 2.0, TLS 1.0, etc.)

2.) Server checks its configuration (which https protocols are setup to be allowed on the server) and returns back on one of the browser client matching protocols.


What I need to determine is how to detect if TLS is enabled on the browser that makes a request (determine it in the ASP.NET server code), so I can generate a page (in the case TLS is not supported on the IE browser) to inform the user.

"User cannot be found" error when creating My Site after upgrading to SP2 for MOSS 2007



Hope this is the place for sharepoint gurus?

I upgraded MOSS2007/WSS3 to SP2 and since then I have been unable to get My Site to create new sites for existing domain users.

Some of the domain users created their My Site before the SP2 upgrade and they still work. We just cannot create new My Sites for existing domain users.

Now when we try to create a My Site we get this error:

"There has been an error creating the personal site. Contact your site administrator for more information."

I checked the event logs and usually no error is recorded when this happens so sharepoint does not even give me a breadcrumb (thanks!).

However, on one occassion I did get an event message after fiddling here and there and many attempts at trying to create a My Site, hooray! See below for all the glorious details of the event message, but the basic error is:

"User cannot be found".

I have checked the My Site settings of shared services (SSP1), veiwed user profiles, all the domain users are imported. So I have no idea why when creating a My Site it fails?

I have searched many forums and although they get the same error it seems to be for different reasons so the solutions don't help my situation.

Is there somewhere in Sharepoint that these domain users need to exist? Would I be able to c

Need help creating Secure Site that will require client certificate



I am trying to create a secure web service that will require certificate from clients. I'm not working with WCF, just a web service. This is what I did so far:

On the default web site, where I have other web sites that are not secured, I've configured one of the virtual directories in the following way: Directoy Security->Secure Communication -> Edit I've Tagged Require SSL, and Require client certificate. Then, I've created a Many to One Mapping rule that maps a certificate, by CN to a certain user account.

When I try to access the web site, with a client application (https://SERVERNAME/VIRTUALDIRECTORY/ASMXFILE.asmx) I get the following message :

"Unable to connect to the remote server"

Ofcourse I send a proper certificate.

What am I doing wrong?


There has been an error creating the personal site. User cannot be found


Few of my Domain Users are able to create MySite and few of them are not, though they are having same permission.

There has been an error creating the personal site. Contact your site administrator for more information.

Event Viewer is showing :

My Site creation failure for user 'DOMAIN\username' for site url ''. The exception was: Microsoft.Office.Server.UserProfiles.PersonalSiteCreateException: A failure was encountered while attempting to create the site. ---> Microsoft.SharePoint.SPException: User cannot be found.

Below are the DLL versions of my installation. 

Microsoft.SharePoint.Portal.dll : 12.0.6420.1000

Creating Sites/Lists/List Items under Current User Context in SharePoint By Using SPUserToken

Usually we do this by performing the action under RunWithElevatedPrivileges method and updating the listitem using SPListItem.SystemUpdate() method (see here). but this approach has its own flaws like (RunWithElevatedPrivileges will run under system account, we cannot use SystemUpdate for SPSite,SPWeb,SPList, since it runs under system we will "CreatedBy" by as SystemAccount).

Creating a user friendly alias for the website path


 Hello mates,

I am hosting my ASP.NET application on a Windows 2003 Server.

To browse to my application one has to type the path :http://serverName/applicationName

I want users to only type  applicationName on the web adress area.I believe there is something to do with alias and CNAME on DNS records that can adress this.

Any help on how to go about doing this will be highly appreciated.

A Simple XML-driven Tool: Monitor Your Web Site's Activity with COM and Active Scripting


This article describes a simple Web site monitoring tool built with XML, JScript, Windows Script Host, and COM objects. Although it is not intended to replace complete Web site monitoring software products, it has many useful features that help to keep Web servers up and running. An XML configuration file specifies which Web sites to monitor and the actions to be taken if the site isn't functioning properly. In addition, the tool can be scheduled to run at any specified interval using the Windows Task Scheduler. Functions that probe the sites, log events, and send e-mail notifications are written in JScript.

Panos Kougiouris

MSDN Magazine July 2000

Create user is creating aspxxxx.mdf database in my app_data folder


I had already setup roles for my pages and requirements call for ability to manage and create users.

So i was looking at code that allows you to do so using membership, even though i got the page to work, it was creating a database in my app_data folder.. i already have SQLExpress setup with the asp schema, but cant figure out how to get my application to use that instead of creating the db in the folder?

What am i missing or doing wrong?

I have the following setup in my web.config file..

		<authentication mode="Windows"/>
			<deny users="?"/>
        <add name="SqlMembershipProvider" type="System.Web.Security.SqlMembershipProvider, System.Web, Version=, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a"

Sharepoint site client access denied


I have an sharepoint application which was working fine.

I encountered a license expired message in sql server enterprise evaluation 2008 version after which i changed the date to 2 months earlier date, I have also changed HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Microsoft SQL Server\100\ConfigurationState to 3 after which sql server started working but the issue is that the clients are unable to access the sharepoint site completely. On providing the url the web site requests for logon information and then access is denied. The same url with the same authentication credentials is accessible from the server and the entire application works fine from the server. 

From the  client the below error page appears.

You are not authorized to view this page

You do not have permission to view this directory or page using the credentials that you supplied.

Please try the following:

  • Contact the Web site administrator if you believe you should be able to view this directory or page.
  • Click the Refresh button to try again with different credentials.

HTTP Error 401.1 - Unauthorized: Access is denied due to invalid credentials.
Internet Information Services (IIS)


Module 8: Creating Silverlight User Interfaces for SharePoint 2010 Solutions

SharePoint 2010 integrates closely with Microsoft Silverlight to enable you to build compelling user interfaces that interact with SharePoint data.

Creating a table-valued function on a user defined type in SQL Server CLR

We would like to be able to create a table-valued function on a user defined type.  We would like the syntax in SQL to look like it works for the XML nodes function:   DECLARE @myXml XML = '<a><b>1</b><b>2</b><b>3</b></a>' ; SELECT  node.query('text()') FROM    @myXml.nodes('a/b') nodes (node) ;   In other words, in the FROM clause, we can access the "nodes" method of the xml variable and it returns a rowset. Thanks!

Creating a Validator class for a custom activity

I created a new Workflow Activity Library and then added a new Activity called BindForm2Activity. After that I added a new class called BindForm2Validator and then placed an attribute to the BindForm2Activity to link it to the validator class.   Here is the code for each of the classes:   BindForm2Activity.xoml.cs: Code Snippet   using System;using System.ComponentModel;using System.ComponentModel.Design;using System.Collections;using System.Drawing;using System.Linq;using System.Workflow.ComponentModel.Compiler;using System.Workflow.ComponentModel.Serialization;using System.Workflow.ComponentModel;using System.Workflow.ComponentModel.Design;using System.Workflow.Runtime;using System.Workflow.Activities;using System.Workflow.Activities.Rules; using FormsCollection;using Utils; namespace ActivityLibrary{    [ActivityValidator(typeof(BindForm2Validator))] public partial class BindForm2Activity : SequenceActivity {        public static DependencyProperty FormToBindProperty = System.Workflow.ComponentModel.DependencyProperty.Register("FormToBind", typeof(FormsCollection.Form2), typeof(BindForm2Activity));         [Description("Form to bind a datasource to it ")]        [Category("BindForm2ToDataSource")]        [Browsable(true)]        [DesignerSerializationVisibility(DesignerSerializationVisibility.Visible)]        public FormsCollection.Form2 Form

User Alert Management for a specific list versus entire SharePoint site?

It seems that to be able to manage User Alerts, one must have Full Access to the entire SharePoint site - and then use => Site Settings > User Alerts. Ideally, I would like to be able to grant access to users to only be able to manage alerts for a specific list. Is this possible (without having to do any programming) and, if so, how? If such access is only available at the site level, I will simply create a Permission Level that allows one to only "Manage Alerts" Thanks in advance for any assistance. Dave

Creating a user limited to a few selected tables.

Hi there!   Im facing some troubles setting up a SQL user for my system. A need to create an SQL User, whom only have read access from the view A, read/write to table B and should not be able to see the remaining tables. I have spent some time on this trying to figure out how the permission system actually works, but I havent found the configuration that actually works. What I have done is created a user without any schemas and roles and under securables granted access to read in A and read/write in B. When I use this configuration I cannot access any tables. If I give the user db_datareader/db_datawriter I can perform all actions on all tables.   Can somebody guide me through how to create a user with these limitations? I'm really stuck.   Thanks in advance, Stig Jørgensen

Checking SQL Server User Roles and Creating SQL Server Users using VB.NET

Hello gurus!Firstly I want to apologies if this question is out of place here.. if someone can direct me to the correct forumn great and Thanks!I have a VB.NET application which uses its own Backend Database (MSSQL Server). I need to distribute this application to sites where there will be an existing SQL Server.So I will need to Create the Database on this server. The Application includes methods for building the database on startup if not already connected to one.However the users windows logon may not have the correct permission to connect and create a Database on the Server. I have a DB Setup form in my application which asks for the Servname, Username, Password and Database name. I have catered for Windows Authentication and SQL Server Authentication within the form - the user makes the choice.Assuming they enter a Username and Password for SQL Server Athentication then I will be trying to connect using this user and create the database on the given server. The following is my outline logic:-                                                                  Create db Process                                                                             |                                                                             |                                                               Check Credentials                                                                   / 
ASP.NetWindows Application  .NET Framework  C#  VB.Net  ADO.Net  
Sql Server  SharePoint  Silverlight  Others  All   

Hall of Fame    Twitter   Terms of Service    Privacy Policy    Contact Us    Archives   Tell A Friend