.NET Tutorials, Forums, Interview Questions And Answers
Welcome :Guest
Sign In
Win Surprise Gifts!!!

Top 5 Contributors of the Month
Gaurav Pal
Post New Web Links

Functioning of K-Means (Scaling of values; Distance between discrete data)

Posted By:      Posted Date: October 20, 2010    Points: 0   Category :Sql Server
Hello everyone,

at the moment I try to figure out how the implementation of k-means in SSAS works, especially how the disctance between 2 datapoints (with continuous and discrete variables) is measured.
I figured out, that in case of only coninuous variables the square of the eucledian distance is used.
Furthermore I figured out that the distance between only discrete variables is described as 1 - the probability of that value in a cluster.

My questions are:

-How does the algorithm work with continuous AND disrete variables? Is the distance calculated by sum the eucledian distance (e.g. 13,2) and the probability of a discrete value in a cluster (e.g. 0,4)?

-Is it necessary to scale the continuous variables to a lower range, maybe -1 to 1? How does SSAS handle this job

Unfortunately there are no sufficient documentations...



View Complete Post

More Related Resource Links

How do you create a custom BDC data field that allows for multiple selected values?

I need help creating a custom data field using the BDC column as a base.  We need to allow for multiple selected values instead of just a single one.  I can't find anything on the net which shows how to do this.

Reading values from data access component individually



I am trying to pick data from the database through data access layer and use those values in different text boxes on the page.Basically on a click on the form, modal popup is planned to read the database and put the values into different text boxes which can be latter changed/ updated.

 What I am unable to do is accessing those values on the form itself progamatically. I will be thankful for any ideas and help.

My data access component is as follows:




new SqlParameter ("@reg_id", SqlDbType.Int ));"@reg_id"].Value=reg_id;try




How to insert values into my table the data is coming from inline table valued function

Hi all,   i have table oi want insert values into my table the data is coming from inline table valued function how i can use the inline table valued function to insert datainto my table i have inline function which out puts 3 collumns of data how i can insert this data into my table i have the insert statment like below insert into tablename(c1,c2,c3,c4,c5) select ('abc',....................,'xyz') how i can use the out put put of my inline function to  to insert data into my columns c2,c3,c4. please help me out Thanks & Regards Sunil Yoganna

Problem with date values in data-driven subscription reports

Hello together, I have a question in regards of data-driven subscription report. I already have an ad-hoc report in place which can be customized by date etc. I now want to run these reports with a subscription. My challenge is now that I don't know how I can pre-define the date. I basically want the start date of NOW() and the end date 7 days in the past. I was looking around but did not get any clue where and how I have to configure it the way it works. I found this thread but honestly do not understand it well... :( http://social.msdn.microsoft.com/Forums/en-US/sqlreportingservices/thread/fb48fd15-09dd-4f5f-a09f-d92bf304c1a2 Can someone help me out please? M.

Comparing columns with NULL values--Merge says unmatched when data is matched.

I found the article below describing this same issue with the Oracle merge statement.  It also described a work-around:    http://searchoracle.techtarget.com/tip/Merging-datasets-with-NULL-values I have been unable to find a solution to this issue for SQL Server 2008.  I am trying to do basic ETL from Staging table to a Type II dimension table in a Data Warehouse.  I am using the Merge statement with the Unique key minus the modification date as my merge key list.  I have a handful of columns (in both Staging and the DW) containing nulls in my merge key list.  I have tried the ISNULL function and the ANSI_NULL db option (OFF) with no success.  When I put zeros in the null columns, it works as expected.  I am about to try separate INSERT and UPDATE statements, but I fear that the NULL comparison issue will bite me there with the JOIN statement.  Has anyone else experienced this?  NULL values are valid in our Data Warehouse.  How can I make T-SQL handle them? Thank you for your help, Jesse

Problems querying XML data with null values

If the tags have "xsi:nil" in them, then my query failes with a "XML parsing: line [x], character [x], undeclared prefix" error.  So my question is how to get the query to handle or ignore those tags with "xsi:nil" embedded in them.  So specifically, the first SQL query below is successful, and the second one fails with the aforementioned error.  Any comments appreciated, thanks. -- Declare XML variable DECLARE @data XML; -- Element-centered XML SET @data = N'<data> <customer> <id>1</id> <name>Allied Industries</name> </customer> <customer> <id>2</id> <name>Trades International</name> </customer> </data>'; -- Using the query() method SELECT T.customer.query('id').value('.', 'INT') AS customer_id, T.customer.query('name').value('.', 'VARCHAR(20)') AS customer_name FROM @data.nodes('data/customer') AS T(customer); Returns: 1 Allied Industries 2 Trades International ================== -- Declare XML variable DECLARE @data XML; -- Element-centered XML SET @data = N'<data> <customer> <id>1</id> <name>Allied Industries</name> <fax xsi:nil="true" /> </customer> <customer> <id>2</id> <name>Trades International</name> <fax xsi:nil=&quo

Importing Data from Excel into SQL Server using SSIS: some datetime values appear as NULLS How to Re

I created a Package in the Business Intelligence studio to Import data from Excel file  into SQL Server 2005 using a Excel Source and a OLE DB Destination that uses a data convertion transformation before it reaches the destination a mjority of the data is copied over. However i am having 2 Issues. 1. In the Date field some of the values appear as Null in SQL Server 2. I need to change the format of the date in Excel from dd/mm/yyyy to mm/dd/yyyy before inserting into SQL Server if Possible. I am not sure of the solution for Ques 1 but i attempted using a script task for #2 It did not work. Please Advice what the best way to proceed Thanks.

Populate a Data Flow Task's variables with values from a .dtsConfig file?

I have an SSIS Project to import exchange rates from an XML file into SQL. The project works when I have certain values hard-coded into variables, such as the URL of the XML File, proxy username and passwords etc. I decided to put in a .dtsConfig file, and have it update the values of the variables in the data flow task. So, one of my SSIS Packages in this solution is called ECBDailyRates.dtsx. It contains one control flow, which is a data flow task. The data flow task is a script task which does some XPATH on an XML file, and then provides outputs to an OLE DB Destination, which in turn puts the data into a table in SQL. That much worked before I put in the dtsConfig file. There are a few variables declared inside the data flow task, such as; PricesXMLUriDaily, String ProxyAddress, String ProxyAddressPort, Int32 etc. etc. These are now being updated from the dtsConfig, which is below. It was my understanding that SSIS would run through the config, and update any of the variables as required, and then run my data tasks. However when SSIS runs my script task, none of the variables have been populated, and so it falls over... as it were :) <?xml version="1.0"?> <DTSConfiguration> <DTSConfigurationHeading> <DTSConfigurationFileInfo GeneratedBy="...." GeneratedFromPackageName="dim_Institution" GeneratedFromPackageID="

Finding table data partition bounds key values using SQL

I have a table that has few million rows and I need the front end application to partition all the data for this table, or any other large table, using sql where clauses so I can retrieve all the data for the table in different threads for each "partition" in parallel (I can't/do not need to know whether the table data is actually partitioned on any specific column at the server). Assume that each "partition" can have n rows (dynamically), is there an easy way of find out what are the bounds for such partitions in terms of the table PK/unique index? Example, create table table_test (col1 char(8) primary key); Example table data: col1 (PK) a b c d e f g   The bounds for table_test for partitions of 2 rows would be four partitions that have the following values for col1: c, e, g  and the font end app would be able to use these bound to generate sql such as: select * from test_table where col1 < 'c'; -- first partition select * from test_table where col1 >= 'c' and col1 < 'e'; -- second partition select * from test_table where col1 >= 'e' and col1 < 'g'; -- third partition select * from test_table where col1 >= 'g'; -- fourth partition So the question is whether the values 'c', 'e', 'g' bounds of the table data can be easily determined by using sql by the client font end.        Farid Zidan Zi

Creating a Form say grid sort of a interface where in data values will be extracted from the table 4


how dis can be done help please with simple button click and changing the values it can be done but how to move columns with data in graceful manner the way we have in calendar control... 

Loop Through Data Key Names / Values


I found this snippet which loops the the old and new values, but I need to figure out the Parameter names that the values are associated with. Can someone post sample code that demonstrates how to do that?

    Sub DisplayValues(ByVal newValues As OrderedDictionary, ByVal oldValues As OrderedDictionary)

        test.Text &= "<br/></br>"

        ' Iterate through the new and old values. Display the
        ' values on the page.
        Dim i As Integer
        For i = 0 To oldValues.Count - 1

            test.Text &= "Old Value=" & oldValues(i).ToString() & _
              ", New Value=" & newValues(i).ToString() & "<br/>"

        test.Text &= "</br>"

    End Sub


Inconsistent data with DateTime values in Word Document Library



I am new to SharePoint (2010), and my company has recently migrated a Document Library from a different Content Management System. The Doc. Lib has been set up with Content Types and custom Word (2010) Templates to provide a specific structure to the documents. There is a requirement that the Metadata Columns be embedded into the content of the Word Documents, which we have done. However, we are an international company, so we are spread through several time zones.

Two of the fields in the documents are date-only datetime fields, but these fields must contain non-time zone aware dates. In other words, regardless of which timezone the document was created in or added to SharePoint, all users world-wide must see the same date.

When we create the documents by using the "New Document" menu in SharePoint, and fill in the Document Information Panel in Word, the dates work as required. However, if we use the "Upload Document" option, and then fill in the properties in the Default Edit List window, then the dates are time-zone aware, and users in an earlier (further west) time zone see the date as one day earlier.

After some investigation, it seems that Word stores the dates in the format yyyy-mm-dd hh:mm:ssz, with no offset information, and SharePoint then doesn't apply an offset when displaying/storing the data. However, when

Compute Values in FormView From Row Data


Here's what I am trying to do:

Inside Form View Want to display the average of a field based from field1/field2


Field 1 = 10

Field 2 = 5

Field 3 would equal 2 (Field 1 / Field 2)

How would I go abaout doing this.  Code currently looks like:

<asp:Label ID="sales_per_qtr" runat="server" Text='<%# Bind("total_sales/total_qtrs") %>' />

Using custom bind expression in the formview but it won't let me do this...

All input appreciated.


SSIS excel data source numeric values returned as null

Hello everyone, long time no see!, I have a problem and was hoping someone can help me:
I'm using SSIS 2005 Enterprise edition,  I'm creating a package that reads an excel (xls) file using the "excel source" component, and it dumps the data into an OLEDB destination (a sql server).
When I drag the excel source component and create the excel connection to my file the component automatically reads the columns and their datatypes.

The problem is that I have a column which has numeric data and the package uploads as NULL every number that starts with a zero. (note: in excel this column is formatted as "text", despite it has only numbers, because it's the only way excel maintains the left sided zeros).
So I checked the data types by right clicking the excel source component -> show advanced editor and my surprise is that this column's data type is detected as double-precision float, and it doesn't let me change it.

I tried the answer posted here: http://devselekta.blogspot.com/2007/09/ssis-excel-data-source-values-returned.html but it only works when the first row of data has a number beginning with zero on this column.
Someone knows how to get the data imported correctly? Thanks in advance.

Loop through SharePoint list and copy values into InfoPath Main Data



i have the following problem, i designed an Infopath form which should display the data (in a repeating table) from a SharePoint list, which is connected to the form.

 I found the following code in the internet to copy rows from a sharepoint list to a repeating node in the Main data source and followed the tutorial.

Public Sub CTRL48_6_Clicked(ByVal sender As Object, ByVal e As ClickedEventArgs)

      Dim secDSNav As XPathNavigator = DataSources("Projektsummary").CreateNavigator()

      ' Zeilen aus der Projektsummaryliste auslesen
      Dim rows As XPathNodeIterator = secDSNav.Select( _
      "/dfs:myFields/dfs:dataFields/d:SharePointListItem_RW", _

      'Dim Current As XPathNavigator
      'Loop durch die einzelnen Zeilen der Liste

      While rows.MoveNext()

        Dim name As String = rows.Current.SelectSingleNode( _
        "/dfs:myFields/dfs:dataFields/d:SharePointListItem_RW/d:Title", NamespaceManager).Value
        Dim nummer As Object = rows.Current.SelectSingleNode( _
        "/dfs:myFields/dfs:dataFields/d:SharePointListItem_RW/d:Projektnummer", NamespaceManager).Value

        ' Werte der wiederholten Tabelle (main data source) übergeben 
        AddItem(name, nummer)

      End W

InfoPath: Copying values from a multiple-selection lookup (secondary data connection) to a multiple-

Trying to use "Set Field Value" action in InfoPath to set values in a multiple selection lookup field. Does not not seem to be possible. Has anyone achieved this?

Listbox values to display data from database



I have a listbox which comprises of data " systemname" . I have a sql database table with columns ( systemname, ip, downmins,pdowntime,udowntime and reason).

On the basis of the selection from the listbox i want to display the respective records for the systemname with all columns mentioned above.

Now I need to be able to take user entry for the columns (pdowntime,udowntime and reason) from the user either through table or gridview and populate this data in the database.

Note - the listbox is getting populated from the table directly using an sql query at the backend.






ASP.NetWindows Application  .NET Framework  C#  VB.Net  ADO.Net  
Sql Server  SharePoint  Silverlight  Others  All   

Hall of Fame    Twitter   Terms of Service    Privacy Policy    Contact Us    Archives   Tell A Friend