.NET Tutorials, Forums, Interview Questions And Answers
Welcome :Guest
Sign In
Register
 
Win Surprise Gifts!!!
Congratulations!!!


Top 5 Contributors of the Month
Easy Web
Imran Ghani
Post New Web Links

Fuzzy lookup problem...same/duplicate records in the buffer,

Posted By:      Posted Date: October 25, 2010    Points: 0   Category :Sql Server
 

Hi there,

I have a problem with a fuzzy lookup and I've been checking all the forums and not only that I can't find the answer but I can't even find other people having this issue although it seems to me that this would happen quite often to people using fuzzy lookup or even the regular lookup component. Here's the problem:

Lets say I have 10,000 records in the source database and I have 500 records (not really important) in the reference table that I'm using for the fuzzy lookup. Lets also say that the buffer size is 1000 records. Here's what happens, the first buffer will check if any of the first 1000 records (out of 10,000) is the same (or similar) to any of the records in the reference table and then based on the similarity value that I've set up (say .80) it'll either take a route "Existing" (if the same or is similar record exists in the reference table) or take the route "NonExisting" (if the incoming records is different than any of the existing records in the reference table or if the similarity value is below .80). The idea here is that if the records goes to "Existing" this record (which is a person btw) will be assigned the same PersonId as the same/similar person found in the reference table. If on the other hand record (person) ends up going to "NonExisting" it'll be assigne


View Complete Post


More Related Resource Links

Problem updating records with LINQ, Concurrency?

  
 My project includes a grid view with some updtable fields, some fields throw an error on update and some do not and it does not really make sense. WORK_STATION_ID does not cause an error, ROOM _ID cause an error, both are int? (I am using c#) and for update I use the code liste below.using (DataClassesDataContext db = new DataClassesDataContext()) { var product = (from p in db.ASSETs where p.ASSET_ID == ASSET_ID select p).Single(); product.WORK_STATION_ID=WORK_STATION_ID; product.ROOM_ID=ROOM_ID; db.SubmitChanges(); }    Row not found or changed. Description: An unhandled exception occurred during the execution of the current web request. Please review the stack trace for more information about the error and where it originated in the code. Exception Details: System.Data.Linq.ChangeConflictException: Row not found or changed. Source Error: Line 93: Line 94: Line 95: db.SubmitChanges(); Line 96: Line 97: Source File: C:\Projects\TEST_II\trunk\ObjectDataSourceLibrary\AssetController.cs Line: 95 Stack Trace: [ChangeConflictException: Row not found or changed.] System.Data.Linq.ChangeProcessor.SubmitChanges(ConflictMode failureMode) +963417 Syst

Duplicate records find in table

  
  Hi ALL, I want to find the dynamically check the primary key values and remove the duplicate records.. please suggest it.   Regards Ram

Problem while retrieving data from a lookup column from sharepoint linq.

  
Hi I am working with sharepoint linq concept. When I am giving a query with lookup column It's working fine.  But when i am trying to retrieve the data from a look up column to spgridview. I was unable to get the output. Here is the above code which i have worked.   string strTitle = string.Empty; string strStatus=string.Empty; var context = new LinqSampleDataContext(SPContext.Current.Web.Url); EntityList<SharePoint2010ConceptsItem> Concept = context.GetList<SharePoint2010ConceptsItem>("SharePoint 2010 Concepts"); var query = from cs in Concept where cs.Status.Title.ToString()!="Completed" select new { cs.Title, cs.Id, //cs.Status }; sgvConcepts.DataSource =query; sgvConcepts.DataBind();   Any help me plz how to retrieve the data from a lockup column.bvnprasad

Problem with Retrieving data from lookup column using SharePoint 2010 Linq Concept

  
Hi I am working with sharepoint linq concept. When I am giving a query with lookup column It's working fine.  But when i am trying to retrieve the data from a look up column to spgridview. I was unable to get the output. Here is the above code which i have worked.   string strTitle = string.Empty; string strStatus=string.Empty; var context = new LinqSampleDataContext(SPContext.Current.Web.Url); EntityList<SharePoint2010ConceptsItem> Concept = context.GetList<SharePoint2010ConceptsItem>("SharePoint 2010 Concepts"); var query = from cs in Concept where cs.Status.Title.ToString()!="Completed" select new { cs.Title, cs.Id, //cs.Status }; sgvConcepts.DataSource =query; sgvConcepts.DataBind();   Any help me plz how to retrieve the data from a lockup column.bvnprasad

(almost) duplicate records returrning

  
Hello, I need some major help. I have a query (see below) that returns survey results... For some reason, some surveys get submitted multiple times. What I need is (for the past 90 days) just the newest result from each of the users. Does this make sense? If not, I can try to clarify.     <br/> SELECT OneClickSurvey.OneClickSurveyID as 'Survey ID', Customer.FullName as 'Customer', OneClickSurvey.UsersID as 'User ID', Users.FirstName + ' ' + Users.LastName as 'User', OneClickSurvey.SurveyDate as 'Date', DATENAME(dw, OneClickSurvey.SurveyDate) as 'Survey Day', OneClickSurvey.Rating, OneClickSurvey.Comment, (select FirstName + ' ' + LastName from Users where Customer.PSAcctMngr = Users.UsersID) as 'Account Manager', (select FirstName + ' ' + LastName from Users where Customer.PSSupportMngr = Users.UsersID) as 'Support Manager', (select FirstName + ' ' + LastName from Users where Customer.PSServiceMngr = Users.UsersID) as 'Service Manager' FROM Customer INNER JOIN UsersCustomer ON Customer.CustomerID = UsersCustomer.CustomerID INNER JOINa Users ON UsersCustomer.UsersID = Users.UsersID INNER JOIN OneClickSurvey ON UsersCustomer.UsersID = OneClickSurvey.UsersID -- Get last day's

Lookup transform partial cache problem.

  
Hi, I've a simple lookup transform in SSIS 2008 (R2). I've created it with a full cache and it worked fine. When i switch to partial cache, it will give me this error: -------------------------------------------------------------------------------------------------- TITLE: Package Validation Error ------------------------------ Package Validation Error ------------------------------ ADDITIONAL INFORMATION: Error at DFT_AdventureWorks [Lookup [411]]: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005. An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 10.0"  Hresult: 0x80004005  Description: "Syntax error, permission violation, or other nonspecific error". Error at DFT_AdventureWorks [Lookup [411]]: OLE DB error occurred while loading column metadata. Check SQLCommand and SqlCommandParam properties. Error at DFT_AdventureWorks [SSIS.Pipeline]: "component "Lookup" (411)" failed validation and returned validation status "VS_ISBROKEN". Error at DFT_AdventureWorks [SSIS.Pipeline]: One or more component failed validation. Error at DFT_AdventureWorks: There were errors during task validation.  (Microsoft.DataTransformationServices.VsIntegration) -------------------------------------------------------------------------------------------------- i've

Problem with listing records from table (object not found)

  
Hi everyone, I'm creating a website based on ASP.NET MVC 2 and SQL Server 2008 R2 Express for the database. After creating the table in database, I want to list all records in that table. For that, I use "scaffold'ing in ASP.NET to automatically generate the view file. But I encountered an error when loading that page. The error message was: [CODE] Server Error in '/' Application. Invalid object name 'dbo.Accommodations'. Description: An unhandled exception occurred during the execution of the current web request. Please review the stack trace for more information about the error and where it originated in the code. Exception Details: System.Data.SqlClient.SqlException: Invalid object name 'dbo.Accommodations'. Source Error: Line 41:         </tr> Line 42: Line 43:     <% foreach (var item in Model) { %> Line 44: Line 45:         <tr> Source File: d:\MyProject\Views\Accommodation\Index.aspx    Line: 43 Stack Trace: [SqlException (0x80131904): Invalid object name 'dbo.Accommodations'.]    System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection) +2030802    System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection) +5009584 &n

Problem Facing While Inserting records into table which os dynamicaly created

  
Hi,I have created table into database dynamicaly,while inserting records into that dynamic table i faced problem.The name "STD000001" is not permitted in this context. Valid expressions are constants, constant expressions, and (in some contexts) variables. Column names are not permitted. this error occured.I created dynamic table by ,declare @STUDENT_Table varchar(50)set @STUDENT_Table = [dbo].[GetStudentTable](@SchoolID)declare @cmd varchar(5000)Set @cmd = 'Create Table  ' + @STUDENT_Table + '(   [student_id] [varchar](10)NOT NULL,    [school_id] [varchar](50)NULL,    [class1] [varchar](50)NULL,    [division1] [varchar](50)NULL,    [educalis_id] [varchar](16)NULL,    [roll_no] [varchar](10)NULL,    [first_name] [varchar](50)NULL,    [middle_name] [varchar](50)NULL,    [last_name] [varchar](50)NULL,    [gender] [varchar](6)NULL,    [father_name] [varchar](50)NULL,    [mother_name] [varchar](50)NULL,    [father_office_address] [varchar](200)NULL,    [mother_office_address] [varchar](200)NULL,    [home_address] [varchar](200)NULL,    [father_mobile_no] [varchar](10)NULL,    [mother_mobile_no] [varchar](10)NU

Delete Duplicate Records from MySQL table

  

I have Revision column in Quote table with time stamp (MySql table) now i am viewing the entire date and time my end user want to view only Date he doesnot want to see time how can i pull only date.i am displaying revision column in two ways one in grid view and another one in field value

Query in my Grid view
Dim query As String = "SELECT QuoteNumber,Revision,Vendor,PartNumber,status,Customer,Requestor from quotes"
On select check box in grid view, filed values will be loaded with data.

field value
txtRev.Text = dt.Rows(indx)("Revision").ToString()

 

 

 


Fuzzy Lookup

  

Hi All,

 

I want to do a fuzzy lookup across two columns. How can I achieve this.

 

For e.g.

 

I have a table called companies and there is column called name in the table.

I have another table called typecode and there is a column called typecode in the table.

 

My source table contains column name and typecode which I need to do a lookup on the table companies and typecode respectively.

I know how to achieve with one column i.e if I take my source table and do a lookup with just name column in companies it is working fine.

How can I achieve this with both the companies table and typecode table and get the name and typecode column in the destination.

Thanks in advance.

Aash.


problem with inserting records??

  

When i am inserting my data i am getting this error 

An explicit value for the identity column in table 'emp' can only be specified when a column list is used and IDENTITY_INSERT is ON.


i have set Identitty specification and is identity of the table as yes so i am getting this problem whenevr i set it to no i am not getting any error,can anyone explain me why i am getting this error??


problem with datasheet view and people and group lookup

  

hi,

There seems to be a problem in my list datasheet view, when I try searching for a certain person's name from the lookup list, whereas when I click the new item, choose from the people and column list..I can view their names..Why is it so..


problem in selecting deslecting multiple records in grid view by clicking control key.plz help

  

i want to select/deselect multiple records inside grid view by clicking control key.I can do the selection but the deselection is not working properly..there is some thing wrong in the  logic.plz help me to solve the problem.

my java script function is like..

<script language="javascript" type="text/javascript">

    function FillColor(cellid, id, evt) {
    
        var isSelected = document.getElementById('<%=hidSelectedRow.ClientID%>');
        alert(cellid);
        if (!evt) var evt = window.event;
        ctrlPressed = evt.ctrlKey;
        if (!ctrlPressed) {
            //alert(ctrlPressed);
            var clearCellColor = document.getElementById('hidCellId').value.split(',');
            for (i = 0; i < clearCellColor.length; i++) {
                document.getElementById(clearCellColor[i]).bgCol

problem in selecting deslecting multiple records in grid view by clicking control key through java

  

i want to select/deselect multiple records inside grid view by clicking control key.I can do the selection but the deselection is not working properly..there is some thing wrong in the  logic.plz help me to solve the problem.

my java script function is like..

<script language="javascript" type="text/javascript">

    function FillColor(cellid, id, evt) {
    
        var isSelected = document.getElementById('<%=hidSelectedRow.ClientID%>');
        alert(cellid);
        if (!evt) var evt = window.event;
        ctrlPressed = evt.ctrlKey;
        if (!ctrlPressed) {
            //alert(ctrlPressed);
            var clearCellColor = document.getElementById('hidCellId').value.split(',');
            for (i = 0; i < clearCellColor.length; i++) {
                document.getElementById(clearCellColor[i]).bgC

SSIS 2008 - Fuzzy lookup warming index takes too much time

  

Hello All,

We are using Fuzzy lookup transformation in our SSIS package.

We have selected option to store and maintain index for first time. And for subsequent executions, we use option to use existing index. So it will not create new index each time. We are doing fuzzy lookup on single source table with single column. The source table contains more than 2.5 million rows.

So while executing the package, although its not taking time to build complete index. But still it takes considerable time and uses large memory whenever we execute it.

We have also set the WarmCache option to true. Although all data is loaded into memory and removed after execution.

Is there any other way so we can keep the data in memory, so for subsequent execution, it gets result directly from memory?

Please let me know if you have any suggestion? Its urgent.

 

Thanks in advance.



Darshan Vyas

Get duplicate Records

  
Hi all,

I have two tables one of the table columns like

tbl_emp
Id                        Total stops   Total Emp
100816080630010P   5                     6

tbl_Details
Id                        Stopnumbers   EmpId
100816080630010P     1     BACS136
100816080630010P     3     EmpHydTest118
100816080630010P     2     EmpHydTest13
100816080630010P     2     EmpHydTest19
100816080630010P     4     EmpHydTest52
100816080630010P     1     hdtest177

Form above tbl_emp total employees are 6 and in the tbl_detail empid count is 6 and stopnumbers should not repeat like this.   It should be like 1,2,3,4,5,6.   If the case is like as show above stopnumbers repeating then we should get those records.

I tried in different ways but i did not get the solution can any one please hel

Get duplicate Records

  

Hi all,

I have two tables one of the table columns like

tbl_emp
Id                        Total stops   Total Emp
100816080630010P   5                     6

tbl_Details
Id                        Stopnumbers   EmpId
100816080630010P     1     BACS136
100816080630010P     3     EmpHydTest118
100816080630010P     2     EmpHydTest13
100816080630010P     2     EmpHydTest19
100816080630010P     4     EmpHydTest52
100816080630010P     1     hdtest177

Form above tbl_emp total employees are 6 and in the tbl_detail empid count is 6 and stopnumbers should not repeat like this.   It should be like 1,2,3,4,5,6.   If the case is like as show above stopnumbers repeating then we should get those records.

I tried like this


SELECT fld_tripid FROM tbl_trips tb
WHE

Categories: 
ASP.NetWindows Application  .NET Framework  C#  VB.Net  ADO.Net  
Sql Server  SharePoint  Silverlight  Others  All   

Hall of Fame    Twitter   Terms of Service    Privacy Policy    Contact Us    Archives   Tell A Friend