View Complete Post
In a dataflow, I am trying to use a Lookup Transformation to join to a Synonym. The preview button displays data, by clicking the Columns button results in "The Lookup transformation method, ReinitializeMetadata, failed."
We are using Fuzzy lookup transformation in our SSIS package.
We have selected option to store and maintain index for first time. And for subsequent executions, we use option to use existing index. So it will not create new index each time. We are doing fuzzy lookup on single source table with single column. The source
table contains more than 2.5 million rows.
So while executing the package, although its not taking time to build complete index. But still it takes considerable time and uses large memory whenever we execute it.
We have also set the WarmCache option to true. Although all data is loaded into memory and removed after execution.
Is there any other way so we can keep the data in memory, so for subsequent execution, it gets result directly from memory?
Please let me know if you have any suggestion? Its urgent.
Thanks in advance.
Good day, i need help please.
The problem i have is that a percentage colume in my table, when i sum the total = '100.0000000'
This fine, but when i insert in SSIS - Lookup & i preview the data in Lookup task the Total = '100.072' which makes my calculations incorrect.
is there something i need to do to keep it in its original sum - but i view my decimal places in advanced properties decmal(38,12) so this should be fine.
Is in the query that i have to perhaps force it to be 100.0000, how?
Can somebody please direct me on what i should do
I'm having difficulty with a lookup task.
Firstly in my Lookup my query contains a "DISTINCT" and my cols match source as only some records fail, Source also has a distinct so no Duplicate there either.
I also added on error to display error records to a dataview. Now the lookup code does exist not sure why he is failing
The Lookup transformation found duplicate key values when caching metadata in PreExecute. This error occurs in Full Cache mode only. Either remove the duplicate key values, or change the cache mode to PARTIAL or NO_CACHE.
Is the records locking each other as source & lookup read from same table with diff filter criteria to gether with (NOLOCK) specified.
I have built an incremental load ETL Process to load some flat files with an SSIS Lookup and Conditional Split. I only have one path in the conditional split and that is for New
I have two questions:
For the new records path, I have to check to see if a record exists and I don’t have a single key that is unique, therefore, I have to use a multiple keys to make the record unique.
Below is what I have put in the conditional transformation editor for my first output condition:
I had an issue recently and I'd like to solicit feedback as to whether this is an SSIS flaw:
In the lookup component, when you select the Partial or No Cache option, a property in addition to the sqlcommand property becomes available called sqlcommandparam. Originally this package was developed using Lookups pointing to a dimension on "schema_A"
and we wanted to change the reference to "schema_B". Now, obviously the sqlcommandparam property became available because you can elect to use the Advanced SQL option in the component. However, I never chose to do that. So, long story short, I go into
this package to change the schema reference in the Lookup's query. It changes the sqlcommand property value to be "select value from schema_B.table" but it didn't change the corresponding value in the sqlcommandparam property. That property remained "select
value from schema_A.table". SSIS never threw an error to say the schema's didn't match. And the Lookup worked as designed, picking up values from the table on schema_B. Not until we finally decommisioned schema_A did I get an error at runtime that said "Table
or view does not exist".
So, can anyone (hopefully Microsoft) confirm that this is in fact a flaw? I am on MSFT VS 2008 V 9.0.30729.1 SP.
we are doing our cms migration. both cms's have their own articleID/contentID, we have a lookup table that contain the article URL and its content id. Now we want to query that table on every single click to get its respective id.
How and where i can implement this?
I have a document library that contains a Category column that is a lookup field. This is a default column that is a required field when uploading documents to the document library. The Category column is empty and I am unable to amend, hide, make it not
required or delete it.
I have gone to Modify settings and columns -> clicked on the Category field to edit, but there is no option to amend the content or delete it. I am only able to amend the Column name and Description.
Since then, I have amended the column name to eg. Category1 and created a new Category field as a lookup and linked it to the correct list.
The problem I am facing now, is that I cannot hide, delete or make the Category1 (old Category) field NOT required. Either I would like to update the original field to display the correct values or alternately hide, delete or make the column not required.
Hello, just wanted to ask a question about SSIS and SharePoint, any input will be greatly appreciated.... did search the forum but could not find anything....
So basically we have a SQL Server DB with the metadata ONLY, WITHOUT the related files(doc/ppt/pdf..etc) which should've been in the DB and they are on a separate web server inside folders. Each row in the DB has a key (column) which matches the related
folder's name, so for row with ID #112, there's a folder named ID112 on the web server with the relevant files inside. There could be more than 8+ files for one folder.
Now, I think it is possible but just wanted to double check, would it be possible to use SSIS and some kind of a script to get the metadata inside the SQL DB AND the related files inside those folders, combine & relate them and
upload them into SharePoint as a custom list with file attachments? would they display the attachment normally (like the paperclip icon in a sharepoint list...etc) I wonder if anyone has tried this...
Any guidance, thoughts, suggestions for other solutions, inputs will be great!!! Thank you!!
When a column that has a lookup is empty in datasheet view and I attempt to update a different column I get this message: the text entered for isn't an item from the list. select an item from the list, or enter text that matches one of the listed items.
I found this hotfix, but it did not apply.
Any ideas how to get this resolved?