.NET Tutorials, Forums, Interview Questions And Answers
Welcome :Guest
Sign In
Register
 
Win Surprise Gifts!!!
Congratulations!!!


Top 5 Contributors of the Month
Kaviya Balasubramanian
Imran Ghani
Post New Web Links

Optimizing Data Mining processing time for a Time Series model in SQL Server 2008 R2

Posted By:      Posted Date: September 25, 2010    Points: 0   Category :Sql Server
 

Does anyone have any references around optimizing the initial processing time for a data mining model? Books, blogs, etc. I have the Wiley “Data Mining with SQL Server 2008” book, and while I’ve learned a lot from it, it doesn’t seem to cover much around trouble shooting things like processing time. I also have a few other books that have a chapter or two on data mining, but again just basic “here’s what it is and how to set it up”, nothing that quite covers trouble shooting or optimization. I’ve also checked out the various Data Mining blogs/sites.

 

I’ve got a Microsoft Time Series model I’m basing on a Cube. Very simple, trying to forecast sales. I have one dimension which is the list of products (about 1600), a second which is the time dimension, finally the measure is daily sales figures for each, about 3.2 million rows in total. On a brand new server, with two quad core processors and 16 gig of ram it took 40 hours to process. Seems rather high?


View Complete Post


More Related Resource Links

time series data mining help

  

I have sales data for several sku's over 2 years by month. (by location but that isn't necessary atm)

How do I use the data mining tool to give me strait predictive sales from this pocket of data.

 

I have cubed it, I have run the time series where I have to pick partnumberDim for start, and then nest the date dim.

But I can't seem to make any sense of what this is telling me.


foxjazz

time series model - mining structure does not exist

  

I have successfully created a time series model using DMX code, but I haven't been able to export the predictions to my SQL database - the results are too large to copy/paste and I haven't been able to figure out code that will allow me to copy it directly to my SQL database. I know you have the option to save predictions to a SQL table in Visual Studio, so I'm trying to recreate the model using the new mining structure wizard on an entirely new SSAS database in Visual Studio. When I go to deploy the structure, it tells me that the mining structure does not exist. I'm confused because I'm trying to create the structure - of course it doesn't exist. Does anyone have any advice?


Myles McKee

Hierarchy ID: Model Your Data Hierarchies With SQL Server 2008

  

Here we explain how the new hierarchyID data type in SQL Server 2008 helps solve some of the problems in modeling and querying hierarchical information.

Kent Tegels

MSDN Magazine September 2008


Advice on collecting data in a time series

  
Hi everyone,  I just wanted to get some ideas of what you would think be the best way to collect data/numbers that are part of a time series?  Let's say I'm collecting monthly data from the users, related to some product and I'd like to be able to provide them a simple and efficient way of entering these numbers based on some month end period.  So for instance on 6/30/2009, they could enter some numbers for a set of data points that pertain to that product.  Would one of the data controls (such as GridView or DetailsView) be sufficient to do this?  I know the GridView isn't so much able to save data but I believe the DetailsView has some functionality for that. In the end, I'd really like to provide a seemless way to do show this and ability to enter and save this.  Any ideas would be appreciated.Thanks

Restoring Database taking long time in SQL Server 2008 R2 -- some how urgent

  

Hi all

I have Database size 12GB in SQL Server 2005 and It is backed up.

Now I tring to restore Database in SQL Server 2008 R2(wizard)....it is not at complted after 2hours...still running.

 

any idea..or help appreciated..

 


SNIVAS

Application time out Error after installing SQL Server 2008 R2 64 bit + CU3

  

Hi all,

webapplications  are  suffering  after installing SQL Server 2008 R2 64 bit  in my mechine.

Did i have do any thjing more make the connectons(validation faster)  or SQL Server 2008 R2 behaves like that..

any idea or suggestions are appreciated.

 

Thanks in advacne

 

 


SNIVAS

How to store only date and only time into sql server 2008 from C# asp.net 3.5

  

Hi 2 all,

can anyone help me how to store only date into sql server 2008 from C# asp.net 3.5.

I want to store only date(like 26/05/1986) and only time (like 04:45:40 AM) into sql server 2008 .

I am using C# asp.net 3.5 as front end.But i am not getting how to convert datetime into only date and only time from front end application.

It should not be as a string from front end.it should be as a date type / time type.

I can not see only date or only time data type in VS 2008.

so please help me how to store only date or only time into sql server 2008 having only date or only time as a data type.


Thanks and Regards,

Arvind Pathak


How to install SQL-Server 2008 product key after evaluation time is over

  

Hi all,

 

in my SQL-Server 2008  installation (from de_sql_server_2008_r2_express_with_advanced_services_edition_november_ctp_x64_455228)the server is not running anymore. Apparently the evaluation time (180 days) is over and we seem not to have put in the product key. At least this is the error message I am getting.

Unfortunately, I can not find the actual tool or application to put in the product key.

 

Could anybody please help and let me know what I have to do to put the key in.

Thank you very much in advance !


Problem with SQL server 2008 UDF and model data entities

  

Hi everyone. I'm very new with this technology and still have to learn lot's of stuff...

I managed to start with basic MVC design but i'm now stuck on adding functions to model..


I created view in mssql

CREATE VIEW MyFirstView
AS
SELECT table1.Field1, table2.Field2
FROM table1 INNER JOIN table2 ON table1.Field1 = table2.Field1


and function


CREATE FUNCTION fnGetMyViewResult(@paramField nvarchar)
RETURNS TABLE
AS
RETURN SELECT * FROM MyFirstView WHERE MyFirsView.Field1 = @paramField





but when i run entity data model wizzard from VS 2010 i can chose only from tables, views and stored procedures. There is no way (atleast no way i know about) to add my sql function to MVC model...

I can see function in ServerExplorer but not in wizzard....

Can someone help me with this?


Thanks in advance..



SQL Server 2008 query execution time is different if i execute it in management studio or from code

  
When I execute query from software which i wrote in c# it required lots of time to complete but if I execute exactly the same query from management studio it will be done in seconds. In both cases execution plan is the same. 

How do I convert UTC to specified time zone in T-SQL (SQL Server 2008 R2)?

  

Question: How do I convert UTC time to specified time zone using SQL in SQL Server 2008 R2?

---------------------------------------------------

Scenario: I have a database/ASP.NET application that I use to manage people from quite a few different time zones. In order to keep activities coordinated, all the times in the database are UTC time. Each user's TimeZone is also registered in the database using .NET Framework time zoneIDs e.g. Eastern Standard Time.

In my query I want to specify a date and pull all the activities for that date. However, because all time stamps are UTC times, sometimes an individual's activies fall on two consecutive days in UTC time zone even though the individual completed them on the same day in his/her time zone. As a result, I get misleading data.

When I specify a date, I want that date to be considered user's date. That means, I need to convert all the activity time stamps into user's time zone in my query. This is where I can use some help.


Thanks, Sam

time series - mining structure does not exist

  

I have successfully created a time series model using DMX code, but I haven't been able to export the predictions to my SQL database - the results are too large to copy/paste and I haven't been able to figure out code that will allow me to copy it directly to my SQL database. I know you have the option to save predictions to a SQL table in Visual Studio, so I'm trying to recreate the model using the new mining structure wizard on an entirely new SSAS database in Visual Studio. When I go to deploy the structure, it tells me that the mining structure does not exist. I'm confused because I'm trying to create the structure - of course it doesn't exist. Does anyone have any advice?


Myles McKee

About data mining algorithm supported by SQL Server 2008 data mining

  
When model training, algorithm read whole training data stored in database.
If whole training data is not fit in memory, how can algorithm handle this situation?
Is it disk based algorithm?
Or does it use sampling or something special techniques?

Errors in Olap Mining Models (Time Series)

  

1.    In a model that is

Data Types - Date and Time in SqlServer

  
Date and time values can be stored with either the DATETIME or SMALLDATETIME data type. The difference between the two is that SMALLDATETIME supports a smaller range of dates and does not give the same level of precision when accounting for time. The DATETIME data type can hold values from January 1st of 1753 to December 31st of 9999. The time is stored to the 1 three hundredths of a second and each value takes up 8 bytes of storage. The SMALLDATETIME data type can hold values between January 1st 1900 and June 6th of 2079. The time is tracked to the minute and each value takes up 4 bytes of storage. The majority of business applications can live happily with SMALLDATETIME, however, if you are in an environment where each second matters or you need to make estimates to the distant future (or past) then you have to resort to DATETIME. If you fail to specify the time when inserting a value into a DATETIME or SMALLDATETIME column, a default of midnight is used. If you fail to specify the date portion the default of January 1, 1900 is used.

Essential SQL Server Date, Time and DateTime Functions

  
The essential date and time functions that every SQL Server database should have to ensure that you can easily manipulate dates and times without the need for any formatting considerations at all.

Date/Time Conversions Using SQL Server

  
There are many instances when dates and times don't show up at your doorstep in the format you'd like it to be, nor does the output of a query fit the needs of the people viewing it. One option is to format the data in the application itself. Another option is to use the built-in functions SQL Server provides to format the date string for you.
Categories: 
ASP.NetWindows Application  .NET Framework  C#  VB.Net  ADO.Net  
Sql Server  SharePoint  Silverlight  Others  All   

Hall of Fame    Twitter   Terms of Service    Privacy Policy    Contact Us    Archives   Tell A Friend