Data Mining

Hi,

I've come along way learning about databases and SQL. I can write basic queries now. Even some with subQueries. What I need to learn, is how to approach data mining. Can someone suggest the best path to follow, to learn how to accomplish data mining from a very large database?
I don't just need to produce reports of acquired data. I need to go in and grab data and look for patterns against known result sets. I hope that makes sense.

Thanks,
MilfredoWell, do you have a basic grounding in statistics?
TSQL lends itself fairly well to exception reporting, but unfortunately it does not have a rich function set for correlational studies. I've written my own code for simple linear regression, but I haven't attempted true multi-linear analysis.
SQL Server 2005 has the CLR toolkit that allows you to build custom aggregate functions, so it may prove more useful for data analysis and I wouldn't be surprised to see 3rd party developers marketing more advanced statistical functions. In the meantime, you will need to spin off subsets of data for further analysis is a stronger statistical tool, such as Excel or SAS.|||Thanks Blindman,

I'm looking into some third party software. There seems to be several things on the market that will alllow me to drill down into my data and do some analysis. For single user's the price isn't bad.

Milfredo|||If you are just looking at pivoting and drill-downs, a simple Excel pivot table linked to a SQL Server view might get you started.|||Thanks. I actually over simplified my project. I have a fairly extensive database, that I need to work with. I need to select certain data set and see what factors that I can add that will make it more predictive. I'm test driving a software called Purple Mineset at present.

Milfredo

data mining

well, i;m doing a thesis about data mining right now.And i found some difficulties. In my thesis i use visual basic 6.0 and sql server 2000 database and sql server 2000 analysis service. For information i use DSO (Decision Support Objects in programming). I've read claude seidmann book about data mining and i really help with that book. But i still have some questions about data mining using DSO :
1. I have made a relational mining model using VB. I've created the code based on Claude Seidman book. well it's process well. But when i want to browse the result in analysis manager there's an error message ;

"Unable to browse the mining model, object or provider is not capable of performing requested operation"
I really don't understand with this error message. Could you tell me what's the meaning of this error message?

2. shoud i make another code in VB to browse the result ?

3. I still don't understand about Microsoft decision tree algorithm works.So could you tell me how microsoft decision tree wroks?

Thank you so much for your attention and i really appreciate with your help.Thank you

Here is some information on Decision Trees algorithm from SQL SERVER 2005 perspective.

http://msdn2.microsoft.com/en-us/library/ms175312(SQL.90).aspx

HTH..

To do a data mining project, may I recommend using Sql server 2005 and Visual Studio 2005? You could download free trial versions from Microsoft site.

ZULFIQAR SYED

HTTP://ZULFIQAR.TYPEPAD.COM

|||

It's likely that some of the client components in your Analysis Services 2000 install are not registered correctly. Re-installing the latest service pack (SP4) should fix the problem you're seeing.

Zulfiqar's reply has valid suggestions about trying SQL Server 2005 Data Mining if you're starting a new data mining project and checking the SQL 2005 Books Online for information about the decision trees algorithm. More in-depth information about the algorithm can be found in the research papers accessible from this tip: http://www.sqlserverdatamining.com/DMCommunity/TipsNTricks/986.aspx