Hierarchical Document Clustering Based On Cosine Similarity Measure

Data cleansing is an issue with very critical importance in data mining. It helps in preserving the quality of data used for data mining. An important sub task of data cleansing is duplicate detection. Duplication occurs when some real world object has multiple representations in data source. A lots of work has been done in duplicate detection in structured data such as relational database. But it is just a recently that the focus has been given on duplicate detection in hierarchical and semi structured data such as XML. In this paper we provide an overview of different approaches used for duplicate detection in XML.

Data mining is another concept closely associated with large databases such as clinical data repositories and data warehouses. However data mining like several other IT concepts means different things to different people. Health care application vendors may use the term data mining when referring to the user interface of the data warehouse or data repository. They may refer to the ability to drill down into data as data mining for example. However more precisely used data mining refers to a sophisticated analysis tool that automatically dis­ covers patterns among data in a data store. Data mining is an advanced form of decision support. Unlike passive query tools the data mining analysis tool does not require the user to pose individual specific questions to the database. Instead this tool is programmed to look for and extract patterns, trends and rules. True data mining is currently used in the business community for market­ ing and predictive analysis (Stair & Reynolds, 2012). This analytical data mining is however not currently widespread in the health care community.

Document opinion analysis is about classifying the overall document that have sentiment words expressed by the authors. The task is to determine whether a document is positive, negative or neutral (Wawre & Deshmukh). Document level categorization attempts to classify sentiments in web forum postings, blogs, movie and news

Data Mining, a sub-branch of computer science, involving statistics, methods and calculations to find patterns in large amount of data sets, and database systems. Generally, data mining is the process to examine data from different aspects and summarizing it into meaningful information. Data mining techniques depict actions and future trends, allowing any individual to make better and knowledge-driven decisions.[1][2]

Today with the ever growing use of computers in the world, information is constantly moving from one place to another. What is this information, who is it about, and who is using it will be discussed in the following paper. The collecting, interpreting, and determination of use of this information has come to be known as data mining. This term known as data mining has been around only for a short time but the actual collection of data has been happening for centuries. The following paragraph will give a brief description of this history of data collection.

Data mining: is a process of discovering patterns in large data involving methods at the intersection of artificial intelligence, machine learning, statistics, and database systems with the aim of extracting information and transforming it into an understandable structure for further use.

In its infancy, data mining was as limited as the hardware being used. Large amounts of data were difficult to analyze because the hardware simply could not handle it [1]. The term "data mining" first began appearing in the 1980 's largely within the research and computer science communities. In the 1990 's it was considered a subset of a process called Knowledge Discovery in Databases of KKD [1]. KKD analyzes data in the search for patterns that may not normally be recognized with the naked eye. Today however, data mining does not limit itself to databases,

Data mining allows companies to focus on the more important information in their data warehouses. Data mining can be broken down into two major categories. Automated prediction of trends and behaviors, and automated discovery of previously unknown patterns. In the first category, data mining automates the process of finding predictive information in large databases. Questions that traditionally required exhaustive hands-on analysis can now be quickly answered directly from data. In the second category, data mining tools sweep through databases and identify previously hidden patterns in one step. This category is where the major focus of research has been on.

Data mining simply explained is automated sorting and analyzing of large amounts of data, searching for patterns and correlations. On a

(Ian, Frank & Hall 2011) The world testifies to the increasing gap between the development of data and our understanding of it. Data mining is defined as the analysis of big observational data sets to establish unsuspected relationships that summarize the data in a novel, understandable and useful way to the data owner (David, Heikki & Padhraic 2001). These relationships and summaries are referred to as models or patterns. Patterns comprise sets of co-occurring attribute values referred to as item sets or more complex patterns that include sequences, which consider explicit precedence relationships that are either positional or temporal, and graphs considering arbitrary relationships between points (Mohammed and Wagner 2014). Other types of additional summarised relationships include rules, clusters, tree structures among others.

Data mining is the process of analysing data to discover meaningful patterns within the data resulting in extracting useful information that may have not been discovered yet. Data mining borrows techniques from a variety of fields such as statistics, machine learning and artificial intelligence. Because of its usefulness, data mining has been used in a range of industries such as, banking, telecommunications, retail, marketing, and insurance.

Nowadays, data mining and machine learning become rapidly growing topics in both industry and academic areas. Companies, government laborites and top universities are all contributing in knowledge discovery of pattern recognition, text categorization, data clustering, classification prediction and more. In general, data mining is the technique used to analyze data from multi perspectives and reveal the hidden gem behind the enormous amount of data. With the explosive growth of data collections, it becomes time-consuming less effective to extract valuable information from massive databases through the use of traditional data analysis methods. An alternative way to solve this problem is to apply data mining, given considerations

Highlight extraction/choice distinguishes essential words in a content report. This is done utilizing strategies like TF-IDF (term recurrence opposite report recurrence) [14], LSI (dormant

Data mining is a new technology which could be used in extracting valuable information from data warehouses and databases of companies and governments. It involves the extraction of hidden information from some raw data. It helps in detecting inconsistency in data and predicting future patterns and attitude in a highly proficient way. Data mining is implemented using various algorithm and framework, and the automated analysis provided by this algorithm and framework go ahead of evaluation in dataset to providing solid evidences that human experts would not have been able to detect due to the fact that they

Document classification is one of the important issues in the field of data mining, where the documents are classified