Classifier (mathematics): Difference between revisions
Appearance
Content deleted Content added
→Learning and Data Mining: - extra type added. |
No edit summary Tags: Mobile edit Mobile web edit |
||
(21 intermediate revisions by 18 users not shown) | |||
Line 1: | Line 1: | ||
⚫ | |||
{{references}} |
|||
A '''classifier''' is a sort of a function that provides a tagged class as an output from a set of attributes taken as inputs. A way to build a classifier is to take a set of tagged examples and try to define a rule that could assign a [[Tag (metadata)|tag]] to any other kind of input data. |
|||
== Introduction == |
|||
Due to the technological progress and the need that people have to live surrounded by much information as possible, the amount of digital [[multimedia]] files is growing very rapidly. This necessitates the search for efficient methods that make possible to quickly retrieve relevant audiovisual information. |
|||
== Learning and Data Mining == |
|||
Both [[Data Mining]] and [[Machine learning]] are techniques related to the processing of large amounts of data. |
|||
The [[Data Mining]] technique tries to obtain [[Design pattern (computer science)|patterns]] or models from the data collected. |
|||
[[Machine learning]] is the basic part that the different types of existing classifiers have in common. The basic idea of learning is using the perceptions not only to act but also to improve the ability of an agent to act in the future. |
|||
There are different types of learning techniques: |
|||
=== ''Supervised learning'' === |
|||
The '''[[supervised learning]]''' involves learning a function from tagged examples above, to establish a correspondence between the inputs and the desired outputs of the system. It is not always possible to do this type of training because the expected output in the input function has to be known. The learning system tries to tag(classify) a set of vectors choosing one of several categories ([[Class (computer science)|classes]]). |
|||
=== ''Unsupervised learning'' === |
|||
The '''[[unsupervised learning]]''' consists in learning from input [[pattern|patterns]] with no output values specified. The main problem of this technique is how to take a decision between all patterns provided. The system takes the input objects as a set of random variables, building a density model for that data set. |
|||
=== ''Semi-supervised learning'' === |
|||
Currently there are techniques that combine the previous two, this is because in some cases can be very difficult to [[tag]] or classify all the data. The aim is to combine tagged and untagged data to improve modeling. Although it is not always helpful and there are several methods to do so. |
|||
=== ''Reinforcement Learning'' === |
|||
The '''[[reinforcement learning]]''' is a way of learning by observing the world. |
|||
The idea of learning consists in building a function with the observed behaviour as their input and output. Learning methods can be understood as the research of a rank of hypothesis to find the appropriate function. |
|||
== Type of classifiers == |
|||
=== ''Bayesian classifier'' === |
|||
A [[Naive Bayes classifier|Bayesian classifier]] is a [[pattern]] classifier based on statistical theories of learning. Bayesian learning calculates the probability of each hypothesis of the data and makes predictions on this bases. It is an almost optimal learning, but it requires an expensive computational cost because the rank of hypothesis is usually very large, even it may be infinite. |
|||
=== ''Parzen classifier'' === |
|||
This classifier is based on the data histogram, it estimates the densities of each class. |
|||
=== ''Backpropagation classifier'' === |
|||
Using simple models or parametric density or [[histogram]] models do not always give the desired results in some of the observed situations . In these cases, a research of more sophisticated density models needed. [[Neural networks]] are a useful approximation technique to build parametric models of density. The usual [[neural network]] model that uses this algorithm consists of a network with an input layer with as many nodes as inputs have, a hidden layer with a variable number of nodes that depend on the characteristics of the situation, and an output layer with as many nodes as possible outputs have. |
|||
=== ''Classifier with PCA'' === |
|||
The new features of the PCA method ([[Principal Component Analysis]]) are functions of the old. A dataset is taken and a smaller linear subspace is buildt. |
|||
=== ''Support vector machine'' === |
|||
The [[support vector machine]] (SVM) is a simple technique that give a great use when a classifier is trying to be built with the use of examples. Unlike [[neural networks]] which aim to build a model after an event, the SVM's tries to get the border decision. Its ease is an advantage because you just have to encode the geometry of the border. |
|||
== Applications == |
|||
The applications of classifiers are wide-ranging. They find use in medicine (drug trial analysis, [[MRI]] [[data analysis]]), finance (share analysis, index [[prediction]]), mobile phones ([[signal decoding]], [[error correction]]), [[computer vision]] ([[face recognition]], [[video tracking|target tracking]]), [[voice recognition]], [[datamining]] (supermarket purchasing analysis, retail customer analysis) and uncountable other areas. |
|||
An example is a classifier that accepts a person's salary details, age, marital status, home address and credit history and classifies the person as acceptable/unacceptable to receive a new credit card or loan. |
|||
For a list of classifier applications and classifier technologies, please see [[statistical classification]]. |
|||
==See also== |
|||
* [[Artificial intelligence]] |
|||
* [[Artificial neural network]] |
|||
* [[Data warehouse]] |
|||
* [[Linear classifier]] |
|||
* [[Machine learning]] |
|||
* [[Metadata]] |
|||
* [[Neural network]] |
|||
* [[Pattern recognition]] |
|||
* [[Perceptron]] |
|||
{{math-stub}} |
|||
[[Category:Classification algorithms|*]] |
|||
⚫ | |||
[[ca:Classificador (matemàtiques)]] |
|||
[[de:Klassifikator]] |
|||
[[es:Clasificadores (matemático)]] |
|||
[[eo:Klasigilo (matematiko)]] |
|||
[[fa:شناساگر (ریاضیات)]] |
|||
[[it:Classificatore]] |
|||
[[fi:Luokitin]] |
|||
[[sv:Klassificerare]] |
|||
[[vi:Phân loại (toán học)]] |
Latest revision as of 03:17, 24 December 2020
Redirect to:
classifier