Tag：Hyperplane

Time：20201026
1. Logistic regression The essence of logistic regression: assuming that the data obey a certain distribution, the maximum likelihood estimation is used to estimate the parameters. LR is actually a classification. Take the simple dichotomy as an example and assume that the training samples are: $$ \left\{ {\left( {x_1^1,x_2^1} \right),{y^1}} \right\},\left\{ {\left( {x_1^2,x_2^2} \right),{y^2}} \right\},…,\left\{ […]

Time：20201024
Idea: find a curve so that the minimum distance between all sample points and this curve is the maximum Distance from point x to line: $$ l = \frac{1}{{\left\ w \right\}}({w^T}x + b) $$ For two categories, Y values are only – 1 and 1, then the same sign indicates that the classification is correct, […]

Time：20201011
It is said that SVM is the watershed of machine learning, machine learning is just around the corner. This paper will introduce the principle derivation process of SVM in detail, including linear, near linear, nonlinear, optimization methods, etc. a lot of ideas are derived from statistical learning method and zero basis introduction Python data mining […]

Time：2020928
The English name of SVM is support vector machine, which is called support vector machine. The perceptron learning algorithm will get different hyperplanes because of different initial values. However, SVM tries to find an optimal hyperplane to divide the data. How to calculate the best one? We can naturally think that if the distance from […]

Time：2020729
Overview of SVM Support vector machine (SVM) is a supervised classification algorithm, and it mostly deals with the problem of binary classification. First of all, through a series of pictures to understand several concepts about SVM. In the above figure, there are orange dots and blue dots representing the two types of labels. If you […]

Time：2020714
Support vector machine Many lines in this diagram can separate the two points. But which one?Intuitively, we will definitely choose the middle one, because it splits the two parts of data most “open” and has the highest fault tolerance rate. The most marginal point here actually plays a very important role. As long as the […]

Time：2020527
background: I always want to sort out my understanding and thinking of generalized linear model, so I have this essay. premise： 1. First of all, the introduction model will follow theThree elementsTo expand, i.eModel(parameter space of the model),strategy(how to choose the optimal model, generally referred to as cost function / loss function),algorithm(method of model learning […]

Time：2020212
Catalog Support vector machine (SVM) 1. Fundamentals 2. Soft septum 3. Kernel function 4. Sklearn implements SVM 5. SVM multi classification 4.1 multi classification principle 4.2 SVM multi classification based on sklearn PrefaceRefer to machine learning. I don’t understand the dual problem…. I’m just a code Porter Machine learning column： Machine learning – linear regression […]

Time：2020131
1. introduction SVM, support vector machine, which is our Chinese name support vector machine, I believe that as long as the children’s shoes have met with machine learning, they have heard the name more or less. As an old member of machine learning family, its classics need not be said. In terms of principle […]

Time：20191114
This study note emphasizes geometric intuition, but also pays attention to the internal motivation of perceptron algorithm. Limited to space, this paper only discusses the general situation of perceptron, the introduction of loss function, and the working principle. Another article will be devoted to dual form of perceptron and nuclear perceptron. The implementation code of […]