【正文】
latt39。s Perceptron Learning Algorithm ? Perceptron learning algorithm Minimize 表示被錯分類的樣品組成的集合 ? Stochastic gradient descent method is the learning rate Rosenblatt39。s Perceptron Learning Algorithm ? Convergence If the classes are linearly separable, the algorithm converges to a separating hyperplane in a finite number of steps. ? Problems Optimal Separating Hyperplanes ? Optimal separating hyperplane maximize the distance to the closest point from either class By doing some calculation, the criterion can be rewritten as Optimal Separating Hyperplanes ? The Lagrange function ? KarushKuhnTucker (KKT)conditions ? 怎么解? Optimal Separating Hyperplanes ? Support points 由此可得 事實上,參數(shù)估計值只由幾個支撐點決定 Optimal Separating Hyperplanes ? Some discussion Separating Hyperplane vs LDA Separating Hyperplane vs Logistic Regression When the data are not separable, there will be no feasible solution to this problem?SVM 謝謝大家 !