Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

时间:2022-12-01 20:39:26

week 3 Classification

  Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

KNN :基本思想是 input value 类似,就可能是同一类的

  Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

  Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Decision Tree

  Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

  Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

  Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

  Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Naive Bayes

  Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

  Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Week 4 Evaluating model


Over-fitting

怎么在Decision Tree 训练时避免 overfitting: Pre-Pruning 和 Post-Pruning

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

pre-pruning 两个停止条件:1. 某个node上的record数目小于一定量,比如 <20个, 2. 纯度到达一定数值,比如80%, 就不再split了.

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

怎么取 validation set

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

holdout 方法如下表示,为了解决training set 和validation set 可能distribution 不同,还有一个引申出来的repeated-holdout

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

除了 accuracy, error rate, F1, Confusion Matrix

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Week 5 Regression, Cluster, Association

Association:

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)

Coursera, Big Data 4, Machine Learning With Big Data (week 3/4/5)