===== Introduction to Machine Learning ===== The study of learning from data is commercially and scientifically important. This one month short course is designed to give first year Ph.D. students a thorough grounding in the methodologies, technologies, mathematics and algorithms currently needed by people who do research in learning and data mining or who may need to apply learning or data mining techniques to a target problem. The topics of the course draw from classical statistics, from machine learning, from data mining, from Bayesian statistics and from statistical algorithmics. \\ Students entering the class should have a pre-existing working knowledge of probability, statistics and algorithms, though the class has been designed to allow students with a strong numerate background to catch up and fully participate. ===== Schedule ===== ^ Topic ^ Date ^ Slides ^ note ^ | Introduction | 2010.03.04 | {{2010:ml2010-introduction.pdf|Introduction}} | [[keynote:lesson01|=>]] | | ::: | ::: | {{2010:ml2010-what_is_ml.pdf|What is Machine Learning}} | ::: | | ::: | ::: | {{2010:ml2010-point_estimation.pdf|Point estimation}} | ::: | | Supervised Learning | 2010.03.11 | {{2010:ml2010-2-1-concept_learning.pdf|Concept learning}} | [[keynote:lesson02|=>]] | | ::: | ::: | {{2010:ml2010-2-2-decision_tree.pdf|Decision tree}} | ::: | | ::: | ::: | {{2010:ml2010-2-3-naive_bayes_classification.pdf|Naive Bayes classifier}} | ::: | | ::: | ::: | {{2010:ml2010-2-4-svm.pdf|Support Vector Machines}} | ::: | | ::: | ::: | {{2010:ml2010-2-5-boosting.pdf|Boosting}} | ::: | | Unsupervised Learning | 2010.03.18 | {{2010:ml2010-dimension_reduction.pdf| Dimension Reduction}} | [[keynote:lesson03|=>]] | | ::: | ::: | {{2010:adaboost.pdf| Why AddBoost?}} | ::: | | ::: | ::: | {{2010:ml2010-clustering.pdf | Clustering }} | ::: | | Reinforcement Learning | 2010.03.25 | {{2010:ml2010-clustering.pdf | Clustering (cont.)}} | [[keynote:lesson04|=>]] | | ::: | ::: | {{2010:ml2010-hidden_markov_model.pdf|Hiden Markov Model}} | ::: | | ::: | ::: | {{2010:ml2010-kalman_filter.pdf|Kalman Filter}} | ::: | | course talk | 2010.04.01 | {{:2010:matrix-decomposition.pdf|Robust PCA}} | By Zhengfang Hu | ===== Text books ===== - [[http://www.cs.cmu.edu/~tom/mlbook.html|Machine learning]] - [[http://research.microsoft.com/en-us/um/people/cmbishop/prml/|Pattern Recognition and Machine Learning ]] - [[http://www.rii.ricoh.com/~stork/DHS.html|Pattern Classification (2nd ed) ]] ===== Reference website ===== - [[http://www.stanford.edu/class/cs229/|Stanford machine Learning course]]