Machine Learning · PEC-IT701D
Priority List · Question Bank · Analysis · Reading Time · Progress
Official MAKAUT Syllabus at a Glance
| Unit | Syllabus |
|---|---|
| 1 | Basic methods: Distance-based methods, Nearest-Neighbours, Decision Trees, Naive Bayes. Linear models: Linear Regression, Logistic Regression, Generalized Linear Models. Support Vector Machines, Nonlinearity and Kernel Methods. Beyond Binary Classification: Multi-class/Structured Outputs, Ranking |
| 2 | Clustering: K-means/Kernel K-means. Dimensionality Reduction: PCA and kernel PCA. Matrix Factorization and Matrix Completion. Generative Models (mixture models and latent factor models) |
| 3 | Evaluating Machine Learning algorithms and Model Selection, Introduction to Statistical Learning Theory, Ensemble Methods (Boosting, Bagging, Random Forests) |
| 4 | Sparse Modeling and Estimation, Modeling Sequence/Time-Series Data, Deep Learning and Feature Representation Learning |
| 5 | Scalable Machine Learning (Online and Distributed Learning). A selection from some other advanced topics, e.g., Semi-supervised Learning, Active Learning, Reinforcement Learning, Inference in Graphical Models, Introduction to Bayesian Learning and Inference |
| 6 | Recent trends in various learning techniques of machine learning and classification methods |
Reading Guide
-
★★★ Must-do · ★★ Important · ★ Asked · ☆ Not asked yet
-
recent papers = this subject's current MAKAUT papers (they set the stars) · other papers = older-scheme and other-branch MAKAUT papers
-
PYQ added from past papers (not named in the syllabus)
-
Topics are in study order: each one builds on the ones before it. A topic without a link is not written yet.
-
Short on time? → Priority List
-
How long each topic takes → Reading Time
-
Finished a topic? Tick Mark as done at its end · what's left → Progress
Topic Map
Unit 0 · Introduction to Machine Learning not in syllabus
These basics are asked in almost every paper, so they come first.
- 0.1Introduction to Machine Learning: Definition, AI vs ML vs DL★★ PYQ
- 0.2Types of Machine Learning★★★ PYQ
- 0.3Data Basics: Features, Variable Types, Data Splits & Pre-processing★ PYQ
- 0.4Parametric vs Non-parametric Models★★★ PYQ
Unit 1 · Supervised Learning
- 1.1Supervised Learning: Classification vs Regression★★
- 1.2Distance-Based Methods & Distance Measures★★
- 1.3K-Nearest Neighbours (KNN)★★★
- 1.4Decision Trees: ID3, Entropy & Information Gain★★
- 1.5Probability Basics & Bayes Theorem★
- 1.6Bayesian Learning & Inference☆
- 1.7Naive Bayes Classifier★★
- 1.8Linear Regression★★★
- 1.9Logistic Regression★★★
- 1.10Generalized Linear Models☆
- 1.11Support Vector Machines: Hyperplane, Margin & Support Vectors★
- 1.12Non-linearity & Kernel Methods (Non-linear SVM)★
- 1.13Beyond Binary Classification: Multi-class, Structured Outputs & Ranking☆
Unit 2 · Unsupervised Learning
4 syllabus lines → 11 topics: each line is split into exam-sized topics (clustering → 2.1–2.3), feature selection and the curse of dimensionality get their own space, and 1 PYQ topic (recommender systems) comes from past papers.
- 2.1Clustering: Concepts, Requirements & Types★
- 2.2K-means Clustering★★★
- 2.3Kernel K-means☆
- 2.4Dimensionality Reduction & the Curse of Dimensionality★★★
- 2.5Feature Selection★★
- 2.6Principal Component Analysis (PCA)★★★
- 2.7Kernel PCA★
- 2.8Recommender Systems: Content-Based & Collaborative Filtering★★ PYQ
- 2.9Matrix Factorization & Matrix Completion★★
- 2.10Generative Models: Mixture Models (GMM & EM)★★
- 2.11Latent Factor Models☆
Unit 3 · Model Evaluation and Selection
- 3.1Confusion Matrix & Classification Metrics★★★
- 3.2ROC, AUC & Other Evaluation Metrics☆
- 3.3Overfitting, Underfitting & the Bias–Variance Trade-off★★★
- 3.4Model Selection & Cross-Validation★★
- 3.5Introduction to Statistical Learning Theory (PAC, VC Dimension)★
- 3.6Ensemble Learning: Principle & Types★★★
- 3.7Bagging & Bootstrapping★★★
- 3.8Boosting & Bagging vs Boosting★★★
- 3.9Random Forest★★
Unit 4 · Sparse Modeling, Sequences and Deep Learning
- 4.1Sparse Modeling & Estimation★★
- 4.2Modeling Sequence / Time-Series Data★
- 4.3Neural Network Fundamentals: Perceptron, Activation Functions & Backpropagation★★★
- 4.4Deep Learning: Concepts, ML vs DL & Applications★★★
- 4.5Deep Learning Architectures: CNN, RNN, Autoencoders, DBN☆
- 4.6Feature Representation Learning★
Unit 5 · Scalable and Advanced ML
- 5.1Scalable ML: Online & Distributed Learning★
- 5.2Semi-supervised Learning★
- 5.3Active Learning★★
- 5.4Reinforcement Learning★★★
- 5.5Inference in Graphical Models: Bayesian Networks★