Machine-Learning

• Author: Mohammad Javad Maheronnaghsh

Suggested Topics

Supervised Learning

Regression

• Linear Regression
• Lasso & Ridge Regression
• Non-Linear (Polynomial) Regression

Classification

• Logistic Regression
• Decision Tree
• Bagging
• AdaBoost

Natural Language Processing

• TF-IDF

Deep Learning

• Neural Networks

Unsupervised Learning

• K-Means

Semi-Supervised Learning

Federated Learning

Loss Functions

• MSE (Mean Squared Error)
• Cross-Entropy
  • Binary
  • Categorical (Multi-class)
• Hinge Loss
  • used in SVMs
• Logistic Loss
  • used in logistic regression

Some Notes

• Logistic Regression is about classification, not regression!
• There are 3 classical regression models: Lasso, Ridge, Linear Regression.
• The cost functions are originated from MLE (Maximum Likelihood Estimator).
  • For example: Cross-Entropy is originated from MLE of Bernoli Distribution, and MSE is originated from MLE of Normal Distribution.

Useful Links

• [Persian] ML in simple words: https://baridsoft.net/machine-learning-in-simple-words/
• ML Fields: https://paperswithcode.com/methods
• [Persian] Wikipedia Page - Dr. Sharifi Zarchi and Mr. Azarkhalili's course on ML
• What is ML in simple words

Resources

• Link 1

TODO

• Upload the lecture notes
• Upload useful slides
• Upload Useful assignments and answers
• Add links of useful courses (videos) and their assignments with answers
• The previous suggestion can be converted into a bank of questions that is useful for teaching assisstants to design homeworks
• add link of ML course (Dr. Motahari)