Machine Learning and Deep Learning - Fundamentals and Applications
Machine Learning and Deep Learning - Fundamentals and Applications
Machine Learning and Deep Learning - Fundamentals and Applications
PROF. M. K. BHUYAN
Department of Electronics and Electrical Engineering
IIT Guwahati
PRE-REQUISITES : Knowledge of Linear Algebra, Probability and Random Process, PDE will be helpful.
INTENDED AUDIENCE : UG, PG and PhD students and industry professionals who want to work in Machine and
Deep Learning.
INDUSTRY SUPPORT : This is a very important course for industry professionals.
COURSE OUTLINE :
In this course we will start with traditional Machine Learning approaches, e.g. Bayesian Classification, Multilayer
Perceptron etc. and then move to modern Deep Learning architectures like Convolutional Neural Networks,
Autoencoders etc. We will learn about the building blocks used in these Deep Learning based solutions.
Specifically, we will learn about feedforward neural networks, convolutional neural networks, recurrent neural
networks and attention mechanisms. On completion of the course students will acquire the knowledge of
applying Machine and Deep Learning techniques to solve various real-life problems.
ABOUT INSTRUCTOR :
Prof. Manas Kamal Bhuyan received a Ph.D. degree in electronics and communication engineering from the India
Institute of Technology (IIT) Guwahati, India. He was with the School of Information Technology and Electrical
Engineering, University of Queensland, St. Lucia, QLD, Australia, where he was involved in postdoctoral
research. Subsequently, he was a Researcher with the SAFE Sensor Research Group, NICTA, Brisbane, QLD,
Australia. He was an Assistant Professor with the Department of Electrical Engineering, IIT Roorkee, India and
Jorhat Engineering College, Assam, India, and he also worked in Indian Engineering Services. In the year 2014,
he was a Visiting Professor with Indiana University and Purdue University, Indiana, USA. Dr. Bhuyan was a
recipient of the National Award for Best Applied Research/Technological Innovation (click here for the video),
which was presented by the Honorable President of India in the year 2012, the Prestigious Fullbright-Nehru
Academic and Professional Excellence Fellowship, and the BOYSCAST Fellowship. He is an IEEE senior member.
He is currently a Professor with the Department of Electronics and Electrical Engineering, IIT Guwahati, and
Dean of Infrastructure, Planning and Management, IIT Guwahati. He is also currently working as a Visiting
Professor, Department of Computer Science, Chubu University, Japan. His current research interests include
Machine Learning and Artificial Intelligence, Image/Video Processing, Computer Vision, Human Computer
Interactions (HCI), Virtual Reality & Augmented Reality, and Biomedical Signal Processing. He has almost 27
years of industry, teaching, and research experience. He is the author of the text book "Computer Vision and
Image Processing: Fundamentals and Applications", published by CRC press, USA, 2019.
COURSE PLAN :
Week 1: Introduction
Introduction to ML, Linear Regression.
Week 2: Bayes Decision Theory
Bayes Decision Theory, Normal Density and Discriminant Function, Bayes Decision Theory - Binary Features,
Bayesian Belief Network
Week 3: Parametric and Non- Parametric Density Estimation
Parametric and Non- Parametric Density Estimation – ML and Bayesian Estimation, Parzen Window and
KNN
Week 4: Logistic Regression, Support Vector Machine
Perceptron Criteria, Logistic Regression, Discriminative models, Support Vector Machine
Week 5: Random Forest, Hidden Markov Model
Decision trees, Hidden Markov Model
Week 6: Ensemble methods
Ensemble methods: Ensemble strategies, boosting and bagging, Random Forest
Week 7: Dimensionality Problem
Dimensionality Problem, Principal Component Analysis, Linear Discriminant Analysis
Week 8: Gaussian mixture model
Concept of mixture model, Gaussian mixture model, Expectation Maximization Algorithm
Week 9: Clustering
Clustering, k-means, DBSCAN, Hierarchical Agglomerative Clustering, Mean-shift clustering
Week 10: Neural Network
Neural network: Perceptron, multilayer network, backpropagation, RBF Neural Network, Applications
Week 11: Introduction to deep neural network
Introduction to deep neural network, Convolutional Neural Networks, AlexNet, VGGNet, GoogleNet.
Week 12: Recent Trends in Deep Learning
Recent Trends in Deep Learning Architectures, Transfer Learning, Residual Network, Skip Connection
Network, Auto encoders and relation to PCA, Recurrent Neural Networks, Applications and Case studies.