Deep Learning Syllabus

Download as pdf or txt
Download as pdf or txt
You are on page 1of 2

Course Structure

A7709 - Deep Learning

Hours Per Week Hours Per Semester Credits Assessment Marks


L T P L T P C CIE SEE Total
3 0 2 45 0 30 4 30 70 100

1. Course Description
Course Overview
This course builds the knowledge on deep neural learning in the aspect of artificial intelli-
gence that depends on data representations rather than task- specific algorithms. It helps
the students to demonstrate supervised, semi-supervised, and unsupervised learning. A
convolution deep learning neural network is built using Keras to show how deep learning
is used in specialized neural networks. Applications of deep learning will help to recognize
and process text, images and speech applications. Introduction of various deep learning
models such as RNNs, Encoders and Generative models will help to relate to real time
projects.

Course Pre/co-requisites
A7512 - Machine Learning
A7704 - Foundations of Machine Learning
2. Course Outcomes (COs)
After the completion of the course, the student will be able to:

A7709.1 Identify the need of neural networks and deep learning for a given problem.
A7709.2 Build a CNN model on the real time data.
A7709.3 Model sequence classification applications using RNN.
A7709.4 Build a deep learning model using encoders.
A7709.5 Make use of generative models in various creative tasks.

3. Course Syllabus
Theory

Introduction : Introduction Deep Learning Architectures Historical trends in Deep


Learning, Challenges motivating Deep Learning, gradient Based Learning, Hidden Units,
Architecture Design, Back Propagation

Convolution Neural Networks : The convolution Operation, Motivation, Pooling,


Convolution and Pooling as an Infinitely Strong Prior, Variants of the Basic Convolution
Function, Structured Outputs, Data Types, Efficient Convolution Algorithms, Convolu-
tion Networks and the History of Deep Learning

Sequence Modeling : Recurrent And Recursive Nets Recurrent Neural Networks, Bidi-
rectional RNNs, Encoder-decoder sequence to sequence architectures,Long Short Term
Memory Networks.

96 www.vardhaman.org
Auto Encoders : Under complete Auto encoder, Regularized Auto encoder, stochastic
Encoders and Decoders,Contractive Encoders. Applications of Auto encoders

Deep Generative Models : Boltzmann Machines, Deep Belief networks, Deep Boltz-
mann Machine, Generative Stochastic Networks, Generative Adversarial networks, eval-
uating Generative Models Networks.

Practice

1. Create neural network class and initialize those weights and biases.
2. Implement all activation functions in Neural Network.
3. Implement Loss function for Neural network.
4. Implement Forward Propagation and Backward Propagation.
5. Program to Train and Test a neural network.
6. Train and test the Convolution neural network using the heart disease dataset, pre-
process it
7. Implement Convolution neural network for image classification.
8. Train and test the recurrent neural network using the heart disease dataset, pre-process
it.
9. Implement Facial recognition using neural network.
10. Implement Object detection using neural network.
4. Laboratory Equipment/Software/Tools Required
1. Computer System with Ubuntu Operating System
2. Python 3.X or above, Keras , Tensorflow
3. Text Editor - Pycharm / Jupyter note book/Sublime.

5. Books and Materials


Text Books:
1. Goodfellow, I., Bengio,Y., and Courville, A., Deep Learning, MIT Press, 2016.
2. Jeff Heaton., Deep Learning and Neural Networks, Heaton Research Inc, 2015.
Reference Books:
1. Bishop, C., M., Pattern Recognition and Machine Learning, Springer, 2006.
2. Yegnanarayana, B., Artificial Neural Networks PHI Learning Pvt. Ltd, 2009.
3. Golub, G., H., and Van Loan,C.,F., Matrix Computations, JHU Press,2013.
4. Satish Kumar, Neural Networks: A Classroom Approach, Tata McGraw Hill Educa-
tion,2004

97 www.vardhaman.org

You might also like