Scribd Logo
Upload

Welcome to Scribd!

  • 40 views

    Back Propagation Neural Network 1: Lili Ayu Wulandhari PH.D

    Uploaded by

    Dewa Bagus Krisna
    This document discusses different learning methods for backpropagation neural networks, including batch, mini-batch, and online learning. It also provides an overview of the backpropagation neural network algorithm, showing how inputs are propagated through the input layer to the hidden layer and then to the output layer, with weights being adjusted. References are provided for further reading on neural networks and learning machines.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd

    Back Propagation Neural Network 1: Lili Ayu Wulandhari PH.D

    Uploaded by

    Dewa Bagus Krisna
    40 views8 pages
    This document discusses different learning methods for backpropagation neural networks, including batch, mini-batch, and online learning. It also provides an overview of the backpropagation neural network algorithm, showing how inputs are propagated through the input layer to the hidden layer and then to the output layer, with weights being adjusted. References are provided for further reading on neural networks and learning machines.

    Original Description:

    BPNN_1

    Original Title

    04 BPNN_1

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    This document discusses different learning methods for backpropagation neural networks, including batch, mini-batch, and online learning. It also provides an overview of the backpropagation neural network algorithm, showing how inputs are propagated through the input layer to the hidden layer and then to the output layer, with weights being adjusted. References are provided for further reading on neural networks and learning machines.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    40 views8 pages

    Back Propagation Neural Network 1: Lili Ayu Wulandhari PH.D

    Uploaded by

    Dewa Bagus Krisna
    This document discusses different learning methods for backpropagation neural networks, including batch, mini-batch, and online learning. It also provides an overview of the backpropagation neural network algorithm, showing how inputs are propagated through the input layer to the hidden layer and then to the output layer, with weights being adjusted. References are provided for further reading on neural networks and learning machines.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    of 8

    Back Propagation Neural

    Network 1

    Lili Ayu Wulandhari Ph.D.


    Learning Method

    In learning process data is divided into two, namely


    1. Data for training (in-sample)
    2. Data for validation and testing (out-sample)
    In order to obtain minimum error, training process is
    carried out, which can be done by:
    • Batch learning
    Whole In-sample data are used in each iteration.
    • Mini-Batch learning
    In-sample data is divided into smaller group to be used
    in each iteration.
    • Online learning (Stochastic)
    In sample data is used one-by-one in each iteration
    which is chosen randomly.
    Backpropagation Neural
    Network Algorithm

    Where:
    b11 b21 xi : The ith Input Neuron
    yj : The jth Hidden Neuron
    w11 zk : The kth Output Neuron
    x1 y1 v11
    w12 wij : Weights of the the ith Input Neuron
    v1m z1 to the jth Hidden Neuron
    w1l
    w21 v21 vjk : Weights of the the jth Hidden
    x2 y2 .
    w22 Neuron to the kth Output Neuron
    . . v2m . b : Bias
    w2l
    . wn1 . vl1 .
    wn2 vlm zm
    . .
    xn yl
    wnl
    Input Layer Hidden Layer Output Layer
    Backpropagation Neural
    Network Algorithm
    Backpropagation Neural
    Network Algorithm
    Backpropagation Neural
    Network Algorithm
    Backpropagation Neural
    Network Algorithm
    References
    • Simon S Haykin, Neural networks and learning machines,
    volume 3. Pearson Education Upper Saddle River, 2009.
    • Sandhya Samarasinghe. Neural networks for applied
    sciences and engineering: from fundamentals to complex
    pattern recognition. CRC Press, 2006.
    • Bishop, Christopher M. Neural networks for pattern
    recognition. Oxford university press, 1995.

    You might also like