Scribd Logo
Upload

Welcome to Scribd!

  • 17 views

    Assignment 3

    Uploaded by

    Saif Bakry
    This document discusses gradient descent methods for machine learning models. It describes three types of gradient descent: batch gradient descent, which updates the model after evaluating all training examples; stochastic gradient descent, which processes one example at a time; and mini-batch gradient descent, which divides the dataset into small batches. It also defines concepts like weights, bias, activation functions, and discusses geo AI, AI GIS, and GIS AI.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd

    Assignment 3

    Uploaded by

    Saif Bakry
    17 views4 pages
    This document discusses gradient descent methods for machine learning models. It describes three types of gradient descent: batch gradient descent, which updates the model after evaluating all training examples; stochastic gradient descent, which processes one example at a time; and mini-batch gradient descent, which divides the dataset into small batches. It also defines concepts like weights, bias, activation functions, and discusses geo AI, AI GIS, and GIS AI.

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    This document discusses gradient descent methods for machine learning models. It describes three types of gradient descent: batch gradient descent, which updates the model after evaluating all training examples; stochastic gradient descent, which processes one example at a time; and mini-batch gradient descent, which divides the dataset into small batches. It also defines concepts like weights, bias, activation functions, and discusses geo AI, AI GIS, and GIS AI.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    17 views4 pages

    Assignment 3

    Uploaded by

    Saif Bakry
    This document discusses gradient descent methods for machine learning models. It describes three types of gradient descent: batch gradient descent, which updates the model after evaluating all training examples; stochastic gradient descent, which processes one example at a time; and mini-batch gradient descent, which divides the dataset into small batches. It also defines concepts like weights, bias, activation functions, and discusses geo AI, AI GIS, and GIS AI.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    of 4

    Assignment 3

    Supervised By

    Dr Mohamed Abo Rizka

    Prepared By

    Saif Allah Mohamed Bakry


    What is Gradient descent method?
    Gradient Descent is a machine learning iterative optimization algorithm that is
    frequently used to train machine learning and deep learning models. It assists
    in determining a function's local minimum

    Types of Gradient Descent


    1. Batch Gradient Descent
    2. Stochastic gradient descent
    3. Minibatch Gradient Descent

    Batch Gradient Descent:


    After evaluating all training examples, batch gradient descent (BGD) is implemented to
    find the error for each point in the training set and update the model. This is referred to as
    the training epoch. Simply put, it is a greedy approach in which we must add over all
    examples for each update

    Advantages of Batch gradient descent:


    It generates less noise in comparison to other gradient descent
    It produces stable gradient descent convergence
    Because all resources are utilized for all training samples, it is efficient and robust.
    ___________________________________________________________________________________________

    Stochastic gradient Descent


    Stochastic gradient descent (SGD) is a gradient descent algorithm that runs one training example
    per iteration. In other words, it processes a training epoch for each example in a dataset and
    updates the parameters of each training example one at a time. It is easier to store in allocated
    memory because it only requires one training example at a time

    Page | 2
    Advantages of Stochastic gradient descent:
    It is simplest way to allocate in the desired memory.
    It is quicker to compute than batch gradient descent.
    For large datasets, it is more proficient.
    ___________________________________________________________________________________________

    MiniBatch Gradient Descent:


    Mini Batch gradient descent integrates batch gradient descent with stochastic gradient
    descent. It divides the training datasets into small batches and then updates each batch
    separately. Splitting training datasets into smaller batches strikes a balance between batch
    gradient descent's computational efficiency and the speed of stochastic gradient descent
    Advantages of Mini Batch gradient descent:
    It is more easy to fit in allocated memory
    It is computationally efficient
    It produces stable gradient descent convergence
    ___________________________________________________________________________________________

    What is weights:
    Weights are real values that are associated with each input/feature and convey the
    significance of that correlating feature in predicting the final output

    What is Bias:
    The constant added to the product of features and weights is known as bias. It is used to cancel
    out the outcome. It aids models in shifting the activation function to the positive or negative side

    What is activation function:


    An activation function is a function in an artificial neuron that generates an output based
    on the inputs. Activation functions in artificial neurons are an essential part of the role that
    artificial neurons perform in modern artificial neural networks.

    Page | 3
    What is Geo AI?
    is a branch of study that integrates the use of geographic information systems (GIS) and
    artificial intelligence (AI) to analyze spatial data and make forecasts or decisions based on
    it. It is an interdisciplinary field that combines geographers', computer scientists', and data
    scientists' expertise to create innovative solutions to real-world problems

    What is AI GIS
    AI GIS is a mixture of AI technology and several GIS functions, including spatial data
    processing and analysis algorithms (GeoAI) that combine AI technology, and a general
    term for a series of AI and GIS consensual empowerment technologies. In recent years, AI
    GIS has gradually become the core focus of geoscience both research and application

    What is GIS AI
    When confronted with AI recognition findings, GIS for AI empowers AI by utilizing its
    geographical visualization and spatial analytic capabilities to further process and mine data.
    Map visualization applications such as traffic flow monitoring and city component
    management can provide decision makers with a more intuitive form of information
    expression, while in-depth processing and mining of AI extraction results can enable real-
    time geo fence alerts, vehicle tracking, and other applications.

    Page | 4

    You might also like