BIT4440_BSE4050_ICT4445

CLO UD CO M PUTI NG AND BI G DATA

M R LISTONE KA PU TU LA
 Cloud Computing and Big Data

Introduction
Cloud Computing Technologies
Big Data Technologies
Cloud Application Development Tools and
Frameworks
Cloud Application Development
Data Management in the Cloud
Big Data Analytics in the Cloud
Cloud Deployment and Management
Cloud Security
Cloud Project Development
 Foundations
Introduction
Cloud computing refers to the delivery of
shared computing resources over the internet.
Shared pool of computing resources are
provided on-demand which includes servers,
storage, databases, networking, software,
and applications.
The key attributes of the cloud are:
on-demand access to compute and storage,
limitless scaling,
and flexible pricing
 Foundations
Cloud Computing – Characteristics & *… Models
Cloud
 Foundations
Cloud Computing – Characteristics & *…
Models
On-demand self-service: Users can provision
and access computing resources without
requiring human intervention from the service
provider.
Broad network access: Cloud services are
accessible over the network through standard
mechanisms, enabling users to access
resources using a variety of devices.
 Foundations
Cloud Computing – Characteristics & *…
Models
Resource pooling: Computing resources are
pooled together to serve multiple users
simultaneously.
Users typically have no control or knowledge
over the exact physical location of the resources.
Rapid elasticity: Computing resources can be
rapidly scaled up or down based on demand,
allowing users to access additional resources
when needed and release them when no longer
required.
 Foundations
Cloud Computing – Characteristics & *…
Models
Measured service: Cloud providers monitor and
control the usage of computing resources,
enabling users to be billed based on their
consumption.
Examples include pay-per-use models.
 Foundations
Ecosystem of Cloud Computing
Consumers of services: These are the end-
users that use cloud services in their day-to-day
business activities.
Provider of services: These cloud providers
offer a variety of functions ranging from
infrastructure services to applications and tools.
Designer of services: These companies build
applications and tools. Often services are
intended to work within a specific cloud
ecosystem or can augment a packaged cloud
application.
 Foundations
Cloud Service Providers
There are several prominent cloud service
providers in the industry, each offering a suite of
cloud services.
Some of the leading providers include:
Amazon Web Services (AWS): AWS is a
comprehensive cloud computing platform offering a
wide range of services, including compute, storage,
databases, networking, AI/ML, analytics, and more.
 Foundations
Cloud Service Providers
Google Cloud Platform (GCP): GCP provides a
variety of cloud services, including computing,
storage, databases, AI/ML, networking, and
analytics.
It also offers unique services like BigQuery and
Kubernetes.
IBM Cloud: IBM Cloud provides a robust set of
infrastructure and platform services, including
compute, storage, networking, AI/ML, blockchain,
and IoT solutions.
It also offers industry-specific solutions.
 Foundations
Cloud Service Providers
Microsoft Azure: Azure is a comprehensive cloud
platform offering services for compute, storage,
databases, networking, AI/ML, analytics, and more.
It also integrates well with Microsoft's other products
and services.
Alibaba Cloud: Alibaba Cloud offers a full range of
cloud products and services, including elastic
computing, databases, networking, security,
analytics, big data, domains, website management,
application services, media services, middleware,
and more.
 Foundations
Cloud Service Model:
Virus
Replicates
 Foundations
Cloud Service Models
Infrastructure as a Service (IaaS):IaaS provides
virtualized computing resources over the internet.
Users have control over the operating system,
applications, and some networking components but
are responsible for managing the rest of the
infrastructure. e.g. many-core
GPUs
e.g. multi-core
CPUs
 Foundations
Cloud Service Models
Platform as a Service (PaaS): PaaS provides a
platform for users to develop, run, and manage
applications without the complexity of infrastructure
management.
Users have control over the applications and data,
while the underlying infrastructure is abstracted.
 Foundations
Cloud Service Models
Google App Engine, Google colab, etc
 Foundations
Cloud Service Models
Software as a Service (SaaS):
Builds on-top of various IAAS & PAAS services
SaaS offers ready-to-use software applications over
the internet.
Users can access and use the applications without
worrying about the underlying infrastructure,
platform, or software maintenance.
 Foundations
Cloud Deployment Models
Software
 Foundations
Cloud Deployment Models
Public Cloud: In the public cloud model, cloud
resources are owned and operated by third-party
service providers.
These resources are shared among multiple users
and are accessible over the internet.
It offers cost-efficiency and scalability but may have
limited customization options.
 Foundations
Cloud Deployment Models
Private Cloud: A private cloud is dedicated to a
single organization.
It can be hosted on-premises or by a third-party
service provider.
Private clouds offer more control, customization,
and security but require higher upfront investments.
 Foundations
Cloud Deployment Models
Hybrid Cloud: The hybrid cloud model combines
the use of both public and private clouds.
It allows organizations to leverage the benefits of
both deployment models,
It enables them to keep sensitive data on-premises
while utilizing the scalability and flexibility of the
public cloud for other workloads.
 Foundations
Cloud Deployment Models
Community Cloud: Community cloud refers to a
shared cloud infrastructure that is designed and
used by multiple organizations with similar interests,
requirements, or compliance needs.
In this model, the cloud infrastructure is tailored to
serve a specific community of users, such as:
government agencies,
healthcare providers,
educational institutions, or
research organizations.
 Foundations
Cloud Architecture
Cloud architecture refers to the underlying
infrastructure and components that enable the
delivery of cloud services.

Key components of cloud architecture include:

Virtualization: Virtualization enables the creation
of virtual instances of computing resources,
such as virtual machines (VMs) or virtual networks.
It provides the foundation for resource
abstraction and efficient resource utilization.
 Foundations
Cloud Architecture
Virtual Machines (VMs): VMs are emulations of
physical computers, allowing multiple operating
systems and applications to run on a single physical
server.
VMs offer flexibility, isolation, and portability of
workloads.
Storage: Cloud storage provides scalable and
durable storage solutions for data.
It includes object storage, block storage, and file
storage services that can be accessed over the
network.
 Foundations
Cloud Architecture
Networking: Cloud networking encompasses the
infrastructure and services required to establish
connectivity between cloud resources, users, and on-
premises networks.
It includes virtual networks, load balancers, firewalls,
and VPNs.
Containers: Containers provide lightweight and
isolated runtime environments for applications and their
dependencies.
They enable efficient resource utilization and
simplified application deployment and management.
 Foundations
Cloud Adoption and Related Trends and Practices
Various trends and practices have emerged to
enhance cloud capabilities and leverage its
potential.
Some of these trends and practices include:
Hybrid Multicloud
Microservices
Serverless Computing
DevOps
Cloud Native
Application Modernization
 Foundations
Cloud Adoption and Related Trends …
Hybrid Multicloud: Organizations are adopting a
combination of public and private clouds from
multiple providers, allowing them to select the most
suitable services and avoid vendor lock-in.
Microservices: Microservices architecture involves
developing applications as a collection of small,
loosely coupled services.
It enables scalability, flexibility, and easier
maintenance of complex applications.
 Foundations
Cloud Adoption and Related Trends …
Serverless Computing: Serverless computing
allows developers to focus on writing application
code without the need to manage underlying
infrastructure. It enables automatic scaling and cost
optimization based on usage.
DevOps: DevOps is a set of practices that combine
software development (Dev) and IT operations
(Ops) to enable faster and more reliable software
delivery. It promotes collaboration, automation, and
continuous integration and deployment.
 Foundations
Cloud Adoption and Related Trends …
Cloud Native: Cloud-native applications are
designed and built specifically for the cloud
environment. They leverage cloud services,
containerization, and microservices to achieve
scalability, resilience, and rapid deployment.
Application Modernization: Application
modernization involves updating and transforming
legacy applications to leverage cloud technologies
and architectures. It helps improve scalability,
performance, and agility.
 Foundations
Cloud Security Basics
Cloud security is a critical aspect of cloud
computing.
Key considerations for cloud security include:
Data protection: Ensuring the confidentiality,
integrity, and availability of data stored and
processed in the cloud.
It involves encryption, access controls, and
backup and recovery mechanisms.
 Foundations
Cloud Security Basics
Identity and access management: Implementing
robust authentication and authorization
mechanisms to control access to cloud resources.
It includes user management, role-based access
control (RBAC), and multi-factor authentication
(MFA).
Network security: Implementing secure network
architectures, firewalls, and intrusion detection and
prevention systems to protect cloud resources from
unauthorized access and attacks.
 Foundations
Cloud Security Basics
Compliance and governance: Adhering to
industry-specific regulations and standards and
implementing proper governance frameworks to
maintain compliance and control over cloud
environments.
Incident response and monitoring: Implementing
proactive monitoring and incident response
mechanisms to detect and respond to security
incidents in a timely manner.
 Foundations
Different Job Roles in the Cloud Industry
The cloud industry offers a wide range of job roles
catering to various aspects of cloud computing.
Some common job roles include:
Cloud Architect: Responsible for designing and
implementing cloud solutions, including infrastructure,
networking, and security.
Cloud Developer: Develops and deploys cloud-native
applications and implements automation and integration
with cloud services.
Cloud Operations Engineer: Manages and maintains
cloud infrastructure, monitors performance, and ensures
high availability and reliability.
 Foundations
Different Job Roles in the Cloud Industry
Some common job roles include:…
Cloud Security Specialist: Focuses on
implementing and maintaining security measures,
including access controls, encryption, and
security audits.
Cloud Data Engineer: Manages and analyzes
large-scale data in the cloud, designs data
pipelines, and implements data storage and
processing solutions.
 Foundations
Different Job Roles in the Cloud Industry
Cloud Solutions Architect: Collaborates with
clients to understand their requirements and
designs cloud solutions that meet their business
needs.
Cloud Consultant: Provides expert advice and
guidance to organizations on cloud strategies,
migration, and optimization.
Cloud Project Manager: Oversees the planning,
execution, and delivery of cloud projects,
ensuring they meet business objectives and
timelines.
 Cloud Computing and Big Data

Introduction
Cloud Computing Technologies
Big Data Technologies
Cloud Application Development Tools and
Frameworks
Cloud Application Development
Data Management in the Cloud
Big Data Analytics in the Cloud
Cloud Deployment and Management
Cloud Security
Cloud Project Development