Hacc 2023 Google Ai - ML Workshop
Hacc 2023 Google Ai - ML Workshop
Hacc 2023 Google Ai - ML Workshop
Google AI/ML
Workshop
Daniel Liu
[email protected]
Google AI Mission Statement
Proprietary + Confidential
Google Cloud End-to End AI Platform
Accelerate Business Outcomes with Enterprise-Ready Machine Learning Pipeline
Cloud AI products
Pre-trained ML APIs to
Building custom ML models
ML Framework
Industry-standard & widely adopted
Infrastructure
Best-in class processors for ML/DL
CPU GPU TPU
Proprietary + Confidential
Confidential + Proprietary
“If everyone spoke to their
phone for three minutes,
we’d exhaust all available
computing resources”
Jeff Dean
Google Senior Fellow
2014
Proprietary + Confidential
TPU vs
Conventional
processors
15 - 30x faster
30 - 80x operations per watt
Proprietary + Confidential
Cloud AI products & solutions
Services & Solutions Collaboration Services
CxOs
Solutions
Ease of
Implementation
Talent Contact Document Profession Cloud AI
Center AI Understanding AI AI Hub ASL al Services Partners
Solution
Sight Language Conversation Structured Data
APIs
Video Natural Speech- Text-to- Dialogflow Recommendations AI
Vision Language Translation
Intelligence to-Text Speech Enterprise
Building
Blocks
Natural
Vision Video Translation Tables
Language
Accelerators Frameworks
Infrastructure
AI Foundation
TPU GPU CPU
Cloud AI products & solutions
Services Solutions Collaboration Services
CxOs
&
Solutions
Contact Document Profession Cloud AI
Ease of Talent
Center AI Understanding AI AI Hub ASL
Solution al Services Partners
Implementatio
n
Sight Language Conversation Structured Data
APIs
Video Natural Speech- Text-to- Dialogflow Recommendations AI
Vision Language Translation
Intelligence to-Text Speech Enterprise
Building
Blocks
Natural
Vision Video Translation Tables
Language
Environment Data
Datasets Data Kubeflow
Notebook VM Images Training Predictions Studio
Dataflow Dataproc BigQuery Dataprep
Accelerators
Pre-built Labeling Frameworks
Algorithms
Infrastructure
AI Foundation
TPU GPU CPU
Google is the pioneer in Bard
AI 202
3
A conversational
202 AI Service
2
AlphaFold predicts
powered by
2020 structures of all LaMDA.
Powered by Foundation Models Powered by Foundation Models Powered by Foundation Models Powered by Foundation Models
Generative AI
App Builder Foundation Vertex AI Search
Models (Enterprise Search)
Developers
End-to-End ML Platform
3. Document AI
Get started today with translation tools known and loved by billions of users, thoughtfully connected
together in a Self-Serve platform built for the enterprise
0 02 03
1
Read Understand it Make it
it useful
Which unlocks significant
value
prediction
results
-0.7 0.9
Life of a
document CATEGORIZE CONTENT
Categorize patent’s content
DETECT DIAGRAMS
INGEST & FILTER Identify diagram and
Patent is read in from Cloud using NLP model. corresponding x & y
Storage. Non-patents are coordinates.
Meet Patent:
filtered out.
Unstructured
document,
multiple formats
& languages
OCR
Extract out raw text into STORAGE
json format for Write out and store results
downstream NLP process. EXTRACT ENTITIES from the pipeline into
Identify named entities in BigQuery
the raw text.
READ : OPTICAL CHARACTER
RECOGNITION US010114351B2
(12) United States Patent
Fadell et al.
(10) Patent No.: US
10,114,351 B2
(45) Date of Patent: Oct. 30,
2018
(54)
(56)
References Cited
SMART-HOME AUTOMATION SYSTEM
THAT SUGGESTS OR AUTMATICALLY
IMPLEMENTS SELECTED
HOUSEHOLD POLICIES BASED ON
SENSED OBSERVATIONS
U.S. PATENT DOCUMENTS
4,475,685 A *
10/1984 Grimado ..............
F23N 5/203
236/46 R
(71)
Applicant:
GOOGLE
INC.,
Mountain
View, CA
(US)
7,689,920 B2
9,330,274 B2
9,450,962 B2
*
3/2010 Robbin et al.
5/2016 Schepis et al.
9/2016 Longhorn ......
(Continued)
H04L 43/50
(72)
FOREIGN PATENT
DOCUMENTS
Inventors: Anthony M. Fadell, San Francisco, CA
(US); Yoky Matsuoka, Palo Alto, CA
CLASSIFY CONTENT
US010114351B2
(12) United States Patent
Fadell et al.
(10) Patent No.: US
10,114,351 B2
(45) Date of Patent: Oct. 30,
2018
Categorization Confidence
(54)
(56)
References Cited
SMART-HOME AUTOMATION SYSTEM
Computer Vision 0.961
THAT SUGGESTS OR AUTMATICALLY
IMPLEMENTS SELECTED
Med Tech 0.030
HOUSEHOLD POLICIES BASED ON
SENSED OBSERVATIONS
Cryptocurrencies 0.009
U.S. PATENT DOCUMENTS
4,475,685 A *
10/1984 Grimado ..............
F23N 5/203
236/46 R
(71)
Applicant:
GOOGLE
INC.,
Mountain
View, CA
(US)
7,689,920 B2
9,330,274 B2
9,450,962 B2
*
3/2010 Robbin et al.
5/2016 Schepis et al.
9/2016 Longhorn ......
(Continued)
H04L 43/50
(72)
FOREIGN PATENT
DOCUMENTS
Inventors: Anthony M. Fadell, San Francisco, CA
(US); Yoky Matsuoka, Palo Alto, CA
(US); David Sloo, Menlo Park, CA
(US); Maxime Veron, Los Altos, CA
EXTRACT ENTITIES
US010114351B2 Publication date: Oct. 30, 2018
(12) United States Patent
Fadell et al. Classification_1: G05B 15/02
(10) Patent No.: US
10,114,351 B2 Classification_2: G05B 15/02
(45) Date of Patent: Oct. 30,
2018 Application Number: 114,351
(54)
(56)
SMART-HOME AUTOMATION Filing Date: MAR. 5, 2015
References
SYSTEM Cited
Applicant: GOOGLE INC.
THAT SUGGESTS OR AUTMATICALLY
IMPLEMENTS SELECTED Inventor: Returns inventor name
HOUSEHOLD POLICIES BASED ON
SENSED OBSERVATIONS First Line of Patent Title: SMART-HOME AUTOMATION
U.S. PATENT DOCUMENTS
4,475,685 A * SYSTEM
10/1984 Grimado ..............
F23N 5/203
236/46 R
(71)
Applicant:
GOOGLE
INC.,
Mountain
View, CA
(US)
7,689,920 B2
9,330,274 B2
9,450,962 B2
*
3/2010 Robbin et al.
5/2016 Schepis et al.
9/2016 Longhorn ......
(Continued)
H04L 43/50
(72)
FOREIGN PATENT
DOCUMENTS
Inventors: Anthony M. Fadell, San Francisco, CA
(US); Yoky Matsuoka, Palo Alto, CA
(US); David Sloo, Menlo Park, CA
(US); Maxime Veron, Los Altos, CA
DETECT DIAGRAMS
2 Agent Assist
Empowers agents with continuous support during their calls by
identifying intent and providing real-time, step-by-step assistance.
3 Insights
Insights Uses natural language processing to identify call drivers, popular questions,
and other information that helps contact center managers learn about patient
interactions to improve call outcomes.
CCAI Demo
Department of
Motor
Vehicles
(DMV)
Proprietary + Confidential
Use Cases
● Vehicle
Registration
Renewal
● Identity
Verification
● Credit Card
Payment
● Drive Test
Scheduling
● Agent
Assist
Demo URL
https://youtu.be/j8Y4q
PgR-C0
^Contains state
specific information
Generative AI and
LLM
Google is the pioneer in Bard
AI 202
3
A conversational
202 AI Service
2
AlphaFold predicts
powered by
2020 structures of all LaMDA.
Consumers Enterprises
Create a How do we
How do we deal with
Plan a 3 day valentine control our fraud &
trip to poem. data
Patagonia
security
How to make GF
pancakes?
We need to be How will we
accurate & control
A picture of a
panda playing explainable costs?
I want to
yahtzee write a novel.
Create a jazz
How do I get
song for a bday
started? How do we integrate our
card
existing data &
applications
Bard + Vertex
MakerSuite AI
Your Data, Your Terms
Your OnPrem or
Alternative Cloud
Perimeter
Generative AI App
Builder
Your Content
Conversation Vertex
AI AI Google Cloud Central
Chatbot, API, etc. Search
Your Data Hosting
Internet/Intranet
Powered by Foundation Models Powered by Foundation Models Powered by Foundation Models Powered by Foundation Models
Generative AI
App Builder Foundation Vertex AI Search
Models (Enterprise Search)
Developers
End-to-End ML Platform
LLMs vs.
virtual agents
Conversation
LLMs are characterized by emergent abilities, or
the ability to perform tasks that were not included
in their training examples.