Generative AI at SAP

Unit 4: Extending SAP Applications with

Generative AI
Extending SAP applications with generative AI
Objectives of Unit 4

In Unit 4, you will learn about

▪ The SAP Business AI approach
▪ Generative AI Hub and its capabilities
▪ Example of Generative AI Hub
▪ SAP BTP reference architecture for generative AI

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 2

Extending SAP applications with generative AI
SAP Business AI approach

Finance | Supply Chain | HR | Procurement | Marketing and Commerce | Sales and Services | IT

Human capital Spend management Customer relationship Business Technology

Cloud ERP
management and business network management Platform

AI ecosystem partnerships and investments

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 3

Extending SAP applications with generative AI
AI foundation

Applications & Extensions

AI Foundation
on Business Technology Platform

AI Services

Foundation Models

SAP built Partner built

Lifecycle Management
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 4
Extending SAP applications with generative AI
AI Foundation

AI Foundation
on Business Technology Platform

AI Services
Document Processing Recommendation Machine Translation

Toolset Trust & Control Access Training Inference

Vector Engine

Data Management

Foundation Models

SAP built Hosted Remote Fine-tuned

Lifecycle Management
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 5
Extending SAP applications with generative AI
Generative AI Hub

Toolset Access Trust & Control

Streamline generative AI Accelerate outcomes with instant Supercharge mission-critical
development with purpose-built access to top-rated foundation processes while preserving security
tools and services models from multiple providers and privacy

Unlock generative AI for your business

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 6
Extending SAP applications with generative AI
Generative AI Hub

Joule Applications & Extensions

Generative AI Hub

SAP AI Playground Libraries & SDKs

Toolset
Launchpad Prompt Engineering Prompt Management Prompt Registry*

Inference Engine Agents* Multi-tenancy Security

Content Moderation* Grounding Plug-ins* Data Privacy

Foundation AVAILABLE UPCOMING

• Microsoft Azure OpenAI • Aleph Alpha
Model SAP built* Custom Partner built • Falcon • Meta Lama2
Access • and more…

• Embeddings
Vector Engine Application data
• Similarity functions

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC * coming soon 7
Extending SAP applications with generative AI
Generative AI Hub: Toolset

Playground
Generative AI Hub

SAP built*

Client
API Custom

Partner built
Libraries & SDK

*planned

Explore Experiment Enhance

different models and different with a prompt engineering your applications with
capabilities of generative AI playground generative AI
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 8
Extending SAP applications with generative AI
Generative AI Hub: Access

Generative AI Hub SAP built*

Custom

AVAILABLE UPCOMING
• Microsoft Azure • Aleph Alpha
Partner built OpenAI • Meta Llama2
• Falcon • and more…

*planned

Connect Accelerate Switch

easily and seamlessly to any adoption thanks to SAP-managed easily between models to find and upgrade
supported LLM model legal and commercial framework to the best suited technology for your needs
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 9
Extending SAP applications with generative AI
Generative AI Hub: Trust & Control

Generative AI Hub

*planned

Secure Control Extend

your applications with native models response with your solutions with advanced
and embedded SAP security grounding capabilities
© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 10
Extending SAP applications with generative AI
Demo

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 11

 Extending SAP applications with generative AI
SAP BTP reference architecture
Business
Analyst

SAP Business Technology Platform

ML Ops Generative AI Hub SAP S/4HANA Business

Engineer Cloud, User
SAP AI Launchpad SAP Fiori UI
Private Edition
ML Operations
Prompt
Playground OData
Engineer
Runtime SAP Private
SAP AI Core Link Service
CAP Application
Partner Foundation AI API
LangChain Anonymization
Models
Trust & Control
Persistency
Azure OpenAI
Foundation Model Vector Similarity Search*
Access
Aleph Alpha Partner built

SAP built**
… SAP Identity & SAP HANA
Authentication Cloud

* Interim: pgvector ** planned

© 2023 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 12
Upcoming: SAP HANA Vector Store
Thank you.
Contact information:

[email protected]
Follow all of SAP

www.sap.com/contactsap

© 2023 SAP SE or an SAP affiliate company. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of
SAP SE or an SAP affiliate company.
The information contained herein may be changed without prior notice. Some software products marketed by SAP SE and its
distributors contain proprietary software components of other software vendors. National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or
warranty of any kind, and SAP or its affiliated companies shall not be liable for errors or omissions with respect to the materials.
The only warranties for SAP or SAP affiliate company products and services are those that are set forth in the express warranty
statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional
warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or
any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation,
and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platforms, directions, and
functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason
without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or
functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ
materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, and they
should not be relied upon in making purchasing decisions.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered
trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. All other product and service names
mentioned are the trademarks of their respective companies.
See www.sap.com/trademark for additional trademark information and notices.