DevSecOps Playbook
DevSecOps Playbook
DevSecOps Playbook
Centre of Excellence
DevSecOps Playbook
Powered by Transformation Office
1.1 Sai Harshini Meda VTB example is added and KPI section November 2022
is updated.
2.0 Sai Harshini Meda Organization Structure, User December 2022
perspective Big Picture, Tools,
Supporting Roles & Responsibilities
and KPI section are updated.
This playbook serves as a guide to provide guidance and This Playbook serves as a guide to provide information on:
references for DevSecOps delivery, DevSecOps best practices
and IBM Garage to the ESCoE delivery teams. • Operating model integration with delivery model
• ESCoE delivery vision
Team members playing the roles below are expected to use this • End to End process overview of a delivery model
playbook as guidance and an understanding of the new ways of • Tools road map
working. • Maturity assessment framework
• Squad leaders
• Squad team members
• Product owners and lead designers
• Operational governance members
• Transformation office members
Introduction
DevOps outlines a software development process and an organizational culture shift that speeds the delivery
of higher quality software by automating and integrating the efforts of development and IT operations teams
– two groups that traditionally practised separately from each other, or in silos.
In practice, the best DevOps processes and cultures extend beyond development and operations to
incorporate inputs from all application stakeholders - including platform and infrastructure engineering,
security, compliance, governance, risk management, line-of-business, end-users, and customers - into the
software development lifecycle
DevSecOps represents a natural and necessary evolution in how development organizations approach
security. DevSecOps integrates application and infrastructure security seamlessly into Agile and DevOps
processes and tools. It addresses security issues as they emerge when they're easier, faster, and less
expensive to fix (and before they are put into production). Additionally, DevSecOps makes the application
and infrastructure security a shared responsibility of development, security, and IT operations teams, rather
than the sole responsibility of a security silo. It enables “software, safer, sooner”—the DevSecOps motto–by
automating the delivery of secure software without slowing the software development cycle.
What is the Why are we using What changes from a What Stays Same?
DevSecOps Model? DevSecOps model? User Perspective?
The 6C DevSecOps Framework (short for Development, Security • Capture, analyze, and prioritize business requirements
and Operations) is a development practice that integrates • Project planning
security initiatives at every stage of the software development • Measure to project metrics
Continuous • Traceability
lifecycle to deliver robust & secure applications.
Business Planning • Dashboard portfolio measures
Steer
Continuous User
Feedback & Optimization Collaborative • Release planning
u Development • Collaborative development
• Monitor capacity and optimize • Configuration management
• Monitor performance and optimize • Build management
• Monitor user experience and optimize (requires integration with build automation)
• Event and incident management Operate Develop/ • Change management
Test • Dashboards
• Traceability
• Test management and execution
Deploy
Continuous • Application health
• Server health Continuous • Sanity Testing
Monitoring Testing • Automated Functional Testing
• Network health
c • Regression Testing
• Performance Testing
• Security Testing
This DevSecOps capability deals with identification, This starts with a development sketch plan and Unit and integration testing help increase the
elaboration, prioritisation and planning of business programming. It is a process for integrating, efficiency and speed of the development. The goal
demands through an open, collaborative and collaborating and system communications with IT of continuous testing is evaluating the quality of
standards based method. It is in this stage, the functions which are accountable for operations, software at every step of the Continuous Delivery
backlog of work is created and elaborated, the application development and quality assurance. Process by testing early & testing often.
pipeline of work examined and right prioritisation is
done through a value based approach.
The deployment takes place continuously in this This is needed to monitor changes and address errors This evaluates the effect of each release on the user
DevSecOps lifecycle phase. Multiple reviews will help and mistakes spontaneously whenever they happen. experience and then reports that evaluation back to
code quality and developer check-ins easily. It is It is the process of identifying threats to the security the DevSecOps team to modify and improve future
performed so that code changes should not affect the and compliance rules of a software development releases.
functioning of the product. cycle and architecture.
ESCoE is the enterprise model of the future which is Deliver with new WoW,
Transform the operating and delivery model and Grow to deliver business value.
Continuous
Testing
Integrated Delivery Cross Functional Support
Continuous Release &
Deployment
Sponsor Business
X- Workstream Services
Product Manager
Design Authority
Integration Services
Product SME
Security Services
Data Services
Deployment Services
Testing and Quality Engineering Services
Release Management Services
Change Management Services
The delivery organization is aligned to the products aka business In addition to the direct contributing members, the delivery organization is
functions / functional work-streams (e.g., Marketing, Finance, also interacting and collaborating with the following entities. These entities
Operations, Treasury, Success Factors, etc.) . Each of these product are the extended wings of the delivery organization.
verticals consists of squads delivering value for business
Squads are cross-disciplinary, autonomous teams (typically Checklist that can help to check squad team readiness is at
6-10 individuals) that focus on one or more user stories/change Appendix 2.1
requests. Each squad has a unique mission that guides the work they do,
an agile coach for support, and a product owner for guidance.
The development team consist of core team members from the home
business function supported by flex team members from cross functions
such as data, integration services, Basis, deployment and security services
(horizontals in the above diagram) as per the requirement of the backlog
and release plan of the squad.
The squad consists of a product owner/lead designer, squad leader and development team (Core & Flex members). Squad teams
are self-organizing and cross-functional. This means the squad team has the ability to define their own work and the best
possible way to execute that work to meet iteration goals and produce done increments that can be released to production.
• The Product Owner is responsible for maximizing • The squad leader is responsible for ensuring WoW is • The Development Team is expected to manage its
the value of the product and the work of the understood and enacted according to the scope. work and it consists of professionals who do the
Development Team. • The squad leader ensures that everyone in the work of delivering a potentially releasable
squad knows their responsibilities and acts Increment of “Done” product at the end of each
The Product Owner is responsible for: according to them. Iteration.
• Clearly expressing Product Backlog items • The squad leader ensures that all agreed • The Development team is solely responsible for
within his/her process area ceremonies are executed with discipline and are delivering the expected user stories/CR.
• Optimizing the value of the work the according to the agreed principles. • The Development team is responsible for
Development Team performs • The squad Leader ensures that all Artifacts are Managing the Iteration Backlog and produce
• Ensuring that the Product Backlog is visible, managed with discipline and according to the agreed working increments that meet the “Definition of
transparent, and clear to all. principles. Done”
• Ensuring the Development Team understands items • At any point in time, the development team is
in the Product Backlog to the level needed and to responsible for providing information on the progress
provide needed support to get needed details. of their work toward the Iteration goal.
BAT Specific Role IBM Specific Role BAT, others & IBM
• Prescribed ceremonies are used to create cadence, enable transparency and provide the opportunity to inspect and adopt.
• All ceremonies are time-boxed events, meaning that they can take a maximum time no more.
• All ceremonies within an Iteration are fixed and the squad leader ensures that they take place at the agreed time and place and all
participants know their roles and responsibilities to meet the ceremony goal.
• Ceremonies: Kick-off Meeting, Backlog Grooming, Iteration Planning, Daily Sync, Iteration Review/Demo, Iteration Retrospective.
Kick-off The squad Kick-off agenda conveys the Max. 1 Hour. Product Owner/ Product Owner Requirements/ Squad goals &
Meeting high-level requirements/CR’s overview and Work Stream Lead Squad Leader CRs Overview. vision, approach.
overarching strategy, vision, scope, team roles, Lead Designer
and responsibilities, as well as the approach and Development Team
supporting ceremonies to be used. This only Business Stakeholders
happens for the first time when the squad is
launched.
Backlog Backlog Grooming discussion involves Max.2 Hours. Squad Leader / Product Owner Product Backlog 1. Identifying business
Grooming the development team, LDs, and Product Product Owner Squad Leader Items ready for value so identifying the
Owners to identify the business value and Development Team grooming. Initial scope for the next
priorities. The squad can have a discovery Iteration and 1-2 following
workshop as necessary. Iterations.
2. Clarifications needed
for planned user
stories/CR’s.
Iteration Iteration planning happens always at the Max. 1 Hour. Squad Leader Squad Leader Product Backlog Iteration Backlog
Planning beginning of each Iteration. It is a session to Lead Designer [Agreed Backlog items for
estimate and plan the task level details needed Product Owner this iteration].
for items selected for the Iteration and how to Development Team
ensure get them done.
Daily Sync The Daily Sync meeting is for the 15 mins. Squad Leader Squad Leader Squad Board Updated Squad Board
Meeting Development team (and product owners) to align Lead Designer Identified blockers.
what was done the previous day and what will be Product Owner
done during the day. Development Team
Iteration Iteration review is a ceremony involving Squad Max. 1 Hour. Squad Leader Product Owner 1.Work done Updated Product Backlog
Review/Demo Leader, Lead Designer, Product Owner, Squad Leader during the for upcoming Iterations.
Development Team, and Business Stakeholders Lead Designer Iteration
where Development Team shows the work Development Team
done during the Iteration and seeks feedback Business Stakeholders 2. Iteration &
from Stakeholders. If any of the planned items Product Backlog
are not done, those will be discussed for further where it stands
actions.
SP1 Func -Unit Update Performance User Business Stage Gate Incident Incident Server Collaborate Assessto System Feedback
Business
Testing Test Scripts Test Acceptance Release Approval Management Management Health toImprove Improve Health
Product Backlog
t
Sprint Backlog
Requirements
Testing Group
Should
Mediu
SP2
m
Easy
Backlog Sprint Code Security Unit Bug Fixes Transport Cutover Stage Gate Transition Maintenance Application New Performance
Prioritization Management Changes Testing Planning Approval toSupport Activities Health Ideas Health
Ceremonies Backlog Kick Off Planning Iteration Review Retrospective Testing Test Data Release Environment Deployment Incident Operational Monitor Optimization Monitor
Grooming Meeting Planning Demo Management Management Management Management Management Analysis Capacity Performance
Tools
KPI Lead Dashboard Metrics Breakdown Velocity Cycle Lead Defect Cycle Time – Deployment Mean Lead Mean Time Change
Time Chart Time Time Leakage Test & Release Frequency Time for to Recover Failure Rate
changes
17 *Some of the tools referred in the picture are to be updated post pilot completion. IBM & BAT Confidential (Ver 1.1)
2.0)
5 Governance & Reporting
Governance seeks to align all the projects being worked on with the goals Reporting refers to the use of selected metrics and tools for analyzing and
of the organization. It is all about creating value across the organization. making informed decisions about the way work is managed. The goal of
Governance is a process that focuses on bringing the most value by reporting is to ensure that work systems deliver outcomes - value with
focusing on what matters. It ensures that the policies and decision-making optimum quality and increased pace. Hence, Agile teams use different sets
process aligns with successful delivery. Governance is understanding group of metrics to achieve greater visibility over the work processes, measure
risk-taking appetite and tolerance level and challenges. Good governance how efficient their process is, track their performance over time, identify
practices help the organization evolve and improve over time. process blockages, and more. The reporting method is usually defined by
the work methodology that a team chooses to apply.
Enterprise Strategy
Value Realisation Office
Business
The governance framework is divided into
four interlinked dimensions. Each of these
dimensions – Business, Delivery, People
and Technology has got their own set of
Product management
Product leadership
ESCOE leadership
Squad leadership
Design leadership
Design Authority
roles and governance charter that focus
Delivery
on specific items for maximum value
realisation. The DevSecOps model is
encapsulated within this governance
framework and operates with the
guidance and direction of the governance
committees aided by the regular cadences
at different operating levels People
Change Management
People Management
Agile Coaching
18 IBM & BAT Confidential (Ver 2.0)
Delivery Governance Transformation
Operating Levels
Role Cadence Visualisation Focus
• Strategic Initiatives Initiative owners Strategic themes discussion Product Canvas Prioritisation of initiatives
• Projects Business unit / product sponsors Lean business case review Product Wall of Work Funding of products
• Change Requests Approved Lean Design Authorities Budget review Lean Business Canvas Budget allocation Initiative
• Enhancements Business Case Global Process Experts Initiative tracking lifecycle
Opportunities will be Senior Product Owner Product canvas refinement Product Wall of Work High level estimate review
Enterprise
Product
directed to ESCOE Teams Lead Designers Value – risk evaluation Epic Hypothesis Cards and approval (epic wise)
backlog and refined in Enterprise Architects Inter-product dependency evaluation Metrics dashboard Team engagement
to an Epic Epic flow, metrics
Refined Epic
PRODUCT BACKLOG PRODUCT BACKLOG PRODUCT BACKLOG PRODUCT BACKLOG PRODUCT BACKLOG Epic 111
Epic 789 Epic 222
in to Features Backlog Reviewed
Epic 123 Refine
Epic 123 Ready for
Epic 123
Feature 789.1
In Progress
Feature789.1 Done
Epic 123
Feature 789.1
Epic 333 Product lead (work-stream leads) Product roadmap governance issues – product
Squad with Story
Squad789.2 Epic 444
(T-Shirt Sizing) Epic 456 Epic 456 Story 789.2
Epic 456
Feature xxx Story 232.6
Release management governance
Story 456.1 Feature yyy Story 267.1
Epic 789 Epic 789 Story 456.1 Story
PRODUCT BACKLOG PRODUCT BACKLOG PRODUCT BACKLOG PRODUCT BACKLOG PRODUCT BACKLOG Epic 456.1
111
Story 456.2 Story 456.2 Story
Feature zzz Story 232.1
Epic 789 Epic 456.2
222
Epic 123 EpicEpic
123 n Epic 123
Epic n Epic 123456.3
Story Feature www Story 232.9
Story 456.3 Story
Epic 456.3
333
Feature 789.1 Feature 789.1
Feature 789.1
Story 456.4 Feature aaa Story 00.1
Story 456.4
Story 789.2 StoryStory 4 5 6Epic
.3
4 5444
6.4
Story 789.2 Story 789.2
Epic 456 Epic 456
Epic
Epic 456123 Story
Feature xxx 222
Story 232.6
Epic 456 Epic 456
Feature Feature yyy Story 267.1
Epic 789 Epic 789 Story 456.1 Story 456.1123.1 Story 456.1 Epic 001
Feature
Story 456.2123.2 Feature zzz Story 232.1
Story 456.2 Story 456.2 Feature 001.1
Epic n Epic n Story 456.3 Story
Story 123.3
456.3 Story 456.3 Feature www Story 232.9
Story 001.2
Story 456.4 Story 456.4
Story 123.4 Story 456.43 Feature aaa Story 00.1
FeatureFeaturewww.63
12
Epic 123 3.2 Story 222
Feature 123.1
Epic 001
Feature 123.2
Feature 001.1
Story 123.3
Story 001.2
Story 123.4
FFeeatauturerew1w2w3.623
Refined Features
Squads and PRODUCT BACKLOG PRODUCT BACKLOG SPRINT BACKLOG SPRINT BACKLOG SPRINT BACKLOG Squad leader Story backlog grooming Story backlog grooming Removal of blockers
decomposed in to Epic 123
Feature 789.1
Feature 789.1
Story 789 1.1 Story 789 12
.
Story 456.1
Task Task
Story 456.1
Task Task
Story 456.1
Task
Story 456.1 Development team Review Review Continuous improvement
Stories & Tasks Story 789.2
Epic 456
Story 789 1.3 Story 789 14
Story 789 15
.
.
Task Task
Story xyz 1.6.1 Task
With Squad
Tools are used within product development to help achieve a few key goals like to adapt and organise
solutions and requirements/user stories/CRs that allow squads to work together, organize, and produce the
best possible solutions. Below table gives a view of the “need for tools” for each DevSecOps feature and what
are the potential tools that could be used.
Continuous Business Collaborative Continuous Continuous Continuous Continuous User Feedback and
Planning Development Testing Deployment Monitoring Optimization
Need for Tool? • Create Product backlog • Perform Iteration planning • Test management • Release planning • Monitor System Capacity & • Iteration retrospective
• Perform R&I assessment, ROI • Perform change and test execution • Cutover planning Optimize • Customer reported defects
validation management • Functional Unit Testing • Data migration • Monitor Performance & (UAT defect and incident)
• Get budgetary approval • Configuration management • Integration Testing • Deployment Optimize • Customer Surveys / feedback
• Backlog Grooming (Document • Develop Code / config • User acceptance testing • Monitor User Experience & • Enterprise reporting and
user stories/CR’s, sizing user • Quality review (FS, TS, Code, • UAT approval Optimize measurements (Trends, Metrics)
stories/CRs) config) • Regression testing • Monitor Security
• Prioritize user stories/CRs (Increase Coverage) parameters
• Perform Iteration planning & • Test automation
create Iteration backlog. • Performance testing
What Tools are • ServiceNow • ServiceNow • HP ALM / UFT / • ServiceNow • SAP Solution Manager • Azure DevOps
Required? • Azure DevOps • SAP Solution Manager Worksoft / Solution • Solution Manager Charm (TechMon, PIMon, BP Mon, • ServiceNow
• SAP Solution Manager • ActiveControl manager CBTA / ActiveControl Notification from Alerts) • HP ALM
• Azure DevOps • TOSCA • ServiceNow • Power BI
• Accelerators (Code Inspector • Load Runner • SCOM / Opsgenie • SurveyMonkey
(SCI++), Code Snippet Generator, • ServiceNow
ABAP Auto TS Generator,
RolePac etc.)
How we will be • ServiceNow can be used to create • ServiceNow / ADO can be used • ServiceNow can be used to • ServiceNow can be used for • Maximise usage of SAP Solution • Capture feedback from retrospective in
Product backlog, perform for Iteration planning perform Change management release planning manager features for monitoring ADO / ServiceNow
using each tool? R&I assessment, ROI validation and •Perform Change management in and UAT approval • Explore implementation • An event management tool can • UAT defect captured in HP ALM
get budgetary approval. ServiceNow • For test planning and execution of Solution manager Charm be introduced and integrated • ServiceNow is used production defect
• ServiceNow / ADO can be used backlog • Use accelerators (Code Inspector HP UFT can be used for deployment in place of with Solution manager and • Enterprise reporting of SLA, KPI and
grooming (Document user stories/CRs, (SCI++), Code Snippet Generator, • Load Runner can be used for Active Control ServiceNow trends can be centralized in Power BI
sizing user stories/CRs), prioritize user ABAP Auto TS Generator, RolePac) performance testing • Integrate ServiceNow and • ServiceNow can be used on ticket • Use a tool for structured customer
stories/CRs, Iteration planning and • Integrate ServiceNow and Solution • Explore the options of Solution manager created from high priority / feedback
create sprint backlog manager increasing test coverage criticality alerts
• SAP Solution Manager Used for
documentation
KPI is a quantifiable metric that helps the organization determine the overall performance and its alignment with organizational objectives.
Below are the key metrics that determine the performance measures for the delivery organisation. This is the initial set of KPIs and more such measures will be added on and
baselined as the new ways of work evolve over time.
KPI Components
Lead Time • Elapsed time between CR Raised Date from CREW/SNOW and Technical Go-Live Date
Cycle Time • Elapsed time between DBT Actual Start date and the FUT actual end Date
[Development]
Cycle Time [Test • Elapsed time between FUT actual end date and Technical Go-Live Date
& Release]
Defect Leakage to • Relative comparison of in-process defects versus the post production incidents caused by the changes in the release
Production
For detailed overview of how metrics are calculated please refer Appendix 3.2.3
1 Glossary of Terms
Ways of Working
WoW
aka “Also known as” – a synonym / alternate word or phrase for the term used
LD Lead Designer
PO Product Owner
CR Change Request
QA Quality Assessment
Product Canvas Product canvas is a planning tool designed to help build Solutions/products
that have a great user experience through a focus on feature development
Epic Hypothesis Epic Hypothesis is a highly iterative process that continues until a data-driven
result is obtained
GPE Global Process Expert
DA Design Authority
1.1 Agile Framework implementation Identify and engage stakeholders and obtain their Work Stream Lead
announcement to stakeholders. input on the new "Ways of Working" (WoW)
1.2 Impact assessment of framework Socialize the impact of process change & provide clarity Work Stream Lead
implementation on existing processes, on roles and responsibilities to stakeholders.
deliverables, workflow.
1.3 Obtain commitment from the Confirm availability of stakeholders/customers to Squad Leader
stakeholders to contribute to the participate in the event.
agile implementation.
1.4 Train team members & Stakeholders Train team members and stakeholders to perform their Agile Coach/
new roles in the agile implementation. Transformation Office
Determine framework applicability Discuss the nature of the work performed by the team. Agile Coach/
2.1 based on type of work Refer the WoW guidelines (Best Practices) shared with Transformation Office
the team
2.2 Identify team members Work with leadership help to identify Product Owner, Work Stream Lead
(Product Owner, LD - Lead Designer LD, End-Market Rep, Squad Leader, and team
Squad Leader, Developers members. (Refer to Agile team formation guiding
(Agile Team = Product Owner + Squad principles)
Leader +Developers + Business Analyst +
End Market Rep + Testing Member, Cross
work stream members, Tier 1/2
members)
2.3 Identify training needs of agile team. Identify specific training needs of the members. Train Agile Coach/
members in overall Agile Framework as well as role- Transformation Office
based trainings to help enable them to perform their
roles
3.1 Identify Definition of Ready (DoR) Criteria (generally based on the INVEST matrix) Product Owner &
that a user story should meet prior to being Development Team
accepted for development.
If the team is part of a program, consider
program definition of ready inherited/adapted
from the program level.
3.2 Identify Definition of Done (DoD) Common set of steps through which every Product Owner &
story goes through before being "done" for e.g., Development Team
analyze, dev, test etc.) If the team is part of a
program, consider program definition of ready
inherited/adapted from the program level.
3.3 Identify Estimation Scale In Agile, our interest is to be able to quantify the Product Owner &
"working software" produced by the team over Development Team
completion of individual activity such as development,
testing etc. Story points are a unit of measurement for
the amount of work completed (produced) by the team.
Team members collectively identify the estimation
scale to use for estimating the work items. Fibonacci
Series (1,2,3,5,8,13, 21...) is a commonly used scale.
3.4 Identify Working Agreements Working agreements are "ground rules", Product Owner,
members way of interacting and functioning Development Team &
together. Squad Leaders encourage team Stakeholders
members collectively define working agreement(s)
4 Backlog Grooming
4.1 Identify Roadmap & objectives Product Owners/LD's to identify key events such Product Owner
as release, milestones, and major commitments
such as upgrades in CR execution timeframe.
4.2 Identify Epics, Features, Stories Build initial backlog. Identify EPIC, Features, Stories Product Owner &
etc. Start with identifying large initiatives or Development Team
objectives and then split them into features and
stories.
4.3 Identify & refine High priority 10-15 Identify high priority work items for the team to work Product Owner
work items(Stories/Defects etc.). on & refine them.
5 Tool Setup
5.1 Identify the tracking tool. Identify & ensure everyone has access to the Squad Leader
tool. SNOW is enterprise-wide Tool. Ensure
that everyone has access to perform the
required operations.
5.2 Provide "Tools" training SNOW Training to Agile Team and Stakeholders. Squad Leader/
Role specific training to Squad Leader, team Workstream Lead
members, Product Owner. LD (can be combined
with WoW Training listed above)
5.3 Create initial backlog in the Tool. Create Backlog in SNOW. This step can be Product Owner &
combined with section 4. Development Team
5.4 Define workflow and setup Setup SNOW Boards step can be combined Squad Leader
required Boards (Backlog with 3.1, 3.2 as they are closely related to
Refinement, Team Boards etc.) each other.
6 Infrastructure Readiness
6.1 Squad Leader to setup Agile Events Set up calendar events by inviting required Squad Leader
(Grooming, Planning, Daily Sync, participants. Since the activity is cadence
Review, Retrospective) on based, It is helpful to set up a series. Having a
everyone’s calendar. meeting set up in the outlook calendar helps in
building awareness.
6.2 Environments Ensure Environment readiness, stability, and Squad Leader &
(Dev, Test) readiness support to operate in 2 weeks cycle. Ensure the Product Owner
production-like status of the environments.
6.3 Build, Deployment and Identify automation opportunities to increase Product Owner
Packaging procedures. the frequency of the build and deployment.
Continuous integration helps in the early
detection of defects and quality improvement.
6.4 Code repository, test case Ensure those technical components, Product Owner
management tools, DevSecOps, Engineering Practices are defined, and that the
and tools readiness. team is aware of how to implement them.
6.5 Agile Team Kick-Off – Milestone Kick-Off Meeting serves as a checkpoint to Squad Leader
transition to operate in Agile WoW.
Apart from the delivery KPIs, we need to assess the maturity of the squad periodically. This framework will help in assessing the performance maturity of the squad.
This is a self-assessment that the squad leader and the team will fill out and asses themselves. This questionnaire is expected to be used about once a quarter to give
the squads enough time to take actions coming out of the previous assessment.
For a copy of the assessment template for use in your squads, please reach out to the transformation office members.
Roles Responsibilities
Lead Designer (LD) • May spread across multiple squads in the lead business function.
End Market • Outside the squads but works in tandem with the squad team as an extended voice of customers
Representative augmenting the product owners.
• Attends daily sync meetings to remain engaged and up to date on the team’s progress.
• Collaborates with stakeholders outside of the team to review progress.
Roles Responsibilities
Work Stream Lead • Provide delivery governance oversight for all squads.
• Monitor the commercials at a product/function level.
• Act as the first-level delivery escalation point for all squads.
• Monitor and report overall product/function squad performance.
Flex Team [QA/PET, • Integral part of the squad for the lifetime of the change delivery.
Data, Integration, • Performs the same tasks as a core squad member.
Testing, Services] • Act as a liaison of the squad with their home squads – helps.
squad leader to seek additional help when required.
Agile Transformation • Helps the Teams in guiding them through new WoW.
Office
Deployment Team • supports ongoing change requests for deployments across multiple
workstreams
• Includes the testing and QA members as part of this team
• Includes the change management team members
Maximize business value and outcomes through an open collaborative standards-based platform and strong
governance framework.
Elements Capabilities
Capture, analyze, Prioritize • Adoption of an Integrated Tooling Strategy to bring continuity in the project
Business Requirements planning, Requirement capturing, and Traceability Dashboard
MoSCoW (Must Have, Should Have, Nice to Have this time) is primarily used to prioritize the Product
Backlog items.
The purpose of Iteration planning is to define what can be delivered in the Iteration and how that work will
be achieved. Iteration planning is done in collaboration with the whole squad.
Agenda:
10 Min Goal of the Iteration. Goals we want to achieve with the Iteration. Product Owner
90 Min Tasks Breakdown Breakdown of requirements into subtasks (max 1- Squad Team
and Estimations. day duration) according to Definition of Done
(DoD), Estimation of subtasks.
10 Min Iteration Capacity • Calculation of the capacity of individual Squad Team
calculation team members.
• Update of Iteration scope based on the capacity.
10 Min Commitment Do you commit to the Iteration plan? Squad Team
Board Preparation Evidence of created tasks in the tool Squad Team
Outcomes:
An introduction to Iteration on goal and Arrange the planning meeting, invites Breakdown of the requirements into
top priority items that must be the necessary people, and prepare the subtasks (max. 1-day duration)
developed in the Iteration. agenda for the meeting. according to Definition of Done (DoD).
Outcomes:
Product Owner Squad Leader Squad Team
PO ensures that user stories/CRs are Board set-up (new Iteration creation and Estimation of tasks.
fulfilling the team’s Definition of Ready drag/drop of user stories as necessary
(DoR) before the Iteration planning. for planning).
Participates in the discussion about Helps team understand metrics so Identification of dependencies
User Stories and acceptance criteria (AC). the team can plan work better than in and blockers.
subsequent Iterations.
Update of the order of user stories/CRs Prepares for team capacity Update the total scope of the
based on information discovered in the calculation. Iteration based on capacity and
Iteration planning and team capacity. dependencies.
Communication of planned scope with Moderates Iteration planning Commitment to the Iteration
stakeholders and other product meetings and takes care of the backlog
owners. meeting time-box.
Outcomes:
Participation in the meeting is Identification of typical issues in task Synchronization of the team
highly welcome. handling on the board. members’ work.
Evaluation of the state of the Iteration & the Process errors and bottlenecks of the Updating the completed tasks.
possibility of its completion on time. value flow before the meeting.
Potential adjustments in the Iteration Preparation of space and tools for Identification of the tasks which every
scope according to the degree of Daily Sync meeting. member of the team will be working
completion. on that day.
Communication of important changes in Meeting moderation. Updating the remaining time of the in-
the scope. progress tasks on the board.
Approval of changes due to unplanned Restrictions recording and informing Identification of the limitations.
requirements in case of scope change team members about the status of
during the actual Iteration. previously reported team limitations. Proposing the modifications for
achieving the Iteration goals
(if necessary).
Agenda:
10 Min Review of the top • Review of up to three top requirements related to Product Owner
requirements. the Iteration goal
10 Min Iteration status. • Share information about the plan vs. actual. Squad Leader
• Review of the Iteration statistics.
• Review of the important technology changes or
improvements, enablers.
• Statistics of bug fixes
• Current program increment (release) statistics.
15 Min Demonstration. • Live Demo of the completed requirements/play- back Squad Team
of the outcome.
5 Min Closing • Information about the next Iteration review. Squad Leader
• Publishing Iteration review presentation.
Outcomes:
An introduction to Iteration goals. An organizer of the meeting, and an Informing about the Iteration status
invitation to participants.
An introduction of top planned Moderator of the meeting. Live demonstration of
requirements that the team has functionality/playback of outcome.
committed to deliver.
Agenda:
5 Min Preparation of the topic. • Theme of the topic (Set the Stage.) Squad Leader
10 Min Review of the previous • Status review of the Ideas from the previous Squad Team
improvement ideas Retrospective session
Agenda:
15 Min Gather Data. • Gather data using a selected retrospective Squad Team
technique.
5 Min Close Retrospective. • Get feedback about the retrospective session. Squad Team
Collaborative whiteboarding tools like Mural may be used as the teams are distributed.
Outcomes:
Considering the Product Owner (PO) as Organizes and moderates the Proposes ideas.
part of the agile team aligns with the meeting.
common goal (to deliver a working
product).
The Product Owner is an active Identification of the topic of Votes for ideas to be implemented.
participant the retrospective as Retrospective.
other team members.
Informs about the resolution status of Identifies the tasks for implementing the
previous improvement ideas. selected ideas.
Below provides the mapping between our WoW activities with SNOW Project Phase and tasks.
This is the current view of tasks when a SNOW waterfall template is applied. Going further, when the Agile/Hybrid template is
applied the table will be enhanced accordingly.
1. Once CR is Pre-Approved, BAT will create a project in SNOW with Prefix PRJXXXXX, and the
description will have a CR number.
2. The project will be assigned to the Workstream Lead and in turn Workstream Lead [Finance,
Marketing, Operations] would assign it to Tier 1, Tier 2, and the other relevant members working
on the CR.
PLAN (Design)
1. Once the Design is completed, task would be closed.
EXECUTE (Build)
1. Once the Build is completed, task would be closed.
EXECUTE (FUT)
1. Once the FUT is completed, task would be closed.
DELIVER (UAT)
1. Once the EXECUTE (UAT Preparation) task is closed, DELIVER (UAT) task would be kept open to indicate
that CR is ready for UAT and would be handed over to the Testing Team.
2. Until UAT gets passed, this task would be kept open waiting for the defects to get logged.
3. If any defects are logged in HPQC, an email would be triggered to the developer for corrections.
4. A new TR would be opened, and defects would be resolved.
This set of SNOW activities is specific to the template currently in use in ESCOE delivery aligned to the “Waterfall” template. As the delivery organisation
matures in the new ways of working and transitions into the “Hybrid” or “Agile” templates in SNOW, this set of activities will be amended and updated.
KPI is a quantifiable measure that gives a vision of the goals being met. The table below provides a mapping of DevSecOps
features covered, calculation, and data source of each metric.
Lead Time 1.Continuous Business Planning. Elapsed Time Between CR raised in CREW (or CREW
2. Collaborative Development. Service Now) and Technical Go-Live Date [TGL [SNOW from Q1 2023]
3. Continuous Testing. Date – Pre-Approved Date] In the interim we will need to use CREW.
4. Continuous Release & Deployment. Refer below Picture 1, for TGL date in SNOW.
SNOW
Cycle Time 1. Collaborative Development Elapsed Time between DBT actual start date and
The DBT actual start date and FUT closure will be tracked
[Development] FUT actual end date.
through the planning task level actual start date and
project template task – Actual End date respectively.
Refer below Picture 3, for DBT start date and Picture 2 for
FUT actual end date in SNOW.
Cycle Time [Test 1.Continuous Testing. Elapsed Time between FUT actual end date and SNOW
& Release] 2. Continuous Release & Deployment. Technical Go-Live date. The date of FUT closure and TGL will be tracked through the
project template task – Actual End Date. Refer below
Picture 1, for TGL date and Picture 2 for FUT actual end date
in SNOW.
Defect Leakage to 1.Collaborative Development. Ratio of [Incidents raised for CRs in a release and SNOW + HPQC
Production [All 2. Continuous Testing. the total defects found in FUT+SIT (if any) [Plus, a possible intermediary calculator]
Priorities] 3. Continuous Release & Deployment. + UAT + Incidents]
4. Continuous Monitoring and Optimisation.
Below is the reference snapshot for pre-approved date and TGL date in SNOW:
Picture 1
Picture 2
Below is the reference snapshot for actual start date[Planning Task] in SNOW:
Picture 3
*All the above metrics and snapshot references are based on current WoW in SNOW. Same will be revisited and modified accordingly as WoW evolve.
*Data required for metrics currently is to be gathered manually from different tools.
*This metrics are practically implemented from ongoing experiment with marketing squads.
*SNOW reporting capabilities provides the above metrics at specified frequency.
*Defect Leakage into production will be calculated with the incidents raised up to 1 month after TGL.
The goal of continuous testing is to evaluate the quality of the software as part of a
continuous delivery process. This is done by testing early and often.
Elements Capabilities
Test Management and Execution • Test Cases, Test Plan & Test Scripts are written during high level design
• Agile approach in place to test the requirements on a continuous way
The goal of continuous Release & Deployment is to ensure that new changes do not affect the existing
functionality.
Elements Capabilities
This is needed to monitor changes and address errors and mistakes spontaneously whenever
they happen.
Elements Capabilities
Operational Analytics • Modern analytics tools used, and feedback used for
continuous improvements
Elements Capabilities
Monitor Capacity and Optimize • Automated monitoring and quick turnaround time.
• Adopt an Integrated Tooling Strategy to bring continuity in the Build
management with Test Management.
Monitoring performance and • Monitoring using tools and automated feedback to the dev team.
optimize • Modern DevSecOps tools for monitoring and integration with development
processes and tools.
Monitoring performance and • Linking online errors, and suggestions in the feedback tool with
optimize Continuous Business Planning processes.
• Integrated online feedback collection service.
• Option to provide feedback anytime during all stages.
• Pain points are to be captured and traceability is to be established
between operation feedback and developments.
Event and Incident management • Latest log management software which is integrated with applications and
infrastructure.