Page MenuHomePhabricator

Release-Engineering-TeamGroup
ActivePublic

Milestones

Members (19)

Watchers (4)

Details

Description

Responsibilities

The WMF Release Engineering Team's mission is to enable confident code deployment with feedback loops to inform optimal delivery to production.

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team

Our Workboards

Milestones

Milestones with emojis

🧟 – An ended sprint with remaining tasks
🔥 – Current active sprint

Software/tooling projects

Here are the projects and components we care about:

Our ACL (Access Control List) project: acl*releng

Team Skill Matrix

Looking for someone to help you on a specific thing? Have a look at the Release Engineering skill matrix.

Deployments

Release-Engineering-Team is responsible for the weekly MediaWiki "Train Deployments," scheduling of code deployments, deployment tooling, etc. Some helpful links below:

Team image: CC-By-SA-4.0 Diego Delso

Recent Activity

Yesterday

brennen added a comment to T382285: Permission denied while running dev-images/fab deploy_devimages.

contint1002:/etc/docker-pkg/dev-images.yaml uses the same creds as integration.yaml, and that was at least working a few days ago.

Mon, Dec 16, 10:05 PM · dev-images, User-brennen, collaboration-services, Release-Engineering-Team
brennen created T382285: Permission denied while running dev-images/fab deploy_devimages.
Mon, Dec 16, 9:56 PM · dev-images, User-brennen, collaboration-services, Release-Engineering-Team
Stashbot added a comment to T381728: Use PHP 8.3 in MediaWiki-Docker.

Mentioned in SAL (#wikimedia-releng) [2024-12-16T20:29:55Z] <brennen> Updating development images on contint primary for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/69 (T381728)

Mon, Dec 16, 8:30 PM · Patch-For-Review, Release-Engineering-Team, dev-images, MediaWiki-Docker
CodeReviewBot added a comment to T381728: Use PHP 8.3 in MediaWiki-Docker.

brennen merged https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/69

Mon, Dec 16, 8:15 PM · Patch-For-Review, Release-Engineering-Team, dev-images, MediaWiki-Docker
Scott_French closed T381473: Generate a dumps-enabled mediawiki image, a subtask of T352650: Migrate current-generation dumps to run on kubernetes, as Resolved.
Mon, Dec 16, 5:38 PM · Patch-For-Review, Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, serviceops
Scott_French closed T381473: Generate a dumps-enabled mediawiki image as Resolved.

@Joe's change is now live. I've confirmed that the debug images now contain the dumps codebase at /srv/deployment/dumps as expected.

Mon, Dec 16, 5:38 PM · Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops
Maintenance_bot removed a project from T381473: Generate a dumps-enabled mediawiki image: Patch-For-Review.
Mon, Dec 16, 5:31 PM · Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops
Stashbot added a comment to T381473: Generate a dumps-enabled mediawiki image.

Mentioned in SAL (#wikimedia-operations) [2024-12-16T17:22:32Z] <swfrench@deploy2002> Finished scap sync-world: Deployment to pick up debug image changes - T381473 (duration: 06m 49s)

Mon, Dec 16, 5:22 PM · Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops
Stashbot added a comment to T381473: Generate a dumps-enabled mediawiki image.

Mentioned in SAL (#wikimedia-operations) [2024-12-16T17:15:43Z] <swfrench@deploy2002> Started scap sync-world: Deployment to pick up debug image changes - T381473

Mon, Dec 16, 5:16 PM · Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops
CodeReviewBot added a comment to T381473: Generate a dumps-enabled mediawiki image.

dancy merged https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/138

Mon, Dec 16, 5:11 PM · Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops
Clement_Goubert added a comment to T352650: Migrate current-generation dumps to run on kubernetes.

You probably also want to if-guard the service deployment in templates/service.yaml.tpl

Mon, Dec 16, 12:49 PM · Patch-For-Review, Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, serviceops
Clement_Goubert added a comment to T352650: Migrate current-generation dumps to run on kubernetes.

[...]

I see various references to mwscript and mercurius here, so if you (or someone) could let me know the current direction of travel regarding these two things, I'd be grateful.

Mon, Dec 16, 12:04 PM · Patch-For-Review, Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, serviceops
BTullis added a comment to T352650: Migrate current-generation dumps to run on kubernetes.

Thanks @Joe - I think that looks useful.

Mon, Dec 16, 11:27 AM · Patch-For-Review, Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, serviceops
Joe added a comment to T352650: Migrate current-generation dumps to run on kubernetes.

I have added a patch to the mediawiki chart to allow claiming persistent volumes for dumps specifically. @BTullis I guess when both this patch and the one to add the needed stuff to the debug image are ready, I think you'll be ready to create a deployment on the DSE cluster.

Mon, Dec 16, 11:12 AM · Patch-For-Review, Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, serviceops
gerritbot added a project to T352650: Migrate current-generation dumps to run on kubernetes: Patch-For-Review.
Mon, Dec 16, 11:09 AM · Patch-For-Review, Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, serviceops
gerritbot added a comment to T352650: Migrate current-generation dumps to run on kubernetes.

Change #1104605 had a related patch set uploaded (by Giuseppe Lavagetto; author: Giuseppe Lavagetto):

[operations/deployment-charts@master] mediawiki: Add support for dumps persistent _volumes

https://gerrit.wikimedia.org/r/1104605

Mon, Dec 16, 11:09 AM · Patch-For-Review, Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, serviceops
Samwilson added a comment to T382133: Requesting GitLab account activation for Hridyesh_Gupta.

Hridyesh_Gupta is a participant in the Indic Wikimedia Hackathon Bhubaneswar 2024.

Mon, Dec 16, 2:01 AM · GitLab (Account Approval), Release-Engineering-Team

Fri, Dec 13

Pppery updated subscribers of T382133: Requesting GitLab account activation for Hridyesh_Gupta.

Please don't subscribe people without their consent.

Fri, Dec 13, 5:42 PM · GitLab (Account Approval), Release-Engineering-Team
Joe changed the status of T381473: Generate a dumps-enabled mediawiki image from Open to In Progress.
Fri, Dec 13, 4:32 PM · Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops
Joe changed the status of T381473: Generate a dumps-enabled mediawiki image, a subtask of T352650: Migrate current-generation dumps to run on kubernetes, from Open to In Progress.
Fri, Dec 13, 4:32 PM · Patch-For-Review, Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, serviceops
Nemoralis renamed T382133: Requesting GitLab account activation for Hridyesh_Gupta from Requesting GitLab account activation for [YOUR DEVELOPER ACCOUNT USERNAME HERE] to Requesting GitLab account activation for Hridyesh_Gupta.
Fri, Dec 13, 11:59 AM · GitLab (Account Approval), Release-Engineering-Team
Adityakumar0545 created T382134: Requesting GitLab account activation for Aditya0545.
Fri, Dec 13, 11:37 AM · GitLab (Account Approval), Release-Engineering-Team
Hridyesh_Gupta created T382133: Requesting GitLab account activation for Hridyesh_Gupta.
Fri, Dec 13, 11:37 AM · GitLab (Account Approval), Release-Engineering-Team
Qgil added a comment to T382014: GitLab Private Repository Request for: WP-Civi security review.

Thank you very much! That works.

Fri, Dec 13, 11:21 AM · Release-Engineering-Team, GitLab
brennen closed T382014: GitLab Private Repository Request for: WP-Civi security review as Resolved.

Seems like it fits the rubric ok. I couldn't figure out how to change the privacy level of a repo in your namespace, so I instead made this one in the namespace we recently created for one-off projects that don't fit anywhere else:

Fri, Dec 13, 10:28 AM · Release-Engineering-Team, GitLab

Wed, Dec 11

Anoop renamed T381940: Requesting GitLab account activation for Amutha2002 from Requesting GitLab account activation for [YOUR DEVELOPER ACCOUNT USERNAME HERE] to Requesting GitLab account activation for Amutha2002.
Wed, Dec 11, 8:24 AM · GitLab (Account Approval), Release-Engineering-Team
Amutha2002 added a comment to T381940: Requesting GitLab account activation for Amutha2002.

Requesting GitLab account activation for Amutha2002 ,I am begineer in this wiki developers.I t help me to wkimedia Hackathon.

Wed, Dec 11, 6:09 AM · GitLab (Account Approval), Release-Engineering-Team
Amutha2002 created T381940: Requesting GitLab account activation for Amutha2002.
Wed, Dec 11, 5:48 AM · GitLab (Account Approval), Release-Engineering-Team

Mon, Dec 9

gerritbot added a comment to T381728: Use PHP 8.3 in MediaWiki-Docker.

Change #1101594 had a related patch set uploaded (by Daimona Eaytoy; author: Daimona Eaytoy):

[mediawiki/core@master] docker: Switch to Debian Bookworm and PHP 8.3

https://gerrit.wikimedia.org/r/1101594

Mon, Dec 9, 9:59 PM · Patch-For-Review, Release-Engineering-Team, dev-images, MediaWiki-Docker
CodeReviewBot added a project to T381728: Use PHP 8.3 in MediaWiki-Docker: Patch-For-Review.

daimona opened https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/69

Mon, Dec 9, 9:54 PM · Patch-For-Review, Release-Engineering-Team, dev-images, MediaWiki-Docker
Daimona claimed T381728: Use PHP 8.3 in MediaWiki-Docker.
Mon, Dec 9, 7:13 PM · Patch-For-Review, Release-Engineering-Team, dev-images, MediaWiki-Docker
Daimona added a parent task for T381728: Use PHP 8.3 in MediaWiki-Docker: T360995: Migrate Wikimedia production from PHP 8.1 to PHP 8.3.
Mon, Dec 9, 4:40 PM · Patch-For-Review, Release-Engineering-Team, dev-images, MediaWiki-Docker
affandymurad created T381774: Requesting GitLab account activation for affandymurad.
Mon, Dec 9, 2:47 PM · GitLab (Account Approval), Release-Engineering-Team
CodeReviewBot added a project to T381473: Generate a dumps-enabled mediawiki image: Patch-For-Review.

oblivian opened https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/138

Mon, Dec 9, 2:38 PM · Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops
Joe added a comment to T381473: Generate a dumps-enabled mediawiki image.

I have started looking into it hypothesizing we might want to create a new derivative image for dumps specifically, but then I realized we're just adding about 150 MB in this layer, so it might make sense to actually add the tools needed for dumps to our "debug" image, in order to reduce the amount of time it will take to build images during the release process.

Mon, Dec 9, 10:20 AM · Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops

Sat, Dec 7

Daimona created T381728: Use PHP 8.3 in MediaWiki-Docker.
Sat, Dec 7, 11:03 PM · Patch-For-Review, Release-Engineering-Team, dev-images, MediaWiki-Docker

Fri, Dec 6

BTullis added a comment to T381473: Generate a dumps-enabled mediawiki image.

Would it be a big problem to have the git command in the final image?
Could you see any other benefits to getting the dumps code with rsync from a deployment host, rather than as a git checkout from gerrit? Thanks.

It's not a big problem, but in general we tend to only add to images what's strictly needed. Is there any other reason why having git in the image would be useful?

Fri, Dec 6, 10:54 AM · Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops

Thu, Dec 5

Aklapper closed T381531: Requesting GitLab account activation for ranjithraj as Resolved.

The GitLab account does not show "Pending approval" on (admin-only) https://gitlab.wikimedia.org/admin/users?sort=created_desc so I assume this has been somehow already sorted out ?

Thu, Dec 5, 12:47 PM · GitLab (Account Approval), Release-Engineering-Team
Joe added a comment to T381473: Generate a dumps-enabled mediawiki image.

Would it be a big problem to have the git command in the final image?
Could you see any other benefits to getting the dumps code with rsync from a deployment host, rather than as a git checkout from gerrit? Thanks.

Thu, Dec 5, 9:04 AM · Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops
Joe added a comment to T381473: Generate a dumps-enabled mediawiki image.

The reason to do what I said is that's how we currently build up the mediawiki code, I'm aware there are other ways to do it but I wanted to maintain consistency with the rest of the process :)

Thu, Dec 5, 9:02 AM · Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops

Wed, Dec 4

Ranjithraj created T381531: Requesting GitLab account activation for ranjithraj.
Wed, Dec 4, 8:34 PM · GitLab (Account Approval), Release-Engineering-Team
hashar added a comment to T381473: Generate a dumps-enabled mediawiki image.

You can retrieve a tarball directly from Gerrit using eg:

Wed, Dec 4, 6:47 PM · Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops
BTullis added a comment to T381473: Generate a dumps-enabled mediawiki image.

Thanks for creating this ticket.

Wed, Dec 4, 5:43 PM · Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops
Joe renamed T352650: Migrate current-generation dumps to run on kubernetes from Migrate current-generation dumps to run from our containerized images to Migrate current-generation dumps to run on kubernetes.
Wed, Dec 4, 10:28 AM · Patch-For-Review, Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, serviceops
Joe created T381473: Generate a dumps-enabled mediawiki image.
Wed, Dec 4, 9:57 AM · Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops
hashar closed T374717: Speed up git clone operation in wmf-quibble job as Resolved.

A build of wmf-quibble-core-vendor-mysql-php74 from this morning show the zuul clone took 34.393 seconds

TOTAL: 142.69199999999995
mediawiki/extensions/WikiEditor 7.649
mediawiki/extensions/CirrusSearch 7.645
mediawiki/extensions/CheckUser 7.156
mediawiki/extensions/Translate 6.735
mediawiki/extensions/Babel 5.763
mediawiki/extensions/CodeEditor 5.474
mediawiki/extensions/ConfirmEdit 5.366
mediawiki/extensions/ContentTranslation 5.072
mediawiki/extensions/Disambiguator 4.565
mediawiki/extensions/Echo 4.258
mediawiki/vendor 3.683
mediawiki/extensions/Wikibase 3.384
mediawiki/extensions/TimedMediaHandler 3.353
mediawiki/extensions/Math 3.236
mediawiki/extensions/PageTriage 2.989
mediawiki/extensions/ProofreadPage 2.579
mediawiki/extensions/CiteThisPage 2.417
mediawiki/extensions/VisualEditor 2.322
mediawiki/extensions/UniversalLanguageSelector 2.238
mediawiki/extensions/WikiLove 2.087
mediawiki/extensions/GrowthExperiments 1.925
mediawiki/extensions/WikimediaMessages 1.807
mediawiki/extensions/Gadgets 1.713
mediawiki/extensions/Interwiki 1.699
mediawiki/extensions/BetaFeatures 1.646
mediawiki/extensions/WikibaseMediaInfo 1.644
mediawiki/extensions/Kartographer 1.633
mediawiki/extensions/AntiSpoof 1.633
mediawiki/skins/MinervaNeue 1.565
mediawiki/extensions/Elastica 1.55
mediawiki/extensions/AbuseFilter 1.52
mediawiki/extensions/FileImporter 1.507
mediawiki/extensions/Thanks 1.502
mediawiki/extensions/MobileFrontend 1.407
mediawiki/extensions/Cite 1.398
mediawiki/extensions/ParserFunctions 1.34
mediawiki/extensions/IPInfo 1.309
mediawiki/skins/Vector 1.275
mediawiki/extensions/Graph 1.223
mediawiki/extensions/InputBox 1.168
mediawiki/extensions/CommunityConfiguration 1.138
mediawiki/extensions/SpamBlacklist 1.127
mediawiki/extensions/JsonConfig 1.123
mediawiki/extensions/WikibaseCirrusSearch 1.116
mediawiki/extensions/GlobalPreferences 1.114
mediawiki/extensions/SiteMatrix 1.113
mediawiki/extensions/GuidedTour 1.106
mediawiki/extensions/ImageMap 1.093
mediawiki/extensions/MobileApp 1.049
mediawiki/extensions/EventBus 1.032
mediawiki/extensions/GeoData 1.009
mediawiki/extensions/EventStreamConfig 0.982
mediawiki/extensions/PdfHandler 0.969
mediawiki/extensions/cldr 0.952
mediawiki/extensions/PageViewInfo 0.944
mediawiki/extensions/MediaModeration 0.918
mediawiki/extensions/SandboxLink 0.911
mediawiki/extensions/GlobalCssJs 0.898
mediawiki/extensions/Scribunto 0.892
mediawiki/extensions/Poem 0.881
mediawiki/extensions/TemplateData 0.865
mediawiki/extensions/PageImages 0.861
mediawiki/extensions/NavigationTiming 0.797
mediawiki/extensions/EventLogging 0.695
mediawiki/extensions/CommunityConfigurationExample 0.672
Wed, Dec 4, 9:10 AM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure

Tue, Dec 3

sbassett closed T381431: Grant Access to /repos/security under gitlab.wikimedia.org for JLy (Jimmy Ly) as Resolved.
Tue, Dec 3, 7:01 PM · Security-Team, Release-Engineering-Team
sbassett added a comment to T381431: Grant Access to /repos/security under gitlab.wikimedia.org for JLy (Jimmy Ly).

you should be able to self-serve this here: https://gitlab.wikimedia.org/groups/repos/security/-/group_members

Tue, Dec 3, 7:00 PM · Security-Team, Release-Engineering-Team
taavi added a comment to T381431: Grant Access to /repos/security under gitlab.wikimedia.org for JLy (Jimmy Ly).

you should be able to self-serve this here: https://gitlab.wikimedia.org/groups/repos/security/-/group_members

Tue, Dec 3, 6:58 PM · Security-Team, Release-Engineering-Team
sbassett renamed T381431: Grant Access to /repos/security under gitlab.wikimedia.org for JLy (Jimmy Ly) from Grant Access to JLy (Jimmy Lee) to /repos/security under gitlab.wikimedia.org to Grant Access to /repos/security under gitlab.wikimedia.org for JLy (Jimmy Ly).
Tue, Dec 3, 6:57 PM · Security-Team, Release-Engineering-Team