Background
We have added the items required in the ToC instrumentation specification (https://docs.google.com/spreadsheets/d/1CAXGqV2JR_bE0ulo9EU3I74Jm0Ln9z1u2CjC6zvra7I/edit#gid=0) which will allow us to perform an A/B test on the new Table of Contents focused on answering the following questions:
- Is the new table of contents used more frequently than the previous table of contents?
- Does the new table of contents reduce the need to scroll back to the top of the page?
- Does the new table of contents decrease the time people spend scrolling/scrolling quickly (if possible)?
- How does the new table of contents affect the time spent on a page?
Acceptance criteria
Ensure all instrumentation is behaving as expected on the beta cluster (production QA will be tracked in T305442: QA ToC Instrumentation)
- New events logged in the mediawiki_web_ui_scroll schema: T303297: Prepare mediawiki_web_ui_scroll schema for table of contents AB test
- All other events are appearing as expected within the DesktopWebUIActionsTracking, mediawiki_web_ab_test_enrollment, mediawiki_reading_depth schemas
- A/B test bucketing is functioning as expected: T302046: Build A/B test bucketing infrastructure for the table of contents.
- Ensure the DesktopWebUIClickTracking schema is logging screen resolution as expected T301391: Update click tracking to take into account screen resolution