We need maintenance scripts to generate the lists of images that will be submitted to $provider for labeling.
Both of these (as well as new uploads) should adhere to the following exclusion criteria:
Doc: https://docs.google.com/presentation/d/14FD1q2f86nHSYC6bgKsikURlCpXueKmrETiBipV1RNM
@Ramsey-WMF Where did we come down on excluding images with existing depicts statements? IIRC, we were leaning toward including them anyway.
Yeah. Because we have bots with some overlap on our target base of existing images, but those bots typically only add one statement, we'd like to give users the tool to enhance the files with additional statements.
On the other hand, some bots (like XRayBot) have done a pretty good job with extensive modeling and we don't need anything additional.
If we're looking for a rule set, I'd say
a.) If an image is a candidate for the stack, check and see if it has only 1 depicts statement. If yes, include it in the stack. If it has more than one, exclude that file from the stack.
b.) (This is the one we weren't sure how to do technically) - If a user using the CAT tool adds the same depicts statement that a file already has, ignore it.
Change 539981 had a related patch set uploaded (by Mholloway; owner: Michael Holloway):
[mediawiki/extensions/MachineVision@master] Add maintenance script to create file list from one or more categories
The script above can be used to create a list of unique files that are members of Category:Featured_pictures_on_Wikimedia_Commons, Category:Quality_images, or Category:Valued_images.
After digging a bit deeper, I see that Template:Valued_image should be used rather than the corresponding category, since the vast majority of candidates are buried in subcategories (and it's easier just to use templatelinks than to traverse the category tree and aggregate results).
OTOH, Category:Quality_images appears to yield a slightly larger number of results than Template:Quality_image (223,957 vs. 218,318). I'm not sure why that would be. Perhaps it's better to stick with the category.
We should continue to use the category approach for Commons featured images. There is no directly corresponding template (it's currently indicated by a parameter passed in to the Assessments tempate).
Change 540439 had a related patch set uploaded (by Mholloway; owner: Michael Holloway):
[mediawiki/extensions/MachineVision@master] Add script to create file lists based on global image usage
Change 540466 had a related patch set uploaded (by Mholloway; owner: Michael Holloway):
[mediawiki/extensions/MachineVision@master] Add filtering for max number of existing depicts statements
Change 540497 had a related patch set uploaded (by Mholloway; owner: Michael Holloway):
[mediawiki/extensions/MachineVision@master] Request and store SafeSearch annotations
Finishing this up depends on landing two different multi-patch branches that are awaiting review.
Change 539981 merged by jenkins-bot:
[mediawiki/extensions/MachineVision@master] Add script to create file list from any combo of categories and templates
Change 540439 merged by jenkins-bot:
[mediawiki/extensions/MachineVision@master] Add script to create file lists based on global image usage
Change 540466 merged by jenkins-bot:
[mediawiki/extensions/MachineVision@master] Add filtering for max number of existing depicts statements
Change 540497 merged by jenkins-bot:
[mediawiki/extensions/MachineVision@master] Request and store SafeSearch annotations
Change 543477 had a related patch set uploaded (by Mholloway; owner: Michael Holloway):
[mediawiki/extensions/MachineVision@master] Provide for withholding "NSFW" images from being reviewed
Change 543477 merged by jenkins-bot:
[mediawiki/extensions/MachineVision@master] Provide for withholding "NSFW" images from being reviewed