@Legoktm Please pay attention to the words

2-3 articles can be added by hand. We don't need a robot for this.

@Bawolff Maybe you can try replacing database queries with CirrusSearch queries. It won't take long but we can at least test this hypothesis.

@Legoktm How do you plan to call this bot? Are you planning to continuously loop through millions of categories and create a list of the latest news in each of them?

@Joe You are the third person to tell me about @Ladsgroup's harassment. But I don't find it in the discussion above.

@Firestar464 The project does not seem to give an error but it is completely inoperative.

We cannot implement the functionality of news feeds through bots.

@Ladsgroup I'm sorry but I'm not trying to be loud. I'm just trying to describe the problem. Please try to hear us.

@Aklapper, this is not an exaggeration. I have attached screenshots above. A news project is not an archive nor a search, a news project are news feeds. It is currently not working. This means that the news project is dead, despite the absence of a server error.

@stjn This is about API. I did not observe such problem this time.

In T287362#7236399, @Ladsgroup wrote:

The site is back online <...>

@Aklapper Please note I don't speak English, but there is nothing offensive in my words in Russian. I apologize if they sounded harsh. Wikimedia is a multicultural environment. Please be patient and stop threatening me. Thanks for your understanding.

In T287362#7236049, @Aklapper wrote:

@Krassotkin: You are very welcome to contribute by providing patches if you have already analyzed the situation and know all the required technical fixes.
Please bring up general technical questions in technical forums instead - again, see https://www.mediawiki.org/wiki/Bug_management/Phabricator_etiquette . Thanks.

Absolutely everyone knows about this problem and the ways to solve it (CirrusSearch) for about a year.

You couldn't solve the problem for a whole year and now you've killed Russian Wikinews again.

In T262391#6473815, @Bawolff wrote:

[...]
The proposed alternative is to rewrite DPL to use elasticsearch as a backend. Inverted indicies are much more suited for set intersection than B-trees are, and would probably be a more scalable long term solution. CirrusSearch already supports some category intersection, so there already exists some similar work. However it should be clear that that is not simple maintenance but a full rewrite of DPL.

As written above it turned out that we have unsupported bomb-level code. I don't know how to solve this problem. But Katherine told me that the Foundation's management monitors this task. We have draw their attention to this.

@RhinosF1 And why can't we identify and transfer critical code to WMF staff support?

@Aklapper Sorry, but I didn't get it. Doesn't the Foundation have its own developers?

Perhaps we should hand over such critical software to Foundation developers? Not only this. Software is also an important part of our platform as are servers. Living on a bomb and doing nothing is a bad idea. How are these issues usually resolved?

Does the closure of this task mean that we can work as usual? For example, can upload bot be enabled? No more tests required?

@Aklapper: I don't blame anyone and I don't want to return to this question. I'm just saying that maybe together we could solve the problem better. I am grateful for the participation of everyone who helped us.

In T262391#6462357, @Aklapper wrote:

In T262391#6462196, @Krassotkin wrote:

But if you could report the issue to our community we could take the necessary measures on the Wikinews side and work without turn it off.

It has been written a few times here that ~900 other projects were affected, that quick action was needed, and that it looked like DPL usage on Russian Wikinews was the culprit, and that quick action was needed, because ~900 other projects were affected. I don't see how repeating this conversation helps anyone. :)

Thank you. I'm here online and ready to respond quickly.

@Marostegui I understand you. But if you could report the issue to our community we could take the necessary measures on the Wikinews side and work without turn it off. But I don't want to go back.

The weekend is over but Wikinews still doesn't work.

@MarcoAurelio & @Kaganer: Thank you very much!

In T262391#6456221, @Urbanecm wrote:

Just remove DPL tags from other pages. [...]

In T262391#6456200, @Bawolff wrote:

[...] Only ~50 wikis [...]

In T262391#6455808, @Marostegui wrote:

Exactly, we are happy to give it a go, monitor it for a few days and see if it solves the performance issues.
We, DBAs, have no interest at all on having DPL disabled whatsoever. We just need the performance problems to be resolved :-)

@MarcoAurelio Everything is great now. Thank you!

In T262391#6453837, @Urbanecm wrote:

[...]

I wrote to Jimbo and Katherine, but there is no reaction https://en.wikipedia.org/wiki/User_talk:Jimbo_Wales#Russian_Wikinews_is_down. Who can resolve this issue?

Literally anyone can solve the main issue with DPL - by proposing a patch just as Bawolff did.

@Bawolff: We discussed your suggestion on the Russian Wikinews and our community has a consensus about this. I made the appropriate changes: https://ru.wikinews.org/?diff=8357270

In T262152#6447502, @Kaganer wrote:

HTML template is updated. See screenshot:

@Bawolff What do you mean?
Do we need to remove DPL from PanARMENIAN categories https://ru.wikinews.org/?curid=19312, https://ru.wikinews.org/?curid=1543119 and https://ru.wikinews.org/?curid=6829679?
Or PanARMENIAN request from "Other themes" template https://ru.wikinews.org/?curid=19721, example (right): https://ru.wikinews.org/?curid=7348599?
Or both? Or somewhere else?

@Urbanecm Sorry, these are emotions. Now I have the dead project to which I have dedicated many years. I'll try to write to Jimbo and Katherine. If the Wikimedia Foundation staff developers don't want to tackle this problem, I'll think about what to do next. Thanks all for the suggested solutions.

@Urbanecm, have you read the previous discussion? We have hundreds of thousands of categories. In order to update their feeds using an external bot in real time, we must launch a cluster of servers. Do you think this is a realistic solution?

In T262391#6447128, @Krinkle wrote:

@Krassotkin I've proposed an edit that temporarily hides the broken DPL sidebar from news articles. https://ru.wikinews.org/w/index.php?diff=8334384&oldid=7596568. Once accepted by a reviewer, this should solve the issue with previews in social media.

In T262391#6447379, @Bugreporter wrote:

You can use JavaScript to generate the feed in client side.

@Ladsgroup You can offer any other implementation of the news feed and we will immediately switch to it. Until then, the project does not exist.

@Krinkle I understand, but the point? Wikinews is not a store of antiquity, but the latest news. There can be no Wikinews without news feeds. You can turn them off completely with the same result. I'm sorry, we already discussed this above.

After updating the cache I see that the problem is much larger. DPL is included in all articles via the "Related news" template (https://ru.wikinews.org/?curid=19721; see in right in any news and first screenshot). Therefore, absolutely all content pages of Russian Wikinews are displayed with errors and without the necessary functionality. Moreover social networks show these error instead of news text (see second screenshot). The project is completely dead.

In T262391#6446207, @Base wrote:

This is also not something that can be done via dumps as it might be suggested for heavy jobs in other cases, as dumps are not updated as often as news sites are supposed to be.

In T262391#6446328, @Urbanecm wrote:

In T262391#6446320, @Krassotkin wrote:

In T262391#6446298, @Urbanecm wrote:

As stated above, our current hypothesis is that DPL queries increased their "difficulty", making them more difficult to compute. I'd appreciate any links to recent DPL configuration changes, that could explain why the queries put more load on the databases. This issue happens from about last Sunday, so I'm especially interested in changes of DPL config made about Sunday. Thanks!

I think this is happend because a sharp increase in articles in the main space from 30 to 100 thousand due to the saving of archives of free news sites. But the total number articles in the main space, as you can see, is too small.

When did that happen, please?

In T262391#6446298, @Urbanecm wrote:

As stated above, our current hypothesis is that DPL queries increased their "difficulty", making them more difficult to compute. I'd appreciate any links to recent DPL configuration changes, that could explain why the queries put more load on the databases. This issue happens from about last Sunday, so I'm especially interested in changes of DPL config made about Sunday. Thanks!

@Kormat: Russian Wikinews is a very small project. We have about 150 thousand articles in the main space. How have developers to written the program in such a way that it cannot select from database such a small number of elements. Maybe the problem in the database structure?

In T262391#6446177, @Bugreporter wrote:

As a simple solution, you can use a bot to periodically update the news feed.

@Aklapper Disabling a news feed in a news agency is equal to completely destroying the project. You could turn it off completely with the same result. In the long term, this applies to all Wikinews editions.

@MarcoAurelio Maybe I don't understand your message, but the changes I described before are not included in this diff.

Last time we found out that this must be done on the Phabricator:
https://meta.wikimedia.org/wiki/Talk:Www.wikinews.org_template#Russian_Wikinews_Update
https://phabricator.wikimedia.org/T130514

In T253441#6159971, @DannyS712 wrote:

@Krassotkin did you provide a summary with your change? If not, they may be a known issue - can you try again with a summary?

In T234715#5562004, @Bawolff wrote:

Should be live now. Please let me know if that fixed the problem

In T234715#5550692, @Bawolff wrote:

...
So my patch should fix this issue (Patch not live yet). It sounds like in later comments, you are describing some additional issues with FlaggedRevs, which sound unrelated to the above issue to me. Just to keep things more clear, can you file separate bugs for any of those issues if they are causing problems.

In T234715#5549895, @Neolexx wrote:

...
I would propose to close this ticket.

Please solve this task as a priority. We stopped work.

@Base: Thank you, then I correctly understood your question.

In T201265#4479503, @Base wrote:

What you probably mean is for autoreview AND editor to now have the rights. Could you confirm?

Thanks!

We need help with this report in Russian Wikinews: https://ru.wikinews.org/?oldid=498970

We are massively confronted with this problem on Russian Wikipedia. See discussion: https://ru.wikipedia.org/wiki/%D0%92%D0%B8%D0%BA%D0%B8%D0%BF%D0%B5%D0%B4%D0%B8%D1%8F:%D0%A4%D0%BE%D1%80%D1%83%D0%BC/%D0%A2%D0%B5%D1%85%D0%BD%D0%B8%D1%87%D0%B5%D1%81%D0%BA%D0%B8%D0%B9#.D0.9F.D1.80.D0.BE.D0.B1.D0.BB.D0.B5.D0.BC.D1.8B_.D1.81_.D0.92.D0.B8.D0.BA.D0.B8-.D0.BF.D0.BE.D1.87.D1.82.D0.BE.D0.B9 (permanent link: https://ru.wikipedia.org/w/index.php?oldid=80553104#.D0.9F.D1.80.D0.BE.D0.B1.D0.BB.D0.B5.D0.BC.D1.8B_.D1.81_.D0.92.D0.B8.D0.BA.D0.B8-.D0.BF.D0.BE.D1.87.D1.82.D0.BE.D0.B9 ).

@matmarex OK. Sorry. Thank you!

@matmarex I still suspect that this file (https://commons.wikimedia.org/wiki/File:Victory_Day_Parade_on_Red_Square_2016_%28Full_Video%29_04.ogv) is not properly uploaded. For example, see transcode status. IMHO, it makes sense to check on the server.

Hm... It returns an error for several hours. But now renamed. Very strange.

@matmarex This is hack for work only.

Is there another way to request the latest revisions without error?

In my opinion, progress bar still work incorrectly.
It displays the upload progress for each part (0-100%) then processed and repeated from zero many times.
Creates the illusion of termination and re-upload.
I almost did not create a new ticket.

In our case, it happens in other browsers (Google Chrome) and with other file types (webm). It seems like a common problem for large files.

In T88958#1024622, @Aklapper wrote:

Hi @Krassotkin.

...

Which version of MediaWiki and UploadWizard did you install in your instance, or is this about some Wikimedia site like Commons?

In T88958#1024622, @Aklapper wrote:

Hi @Krassotkin.

Is this problem reproducible?

Step by step....

In T87337#990982, @TTO wrote:

...

the problem is probably with the HotCat gadget. It looks like your copy of HotCat is severely out-of-date.

To #2 demo: I cannot hide (close) ad.

I see three tabs only if I disconnect simultaneously all the gadgets of editing (https://ru.wikinews.org/wiki/MediaWiki:Gadgets-definition). But it is no good.

#4 & #5 (tab comments - "комментарии" in russian)

This is my first ticket here. Thank you for your recommendation. I will follow them in the future.