Grants:Project/Rapid/Akeron/Wikiscan

statusfunded

Rapid Grants

Akeron/Wikiscan

Migrate the Wikiscan site to new servers, extend the tool to all the Wikimedia wikis, optimize code and queries.

targetAll wikis

start dateAugust 15

end dateSeptember 30

budget (local currency)1780 EUR

budget (USD)2000 USD

grant typeindividual

grantee• Akeron

contact(s)• Special:EmailUser/Akeron

friendly space expectations

ucc

privacystatement

Review your report

Project Goal

Briefly explain what are you trying to accomplish with this project, or what do you expect will change as a result of this grant. Example goals include, "recruit new editors", "add high quality content", or "train existing editors on a specific skill".

The wikiscan.org site provides statistics for Wikimedia wikis, especially statistics by contributor (for instance: Wikipedia in English).

Goals:

1. Migrate wikiscan.org to new servers provided by Wikimedia France.
2. Include all the Wikimedia wikis and make the necessary optimizations (from 380 wikis to more than 800).
3. Adapt and optimize the code to the recent restructurings of Mediawiki tables.

Project Plan

Activities

Tell us how you'll carry out your project. What will you and other organizers spend your time doing?

1) Migrate wikiscan.org to new servers provided by Wikimedia France (especially to manage more wikis):

• Receive and verify the new servers.
• Support HTTPS for all subdomains (wildcard). Only the largest sites are currently included in the free certificate.
• Set up and configure the servers.
• Adapt the Wikiscan code to distribute the wikis on two external databases and ensure the compatibility with PHP 7.
• Move databases to the new servers.

2) Include all the Wikimedia wikis and make the necessary optimizations, the site would go from the current 380 wikis to more than 800:

• Optimize statistical queries for small wikis to minimize the number of requests (for instance use the whole year instead of day by day).
• Optimize the servers, which will have to manage more than 800 sites parallelly, in particular with numerous accesses by robots.
• Add all the Wikimedia wikis not already included.

3) Adapt and optimize the code to follow the recent restructurings of the Mediawiki tables:

• Revisions comments have been moved to a separate table [2], which requires a fairly heavy join, slowing down the updates, which can then fail and slow down all the others. The code should be readjusted to make smaller queries, especially for large wikis.
• Same problem with user names moved in the actor table [3], the code must be adapted and optimized.
• Big wikis lead to more and more problems of slowness, if there is enough time left I will try to reduce the size of some tables, for instance by including only users who have more than five edits.

How will you let others in your community know about your project (please provide links to where relevant communities have been notified of your proposal, and to any other relevant community discussions)? Why are you targeting a specific audience?

The grant application will be announced with a banner on the wikiscan.org site for users who visit regularly.

What will you have done at the end of your project? How will you follow-up with people that are involved with your project?

Normally all the items listed above in Activities will be completed.

Impact

How will you know if the project is successful and you've met your goals? Please include the following targets and feel free to add more specific to your project:

1. Number of total participants: 1
2. Supported wikis before the grant: 381
3. Supported wikis after the grant: 800+

The Wikiscan tool will work on the new servers, all the Wikimedia wikis will be supported with the necessary optimizations.

Resources

What resources do you have? Include information on who is the organizing the project, what they will do, and if you will receive support from anywhere else (in-kind donations or additional funding).

• I will make all the realizations (programming, servers configuration, etc.)
• The hardware costs of the servers are supported by Wikimedia France.

What resources do you need? For your funding request, list bullet points for each expense:

1. Migrate wikiscan.org to new servers: 21 hours.
2. Include all the Wikimedia wikis: 10 hours.
3. Adapt and optimize the code to the Mediawiki restructuring: 10 hours.

• Total development and servers configuration: 41 hours at 40 €/h = 1640 €.
• Project management: 7 hours at 20 €/h = 140 €.

Total : 1780 € (2000 $).

Endorsements

Community members are encouraged to endorse the project request here.

• Obviously, especially the point 2! VIGNERON * ^discut. 09:28, 15 June 2019 (UTC)
• Very useful tool, thanks for your efforts! --MisterSynergy (talk) 12:52, 20 June 2019 (UTC)
• Of course! This tool is very useful, and the budget seems well defined. — Envlh (talk) 08:04, 21 June 2019 (UTC)
• Very useful tool, highly used. Akeron is a serious editor and I know that he will deliver the goods. Simon Villeneuve 10:39, 21 June 2019 (UTC)
•  Strong support I have benefited greatly from a tool. --Geonuch (talk) 13:36, 21 June 2019 (UTC)
• Very useful tool, thanks to Akeron to keep it up-to-date. Jules78120 (talk) 21:21, 23 June 2019 (UTC)
• j'aime beaucoup cet outil. P@d@w@ne 16:44, 24 June 2019 (UTC)
• Great tool. --NicoScribe (talk) 10:18, 26 June 2019 (UTC)
• Sure! Ymnes (talk) 07:52, 29 June 2019 (UTC)
• Absolutely; if this helps prevent slowdowns in updates, then I support this grant proposal. Mahir256 (talk) 04:31, 4 July 2019 (UTC)
•  Strong support! —— Eric Liu_{（留言．百科用戶頁）} 02:02, 5 July 2019 (UTC)
•  Strong support Very very useful for everyone! Sebleouf (talk) 09:40, 7 July 2019 (UTC)
• Strong  Support. Very useful source of information for monthly reports I generate on the Wikimedia projects in the languages of Russia within wmru:Smart region/Multilingualism project. This would save me lots of manual labor. Frhdkazan (talk) 15:36, 8 July 2019 (UTC)
•  Support Great tool! Kruusamägi (talk) 09:51, 18 July 2019 (UTC)
•  Strong support. Very useful. Regarrds, Ivanhercaz (talk) 16:05, 30 July 2019 (UTC)