Grants:IdeaLab/Article quality improvement rate

Inspire campaign

Article quality improvement rate

Use ORES (Wikimedia's machine learning web service) to regularly score the quality of an article to measure the improvement of the article over time. This article quality improvement rate would be useful for editing communities around single articles, but could also form the basis for a combined improvement score for WikiProjects and task forces.

countryUnited States

themeediting statistics

idea creator• Qono

this project needs...

volunteer

developer

advisor

project manager

community organizer

designer

researcher

contact email

created on16:34, 26 July 2018 (UTC)

Project idea

What Wikimedia project(s) and specific areas will you be evaluating?

Is this project measuring a specific space on a project (e.g. deletion discussions), or the project as a whole?
Wikipedia as a whole and WikiProjects.

Describe your idea. How might it be implemented?

Provide details about the method or process of how you will evaluate your community or collect data. Does your idea involve private or personally identifying information? Take a look at the Privacy Policy for Wikimedia’s guidelines in this area.
ORES would regularly assess the quality of articles to provide a rough score that represents the rate at which an article's quality is increasing (or decreasing). This would enable a visualization of the article's improvement over time, which would motivate editors, and would provide a metric for evaluating the article's health, the best proxy for the health of a community.

This article improvement rate score could then be combined for all the pages in a WikiProject to provide an overall score for the health of the articles in that WikiProject, perhaps with weighting that accounts for the article's importance as well.

In implementing this, we would also have to work out the relationship between ORES's automatic assessments and human assessments. Human assessments should overrule the automatic assessments unless the human assessment is dated and the article has changed substantially.

Are there experienced Wikimedians who can help implement this project?

If applicable, please list groups or usernames of individuals who you can work with on this project, and what kind of work they will do.
The Scoring Platform team, Wikipedia Version 1.0 Editorial Team, User:Mabeenot, User:Scott5114, User:Fredddie, User:Rschen7754, User:Hurricanehink.

How will you know if this project is successful? What are some outcomes that you can share after the project is completed?

Implementation of the score and associated graphs on talk pages and WikiProjects.

How would your measurement idea help your community make better decisions?

After you are finished measuring or evaluating your Wikimedia project, how do you expect that information to be used to benefit the project?
The information would provide an actionable benchmark about article health and the health of the communities attached to those articles, revealing areas where exceptional work is taking place. The practices of those high-performing communities can then be applied to low-performing communities.

Do you think you can implement this idea? What support do you need?

Do you need people with specific skills to complete this idea? Are there any financial needs for this project? If you can’t implement this project, can you scale down your project so it is doable?
I don't have the technical chops to implement this by myself, so I would need the support of those more familiar with ORES, stats, bot programming, and potentially data visualization to implement this.

Get Involved

Expand your idea

Would a grant from the Wikimedia Foundation help make your idea happen? You can expand this idea into a grant proposal.

Expand into a Rapid Grant

No funding needed?

Does your idea not require funding, but you're not sure about what to do next? Not sure how to start a proposal on your local project that needs consensus? Contact Chris Schilling on-wiki at I JethroBT (WMF) (talk · contribs) or via e-mail at cschillingwikimedia.org for help!