Community Resources/Reports/Grantee partners’ intended programming and impact 2022/Content contributions

Grantee partners’ intended programming and impact
Content contribution
Executive summary

“If they [potential contributors] do not see themselves reflected online with articles in their language and relevant to their experiences, they are unlikely to contribute content” (grantee MEA region) Challenges:

  • Grantees are seeking opportunities, not only to grow and diversify content in line with the Movement Strategy focus on Knowledge Equity, but also to work with partners to position Wikimedia projects as a service for their institutions, and for wider public interests, be it in education, social change, public services, etc.
  • Addressing global issues through access to better information (particularly in the LAC and MEA regions) and address knowledge injustices by empowering content creation in underrepresented communities, preserving culture and heritage, re-writing histories and working with a decolonisation framework.

Strategies:

  • For 60% content contribution is a main focus. Grantees prioritise addressing content gaps related to gender, geography, and language. Some regional variations, with contents representing cultural/ethnic diversity being more prevalent in the MEA and SA regions, whilst “topics of impact” prioritised more in LAC and USCA.
  • Wikipedia is still a central focus [1] of content contribution (for 80% of grantees) however there is a growing interest in Wikimedia Commons [2] and Wikidata, [3] particularly with key partners to show it as a service to digitalise and open their knowledge. However, there are challenges with measuring the use/quality of these contributions and documenting case studies.
  • A small group of grantees are working on smaller Wikimedia projects, mostly newer grantees in underrepresented communities in SA, MEA, and LAC.. Whilst they are seen as easier entry points for knowledge equity because of more lenient policies and formats for documenting knowledge. However, there are ongoing questions about the readership scope of this content and some uncertainty about future Movement-wide investments in these smaller projects.
  • Some of the more common strategies to mobilise contents are: Campaigns (55%) that provide structure, straightforward tasks and connection to organised interest groups. Content-building events with training: Edit-a-thons are still the main method, despite questions around their effectiveness as one offs. GLAM partnerships (69%) to digitalise and open collections. Educational partnerships (70% state it is a top strategy, but 40% mention working with the formal educational sector) more focused on building awareness, but also state a desired outcome in terms of content contribution. An expectation that could require further measurement and discussion.
  • Less common strategies include things like participatory list building with different audiences, reviewing the inclusivity of policies on reliable sources (including things like oral citation), decolonisation approaches and research about content gaps.
  • Grantees are also seeking to decentralise content contribution initiatives, by encouraging more individual/group organiser-led initiatives through micro-grants or by offering logistical support.
  • An interesting challenge that a few grantees are starting to discuss is how to integrate programming to ensure that different content-creation tactics are not silos, but that there are efforts across programmatic areas and sustained through a period of time to be more effective (ie. over a month).

Learning and evaluation:

  • Grantee partners are planning to contribute to Wikipedia stating an estimated goal of 201,000 contents, between improved and created articles. For 67% of grantees, Wikimedia is where most of their content contribution efforts are placed. 53% of grantees aim to contribute to Wikidata with 1.7M contents, and 60% of grantees to Commons with 1.1M contents. Content metrics can not be compared between Wikimedia projects however, it is interesting to note that 97% of content goals are for the content on Wikipedia, Wikimedia Commons, and Wikidata, and only 3% on smaller Wikimedia projects.
  • Grantees metrics are mostly focused on the number of contents per Wikimedia project (89% capture these), even though there is an expressed interest in the quality of the content and what we understand by quality - is how it is used across Wikimedia projects, its readership or value in terms of representing a knowledge gap or injustice? Only 10% are collecting data to analyse content use/quality, 5% disaggregate content targets per knowledge gap.
  • Having clearer definitions and prioritising this data collection would be valuable so that content contributions can be guided by this and contributors can also feel value in their work (a key aspect that can determine continued engagement).
  • Whilst contexts and programmes differ greatly, having content metric benchmarks for different types of strategies and Wikimedia projects would be useful, particularly for new grantees and for Regional Funds Committees in their proposal review. Without acting as a strict parameter, but to give numbers a bit more context, comparative sense, and historical analysis.
  • As with contributor metrics, there are a number of challenges to improve the way these metrics are captured and this is a collective effort. Here is a list of some of the shorter-term issues that can be addressed with better guidance, support, and format adjustments, and medium terms ones that require Foundation and Grantee-wide efforts that we need to start discussing together.
  • It should be a Foundation priority to invest in user-friendly tools to support grantees in this analysis across many editors and content-creation activities. Grantees do not have the time to do this on a more manual basis.
Detailed report

Challenges grants want to address/changes they seek

edit

Wikimedia community-related challenges:

  • Knowledge equity: A common challenge, particularly in ESEAP, SA, LAC, and MEA regions is bringing in content that reflects local languages and culture and contributing greater Knowledge Equity.
  • Another challenge is understanding how contents are valued and used by readers and across Wikimedia projects and tools to measure the quality, accuracy, and representation of content. [4]
edit
  • Address knowledge injustices against marginalised communities. “Communities historically written out of history to participate in writing (and righting) our stories”. [5] This is also related to the idea of “decolonising the internet”, [6] preserving culture and heritage, particularly those that are at risk of being transformed or damaged, and tackling the loss of “minority languages” [7] or World Heritage sites. [8]
  • Addressing global issues through access to better information, as a starting point for individual and collective action, as well as advocacy and policy efforts. This is particularly relevant around topics such as climate change and human rights, both of which have become areas of focus for work in the LAC and MEA regions.

Strategies

edit

Knowledge equity

Priorities in terms of addressing knowledge content gaps:

  • In responding to this challenge 60% of grantees state that improving or creating content is one of their main focuses. The content gaps that grantees want to address as a priority are those relating to gender, geography, and language. Language and geography are very much associated with writing about local culture and history. For the Alliances Fund, the top 3 priorities differ, being Geography, Topics for impact, and culture/ethnic diversity.
  • Regional variations: cultural/ethnic diversity also appear in the top three priorities in LAC, SA, CEE, and MEA. In the MEA region, language diversity is the top issue, with many grantees partners focusing on contributions to smaller language Wikipedias, whilst also contributing to English Wikipedia. “Topics for impact” is more prevalent in the LAC and USCA regions. [9]
  • Sexual diversity is not recognised as one of the main content gap priorities. It is slightly more important for grantees in LAC and USCA regions. [10] Few countries in most regions are focusing on socio-economic issues in terms of addressing content gaps. [11]
  • Despite diversification (with over 70% of grantees working on more than 2 to 3 projects), Wikipedia is still a central focus [12] of content contribution (for 80% of grantees). Smaller language  Wikipedias are seen as keen in the strive for knowledge equity, particularly in the MEA region. Whilst past data has not been aggregated to compare numbers, in grantees’ narratives there seems to be a growing interest in Wikimedia Commons [13] and Wikidata. [14]
  • A surprisingly small group of grantees are working on smaller Wikimedia projects (such as Wiktionary, Wikiquote, Wikisource), mostly newer grantees in underrepresented communities in SA, MEA, and LAC. Whilst they are seen as easier entry points for knowledge equity, there are ongoing challenges related to the use of this content and future Movement-wide investments in these smaller projects.

Knowledge as a service:

Grantees are seeking opportunities, not only to grow and diversity content in line with the Movement Strategy focus on Knowledge Equity, but also to work with partners to position Wikimedia projects as a service for their institutions, and for wider public interests, be it in education, social change, public services, etc.

  • Wikipedia: grantees focused on educational programs are doing awareness-raising around Wikipedia as the world's most open educational resource and a pedagogical tool to help develop media, literacy and information skills. This is complex advocacy work for serval grantees, particularly those working in certain regions where negative views of Wikipedia are widespread in the formal educational sectors. [15]
  • Wikidata: grantees starting to engage with Wikidata see it as a new opportunity to showcase the value of mass open/free information. They are using this to further enhance partnerships with GLAM institutions, particularly libraries. [16]
  • Wikimedia Commons: seen as a growing opportunity for digitising knowledge - particularly with GLAM institutions or professions (such as photographers). Also to diversify the way knowledge is documented and shared - incorporating more audio-visual resources. A key challenge is showing interesting case studies of the value of these images/videos in terms of their usage.
  • Wikisource: is seen as an opportunity to document traditional knowledge (transcripts, oral history) and an entry point for knowledge that is not documented in written form with reliable sources.
  • Smaller projects: Wiktionary and Wikiquote are seen as a way of documenting local languages.

Common strategies:

Campaigns as content mobilisers: around 55% of grantees participate in 1 or more campaigns and contests that operate at a local, regional or global level. They act as important content contribution mobilisers, particularly for newer communities that want a clear way to organise activities around set topics and a determined period of time. Some user groups base most of their work around these campaigns. [17] It also allows organisers to connect to training and support from regional or internationally run campaigns. [18] The most common ones are: For photos: WikiLovesAfrica (mostly in the MEA region, but now with interregional participants such as Haiti), WikiLoves Monuments (the most global involving all regions). [19] For images linked to articles: Wikipedia Wanting Photos (WPWP), [20] WikiLovesFolklore. [21] For Articles: Art + Feminism, WikiForHumanRights, 1Lib1Ref, WikiGap.

Content-building events with training: Edit-a-thons continue to be one of the main tactics used in grantee mobilisation, either within campaigns or within their own programs. However, several grantees have started to question whether the one-off event is really enough to engage newcomers to edit and whether a more phased approach is needed focusing on small actions that can be done over a course of time and linked to more training and support. [22] This is linked to the strategy of mobilising around topics that are of interest to specific communities or professions - such as human rights, climate change, academic research, and scientific knowledge.

Individual organiser-led initiatives: Another form of content mobiliser is encouraging local organisers to lead content-building activities, be it as part of campaigns, as one-off events or more continuous meet-ups. For this, several grants are exploring micro-grants or logistical support for individual organiser-led activities. Aside from being a part of decentralising efforts, it is also seen as a way to encourage more autonomy and skills development in local organisers and to build trust and connection with local editors.

Culture, Heritage, and GLAM partnerships: Given its nature, GLAM is one of the most important programs to mobilise content contribution. 69% of grantees are working in this area with partners to digitalise and upload collections onto Wikimedia projects, particularly Wikimedia Commons and Wikidata. Long-term partnerships seem to evolve when there is more ongoing collaboration through Wikimedia-in-Residence roles, and when digitising, adopting open access and uploading are part of their institutional strategies.  

There are some regional differences in the way GLAM mobilises contents, and this requires different approaches and levels of effort. In MEA and CEE individuals related to institutions may become engaged as a professional development opportunity, bringing in their institutions, often with difficulties in engaged institutional leadership. In LAC content contributions with Wikimedia are seen as an opportunity to engage with issues that are not yet receiving widespread public attention or funding, such as digitalisation, conversation, decolonisation or concepts such as visual literacy. In NWE and USCA, where GLAM digital content partnerships are more consolidated, grants are focused on expanding and finding ways to “institutionalise/or embed'' these processes so that it is financed by and part of the institution’s strategy and a way to enhance their mission, and not dependent on the efforts of engaged individual professionals that are primary drivers, as is so many times the case. [23]

Educational partnerships: 40% of grantees state they are working within formal educational contexts and with educational partners. Teachers and students have also been seen as a focus of  content-creation efforts,  as well as a means of shaping negative perceptions of the use of Wikimedia projects as an open educational resource, as well as its value as a pedagogical tool for developing key media, literacy, and information skills. Reading Wikipedia in the Classroom (RWIC) has been a key program in incentivising work in this area and it is a growing trend amongst grantees. Grantees working within this RWIC are starting to adapt the program to local languages and contextualising resources and training for teachers, [24] as well as others reaching this through their own initiative. [25]

Something to think about: How much content can and should be created through educational programmes? Educational programs are becoming an important platform for large-scale awareness building and skills development that are central to the Free Knowledge Ecosystem. [26] Given that some grantees focused on working with teachers and structures see it as an exciting way to grow in contents and contributors it may be worth digging deeper into this, with some use cases to see if this is the case.

Less common strategies:

Participatory list building: A less common strategy, but one that has started to be more widely discussed by grantees is to work with different audiences (particularly those coming from underrepresented groups) to discover topics of interest and build good lists for contributors to guide and track contributions. [27]

Decolonisation approaches: Some larger affiliates (type C), with the inter-regional scope, are working on content that has been underrepresented with a lens of decolonisation, [28] as a central objective of their content contribution [29] or by working with underrepresented groups such as indigenous communities finding diverse formats to document that knowledge.

Engaging in content research: a few grantees include research within their strategies to define knowledge content gaps [30] or around topics related to reliability and sourcing, with discussions around the inclusivity of reliable sources guidelines. [31]

Learning and evaluation for content contribution

edit

What do grantees learn about their work?

edit
  • How are contents used? What is their value for readers?
  • Deeper understanding of knowledge gaps and audiences related to these / how do we most effectively identify gaps and work with volunteers to bridge them? [32]
  • What is the best way to encourage contributors to maintain and update article contributions, particularly about important and popular topics? [33]
  • Can Wikimedia projects become an important platform for local historical research? [34]

What are they measuring?

edit

An overview

edit
 
The total number of contents contributed in the three main Wikimedia projects grantees contribute to.

Grantees metrics are mostly focused on the number of contents per Wikimedia project, even though there is an expressed interest in the quality of the content or how it is used across Wikimedia projects and the impact this might have. [35] There is a lack of easy tools that can measure content quality and use across several editors and content-creation activities, and it is a priority to invest in movement-wide user-friendly tools for this.

There have been several discussions on the definitions of quality. On one hand, it may mean that the content is reused in Wikimedia projects [36] or has the largest readerships, for others, it is of value in sense of the knowledge gap it addresses. Having clearer definitions and prioritising this data collection would be valuable so that content contributions can be guided by this and contributors can also feel value in their work (a key aspect that can determine continued engagement).

Common metrics included

  • # of new content contributions per Wikimedia project (89% of grantees measure these)
  • 35% disaggregate the type of contribution. For instance, describing what type of image on Commons, or if a contribution on Wikipedia is a minor edit, substantial edit, creating a stub or substantial article, or rewriting an article with an equity lens.
  • 10% are collecting data to analyse content use/quality.
  • 5% disaggregate content targets per knowledge gap, they do so more by program or tactic.

Wikipedia as a primary focus: 80% of grantee partners are planning to contribute to Wikipedia stating an estimated goal of 201,000K contents, between improved and created articles. For 67% of grantees, Wikimedia is where most of their content contribution efforts are placed. 53% of grantees aim to contribute to Wikidata with 1.7M content contributions, [37] and 60% of grantees to Commons with 1.1M file uploads or edits.

Content contribution metrics can not be compared between Wikimedia projects - for instance comparing 1 Wikibook with 1 Wikidata item. However, it is interesting to note that 97% of content goals are for the content on Wikipedia, Wikimedia Commons, and Wikidata, and only 3% on smaller Wikimedia projects.

Diversity of Wikimedia projects

edit
 
Percentage of grantees that intend to contribute to different Wikimedia projects.

As the graph above shows across regions more than 51% of grantees are contributing to between 2 and 3 Wikimedia projects, the majority to Wikipedia, Wikidata, and/or Commons. This is a tendency across all regions and grant sizes.

Only 20% are only contributing to a single project, of these most only contribute to Wikipedia, but there are a few others that contribute only Commons, [38] Wikidata, [39] or smaller projects. [40]

22% of grantees are focused on more than 3 Wikimedia projects, [41] mostly grantees in CEE, MEA and NWE. In the latter case, it is interesting to see larger funds investing in content in these, such as France, Spain, and Israel. There are no projects in the USCA focusing on a variety of smaller Wiki projects.

The MEA region accounts for a majority of  content goals for Wikiquote (77%), and Incubator for new language Wikipedias (89%) and Wikivoyage (86%). CEE accounts for the majority of content on Wikibooks (59%) and Wiktionary (57%). [42]

5% grantee partners that do not have content metrics, given the nature of their work, for instance, Wikimedia Community User Group CEE Spring and Wiki Loves Monuments given that they are international campaign organisers and these metrics are counted by participating countries, or projects focused on training. [43] There are a few cases of projects that have decided to determine their metrics through a more detailed learning and evaluation plan to be developed at the start of their grant. [44]

It is interesting to see a quick overview of how Wikimedia projects and content goals are distributed globally. The darker colours in each map indicate higher content goals.


An important note on aggregating and comparing metrics:

The purpose of aggregating data is not to rank or value grantee’s work based on their level of contribution. It is important to first consider that these metrics should always be contextualised. Grantees with higher funding but a smaller number of participants, editors, or organisers are often making efforts in terms of training or researching and testing new approaches, or bringing in smaller groups from underrepresented communities.

However, aggregate data can perhaps serve as general benchmarks and be useful for grantees to review their targets -  comparing their targets with grantees with similar programs, funding, or contextual dynamics. They can also be helpful for newcomers that often express that they find it hard to set targets when initiating their work.

An in depth view of content contributions in each Wikimedia project

edit

Wikipedia

edit

80% of grantees are planning to contribute to Wikipedia stating an estimated goal of 201,000 contents, between improved and created articles. 36% disaggregate the data, stating whether they will be items improved or created or provide a description of the content. [45]

The following image shows some of the main countries with their intended targets of improving or creating articles on Wikipedia.

Regional and programmatic variations

edit
 
Regional distribution of grantees’ targets for articles created or improved on Wikipedia

Looking at regional averages is not very telling as the content contribution targets vary widely from 50 to 20.000 in some regions.

  • NWE is the region with the highest target, aiming to contribute 75,000 articles created or improved with 37% of all articles improved or created globally. This is largely due to the history of larger chapters (type C grantee partners) with a lot of years of experience contributing content with a wider editor base and able to improve or edit over 10K per year. [46] Those contributing smaller amounts, also emphasise that they are more focused on contents related to knowledge gaps, [47] on contributing to different language Wikipedias [48] or concentrating more efforts on other Wikimedia projects. [49]
  • CEE represents 33% of the global target for content on Wikipedia (with an average of 5.500 per project, but also with a large variation within grantees in the region. A third of these content targets are from Serbia, [50] followed by Ukraine with a specific focus on the gender gap. An interesting innovation to look for is the Alliance Fund in Armenia where young graphic designers will be trained to illustrate the most read Armenian Wikipedia articles, this could be an interesting development in linking different visual content on Wikipedia.
  • USCA represents 8% of the global target for content on Wikipedia. 70% of these are Wiki Education Foundation content contributions. [51] Lower content counts can be explained by other larger grantees focused on addressing the knowledge gap through contributions to other Wikimedia Commons, [52] on finding new approaches to work with academic content or media institutions [53] or in training and strengthening communities and working with a more global scope. [54] What will be important in these cases, is documenting these learnings so they can show their value for the movement and be widely shared with others.
  • MEA represents 8% of the global target for content on Wikipedia. There is less of a variation between grantees, most of them have a target of 50-1500 contents per grant.
    • Many grantees are focused on smaller language Wikipedias such as Igbo, Hausa, Dagbani, Swahili, Twi, and new incubators. Also on the quality of content that documents local language and culture.  
    • Some grantees are focusing more on training or community building [55] or creating new content on other Wikimedia projects. [56]
    • 66% of grantees in this region are working on more than 2 Wikimedia projects, mostly combining Wikipedia, with Wiki Data, Commons, Wiktionary, and Wikiquote, however only 1 grantee is using Wikisource. [57]
    • MEA community members have expressed interest in learning more about Wikisource, particularly for knowledge that has not been documented in commonly used sources and has difficulties in being used in Wikipedia. [58]
  • LAC accounts for 6% of Wikipedia content goals with an average of 1,000 contents per grant. Those contributing above the average are larger grantees (type B and C) such as Argentina, Brazil, and Wikimedia México. [59] Likewise, those contributing less, are with Alliances Funds more focused on awareness or advocacy with important audiences such as journalists, [60] or smaller user groups with smaller content contributions but focusing on addressing content around gender, ecology, [61] and culture or researching new approaches. [62]
  • ESEAP accounts for 8% of content goals on Wikipedia, with Wikimedia Indonesia accounting for 80% of this. The other projects on average contribute 200 contents per grant. Several of the projects are focused on creating new content around topics that have not been represented, [63] but also focusing on working with underrepresented groups. [64] There are also important contributions to Wikimedia Commons with active participation around cultural and heritage contents through campaigns such as Wiki Loves Heritage and Wiki Loves Earth and Alliances Funds OpenStreetMap experimenting with street-level 360-degree quality images linking Wikidata-Commons, Wikipedia, and Wikivoyage. A majority are also contributing to Wikidata.
  • South Asia, represents 1% of Wikipedia content goals in three grants. This is because the largest grant is focused on content contribution to a number of other Wikimedia projects as well as languages [65] another is focused more on researching the value of Wikipedia as a pedagogical tool in Indian-specific contexts. 96% of Wikisource content goals are from these 2 grants in South Asia. [66]

Wikimedia Commons

edit

61% of grantees are planning to contribute to Commons stating an estimated goal of 1.1M contents, between improved and created articles. 80% disaggregate the data, stating whether they will be items improved or created, with a target of 869,000 new file uploads and 51,000 improved files.

Grantee type and regional variations:

edit
 
Regional distribution of grantees’ targets for files uploaded or improved on Wikimedia Commons

The average contribution of those contributing to Commons is 18,000 per grant. However, it is important to see the huge variation within grants, from 20 contents to 500,000.

NWE: Represents 68% of the global contribution target. Within the region, Wikimedia Sverige (Sweden) accounts for 70% of this, largely because of its history and capacity to engage in multiple GLAM partnerships, and as an active batch editors history. [67] This is followed by CEE which aims to contribute 12%, mostly from Ukraine as an organiser of the Wiki Loves Earth campaign.

15% of grantees aim to contribute less than 300 files. They are mostly from smaller organisations (type A) [68] or Alliances Funds partners, [69]that are starting to explore Commons. It also includes projects working on audiovisual content to capture the local culture, such as the Wayuu indigenous community in Colombia/Venezuela.

23 % aim to contribute 350-1,000 files. These mostly type A and B grantees from various regions (except NWE), working mainly on Wikipedia but contributing to Commons through photo competitions.

40% aim to contribute 1-10,000 files. They mostly type B and C grantees, some of whose main focus is Wikimedia Commons, [70] and participate actively in international photo competitions. In this group, interesting innovations to look for are Wikimedia Cameroon, which is contributing 6000 Images and audio file pronunciations for words, and Wikimedia Thailand uploading high-quality 3D models.

22% aim to contribute between 10-500K are all type B and C organisations, mostly from NWE and a few more experienced grantees from MEA, CEE, SA, and LAC regions. [71]

Wikidata    

edit

53% of grantees are planning to contribute to Wikidata stating an estimated goal of 1.7M contents, between improved and created articles. 27% of gratees disaggregate the data, stating whether they will be items improved or created. [72] This means 101,000 data items created and 256,000 improved.

The following graph shows the countries ranked according to their goal of improving or creating articles on Wikidata. This data is shown in comparison to the amount of funding they receive (in pink) and the % of this funding in terms of the global funding (in blue) for the top 15 contributors.

Grantee type and regional variations:

edit
 
Regional distribution of grantees’ targets for data items created or improved on Wikidata

As with the other Wikimedia content contribution the target contribution sizes vary widely per grant, from 30 “items” to over 300K. It is currently difficult to compare data numbers given the different ways of counting contributions. This needs to be standardised to get more comparable data. For instance, some grantees count “the number of links between external identifiers and Wikidata items”, others specify that they are counting the “unique content pages created or improved, not the number of edits to each page”,  whilst others just mention “items created or improved” with no further detail. This may account for the huge variation in data.

All the following analysis has to be considered just an approximation given that many of the numbers may not be comparable.

If we look within the regions, there are few organisations contributing most of the content - for instance in ESEAP it is Wikimedia User Group New Zealand, in CEE Wikimedia Czech Republic, and in NWE, Avoin GLAM, and Wikimedia Netherlands.

The region with the most number of grants contributing to Wikidata is the MEA region (with 15 grants). The MEA region is exploring important partnerships with governmental, educational, and GLAM institutions to open valuable databases that have an important public value. There is an opportunity to document interesting Wikidata case study uses in this context. There is particular interest in connecting databases of public library resources regionally, particularly resources related to regional culture and heritage. There is also an interest in creating or translating items into local languages [73] and experimenting with the use of Wikidata to document local knowledge, such as Igbo endangered dances and linked data to Commons files and Wikipedia articles.

However, the average number of content contributions per grant is lower than in other regions. Particularly because in many cases they are sourcing new data documenting cultural heritage rather than just connecting existing data sets. Lower contributions tend to be in grants focused more on Wikipedia and on Wikimedia Commons, but that are starting to experiment with Wikidata to show its value, for both new and existing editors, but also for partnerships.

Likewise in the ESEAP region is exploring important partnerships with governmental, educational, and GLAM institutions to open valuable databases that have an important public value. [74] There is an opportunity to document interesting Wikidata case study uses in this context. [75]

Types of contributions:

  • There is an increase in the tendency for more grantees to use Wikidata, as a way to link this to Wikipedia and Wikimedia contributions. So it has become a key support structure for other Wikimedia projects.
  • Grantees seek to build capacities to use Wikidata, rather than the number of contributions. For instance, organisations working with Libraries to include Wikidata (ie. the Global-Open Initiative Foundation in Ghana, Wikimedians of United Arab Emirates User Group). Wikidata is seen as an opportunity to open up public library resources, particularly on information about the culture and context.
  • Partnerships are a key aspect of Wikidata, with grantees seeking to build partnerships with governmental, educational, and GLAM institutions to open valuable databases that have an important public value [76]
  • Innovations to look out for: Wikimedia User Group of Aotearoa New Zealand has created a Wikidata Fellowship. Some communities like the Dagbani User Group (Ghana) are focused on describing Wikidata labels in Dagbani. The Analysis & Policy Observatory (Alliances Fund grantee) is using Wikidata to upload information related to organisations and reports focused on First Peoples policies. OpenStreetMap Indonesia intended to work with youth to link Wikidata to Open Street maps to enrich knowledge about historical infrastructure. There is an opportunity to document interesting Wikidata case study uses, particularly with data that includes GLAM partnerships and addresses knowledge gaps – for instance related to gender or geographical diversity.

Other Wikimedia projects    

edit
  • A surprisingly small group of grantees are working on smaller Wikimedia projects (such as Wiktionary, Wikiquote, and Wikisource), mostly newer grantees in underrepresented communities in South Asia, MEA, and LAC. They are seen as easier entry points for knowledge equity because they allow contributors to work with primary sources, such as archival documents, images, and audio-visual material. However, there are ongoing questions about the readership scope of this content and some uncertainty about future Movement-wide investments in these smaller projects.
  • The MEA region accounts for a majority of content goals for Wikiquote (77%), and Incubator for new language Wikipedias (89%) and Wikivoyage (86%). CEE accounts for the majority of content on Wikibooks (59%) and Wiktionary (57%). [77] Despite the interest in WikiSource, there are no current grantees contributing to Wikisource, [78] at least stated in their intended metrics.  
  • In LAC there are just a few smaller grantees working on Incubator, Wikivoyage and Wiktionary. Only Argentina affiliate is working on Wikisource. There are no grants focused on Wikibooks, Wikiversity, or Wikiquote.
  • In South Asia: 96% of global Wikisource content goals are from 2 grants [79] with 22,000 pages proofread. Also investing funds in improving technology for Wikisource through an Android app. There are now current grants contributing to Wikibooks, Wikiquote, Wiktionary, Wikivoyage or Wikiversity.

Challenges and opportunities

edit

Whilst contexts differ greatly it would be useful, particularly for new grantees to have a sense of what can be expected for certain types of tactics and priorities for each Wikimedia Project: for instance, a project that seeks to largely make smaller improvements to bring in newcomer editors, to a program focused more on efforts to create diverse contents in local languages or covering specific gaps. This benchmark in each region is also something that Regional Funds Committees have asked for to support their proposal review, without acting as a strict parameter but to give numbers a bit more context, comparative sense, and capture past experiences.Several newer grantees have also requested this.

There is also room for better supporting grantees during their submission and review process, to make sure that projects that do propose content contribution try to establish goals for these metrics, as it is the case with a few grant proposals.

As with contributor metrics, there are a number of challenges to improve the way these metrics are captured and this is a collective effort. Below is a list of some of the shorter-term issues that can be addressed with better guidance, support, and format adjustments, and medium terms ones that require Foundation and Grantee-wide efforts that we need to start discussing together.

List of things that could be improved
edit
Short term (for next funding round in 2023) Medium term (for fiscal year 22/23)
Project Grantee portal (Fluxx) adjustments Grantee Metric registration and support Collective thinking - Grantees-RFC and Foundations
Wikipedia Provide a space to disaggregate contents per Language Wikipedias, or at least register which languages the project addresses when registering metrics. Work with grantees to make sure they correctly disaggregate their goals per Wikimedia project. About 10% did not do so and 1:1 follow-up was necessary to get clear metrics. Create classifications for types of content contribution to give more value to each effort and not just count the number (ie. from minor edits to rewriting whole articles with an equity lens) [80]
Wikidata Improve unified measurement of how contents are counted.

Standardising the way contributions are counted to make the numbers comparable and also. [81]

Think of ways to also classify contributions based on their value and use.

For instance, distinguish the creation of new dataset from the migration of existing datasets recognising that they are both valuable but imply different levels of effort.

Also, depending on the different ways Wikidata contributions are used by consumers or partners and the value this adds.

Commons Provide a space to disaggregate contents per content type. Better categorisation of types of content to compare the content-creation effort, quality, and potential use.

Support grantees in making sure they describe what types of content they are going to upload or improve, as 20% do not give any descriptions when describing the metric.

Disaggregate commons uploads with some type of “quality” catagorisation. [82]
General Have a space to numerically  disaggregate new or improved contents or types of contents and encourage this where possible (only 30% disaggregate) Grantees not using additional documents for this as the information is not automatically pulled on Fluxx. Start to build regional or programmatic/tactical benchmarks for content metrics. This will also help newcomers write proposals. As a guide, not as a requirement.

Working with international campaign organisers to report  metrics related to the international organising and support, rather than the contents produced by campaigns themselves as these are also counted by participating countries, many also grantee partners.  

Notes

edit
  1. The word Wikipedia appears 186 times when grantees talk about the change they want to bring about, Wikidata appears 54 times, Commons 22 and Wikisource 8.
  2. Seen as an opportunity for digitising knowledge - particularly with GLAM institutions or professions (such as photographers). Also to diversify the way knowledge is shown - incorporating more audio-visual resources. Quick and engaging entry point for newcomers.
  3. As a new opportunity to showcase the value of mass open / free information, particularly with GLAM partnerships.
  4. This is a challenge grantees like Wiki Education Foundation want to address with greater investment in the widely used Program and Events Dashboard.
  5. Art + Feminism
  6. Whose Knowledge?
  7. “One of these languages disappears every 15 days”: UNESCO
  8. For instance, World Heritage sites are endangered and many are lost every year before being documented. There is an opportunity to engage local communities in documenting their own heritage.Wiki World Heritage User Group
  9. This is also a key issue for some countries in other regions such as Nigeria, Wikimedia Community User Group Côte d'Ivoire, Vereniging Wikimedia Nederland (Netherlands), Wikimédia France, and Wikimedia Österreich.
  10. There are a few grants prioritising this in the CEE region (such as Wikimedia Serbia ) and NWE (Wikimedia Österreich  and Vereniging Wikimedia Nederland (Netherlands).
  11. Wikimedia Ireland, Colombia, Brazil, United States, Canada, North Macedonia, Uganda, Taiwan.
  12. The word Wikipedia appears 186 times when grantees talk about the change they want to bring about, Wikidata appears 54 times, Commons 22 and Wikisource 8.
  13. Seen as an opportunity for digitising knowledge - particularly with GLAM institutions or professions (such as photographers). Also to diversify the way knowledge is shown - incorporating more audio-visual resources.
  14. As a new opportunity to showcase the value of mass open / free meta data or Linked Open Data (LOPD), particularly with GLAM partnerships.
  15. This is repeatedly highlighted in the LAC and CEE regions, but is an issue faced by grantees across regions.
  16. Wikidata is seen as having the potential to make information about public library resources more visible, as well as connecting library resources, and perhaps information systems on a regional scale.
  17. Wikimedia Community User Group Rwanda and Wikimedia Community Malta are two examples.
  18. Click here for a list of other popular campaigns.
  19. Associação Wikimedia Portugal, Uganda, Brazil, Nigeria, Wikimedia Suomi ry (Finland),  Wikimedia Österreich, Wikimedia Community Malta, Wikimedia Sverige (Sweden), Rwanda, India, Ghana, Italy and Wikimedia Ireland.
  20. Most popular with MEA region grantees (Wiki in Africa, UAE, Wikimedia Community User Group Côte d'Ivoire,  Nigeria, Guinea, Wikimedia Community User Group Rwanda), an Alliance Fund grantees like Hack Hackers (United States), and two other grantees from other regions: Wikimedia Community Malta (NWE), Taiwan (ESEAP)
  21. Malta, Wikimedia Community User Group Haïti, Wikimedia Community User Group Rwanda, Tanzania, Ghana, Wikimedians of Republic of Srpska (Bosnia and Herzegovina)
  22. Asociación Civil Wikimedia Argentina and Wikimedistas de Uruguay
  23. There are good examples of this such as in Wales and the United States with the Metropolitan Museum.
  24. Wikimedia MA User Group (Morocco), Nigeria, Wikimedia México, Tanzania, Guinea, and Ghana in addition to Bolivia. Asociación Civil El Faro Digital and alliances fund in Argentina with the aim of co-creating training courses in MIL skills in rural contexts. Wikimedia Colombia is working with the Ministry of Education to adapt the RWIC and pilot access to Wikimedia projects through offline solutions(Kiwix + Red Local Kimera).
  25. Example of a project  in India to do research on the effectiveness of Wikipedia as a platform of learning adapted to the local context.
  26. Reading Wikipedia in the Classroom has laid emphasis on this as the principal outcome.
  27. For instance in a Brazil grant that developed from a rapid fund, “The Theory of History” contents lists will be built in a participatory fashion between the different labs and scientific societies. Another good example to look out for is the United Arab Emirates User Group is developing a research fund for groups to research specific subject areas such as Art, Calligraphy, History, Tourism, and Science To develop a strong database in Arabic and English for volunteers to prioritise Wikipedia articles.
  28. Vereniging Wikimedia Nederland (Netherlands) in the Caribbean and Asociación Civil Wikimedia Argentina in their GLAM work.
  29. Whose Knowledge?, AfroCROWD, Black Lunch Table , Art + Feminism, Wiki Education Foundation
  30. Whose Knowledge?,  which is partnering with other organisations to “State of the Internet’s Languages” (STIL) Report, and Wikimedians of the United Arab Emirates User Group that are investing funds in research groups to better understand topics of impact related-to knowledge gaps related to Arabic culture
  31. Hacks Hackers (based in the United States) but with participation of participants globally.
  32. Wikimedistas de Uruguay, Wikimedia Ukraine (Вікімедіа Україна)
  33. Wikimedia Ukraine (Вікімедіа Україна)
  34. Department of History, National Cheng Kung University(Alliances Fund in Taiwan)
  35. Wikimedia Belgium v.z.w established a goal of 20% of images related to heritage used in Wikipedia projects. Wikimedia UK  has also included this analysis by measuring the number of views of images and articles released/created directly through their programmes to have an understanding of Wikimedia UK's reach, setting a  target for articles (123 million) and images (5 billion).
  36. For instance a high quality image on Commons, linked to structured data on Wikidata, used in an article on Wikipedia)
  37. There is a need to clearly define and classify these types of contributions, ie. items are created, or just labels are translated for existing items, or if Wikipedia pages or Commons files are linked to Wikidata items or two Wikidata items are linked to each other, etc.
  38. Whose Knowledge? and Wikimedia Thailand
  39. Canadian Arts Presenting Association
  40. Wiki Kouman (Wiktionary), WikiJournal (Wikiversity)
  41. CEE region (where they are complimenting the main Wikimedia projects with Wiki Source, Voyage, Wikiquotes, and Wiki Books) in the MEA region (with Source, Books, and Incubator of new language Wikipedias) and NWE with Wiktionary and Wikisource).
  42. Mostly because of Wikimedia Serbia (Викимедија Србије)
  43. Open Environmental Data Inc, Asociación Civil El Faro Digital, Art + Feminism, Shin Leh Yuan Art Space, Wikimedia Community User Group Guinée Conakry
  44. Art + Feminism
  45. Of those that disaggregate, they hope to create 6.7K articles and improve 34K.
  46. Such as Wikimedia UK, Wikimedia Sverige, and Wikimedia Österreich  (Austria) contributing over 10K to articles improved or created.
  47. Wikimedia España (Spain) and Wikimedia Ireland
  48. For example, Wikimedia Israel contributing to Hebrew and Arabic
  49. For example, Wikimedia Suomi ry (Finland) and Associação Wikimedia Portugal with Wikidata.
  50. Wikimedia Serbia  is focused on improving Wikimedia articles with photos.
  51. Wiki Education Foundation also accounts for 20% of the funding in the USCA region.
  52. Whose Knowledge?
  53. WikiJournal and Hacks Hackers.
  54. Art+Feminism, Open Environmental Data (Alliances Fund)
  55. Media in Cooperation and Transition (MICT) Tunisie
  56. For example, Wiki in Africa with Commons and Wikiquote and Wiki Kouman with Wikiquote.
  57. Wikimedians of the United Arab Emirates User Group are working on Wikisource.  There may be an opportunity to expand this based on the learning and other interesting cases of using Wikisource to document oral and written histories.
  58. This was expressed in the recent Libraries and Wikimedia Convention many participants, particularly from the MEA region, expressed interest and lack of knowledge on the potential use of Wikisource to address this knowledge equity challenge.
  59. The two largest grantees, Asociación Civil Wikimedia Argentina and Brazil,  are also focused on producing content on Wikimedia Commons, the former is the only grantee that reported goals for Wikisource. Only Wikimedia Community User Group Haïti and a grant project in Colombia/Venezuela working with the Wayuu indigenous community are focusing on smaller Wiki Medias such as Wiktionary and Incubator.
  60. Red de Periodistas Sociales - Periodistas a Pie Asociación Civi
  61. WikiAcción Perú
  62. Wikimedistas de Uruguay and Wikimedia Chile
  63. For instance, the alliances fund in Taiwan with the Department of History, National Cheng Kung University working to represent rural medical histories and also contributing data to Wikidata and content to Wikiquote, Wikimedia Community User Group Malaysia, and Wikimedia Australia and New Zealand around contents related to First Nations.
  64. Such as First Nationals People in Australia, to develop a set of First Nations protocols for discussion and begin to explore opportunities to improve cultural safety of content on Wikimedia platforms. As the user group recognises, this will require” time and resources to ensure we achieve a suitable outcome based on engagement and consultation across the community”.
  65. The Centre for Internet and Society (CIS-A2K) grant is focused on content in Indian languages and Wikidata, also to Wiki Commons and Wikisource contributions.
  66. West Bengal Wikimedians User Group and The Centre for Internet and Society (CIS-A2K).
  67. Wikimedia Sverige (Sweden) has a goal to contribute 500K files to Commons and also includes improvements to the content uploaded.
  68. For example WikiAcción Perú, Wikimedia Community User Group Haïti.
  69. OpenStreetMap Taiwan (Alliances Fund) and Productions Rhizome in Canada.
  70. Such as Whose Knowledge? which has a specific target of ⅓ of content about underrepresented women in the Global South.
  71. Asociación Civil Wikimedia Argentina, Grupo de usuários Wiki Movimento Brasil, The Centre for Internet and Society (CIS-A2K), Wikimedia Ukraine (Вікімедіа Україна) and Serbia, Wiki in Africa and Wikimedia Nigeria Foundation.
  72. Of those that disaggregate, they hope to create 107K items and improve 256k.
  73. Dagbani Wikimedians User Group is aiming to describe Lexemes and Wikidata labels in Dagbani, as is the Cameroon UG.
  74. In ESEAP region: the Analysis & Policy Observatory (Alliances Fund grantee) is using Wikidata to upload information related to organisations and reports focused on First Peoples policies. In other regions: Wikimedia Sweden and Wikimedia Czech Republic is an interesting case of partnerships for Wikidata contributions, the former with international NGOs and linked to gender gap).
  75. Through the Alliances Fund, Shin Lei Yuan Art Space will be conducting a needs assessment with leading alternative Art Spaces in Taiwan on using wikidata and wikibase for their archival needs and establishing an interest group on Wikibase as part of Wikimedia Taiwan community.
  76. Wikimedia Sverige (Sweden) and Wikimedia Česká republika is an interesting case of partnerships for Wikidata contributions, the former with international NGOs and linked to gender gap).
  77. Mostly because of Wikimedia Serbia  (Викимедија Србије)
  78. 1 grantee in Colombia (Wayuu community) will be working with Wiktionary and Incubator, Wikimedia Argentina is the only grantee aiming to contribute to Wikisource and a grant in Venezuela is piloting with content contribution on Wikivoyage. Wiki Small projects (Venezuela) is focused on piloting a content contribution on Wikivoyage.
  79. West Bengal UG: 12000 Number of pages proofread in 4 proofreading competitions on Bengali Wikisource. CIS-2K: 550: Number of books relicensed + Number of books scanned and uploaded on Wikimedia Commons. 10,000: Total number of pages proofread in the proofread-a-thon events.
  80. Such as making it gender inclusive, rewriting articles with a decolonising framework, etc
  81. Differentiate between things like the number of links between external identifiers and Wikidata items, unique content pages created or improved, or edits to items.
  82. Today's full training manual can be counted the same as a picture of a training activity or a featured photo. All being important contributions, but with very different efforts and future uses for communities or other Wikimedia content.