Wikimédia France/Indicateurs (Metrics)/2018-2019

Impact&Metrics
Impact&Metrics
Courriel	remy.gerbetwikimedia.fr
Référent·es	Rémy Gerbet WMFr
Sous-pages
	Indicateurs (Métrics 2018-2019) ; Indicateurs (Métrics 2019-2020) ; Outils

Impacts et indicateurs

Pour l'année 2018 - 2019, en matière d'évaluation, sont mis en place trois indicateurs communs à tous les chapitres et définis par la Fondation, et des indicateurs définis par chaque chapitre.

Indicateurs partagés

Les trois indicateurs partagés par tous les chapitres (shared metrics) sont :

nombre de participants à une action (un participant n'est pas un organisateur) ;
nombre de nouveaux comptes utilisateurs créés (jusqu'à 2 semaines avant l'action) ;
nombre de médias, articles, entrées.. créés et/ou améliorés sur l'ensemble des projets Wikimédia

Indicateurs Wikimédia France spécifiques :

Les deux indicateurs définis par l'association (grantee-defined measures) sont :

nombre d'heures bénévoles ;
satisfaction des partenaires (évaluée une fois par an à l'aide d'un questionnaire)

Indicateurs Wikimédia France spécifiques par action

D'autres indicateurs permettant de mesurer l'impact des actions menées ont été définies par thématique et action (liste non-exhaustive) :

nombre d’actions visant à réduire le faussé des genres sur les projets Wikimedia soutenues par WMFr
nombre de partenaires linguistiques impliqués
nombre d’actions organisées à l’initiative d’un groupe local
nombre de fois que l’espace contributeur est utilisé.
nombre d’accréditations accordées lors d'un évènement international
nombre de photos réutilisées dans le cadre des concours photo
nombre d’établissements scolaires qui mènent une action utilisant les projets Wikimédia

Page de travail recensant les indicateurs utilisés par Wikimedia France qui servira également à rassembler les métrics pour le process FDC

Progress Report 2018-2019

Axe 1: Partnerships and Content improvement

Axe 1: Partnerships and Content improvement
Metrics	2018/19 Target	Progress (at end of Q2)	Projected (end of year)	Explanation
Participants	8,075	1,083	Opportunity for improvement	The delay accumulated on certain projects and in particular in terms of communication has impacted the participation of the general public (Ma Commune Wikipedia, Lingua Libre). We expect to make up most of this delay in the next 6 months with concrete actions in this direction.
Newly registered editors	500	322	On track	We plan to reach our goal by creating new accounts via the Lingua Libre project but also by GLAM activities already planned.
Pages added/improved	94,600	84,911	On track	We should reach and exceed the intended goal because some content-providing actions have not yet been realized. In the same way, Lingua Libre workshops should still produce tens of thousands of contents.
Volunteer hours	1,745	1,092	On track	We have included participation in working meetings, activities carried out within GLAM partner organisations and the time required for a photo competition jury.
Partners satisfaction	85%	To be evaluated in June 2019	On track	This result will be collected by means of an annual survey sent out to all partners having supported a contribution-related activity during the year.
Images/media added to Commons	90,600	84,911	On track	As explained above, we should exceed our goal. Even if the number of partnerships has not substantially increased, the number of contributions belonging to GLAM projects on Wikimedia commons has exceeded our expectations.
% uploaded media used in content pages	50%	50.5%	Achieved	Among the GLAM activities, the photo competitions, Lingua Libre and Ma Commune Wikipedia, we have set a target of 50% of files reused in other Wikimedia projects. This figure is based on an average between the reuse rates of these different projects
Leading volunteers (WLM+WLE)	11	14	Achieved	Here, we take account of people involved in the organisation of the competition, the selection of photos and participation in the jury’s decisions. We managed to mobilize new people in the organization of competitions
Numbers of page views of Lingua Libre	2,000/days	135/days (32500/6 month)	On track	We have modified this indicator to take into account the number of pages viewed on Lingua Libre, which seems to us, all the same, indicative of the traffic generated by the site. The number of visitors required the setting up of an ethically problematic tracking system.
Numbers of recording session with Lingua Libre	10	4	On track	Wikimédia France has committed to organising 10 recording workshops in various languages on its premises.
Number of photo accreditation granted	10	3	On track	Some shows and public event are coming
Leading GLAM partners of WMFr	5	3	On track	We currently have three partners involved as ambassadors for the movement. We would like to see two other partners take on this role thanks to the organisation of a GLAM meeting conférence.
Contributing activities organized within a GLAM partnership	24	23	Achieved	We have already achieved this goal and should therefore exceed it.

Axe 2: Working with communities

Axe 2. Working with Communities
Indicator	2018/19 Target	Progress (at end of Q2)	Projected (end of year)	Comments
Participants	700	356	On track	The photographic competition devoted to Overseas France and Wikiconvention francophone 2018 are the two main actions that brought the most participation.
Newly registered editors	330	70	On track	The delays in the minority languages program and the difficulty of measuring the activities of local groups will certainly not allow us to achieve the expected objective. On the other hand, actions such as the Wiki4women or the month of the francophone contribution that will take place in March 2019 attract new contributors.
Pages added/improved	15,000	1,051	Attention required	The decision taken by Wikimedia France to stop its partnership with Signes de Sens deprives us of a gift of 10,000 videos in French sign languages which will not allow us to achieve our goal.
Volunteer hours	1,950	1,020	On track	The organization of the Wikiconvention francophone 2018, the jury of the photo competition dedicated to Overseas, contribution activities related to gender gap but also the involvement of the members of the micro-financing commission are the main activities requiring time volunteer.
Partners satisfaction	85%	To be evaluated in June 2019	On track	This result will be obtained by means of an annual survey sent out to all partners having supported at least one contribution-related activity during the year.
Contribution activities to reduce the gender gap on Wikimedia projects	25	11	On track	The Wikisource contribution workshops organized at Wikimedia France or the workshops conducted by the Sans Pages in Paris and Marseille bring new dynamics of beneficial contribution to the association.
Number of contributors involved in the Languages of France project	10	10	On track	The working group around the languages of France is dynamic and voluntary for new projects. We lack a direction of development because the group can not engage with the sixty linguistic communities existing in France. There is a real need for prioritization.
numbers of local leading volunteer organizers	35	20	On track	We currently have 20 leading volunteers in France, they organize, coordinate or run a large part of the contribution activities in France. These volunteers will be meeting in 2019 in Paris to discuss with them the relationship between the chapter and local groups.
Numbers of events organized by local groups	100	71	On track	We count all the activities listed in the agenda of Wikimedia France. We incorporate activities in the main objective is not necessarily the contribution but participates in the consistency of groups and the reception of potential new members.
Numbers of volunteers granted	60	25	On track	The enlargement of the micro-financing commission has allowed us to improve transparency on the use of the funds of the association. We note, however, that some volunteers are reluctant to use the microfinance commission or ignore its existence. We need to improve this for the next six months while creating a real reporting system.
Contribution activities organized into Cléry contributor space	30	21	On track	The contributor area of Wikimedia France is occupied very regularly for contribution activities (Archeotopia, Wikisource, the Sans Pages ...). This is a real asset for the community that has seized this space to organize both convivial and contributory events but has also brought the salaried team closer to the volunteers.
Number of document package requested	60	20	On track	The month of francophone contribution is a moment of strong demand. In addition, some local groups participate in forums in the period from January to June and request documentation at that time.
Percentage of contributors claiming to have been supported by Wikimédia France	55%	To be evaluated in June 2019	On track	During the survey carried on February 2018, of the 172 respondents 43.9% stated that they received support from Wikimedia France. We would like to increase this figure to 55% in 2018-2019.

Axe 3: Education et Formation

Axe 3. Education and Training
Metric	2018/19 Target	Progress (at end of Q2)	Projected (end of year)	Explanation
Participants	5,300	2,438	On track	This number includes WikiMOOC subscribers until December 31, 2018. The MOOC currently counts 8 registrations per day which allows us to project a figure for the next 6 months. We did not count participants in the Wikiconcours high school student.
Newly registered editors	1,350	200	On track	We have included WikiMOOC participants who have created an account on Wikipedia and plan to exceed the target set due to the large number of Wikiconcours high school students.
Pages added/improved	21,500	4,805	On track	We expect to achieve the goal in view of the expected contributions in the WikiMOOC and Wikiconcours high school student.
Volunteer hours	460	194	On track	Via the Wikiconcours which should see its number of registered participants increase and a MOOC which will not require new filming, the number of volunteer hours reflects the long-term involvement linked to support for teachers’ educational projects.
Partners satisfaction	85%	to be evaluated in June 2019	On track	This result will be collected by means of an annual survey sent out to partners having supported at least one contribution-related activity during the year.
Numbers of educational establishment using Wikipedia in a educational project	70	73	Achieved	As part of the Wikiconcours high school student, 70 institutions are registered and lead a teaching project with Wikipedia. 3 other institutions are also conducting a pedagogical project. We are in conversation with 2 other institutions that should integrate a project in the next 6 months.
Numbers of volunteers involved into Wikiconcours	10	To be evaluated in June 2019	On track	We would like to get non-member contributors more involved, in the same way as Wiki Loves Monuments and the checkers.
Numbers of diploma courses integrating the contribution to Wikimedia projects	5	3	On track	Calculating the integration of contributions to Wikimedia projects in diploma courses is a relevant indicator regarding the efforts made by the association.
Numbers of consultation of the educational kit	4,800	3,000	On track	The number of visits has increased significantly from 3,000 visits per year to 3,000 visits every 6 months.
Numbers of participants having completed the Wikimooc 3	400	To be evaluated in June 2019	On track	Based on data from the previous years, but in view of the new format chosen this year, we hope to reach this goal.
Numbers of new editors still editing Wikimedia project a year after completed the Wikimooc	40	to be evaluated in June 2019	On track	Based on data from the previous years, we believe that 40 people will continue contributing a year after the MOOC ends, i.e.10%
Percentage of volunteers expressing an increased level of skills	75%	to be evaluated in June 2019	On track	A survey will be sent out to volunteers having completed a training course run by Wikimedia France. We estimate that three quarters of the participants will declare that they have acquired new skills during the year.

Impact report 2018-2019

Axe 1

Axe 1: Partnerships and Content improvement
Metrics	2018/19 Target	Progress (at end of Q2)	Impact report (end of year)	Explanation
Participants	8,075	1,083	1346	We stopped working on Ma Commune Wikipedia and Lingua Libre has seen significant improvements. A major communication campaign will be initiated around Lingua Libre in early 2020.
Newly registered editors	500	322	543	We reached our goal by creating new accounts via the Lingua Libre project but also by GLAM activities already planned.
Pages added/improved	94,600	84,911	195518	The goal has been exceeded, especially because of Lingua Libre which generated more than 100,000 new audio files in the space of 6 months.
Volunteer hours	1,745	1,092	1758	We have included participation in working meetings, activities carried out within GLAM partner organisations and the time required for a photo competition jury.
Partners satisfaction	85%	To be evaluated in June 2019	83%	This result comes from an annual survey sent out to all partners having supported a contribution-related activity during the year.
Images/media added to Commons	90,600	84,911	185232	As explained above, we should exceed our goal. Even if the number of partnerships has not substantially increased, the number of contributions belonging to GLAM projects on Wikimedia commons has exceeded our expectations.Lingua Libre is particularly responsible for this result
% uploaded media used in content pages	50%	50.5%	58%	Among the GLAM activities, the photo competitions, Lingua Libre and Ma Commune Wikipedia, we have set a target of 50% of files reused in other Wikimedia projects. This figure is based on an average between the reuse rates of these different projects
Leading volunteers (WLM+WLE)	11	14	24	Here, we take account of people involved in the organisation of the competition, the selection of photos and participation in the jury’s decisions. We managed to mobilize new people in the organization of competitions
Numbers of recording session with Lingua Libre	10	4	10	Wikimédia France has committed to organising 10 recording workshops in various languages on its premises.
Number of photo accreditation granted	10	3	7
Leading GLAM partners of WMFr	5	3	3	We currently have three partners involved as ambassadors for the movement. We would like to see two other partners take on this role thanks to the organisation of a GLAM meeting conférence.
Contributing activities organized within a GLAM partnership	24	23	55	We have already achieved this goal in January but other actions carried out during the period lead us to far exceed our forecasts.

Axe 2

Axe 2. Working with Communities
Indicator	2018/19 Target	Progress (at end of Q2)	Impact (end of year)	Comments
Participants	700	356	1.069	The photographic competition devoted to Overseas France and Wikiconvention francophone 2018 are the two main actions that brought the most participation.
Newly registered editors	330	70	247	The delays in the minority languages program and the difficulty of measuring the activities of local groups will certainly not allow us to achieve the expected objective. On the other hand, actions such as the Wiki4women or the month of the francophone contribution that will take place in March 2019 attract new contributors.
Pages added/improved	15,000	1,051	3.415	The decision taken by Wikimedia France to stop its partnership with Signes de Sens deprives us of a gift of 10,000 videos in French sign languages which not allow us to achieve our goal.
Volunteer hours	1,950	1,020	3273	The organization of the Wikiconvention francophone 2018, the jury of the photo competition dedicated to Overseas, contribution activities related to gender gap but also the involvement of the members of the micro-financing commission are the main activities requiring time volunteer.
Partners satisfaction	85%	To be evaluated in June 2019	83%	This result comes from our annual survey sent out to all partners have supported at least one contribution-related activity during the year.
Contribution activities to reduce the gender gap on Wikimedia projects	25	11	43	The Wikisource contribution workshops organized at Wikimedia France or the workshops conducted by the Sans Pages in Paris and Marseille bring new dynamics of a beneficial contribution to the association.
Number of contributors involved in the Languages of France project	10	10	10	The working group around the languages of France is dynamic and voluntary for new projects. We lack a direction of development because the group can not engage with the sixty linguistic communities existing in France. There is a real need for prioritization.
numbers of local leading volunteer organizers	35	20	25	We currently have 25 leading volunteers in France, they organize, coordinate or run a large part of the contribution activities in France. These volunteers have met in 2019 in Paris to discuss with them the relationship between the chapter and local groups.
Numbers of events organized by local groups	100	71	134	We count all the activities listed in the agenda of Wikimedia France. We incorporate activities in the main objective is not necessarily the contribution but participates in the consistency of groups and the reception of potential new members.
Numbers of volunteers granted	60	25	86	The enlargement of the micro-financing commission has allowed us to improve transparency on the use of the funds of the association. We note, however, that some volunteers are reluctant to use the microfinance commission or ignore its existence. We don't succeed yet to create a clear reporting system but we are working on it.
Contribution activities organized into Cléry contributor space	30	21	33	The contributor area of Wikimedia France is occupied very regularly for contribution activities (Archeotopia, Wikisource, the Sans Pages ...). This is a real asset for the community that has seized this space to organize both convivial and contributory events but has also brought the salaried team closer to the volunteers.
Number of document package requested	60	20	40
Percentage of contributors claiming to have been supported by Wikimédia France	55%	To be evaluated in June 2019	40.2%	We have not been able to increase this percentage this year, and this is partly unaccounted for on the date used to send this form (July 2019) and the few answers received to the questionnaire about 70 or 100 less than the last year

Axe 3

Axe 3. Education and Training
Metric	2018/19 Target	Progress (at end of Q2)	Impact (end of year)	Explanation
Participants	5,300	2,438	5350	This number includes all WikiMOOC participants and the participants into the Wikiconcours high school student.
Newly registered editors	1,350	200	1077	We have included WikiMOOC participants who have created an account on Wikipedia and students who have been engaged in the Wikiconcours in high school
Pages added/improved	21,500	4,805	23,328
Volunteer hours	460	194	575	Volunteers participated by correcting and annotating students' productions and also by offering advice to WikiMOOC participants
Partners satisfaction	85%	to be evaluated in June 2019	83%	This result comes from the annual survey sent out to partners having supported at least one contribution-related activity during the year.
Numbers of educational establishment using Wikipedia in an educational project	70	73	73	As part of the Wikiconcours high school student, 70 institutions led a teaching project with Wikipedia. 3 other institutions have conducted a pedagogical project.
Numbers of volunteers involved into Wikiconcours	10	To be evaluated in June 2019	8	We
Numbers of diploma courses integrating the contribution to Wikimedia projects	5	3	3	Despite the opportunities and ongoing issues, there have been no new trainings initiated this year. Several projects are awaiting validation by the academies.
Numbers of consultation of the educational kit	4,800	3,000	5569	The number of visits has increased significantly from 3,000 visits per year to 3,000 visits every 6 months. This demonstrates the need for teachers to be accompanied
Numbers of participants having completed the Wikimooc 3	400	To be evaluated in June 2019	467	This is a very good result compared to the other MOOCs hosted by the FUN platform
Numbers of new editors still editing Wikimedia project a year after completing the Wikimooc	40	to be evaluated in June 2019	not evaluated yet
Percentage of volunteers expressing an increased level of skills	75%	to be evaluated in June 2019	not evaluated yet	A survey will be sent out to volunteers having completed a training course run by Wikimedia France.