Long term impact of Wikimedians in Residence (2018)/additional info

Methods of evaluation

In preparation, we brainstormed our planned approach and interview questions with the Learning and Evaluation team at the Wikimedia Foundation. This was followed by desk research including a review of past documentation such as partnership agreements, final residency reports and exit interviews. The heart of the evaluation project were structured interviews with host organisations to explore their reflections on impact and its barriers/enablers (full interview questionnaire in appendix). We approached 11 institutions and secured interviews with six (in some cases with multiple people, resulting in 10 separate interviews).

These interviews were supplemented by discussions with past and current Wikimedians in Residence, including during a summit gathering in mid-2017. The writing process was supported by an independent consultant to lend an external perspective.

This research also referred back to the 2014 programme review to see how changes to delivery introduced at that point influenced the impact we achieved over the following three years.

Further content - WIR reports and materials

• 2014 programme review https://wikimedia.org.uk/wiki/Wikimedian_in_Residence_2014_review
• For extensive summary of outputs, outcomes and earlier learning about impact refer to the 2014 reserach: https://wikimedia.org.uk/wiki/Wikimedian_in_Residence_2014_review#Project_delivery_-_overview_of_the_residencies
• Current and past residencies, links to project portals and individual summary reports https://wikimedia.org.uk/wiki/Cultural_partnerships#Wikimedians_in_Residence
• Template WIR partnership agreement https://wikimedia.org.uk/wiki/File:Example_WiR_agreement.pdf
• Example monthly report from a Resident, with activities mapped to WMUK’s strategic goals https://en.wikipedia.org/wiki/Wikipedia:GLAM/Oxford/Month_9_report
• WMUK strategic framework https://wikimedia.org.uk/wiki/Wikimedia_UK_Strategy_2016%E2%80%9319#Strategic_Framework

Long term impact interview questions

1. From today’s perspective, what were the benefits of having a Wikimedian in Residence programme in your organisation?
2. From today’s perspective, what is the biggest change that the residency introduced to the organisation during the project?
   1. If no change took place, why do you think that is?
3. Since the end of the residency, how has your organisation’s engagement with the areas below changed? (on a matrix, column with the list below, row with: start/increase / no change / decrease / stop)
   1. awareness of open knowledge among staff
   2. understanding of open knowledge, including Wikimedia
   3. participation in open knowledge initiatives (e.g. uploads of freely licensed media)
   4. changing focus of programmes towards open knowledge
   5. dedicating staff time for open knowledge projects
   6. leading/collaborating on open knowledge initiatives with other organisations
   7. implementing internal policies and procedures supporting open knowledge implementation
   8. advocating for open knowledge externally, e.g. within your sector
   9. None at all
   10. Box for comments
   11. (if yes to policies) What kinds of policies or procedures?
   12. (if yes) Are those still being used today? Why or Why not?
4. What aspects/outputs of the residency contributed to the implementation/adoption of these changes?
5. If you didn’t start or increase your engagement with the areas above, to what would you attribute the reason? (barriers)
6. Does the organisation currently run activities that were introduced by the residency?
7. What tactics did you use to ensure a sustainable collaboration with Wikimedia?
8. Has the residency resulted in unexpected outcomes/impact? What were they?