Wikimedia Meta-Wiki

Learning and Evaluation/Evaluation reports/2015/Other Photo Events/Outputs

< Learning and Evaluation | Evaluation reports | 2015 | Other Photo Events
(Redirected from Grants:Evaluation/Evaluation reports/2015/Other Photo Events/Outputs)
Other Photo Events


What does a typical Photo Event produce in terms of on-wiki content?

We examined how many participants contributed to each program implementation, how many of those participants were new users, existing users, and active users, as well as used this output along with budget to learn examine the dollar cost for each participant.

Read this page to learn about the amount of on-wiki content you might expect and costs that have been associated


ViolaTricr812856149

Participation

edit

Event Length
edit

The majority (78%) of the photo events examined were held over 30 or more days.


Due to the variety of event styles, the length of reported events varied widely. The shortest event lasted two days and the longest lasted 371 days. As illustrated in the graph below, out of 83 events for which we have dates, most events (59%) lasted longer than 30 days.[1]

Graph: Event Length
Most events lasted longer than 30 days.

Participation[2]
edit

The number of participants in photo events was wide ranging; the typical 2013 or 2014 event had fewer than five participants (63% of events); still, the report captured a total of 4,220 event participants, 65% of which were were new users.

Participant counts were obtained for 94 of the events (91%). [3] The number of participants in each contest or event ranged from 1 to 921, with median average of only two participants [4] Of the total participant base (4,220 users), 2741 (65%) were newly registered (see graph below).

Events with fewer participants tended to have more existing and existing active users, while events with more participants tended to have more new users.[5]

Cost per Participant
edit

The photo events captured in this report generated an average of 92 media uploads at costs ranging from $0 up to nearly $900 USD per participant and from $0 to $56 USD per image uploaded with a total of 126,544 media uploaded through the events captured in this report.

With budgets reported for 11 of the events (10%) for which we also had participant data we were able to calculate the cost per participant for each event.[6] Costs ranged widely from large events and small with the most typical cost per participant being zero USD. Still, events cost up to $874.61 per participant in one case,[7][8] while costs more typically ranged from $2.84 to $28.72 USD. The box and whisker plots illustrate the cost per participant. The chart below shows the cost per participant for two groups: all 18 events and only those four events that reported budgets of more than $0.00 USD.

Graph: Cost per participant.

This boxplot displays the distribution of the cost per participant for the 18 events reporting budget, as well as separately for the four which reported non-zero budgets.

As the box plots illustrate, typically the photo events had little financial investment, when budgets were reported costs ranged from $1.12 to $874.61 USD per participant and averaged just under $100 USD.


Notes
  1. ↑ ’’Median’’=32; Mean=70.61; SD=88.
  2. ↑ Where participant counts were not reported, the count of users that contributed to the Commons category associated with the contest was used as proxy.
  3. ↑ Program leaders had reported participation for 34 events and we mined on-wiki data to produce counts for 60 more. Specifically, where the number of participants was not reported, we replaced the count of people that contributed to the event’s category on Commons during the event period.
  4. ↑ Mean= 45; SD= 140
  5. ↑ Proportion of new users to number of participants: Correlation coefficient=0.69; Proportion of existing editors to participants: Correlation coefficient=-0.47; Proportion of rolling active users to participants: Correlation coefficient=-0.45
  6. ↑ These cost per participant statistics exclude one event that reported budget and participants, because the budget included expenses for international coordination of a variety of events.
  7. ↑ The event that spent $874.61 sent Wikimedians to the Paralympic Games in Sochi in 2014.
  8. ↑ Median=$0.00 USD; Mean=$64.93 USD; SD=$198.50 USD

Content Production and Use [1]

edit
The average number of media uploaded to Commons by the reported photo events was just under 100. The number of media placed in Wikimedia articles per event was, on average, 26.

Upload counts were available for 95 photo events (92%). A total of 126,544 images were uploaded to Commons during the 103 events. Of those images, 12,187 (10%) had already been used on Wikimedia project pages by February 2015 when use was assessed. The number of media added per event ranged from 2 to 23,002. The average number of media added per event was 92.[2]

Budget & Content Created
edit

While some larger events with sizeable budgets delivered more media uploaded, the average photo event reported no budget and demonstrates a lot of small-scale, low-resource program events that combine for collective impact.

The graphic below crosses data about event participation, budget, and number of media uploaded. While programs with more participants and more media uploaded tended to have higher budgets, the 15 events with $0.00 USD budgets offer examples of how small-scale, low-cost programs can be impactful and how they can be applied in different contexts.

Graph: Cost per media uploaded.

This bubble chart presents the budget vs participation of 23 photo events. Bubble size is determined by the number of media uploaded.

Cost per Media Uploaded
edit

For the 23 photo events that reported their budget, the average cost per media uploaded was $0.00 USD.

We calculated the cost per media uploaded for 18 events for which we had budget and media upload data.[3]The graph below compares the cost per media uploaded for the 18 total other photo events and the four events that reported budgets of more than $0.00 USD to the Wiki Loves Monuments events reported this round. Compared to Wiki Loves Monuments, other photo events have a wider spread of costs, with some events being less expensive and others being more expensive.

Graph: Cost per media uploaded.

This boxplot displays the distribution of the cost per media uploaded for the 2013 and 2014 contests, and for both combined. Interestingly, the boxplot shows that there was a much wider distribution of cost per photo added for the 2014 contests compared to those in 2013. Quartile 1 is similar ($0.33 USD for both 2013 2014) but the 2014 median and the upper quartile extends nearly a dollar higher per image ($1.36 USD for 2013 and $2.14 USD for 2014) suggesting a larger number of contests with higher costs per photo in 2014.
Across all events captured in this reporting 12,187 media (10%) had already been added to the main article namespace on over 33,000 Wikimedia pages.

The highest proportion of unique media used on Wikimedia project pages was 96%

The number of unique media used on Wikimedia article pages ranged from 0 to 1,307. Most often the number of unique media used per event was one, while the median average was 26.[4]representing article use rates ranging from 0% to 96% with an average of 12%.[5] As the graph below illustrates, several events with $0.00 USD budgets uploaded media that were quickly used on Wikimedia article pages. More data may help us determine the trends between these metrics and if the impact continues with scale.

We also looked at how much it costs in terms of media which were used on Wikimedia article pages. The costs reported were typically zero, but from $0 to $114.09, and averaged zero in median and mode.[6]

Graph: Budget, Media Uploaded and Unique Media Used.

This graph displays the budget vs the number of media uploaded. The bubble size reflects the number of unique media used.

Hours, Participation, and Media Used
edit

Organizer hours per week per participant averaged 7.16 and events with more organizer hours per week per participant tended to have more media uploaded and unique media used.

There are 12 events for which we have number of organizer hours per week (staff + volunteer),[7] number of participants, media uploaded, and unique media used. Organizer hours per week per participant ranged from 0.48 to 31.6 with an average of 7.16.[8](See the graph below, Organizer hours, media uploaded and unique media used.) Events with more organizer hours per week per participant tended to have more media uploaded and more unique media used per participant.[9] A wider sample of data on organizer hours may reveal more or more nuanced trends between these inputs and outcomes, as well.

Graph: Organizer Hours, Media Uploaded and Unique Media Used.

This graph displays organizer hours per week per participant vs media uploaded per participant. The bubble size reflects the number of unique media used per participant.

Participation and Content
edit

Events with more participants tended to have more media uploaded and more unique media used on Wikimedia project pages. smaller events with fewer participants and fewer media uploaded have a higher proportion of media used on project pages.

There are very rich data on impactful small programs that we would like to explore more.


Events with more participants tended to have more media uploaded and more unique media used on Wikimedia project pages.[10] The majority of events (74 events, or 84%) had less than 100 participants, less than 2,000 media uploaded, and less than 250 unique media used. These events comprise very rich data on impactful small programs that we would like to explore more. As you see in the graph below (Participation, media uploaded and unique media used), these smaller events with fewer participants and fewer media uploaded have a higher proportion of media used on project pages.

Smaller events with fewer participants and fewer media uploaded have a higher proportion of media used on project pages.

This could be due to different approaches, whereby smaller events gathered media specifically to populate articles while larger events focused on content generation irrespective of specific use on Wikimedia article pages.

Graph: Participation, Media Uploaded and Unique Media Used.

This graph presents the number of participants vs number of media uploaded. The bubble size reflects the number of unique media used.
Notes
  1. ↑ Note: Although content production is listed here as a direct product of the program events and listed here among program outputs most of the program leaders who participated in the logic modeling session set it as their end outcome, and can be considered differently from one program implementation to the next, and should be honored as whichever an individual program leader decides.
  2. ↑ Mean=1346; SD=3585.
  3. ↑ Median=$0.00 USD; Mean=$3.13 USD; SD=$13.15 USD
  4. ↑ Mean=128; SD=272.
  5. ↑ Mean=22%; SD=24%
  6. ↑ Mean=$9.22; SD=$27.04
  7. ↑ Number of organizer hours per participant divided by the length of the event in weeks.
  8. ↑ Mean=10.14; SD=11.05.
  9. ↑ Organizer hours per week per participant to media uploaded: Correlation coefficient=.81; Organizer hours per week per participant to unique media used: Correlation coefficient=.83
  10. ↑ Participants to media uploaded: Correlation coefficient=0.56; Participants to unique media used: Correlation coefficient=0.56


Retrieved from "https://meta.wikimedia.org/w/index.php?title=Learning_and_Evaluation/Evaluation_reports/2015/Other_Photo_Events/Outputs&oldid=24893338"