e-Valuation is a novel approach for conducting project and programme evaluations that I developed together with Dominique Darmon, a Dutch-based Canadian film producer. We integrate multimedia tools such as video, photography and social media, into quantitative and qualitative methods.
To gather data, for example, we collect -besides secondary data- stories through methods like the Most Significant Change. The stories are recorded on video, and the most significant change stories are then validated, discussed, quantified and transcribed for written reports.
Visuals complement written texts very effectively as they provide extra information such as facial expressions and body language. Instead of having a consultant quoting a stakeholder, interviewees can now speak for themselves.
Throughout the evaluation process, we stress the importance of conducting the evaluation ‘collectively.’ We include representatives of all key
Since all organizations and projects have different needs, we design a specific plan for each evaluation process. And for each of the steps, e-Valuation uses a winning combination of visuals and text.
e-Valuation is conducted by the e-Valuation team, in collaboration with local evaluators, cameramen, and photographers. In Africa, our preferred partner is Africa Interactive.
e-Valuation follows a number of steps:
(1) Design of the e-Valuation: We first clarify the evaluation questions, re-build the theory of change with key stakeholders, take stock of existing data, discuss the role of video, images and internet. The design involves representatives of all stakeholders, including donors, (I)NGOs, local capacity builders, and the ultimate target group. This ensures that all perspectives are taken into account. Depending on logistics, this can be done through a start-up workshop where representatives are all present, or through a web based application.
(3) Once we have collected the data, we perform a collective data analysis with groups of stakeholders. We show and discuss most important image/video captures and other findings. What are the most important trends, intended and unintended results? Whose views count, why? Analyses are then shared on the web application.
(4) The next step, collective reflection on data with groups of stakeholders, is sometimes combined with step 3. What are the main conclusions, claims, concerns, issues, and what do they mean for the follow-up of the programme? We record this discussion with pictures and video as well (with each group of stakeholders, or with all stakeholders, depending on logistics). Reflections are then shared on the web application.
(5) Finally, we share our findings by synthesizing and presenting our results through a report and video captures with representatives of all stakeholders (either through a physical meeting or through a web application).
(6) Simultaneously, we discuss how the findings will be used for the follow-up programme. With all stakeholders involved, we draft a plan of action. If deemed useful, we use the existing material to produce a journalistic report and video to share lessons learned with the outside world.
Why work with us? • By using video, we are sure to always connect all of our stakeholders’ perspectives • With video, we not only discuss change, but show change • We are cost effective • We work with local people • Between the two of us, we have more than 30 years of experience.
Marlèn Arkesteijn, www.capturingdevelopment.com
Dominique Darmon, www.mapletulip.com
Brochure: Brochure eValue