Welcome to Capturing Development’s (blog) site

Through my company Capturing Development, I (Marlen Arkesteijn) support NGOs and research institutes active in the field of nature conservation, agriculture and poverty alleviation in planning, monitoring and evaluation (PM&E) mechanisms that promote learning.

The core of good monitoring and evaluation practices lies -in my view- in curiosity combined with the need for change: Wanting to know how your interventions contribute to lasting sustainable change and exploring how interventions can be made more effective.

Currently we are using 50 per cent more resources than our Earth can provide (see e.g. Living Planet report 2012). To ensure that both human beings and other living creatures on this planet can live in harmony  and have sufficient space, clean water, air and food, transformative change is needed. One of the keys lies in changing our consumption and production patterns, at all levels. Individuals (you and me), organisations, companies, governments all need to change their practices and -maybe even more important- the rules that (re-)produce these practices and sustain the current system.

For transformational change of practices and rules there are no (simple) recipies. Many times it is a matter of questioning assumptions, of trial and error, exploring what works, what does not, and why. Capturing Development supports NGOs in this exploration. I facilitate collaborative inquiries and research, trying to make differing roles, perspectives and assumptions explicit, conduct evaluations and reviews (preferably collectively with staff to embedd results and lessons), support the development and structuration of M&E practices within NGOs, encourage double loop learning and system learning (moving towards questioning our ways of thinking, our problem definitions) etc.

Tools and methods (both qualitative and quantitative)  can be helpful (but not leading) in these ventures: I have good experiences with Outcomes Mapping, Most Significant Change, Reflexive Monitoring in Action, (action research), Survey Monkey, surveys etc.

Besides, whenever relevant and usefull, I use visuals (videos and photographs) in my assignments to facilitate internal communication and reflection (see Visual M&E).

Video made by staff of Masindi Farmers’ Association on Gender Impact, after I trained them in camera, editing, interviewing and gender framework.

Capturing Development is owned by Marlen Arkesteijn (see ‘Who is Capturing Development?’). Although self-employed, I frequently work together with other professionals.

Capturing Development is partner of Evaluation & Co. Partnership for Innovative Evaluation. This group is specialised in evaluation for learning in complex situations.

With Barbara van Mierlo, working at the Wageningen University/ Communication and Innovation Science, I work on Reflexive Monitoring in Action, an M&E methodology especially developed for learning for social innovation and system change.

With Maple Tulips (Dominique Darmon) I developed e-Valuation, a novel visual evaluation method.

Posted in Power of images, System thinking | Tagged , , , | Leave a comment

Happy 2017!

kaart-2017-work-web-light-2

Image | Posted on by | Leave a comment

Happy 2016!

kaart2016zakweblight3

Image | Posted on by | Leave a comment

Documenting Gender Impact in Uganda

Training in visual documentation techniques.

A few months ago I trained staff of three district farmers associations (Hodfa, Madfa Mbabadifa) , three partners of Trias Uganda, in visual documentation techniques.

Over the years the three district farmers associations implemented a range of gender projects to ensure that women, men and youth equally benefit from their general programmes on food-and income security, and on value chains. And indeed, the associations seemed to be quite successful in their endeavour to mainstream gender -as reported by different experts visiting the districts- but none of the farmers associations really kept systematic track of these results. With years of experience, the need was felt to review and discuss the status and results of gender mainstreaming, and to determine the way forward.

At the same time the farmers associations felt the need to go off the beaten track and to show their results instead of writing up a study. Through an earlier evaluation two of the farmers associations had seen the power of video for facilitating discussions, and so they decided they wanted to document their gender results through videos, themselves. And so it happened.

This meant that staff needed to be trained in video documentation; especially in documenting results of gender mainstreaming. I developed a comprehensive training, including camera and editing techniques and skills, and -more important- social research techniques, interviewing and story telling, triangulation and validation, and training in understanding and recognising gender impact.

Especially this last issue ‘recognising gender impact’ took an important place in the training: What does gender impact mean in the light of farmers associations and their programmes?

To move beyond capturing of mere singular testimonies, I introduced the gender@work framework that includes changes in gender awareness, access and control over resources, services and decision-making of women, men and youth, and changes at institutional and community level (laws, regulations, policies and norms, values and practices) that enable gender changes to happen.

The results of three weeks training were absolutely amazing, and certainly not without challenges! In the end all three farmers’ associations had rather strong videos on gender impact, featuring specific women and men. The changes in awareness and the changes of norms, values and practices at community level

are very well visible. As Benon, one of the interviewee tells: ‘Only 15 years ago, women were not supposed to join our meetings, and if they did, they were supposed to keep their mouth shut. And look at us now, we even have women leaders that lead our groups.’ Showing access to services like extension and credit, and to resources like land and seed were visible in the videos as well. However, having control over resources and services was still kind of absent: For example ownership of land and decision making about money is still mainly in the hands of men.

Recently, the videos were published by Trias Uganda. And to be honest, I am really really proud of my students and how they were able to capture gender impact after a training of three weeks only.

Posted in Power of images | Tagged , , | Leave a comment

Visual outcome mapping and harvesting

Today I would like to showcase some of the work I do with my partners of Evaluation & Co on Visual outcome mapping and harvesting. Please find below our UpdateOne:

EvCoUpdate

  Why using Outcome mapping?
Untitled1The organisations we work with on Visual Outcome Mapping have programmes with specific characteristics: They involve a broad range of actors, their objectives focus on changing behaviours, policies and practices of another range of actors, while at the same time it is not clear what exactly could work and how, and the programmes are facing rapidly changing environments.  Good old Logframe planning and simple monitoring methods are not particularly helpful in these cases. For these problems dynamic, flexible design, monitoring and evaluation methods are needed that pay heed to the uncertainty of ‘not knowing’ and to the different perspectives on solutions and problems. Outcome mapping is such a method.  Read more

Does one image say more than a thousands words?
outsidersIn many organisations written words are the lifeline of policies, practices, learning, reporting and communications. This is how we have been educated. But there are other, and sometimes more effective or relevant, ways of sharing lessons, ideas and results for example through visuals. A large group of people learn better through seeing things. Visuals like pictures and videos provide information that words and texts alone cannot, like attitudes, images of situations, spheres etc.. Read more

Monitoring is the new ‘evaluation’
puppetsonastringCurrently, we are supporting an advocacy organisation in The Netherlands in their efforts to monitor and learn from one of their programmes. Their problem was that they were so hooked up in their daily work that even a simple joint reflection on what has been achieved was postponed time and again. So they have beautiful plans but no time to look back, reflect and take stock. Sounds familiar, isn’t it?

Fortunately the team leader realised that they would loose many opportunities for learning and asked us to facilitate the monitoring process. This was also something relatively new for us: We were educated with the notion that monitoring is for internal learning and reflection and is best done by the organisations themselves, while outsiders (evaluators like us) conduct mid- and end-term evaluations. Read more

Wemos – Visual Outcome Mapping for the HRH Alliance

OLYMPUS DIGITAL CAMERAIn 2012 we supported Wemos – a Dutch Health NGO – in developing a 3-year planning and monitoring trajectory (2013-2015) for one of their networks ‘the Human Resources for Health Alliance’.  This alliance attempts to promote  – within the Netherlands – the WHO Code of Practice on ethical international recruitment of health personnel and to facilitate the strengthening of health systems.

Currently the Netherlands has a health workers surplus. However, in the next decade, the demand is expected to increase sharply as the population ages. This will have consequences for the number of health workers needed, their skills and competences. To avoid shortages of health workers in the future, policy measures have to be developed now. Read more

140107FooterUpdate.jpg

Posted in Methods, Power of images | Tagged | Leave a comment

Complexity season

complexityAlthough discussions on ‘complexity’ never really waned,  lately the topic seems to gain momentum and attention as never before. Just to name a few: Within the Outcome Mapping Learning Community an interesting discussion is going on about the use of Outcome Mapping for complex situation; ODI has released a background note on ‘Planning and strategy development in the face of complexity’, and last but not least, Ben Ramalingam will soon launch his new book ‘Aid on the Edge of Chaos: rethinking international cooperation in a complex world’. This launch is taking place on 6 november 2013 and can be attended online. Do not miss it, it is for sure going to be interesting.

One of the questions that was posed in the Outcome Mapping Learning Community was what the added value was of using Outcome Mapping in complex systems, or in more general terms ‘what is the use of planning when facing complexity’. The ODI background note, written by Hummelbrunner and Jones, answers this question (and other questions) quite nicely.

Hummelbrunner and Jones reason that a situation is complex when there is a) no clear advance knowledge on how to tackle the issue at hand, we do not know what interventions could be useful and/or we do not know how contexts and trends will influence the issue (uncertainty); and b) no agreement among actors about what to do (disagreement) (see also Kurtz and Snowden, 2003; Patton, 2011 etc). In addition they add a third characteristic: the distribution of knowledge and capacities [I would rather add the dimension of ‘systemic stability’ instead, but for the sake of space and time I  will come back to that discussion in another blog.]

They state that planning does not become obsolete in the face of complexity, but requires different approaches and formats. First of all they reason (as Rogers, 2008 and Wilson-Grau, 2013) that not all aspects of a situation are complex. Secondly, for the aspects of a situation that are complex, they reckon that plans should be adaptive to incorporate new developments, challenges and opportunities since a large part of the information needed is generated along the way.

Setting learning objectives may be as important as performance objectives, and interventions should in their view be designed to actively test hypotheses. This means short feedback cycles are needed (see also Patton, 2011) to regularly adapt plans. They suggest moving from static to dynamic planning, from prescriptive to flexible planning modes and from comprehensive to diversified planning.

In their note they present various planning approaches that are appropriate for complex aspects of situations, ranging from scenario techniques to assumption-based planning, adaptive strategy development and outcome mapping.

In my view this is an excellent background note, and very timely.  So let us embrace uncertainty and realise  that ‘without any planning on where to go, the chances are smaller we eventually get anywhere’. The focus however could move from ‘front-loaded’ planning to learning and adapting on the road.

Posted in Complexity | Tagged , , | Leave a comment

Viewing evaluation-videos underneath the mangotree

IMG_4781In the year 2012 I hardly had time to write blogs. One of the reasons was that I was engaged in a video-evaluation of the Community Agro-Enterprise Development Programme (CAEDP) in Uganda, with Trias Uganda and their partners Hodfa and Madfa (two district farmers associations) and Hofokam (micro-finance institution). Actually, the word video-evaluation is not entirely correct: I used video as a tool to harvest stories and for reflection, next to all kind of other tools like a one-page survey, focus group discussions, reflection sessions, document review, in-depth interviews etc. But since using video is still rather new in the world of evaluation, I use the word video-evaluation to emphasize the use of video.

IMG_4805During the CAEDP evaluation I used video to harvest stories -in this case Most Significant Change stories- told by farmers (men and women) on changes in food and income security, and told by CAEDP staff on capacity strengthening. In every community we visited  people selected two most significant change stories that would be put on video. Ofcourse we held -before leaving the community- a reflection session during which the selected MSC stories were shown and further reflected upon. Since none of the communities had electricity, we used a generator and that worked very well, even viewing underneath the mango tree went very well.

IMG_4855Viewing always provoked a lot of discussion and laughther! It was never a problem to get people’s reaction and reflection.

With the partners we (re-)viewed the stories told by the farmers as well. And again here the videos really facilitated the discussions and the reflections on progress.

Once again I have seen  how videos tremenduously support evaluations, the data gathering, the analyses and the reflections. I say ‘support’ evaluations since while the videos clearly showed how the programme contributed to income and food security, and provided qualitative information on impact and the process, the groups discussions and the one-page household survey showed what the quantitative impact was of the programme. The qualitative cannot show its glory without the quantitative, and viceversa.

Below you find a trailer of the farmer MSC stories.

Posted in Power of images | Tagged , , | Leave a comment