Development action with informed and engaged societies
After nearly 28 years, The Communication Initiative (The CI) Global is entering a new chapter. Following a period of transition, the global website has been transferred to the University of the Witwatersrand (Wits) in South Africa, where it will be administered by the Social and Behaviour Change Communication Division. Wits' commitment to social change and justice makes it a trusted steward for The CI's legacy and future.
 
Co-founder Victoria Martin is pleased to see this work continue under Wits' leadership. Victoria knows that co-founder Warren Feek (1953–2024) would have felt deep pride in The CI Global's Africa-led direction.
 
We honour the team and partners who sustained The CI for decades. Meanwhile, La Iniciativa de Comunicación (CILA) continues independently at lainiciativadecomunicacion.com and is linked with The CI Global site.
Time to read
7 minutes
Read so far

'We can't solve everything!'

8 comments
Image
Your Blog
Just before Christmas I was at a workshop in the beautiful mountain village of Caux in Switzerland with several dozen other thinkers and do-ers in media and development (and no, we were not doing any skiing, we were working hard...). We were applying ourselves to the difficult task of defining how best to evaluate media interventions in conflict countries. We came up with what I believe to be some useful guidelines. But out of all our deliberations, the most significant for me was that we all agreed on the importance of managing donors' and policy-makers' expectations. In other words, donors must realise - and implementers must be honest about - what can be realistically achieved and especially that the outcomes of media programmes in conflict countries need to be assessed in the broader political context, much of which is beyond the control of media programmes. So, when the bullets are still flying at the end of a multi-million dollar programme in a war-torn country entitled 'media for peace-building,' what do you do? Do you: A. shovel more money into it and hope a second phase will ensure that peace eventually breaks out? B. axe all further funding for any more media projects and conclude they are all a waste of time? or C. manage expectations a little more and focus on outputs and outcomes rather than ultimate impacts? The answer, for us at Caux was obviously the last option, C. The guideline we formulated, subject to some possible further word-smithing, was: 'Donors and implementers should be flexible in considering amending project outcomes in the light of a better understanding of how the wider situation or context is evolving.' An example from my own experience in the D R Congo is the aim of establishing an independent media regulator in that country, as part of a large media-support programme financed by Britain, Sweden and France. This aim was originally written into the programme's logical framework - the road-map which is meant to guide the whole programme. Three and a half years into the project, we find, to our disappointment, that the DRC government is seriously dragging its heels on promulgating a law which will make this new regulatory body a proper legal entity and with its own budget and staff independent of the ruling elite. This is not surprising given that elections in the DRC are on the horizon later this year, and politicians of all stripes depend heavily on the various TV and radio stations they own and control in their local areas, to win votes and get re-elected. They are not particularly interested in fair regulation of broadcasting if it means that the partisan - if not hate - messages they are planning to broadcast are regulated. Such is the norm in many a conflict-affected country that I have observed, especially in Africa. We will have to amend this particular goal - perhaps even cut it. But our media-support programme will not have 'failed' if some of these higher goals - sometimes called 'impacts' - are not achieved. There are many other achievements that can be pointed out (in the case of this particular programme in the DRC, the wonderful Radio Okapi, for one). Let us finally say loud and clear: 'it's OK not to solve everything and it's OK not to pretend we can!'

Comments

User Image
Submitted by Anonymous (not verified) on Wed, 01/19/2011 - 19:03 Permalink

Your approach resonates. Log frames are awkward at best, and in turbulent contexts they seem abstract and detached. So many contexts today are unpredictable, even in states that are not recently emerged from conflict. Your Option C should be the starting point until sufficient stability can allow for a robust expectation of some outputs leading to a few desirable outcomes. Meyer Brownstone, a past chair of Oxfam Canada once said that they were after the 'educated dollar' from their contributors. I think the same should apply to many donors. Thanks for your insights!
Ricardo Ramirez

User Image
Submitted by Anonymous (not verified) on Wed, 01/19/2011 - 22:01 Permalink

While setting clear and some times ambitious goals is critical, the need to manage expectations cannot be over-emphasized. Working in a fragile context often requires re-assessment of goals and strategies and might even call for change in direction, if prevailing circumstances demand so. The political, economic and even social currents that exist in such environments often determaine the extent of progress of media interventions. It's critical to be willing to lower expectations when the tide of political and social currents rise and to focus on smaller and manageable goals that have shorter time frames than to expect extensive, high level results in a threatening environment.

User Image
Submitted by Anonymous (not verified) on Wed, 01/19/2011 - 23:20 Permalink

your are true.I am facing same kind of problems and somethimes questioned. What is relation between peace and journalist? why you are engaging on peace or etc...though some countries have their own meaning of peace!
my suggestin is for work...search commone ground among coflict...do work for unheard people and for the poor.

User Image
Submitted by Anonymous (not verified) on Thu, 01/20/2011 - 02:23 Permalink

Mary's comment is well made. I contributed to media programmes in the Balkans where it seemed that the larger the aim and the grander the rhetoric, the greater the shortfall. Not least, because at the same time as journalists and media 'experts' were expounding on the virtues of media freedom, professional codes of conduct and self-regulation, media conglomorates, often from the same countries as the experts, were bargain hunting with a view to implementing their own standards of low editorial standards, high profit. A key lesson for journalists was the relationship between their economic rights and their ability to practise high quality journalism.
I still felt that the workshops I attended were of high value, because of the quality of the interactions with a core of journalists who were realistic and clear sighted, but also retained their idealism. They had a high work ethic, strong ethics, impatience with the past, and a determination to do better. I hope that they came away strengthened; I know I did.
Working as a writer and trainer with projects on water and sanitation (in Africa), I am struck by the same paradox. There is, as Mary says, a need for donors to be much more realistic about what external interventions can achieve and a desperate need to rid ourselves of the arrogance of being 'experts'. However, at the same time, if we have skills we can share and we fully engage in the process, something good happens.
Usually, we evaluate the wrong things – trying to relate what has happened to the target outcomes that were in the project proposal. We can instead honestly describe the process, and try to learn from positives and negatives (if we know what these are!). As journalists, we almost always write about processes, because it is the processes that are interesting. Even where there are clear rules and boundaries, we enthuse about the football match rather than the score.
An immunisation campaign can (under the right conditions) have clear impact. Anything that is about human ways of thinking and behaving is much too complex and messy to be evaluated in this way. Even if goals are 'achieved' they cannot clearly be attributed to the programme. And let's face it; if the goals have been achieved, the report that says so is probably suspect. Well informed donors support good processes rather than chasing unrealistic outcomes. Impact is as process does.
Peter McIntyre

User Image
Submitted by Anonymous (not verified) on Thu, 01/20/2011 - 03:49 Permalink

Mary Myers reaches the right conclusion in relation to evaluating media interventions in conflict countries: manage the expectations of donors and implementers more, and focus on outputs and outcomes within the context of the broader political context rather than ultimate impacts. Since the ultimate objective of media projects is change, evaluators should seek to measure change. However, the change that is overlooked is the local effort, new knowledge and new practice produced to get a media project up and running in a conflict country. Therefore, shifting the focus of evaluations towards interim change is more realistic and less delusional than expecting peace to break out or radical behaviour change. I am reminded of a request for an evaluation of a 10 part TV series for youth broadcast in a war zone. Although the implementers’ stated objective was to assess the appeal and comprehension of the broadcasts, what they wanted was an evaluation methodology that included a qualitative representative sample survey as well as qualitative research with groups of viewers and non viewers of different ages, sex, religion and ethnicity as well as a handful of parents in at least seven different provinces to establish whether young people’s perception of themselves in relation to national, ethnic and gender identity was changing – as a result of a 30 minute game show. Another issue in relation to evaluation of media projects is attribution. And yet, proving attribution does not help media projects work better. Demonstrating contribution on the other hand may provide useful insights.

User Image
Submitted by Anonymous (not verified) on Fri, 01/21/2011 - 08:50 Permalink

Donors should have the wit to judge for themselves. If you commission a project in media for development you should first have confidence in the model, the principles and the organisation you are working with. Of course you should monitor and to do that you will need data. But media effects are notoriously hard to measure, let alone evaluate. It is usually only in the absence of healthy media and communications that we notice it's loss. Most media practitioners instinctively know the limits of what they do (as well as the incremental benefits), it is generally those who seek to use it to power direct development benefits who overclaim and are disappointed.

User Image
Submitted by Anonymous (not verified) on Mon, 01/24/2011 - 04:38 Permalink

I think one of the major reasons for which high profile programmes don't produce desired results in the field of communication is because participation is not really practiced. Most often the top sets the agenda and does everything for that agenda to be met. This stifles initiative and commitment which to a large extent is responsible for their failure. Stopping such programmes is however not the solution. there should be revised along lines that make room for participation.

User Image
Submitted by jasonbrown.jicc (not verified) on Tue, 02/22/2011 - 20:16 Permalink

Important point that - managing expectations.

Convincing funders option C is the right one is made more difficult by the fact that many donors are 'one hit wonders' - they fund a workshop, a tick goes into their own logical framework matrix box and, lo, behold; that particular aspect has been "addressed."

Complication is added by the fact that donors themselves frequently do not value feedback towards the critical end of the spectrum - constructive or otherwise. Anything less adulatory than "fantastic, thanks, learnt so much" disappears into maw of the aid matrix, never to be seen again.

And this is even with so-called media organisations. I once asked a representative from the International Federation of Journalists whether evaluation of our feedback forms would be made public?

Judging by the eyeball bulge my question was one of the stupider the workshop host had been asked.

If not even media organisations are accountable to their so-called "stakeholders" then how can we expect our governments to lead the way?

Until we as an 'industry' actually practice what we preach in transparency, there will be little for the shifting sands of political correctness to catch on to. When we are asking others to lay out their secrets, but withhold our own, where is our credibility?

Thanks to Mary Myers for a nicely written piece and a quite significant question for donor perfectionists everywhere.

Is this something that can be linked to productivity versions of the Pareto Principle? That 80% perfect is perfect enough? Or, in the real world, a 60/40 split might be more achievable.

Perhaps there is a need for a workshop for donor on the need for Minor Expectations!