End Evaluation of Amnesty International's Education- Empowerment-Justice Programme (EEJP)

Pamodzi Consulting is very pleased to announce it has been awarded the contract to complete the end program evaluation of Amnesty International's Education- Empowerment-Justice Programme (EEJP).  The EEJP is a five year programme that is managed by Amnesty International Norway. It offers Amnesty's national and regional offices globally the opportunity to implement Human Rights Education activities in five different thematic areas: 

  • The Price of Freedom and Expression (ensuring justice for those penalised for exercising their freedom of expression in Middle East and North Africa)
  • Targeted and exploited (ensuring justice for women suffering discrimination globally)
  • Targeted and exploited (ensuring justice for minorities suffering discrimination in Europe)
  • Unscrupulous Greed (ensuring justice for victims following corporate infringements of human rights globally
  • In War’s Backyard (ensuring justice for victims after armed conflicts in Africa)
  • New Spring (ensuring fair legal systems in Tunisia, Egypt and states in the Middle East)

In 2015 with our associate Community Works we completed the mid-term review.  We are pleased to be collaborating again for this end of programme evaluation which will be implemented between April and November 2017. 

Amnesty expects that  this evaluation will make assessment of three aspects of the programme:

The evaluation will make an assessment of three aspects of the programme:

i.     Results - the extent that results against the programme’s objectives were achieved and are sustainable;

ii.    Monitoring and Evaluation (M&E) – the methods used at programme and individual project level and the effectiveness of the methods used;

iii.   Empowerment – the extent to which empowerment of the target groups has been achieved and the ways in which this has been measured;

The evaluation process applied is expected to be participatory, generate learning for the project partners and for Amnesty, and support capacity development.  

To fulfill the objectives we have designed an evaluation methodology that focuses on qualitative and participatory methods that engage with and gain contributions from the implementing partners in data collection, analysis and in generating shared learning and findings. We will use an on line interactive discussion and learning forums that explore the empowerment concepts applied in the programme, and the M&E approaches used. Four regional workshops will be facilitated that will enable  face to face interaction and more indepth analysis and discussions; and an on line survey and key informant interviews will also be used to collect data. 

We look forward to sharing more about our experiences of implementing the process and our findings over the coming months. 


Sharing Evaluation Practice - Facing Forward: Innovation, Action, and Reflection

Between April 30th and May 3rd 2017, Sarah participated in the annual conference of the Canadian Evaluation Society in Vancouver, British Colombia. The theme for the conference was Facing Forward: Innovation, Action, and Reflection. Sarah shared her experience of the formative and summative impact evaluation completed over a 12 month period on disability inclusive practice in the Australia Indonesia Partnership on Justice (AIPJ).  In this evaluation Sarah worked in a participatory way supporting the implementing partners to collect, and analyse data about effective processes and results achieved in implementing disability focused and inclusive practice in the program. Outcome harvesting was the methodology chosen for the evaluation, and 15 different outcome areas were investigated and the results shared (refer: http://www.aipj.or.id/uploads/reports_publication/47_f_20160426-020842_FA_Report-12_AIPJ_Evaluation_Report_08.pdf.pdf). The particular features of the evaluation process that Sarah shared at the conference that supported a strong participatory and learning process were: 

  • Building on existing relationships with partners - the partners had worked together and with Sarah in her role as advisor on the program over a four year period; the shared experiences, knowledge, trust helped shared purpose and objectives for the evaluation to be set and supported the strong participatory process that were used throughout
  • Time period  - the evaluation was implemented in stages over a 12 month period which gave time for strong participation by partners as they could incorporate the evaluation activities into their work plan and dedicate a good amount of time and level of resources to the process
  • Accessible - all aspects of the evaluation were fully accessible; sign language interpreting, English / Bahasa Indonesian translation and interpretation and audio versions of the report were provided and the facilitation in the workshops enabled fair and equitable participation and contributions

SPAK - A Review of a Women's Anticorruption Network in Indonesia

Corruption and Indonesia

Indonesia is ranked 90 out of 176 in Transparency International’s (TI) 2016 corruption index. The public perception of corruption is high - ranked as 37 on TI’s scale, where100 is very clean and 0 is highly corrupt.  When the public perceives corruption as highly prevalent and it has been “normalized” within the prevailing culture, individuals typically feel powerless to change the situation. The presence of persistent systemic corruption in societies tends to be further embedded through the collective belief that “ -- efforts to resist, abstain from, or fight corruption will be wasted. This is because many people assume the vast majority of others will engage in corruption”.

Saya Perempuan Anti-Korupsi(SPAK) – ‘I am a Woman against Corruption"

SPAK was launched through a partnership between the Australia Indonesia Partnership for Justice (AIPJ) with Indonesia’s Corruption Eradication Commission (Komisi Pemberantasan Korupsi, KPK) on 21st April 2014.

During the three years since SPAK was launched it has grown into a national movement.  In December 2016 it has 1025 SPAK Agents active in each of the 34 provinces in Indonesia. These are women who have completed the initial 3 day Training of Trainers (ToT) and the follow up Post ToT that takes place 3 months after the initial training.

The principle of Multi-Level-Marketing has been successfully used to expand the movement’s membership. This has been achieved by targeting women from a range of employment and professional backgrounds, and who are active in voluntary organisations and networks, including those associated with other KPK activities. During 2015 / 2016 certain groups of women were specifically targeted including women from legal background, law enforcement (police officers), entrepreneurs, students, and members of certain professional groups- pharmacy, pre-school teachers and business women. 

Certain key characteristics distinguish SPAK from other programs and organisations tackling corruption in Indonesia. The focus on prevention rather than retribution; targeting women as agents of change; and the innovative participatory and inclusive pedagogy used in training and for wider commun's ication and socialising of concepts.

The Theory of Change (ToC) of SPAK is simple. It focuses on three area of change:

√ Individual change in knowledge – understand what constitutes the different forms of corruption

√ Individual change in behaviour  - be corrupt free in ones own life 

√ Wider change – to stop corruption in families, communities and systemically  

Sarah was contracted to complete the evaluation of SPAK between November 2016 and March 2017.  The evaluation explored the extent to which the targets set have been achieved, and ways in which SPAK as a women’s social movement has contributed to improved knowledge and changes in behaviour that support prevention of corruption at an individual, organisational and system level in Indonesia.  The evaluation findings and recommendations are expected to assist in setting priorities and strategies for the next phase of SPAK, particularly in relation to its continued growth; new areas of activity; and options for ensuring longer term sustainability of the SPAK movement. 

A formative approach was applied in the evaluation to help improve understanding about the factors internal to SPAK and external in the operating context that are influencing the effectiveness of implementation strategies, and to provide information that can be applied to enhance aspects of design and performance in the next phase. The formative enquirywas complemented by summative investigation that captured the outcomes and impact of SPAK’s activities and the processes and approaches used that have contributed focusing on the period since the last evaluation.  

Power and Empowerment

To guide data collection and analysis for the first three area of enquiry the Alternative Forms of Power framework was used.  This considers power as a positive empowering force that is described in three dimensions:

Power within – self-worth, dignity

Power to – individual ability to act

Power with – collective action, working together

Data was collected by:

Survey  - through semi structured questionnaire distributed to all SPAK agents

Field visits – to 5 provinces where focus group discussions (FGDs) and interviews with SPAK gents, semai agents and other participants and stakeholders took place

Interviews – with KPK leadership, ministry and government officials, and other CSO / NGOs working on anticorruption and corruption prevention

Document review – of reflections of SPAK agents following Post ToT completed in the last 12 months, media and Facebook postings.


The evaluation findings and recommendation will be shared during May 2017. 

Private Sector: Disability Inclusion in Market Development

The inclusion of people with disabilities in market driven development is a new and relatively poorly informed area of practice. Very little information is available about effective strategies that promote participation, contribution and benefits by people with disabilities in Making Markets Work for the Poor (M4P). With the recent increased focus on economic development and recognition of the important role that the private sector plays in development, combined with the commitment of development agencies to inclusion (including people with disabilities), as articulated in the“leave no one behind” agenda (a key feature in the post-2015 agenda and is promoted through the Sustainable Development Goals (SDGs)),[1] makes market development an important and growing area.  Initial findings from research published on social inclusion in market-based solutions published in late 2016 by a global partnership recommended that: “-- there are viable opportunities for a much greater use of market-based approaches that improve the livelihoods and incomes of people who are extremely poor and marginalized [including people with disabilities]. This can be done by changing the rules and norms, supporting functions, information or risk profiles that market actors experience, in order to incentivise new business models, structures, services or technology”[2]. [Extract from Disability Inclusion Strategy for the Australia Indonesia Partnership for Rural Economic Development (AIP-Rural)- 2016]

In late 2016 Sarah completed the consultation and design process of the first disability inclusive strategy for AIP - Rural an Australian Government partnership in Indonesia that is promoting and supporting market development for poor rural women and men farmers in Eastern Indonesia. She completed this piece of work with the Indonesian disability activist and consultant Joni Yulianto. 

Promoting disability inclusion in a market development program is a new and relatively unchartered area of practice. There are challenges in determining how to balance human rights that underpin disability inclusive practice with economic and market driven development objectives. The first stage of implementation of the new strategy will commence in mid 2017. Sarah and Joni will facilitate training to AIP-Rural staff on disability inclusive rights and development. They will also work with the program team and partners in identifying entry points for disability inclusion. This will include refining collection of monitoring and evaluation data to include disability indicators; seeking information about the presence and situation of people with disabilities and families with family members with disabilities in the target populations; and seeking and forming technical and program alliances with disabled peoples organisations in the locations where the activities are implemented. 

Updates on implementation, and progress made and lessons learned will be shared on this web site in the latter part of 2017. 



[1] http://www.un.org/press/en/2016/sgsm17726.doc.htm, May 2016, accessed 8th November 2016

[2] http://www.ids.ac.uk/project/market-based-solutions-for-the-extreme-poor, accessed 6th September 2016



Sustainable Development Goals - Promises and Challenges and Disability Inclusion

Sarah was invited to participate as a speaker at this event held in March 2016 at the University of Melbourne. The workshop examined the implications of the 2030 agenda for the aid industry and development studies, as well as the challenges that lie ahead. By engaging voices from the academia, the development and private sectors, and the Australian Government, the event provided an opportunity to foster dialogue and strategic linkages as well as explore avenues for collaborative action between key players within and beyond the Australian context. 

Sarah contributed to the panel discussion on Inequality and the SDGs. She presented the opportunities and options for promoting and ensuring that people with disabilities are part of the Agenda 2030.

A summary of the workshop report can be found at http://humanitarianadvisorygroup.org/wp-content/uploads/2016/06/SDGs-2016-Workshop-Outcomes-University-of-Melbourne-1.pdf




Oil pollution and corporate accountability in the Niger Delta

Visit to Bodo Community, Ogoniland, South East Nigeria, January 2015 

“ On 28 August 2008 a fault in the Trans-Niger pipeline caused a significant oil spill into Bodo Creek in Ogoniland. The pipeline is the responsibility of Shell. The spill, which was due to equipment failure, resulted in tens of thousands of barrels of oil polluting the land and creek surrounding Bodo, killing the fish that people depend on for food and livelihood. “ 

Update - Impact Evaluation of Disability Inclusion in the Australia Indonesia Partnership for Justice (AIPJ)

The AIPJ program is an Australian Government funded project that working in partnership with the Government of Indonesia aims to improve the access to justice and realisation of rights by Indonesian people.  People with disability, women and children are the three main target groups of the program.