Mutual Peer Reviews between Organisations based on CSO Development Effectiveness principles have been piloted in 2012 by the Czech Forum for Development Cooperation - FoRS. This presentation for the association IDEAS shows key principles, steps for implementation and lessons learnt. The peer reviews can be used to bring Codes and frameworks alive and to develop capacities of orgaisations.
1. Experience from Implementing
Mutual Peer Reviews among
Czech Development Civil Society
Organisations
Inka Píbilová
inka@evaluace.com
IDEAS GA 2013
2. 2
FoRS
•Czech Forum for
Development Cooperation
•50 development CSOs
involved in 60 countries
•Combined turnover is similar
to the Czech official bilateral
development cooperation
3. Code on Effectiveness *2011
http://www.cso-effectiveness.org/istanbul-principles,067?lang=en
http://www.fors.cz/user_files/fors_code_on_effectiveness_en.pdf
1. Grassroots knowledge
2. Transparency and accountability
3. Partnership
4. Respect to human rights and gender equality
5. Accountability for impacts and their sustainability
How to support CSOs to be more effective?
5. Code on Effectiveness Annual Selfevaluation
Czech CSO´s self-assessment 2011 - 2013
Strengths
Validate data in the field
Publish most information
including contacts
Refuse corruption in
fundraising
Mutual capacity building
Avoiding stereotypes
Not using pictures of extreme
suffering for fundraising
Areas for Improvement
Publish strategic priorities online
Contribute to FoRS working
groups
Publish funding / financial info
Sharing project docs, other
projects
Impact indicators missing
Lack of participatory evaluations
6. Code on Effectiveness Annual Selfevaluation
How to make self-assessment more objective?
7. Books
Peer Reviews
Code on Effectiveness Annual Selfevaluation
How to develop CSOs´ capacities?
Conferences
Working GroupsDevelopment
Coffee.org
Workshops
70%
20%
10%
8. 8
Peer Review – Strategic approach
ToR
FoRS Code of
Effectiveness
Self-assessment
Interested
Peers
Briefing
WG1
WG2
WG3
Final
workshop
& report
Strategic Peer Review
9. 9
Peer Review – Strategic approach
Strategic Peer Review
„Peer Review reminded us what we forgot, it opened questions we did not
ask ourselves and mapped different experiences that we may utilise. The
challenge was the low ownership through the organisation and commitment
of the new management to implement suggested changes.“
10. 10
Peer Review – Quick version
DWW
FoRS Code of
Effectiveness
Self-assessment
Bilateral
peer
review
Bilateral Mutual Peer Review
• Self-selected peer CSOs
• Trust to share mutually
• Following indicators of the
Code on Effectiveness
• Constructive and appreciative
• Focus on improvements
• Respect for diversity
• Voluntary
Interested Peers
11. 11
Peer Review – Quick version
Benefits of Mutual Peer Review
• Perspective of other
practicionaires
• Mutual learning
• Low costs
• Time flexibility
• Brings Codes / frameworks
alive
12. 12
Peer Review – Quick version
Myths about Mutual Peer Reviews
• External evaluation or audit
• One-way feedback
• A peer from the same
background
• Experts for low costs
• Losing know-how
• Peer Reviews will bring a positive
change
13. 13
Peer Review – Quick version
Key Steps for CSOs to Implement Peer Reviews
1. Agree within the organisation why
to do a Peer Review
2. Secure sufficient capacities and
ownership
3. Choose a partner you trust
4. Be open to a different perspective
and a change
5. Priritize and follow-up
14. 14
Peer Review – Quick version
How platforms can help
1. Identify appropriate framework to
guide Peer Reviews
2. Tailor Peer Reviews to local
context
3. Pilot Peer Reviews
4. Connect potential peers and set
the basic rules and expectations
5. Support them on their way
6. Evaluate the process and
incorporate improvements
15. Thank you for your attention!
Inka Píbilová
inka@evaluace.com
www.fors.cz
Notas del editor
How to make assessment more objective ? How to build capacities of CSOs beside workshops ? How to enhance sharing expertise of the platform members ? How to involve small, volunteer -based organisations, with highly limited resources? How to promote the guidelines beyond the platform? … And how to do it with minimum costs ? Workshops have been organized by FoRS as per the needs identified. However, only a limited number of CSO representatives could participate due to limited capacities and time constraints. Moreover, it has been realized that workshops and guidelines (such as the Code) are not sufficient to progress on the quality issues. It was identified that innovative solutions were needed to ignite a wider debate on development effectiveness and to foster capacity building among diverse actors, including less formal, often volunteer-based CSOs, individual experts, students as well as companies and state actors. Therefore two new concepts have been launched: (A) DevelopmentCoffee.org and (B) Peer Reviews.
Besides annual self-evaluations as the main voluntary principle agreed in the FoRS Code on Effectiveness, the Peer Reviews are strongly recommended in order to increase objectivity of the assessment, to provide valuable external feedback to reviewed organisations and to support mutual learning and capacity building. The Peer Reviews have been inspired by the Global Education Network Europe (GENE) approach and especially by the experience of RORG-network , which introduced Peer Reviews in 2008 as one of the quality-building measures of the development education sector in Norway. The main purpose of RORG-network was to develop a certain degree of common understanding of development education. The lessons learnt, especially the engagement of several experts and focus on the uniqueness and added value of each organisation, in line with the appreciative inquiry approach , have served as a basis for developing a Czech system of development CSO Peer Reviews (FoRS, September 2011). FoRS Peer Reviews allow a structured, in-depth debate on each principle of the FoRS Code on Effectiveness and mutual learning among self-selected peer CSOs. The process is facilitated through FoRS on-line Code of Effectiveness questionnaire, where FoRS members indicate their interest in the Peer Review. The member CSOs can also directly approach concrete peers based on the area they would like to get feedback on, ranging from awareness raising activities, to development interventions in the field, to general management. The sector overview of FoRS Secretariat is often helpful to identify such peers from among the member organisations. Drawing from the Norwegian experience, pilot Peer Reviews were launched by FoRS in cooperation with its member organisation SIRIRI in 2012, whereby five organisations were involved in this pilot phase. During the process, evidence is shared to jointly assess each indicator and draw recommendations for any changes if applicable. Moreover, SIRIRI has used the exercise not only to review each principle of the FoRS Code on Effectiveness, but also to get feedback on its overall strategy and ways forward. Other members tested mutual Peer Reviews bilaterally.
Besides annual self-evaluations as the main voluntary principle agreed in the FoRS Code on Effectiveness, the Peer Reviews are strongly recommended in order to increase objectivity of the assessment, to provide valuable external feedback to reviewed organisations and to support mutual learning and capacity building. The Peer Reviews have been inspired by the Global Education Network Europe (GENE) approach and especially by the experience of RORG-network , which introduced Peer Reviews in 2008 as one of the quality-building measures of the development education sector in Norway. The main purpose of RORG-network was to develop a certain degree of common understanding of development education. The lessons learnt, especially the engagement of several experts and focus on the uniqueness and added value of each organisation, in line with the appreciative inquiry approach , have served as a basis for developing a Czech system of development CSO Peer Reviews (FoRS, September 2011). FoRS Peer Reviews allow a structured, in-depth debate on each principle of the FoRS Code on Effectiveness and mutual learning among self-selected peer CSOs. The process is facilitated through FoRS on-line Code of Effectiveness questionnaire, where FoRS members indicate their interest in the Peer Review. The member CSOs can also directly approach concrete peers based on the area they would like to get feedback on, ranging from awareness raising activities, to development interventions in the field, to general management. The sector overview of FoRS Secretariat is often helpful to identify such peers from among the member organisations. Drawing from the Norwegian experience, pilot Peer Reviews were launched by FoRS in cooperation with its member organisation SIRIRI in 2012, whereby five organisations were involved in this pilot phase. During the process, evidence is shared to jointly assess each indicator and draw recommendations for any changes if applicable. Moreover, SIRIRI has used the exercise not only to review each principle of the FoRS Code on Effectiveness, but also to get feedback on its overall strategy and ways forward. Other members tested mutual Peer Reviews bilaterally.
Besides annual self-evaluations as the main voluntary principle agreed in the FoRS Code on Effectiveness, the Peer Reviews are strongly recommended in order to increase objectivity of the assessment, to provide valuable external feedback to reviewed organisations and to support mutual learning and capacity building. The Peer Reviews have been inspired by the Global Education Network Europe (GENE) approach and especially by the experience of RORG-network , which introduced Peer Reviews in 2008 as one of the quality-building measures of the development education sector in Norway. The main purpose of RORG-network was to develop a certain degree of common understanding of development education. The lessons learnt, especially the engagement of several experts and focus on the uniqueness and added value of each organisation, in line with the appreciative inquiry approach , have served as a basis for developing a Czech system of development CSO Peer Reviews (FoRS, September 2011). FoRS Peer Reviews allow a structured, in-depth debate on each principle of the FoRS Code on Effectiveness and mutual learning among self-selected peer CSOs. The process is facilitated through FoRS on-line Code of Effectiveness questionnaire, where FoRS members indicate their interest in the Peer Review. The member CSOs can also directly approach concrete peers based on the area they would like to get feedback on, ranging from awareness raising activities, to development interventions in the field, to general management. The sector overview of FoRS Secretariat is often helpful to identify such peers from among the member organisations. Drawing from the Norwegian experience, pilot Peer Reviews were launched by FoRS in cooperation with its member organisation SIRIRI in 2012, whereby five organisations were involved in this pilot phase. During the process, evidence is shared to jointly assess each indicator and draw recommendations for any changes if applicable. Moreover, SIRIRI has used the exercise not only to review each principle of the FoRS Code on Effectiveness, but also to get feedback on its overall strategy and ways forward. Other members tested mutual Peer Reviews bilaterally.
Besides annual self-evaluations as the main voluntary principle agreed in the FoRS Code on Effectiveness, the Peer Reviews are strongly recommended in order to increase objectivity of the assessment, to provide valuable external feedback to reviewed organisations and to support mutual learning and capacity building. The Peer Reviews have been inspired by the Global Education Network Europe (GENE) approach and especially by the experience of RORG-network , which introduced Peer Reviews in 2008 as one of the quality-building measures of the development education sector in Norway. The main purpose of RORG-network was to develop a certain degree of common understanding of development education. The lessons learnt, especially the engagement of several experts and focus on the uniqueness and added value of each organisation, in line with the appreciative inquiry approach , have served as a basis for developing a Czech system of development CSO Peer Reviews (FoRS, September 2011). FoRS Peer Reviews allow a structured, in-depth debate on each principle of the FoRS Code on Effectiveness and mutual learning among self-selected peer CSOs. The process is facilitated through FoRS on-line Code of Effectiveness questionnaire, where FoRS members indicate their interest in the Peer Review. The member CSOs can also directly approach concrete peers based on the area they would like to get feedback on, ranging from awareness raising activities, to development interventions in the field, to general management. The sector overview of FoRS Secretariat is often helpful to identify such peers from among the member organisations. Drawing from the Norwegian experience, pilot Peer Reviews were launched by FoRS in cooperation with its member organisation SIRIRI in 2012, whereby five organisations were involved in this pilot phase. During the process, evidence is shared to jointly assess each indicator and draw recommendations for any changes if applicable. Moreover, SIRIRI has used the exercise not only to review each principle of the FoRS Code on Effectiveness, but also to get feedback on its overall strategy and ways forward. Other members tested mutual Peer Reviews bilaterally.
Besides annual self-evaluations as the main voluntary principle agreed in the FoRS Code on Effectiveness, the Peer Reviews are strongly recommended in order to increase objectivity of the assessment, to provide valuable external feedback to reviewed organisations and to support mutual learning and capacity building. The Peer Reviews have been inspired by the Global Education Network Europe (GENE) approach and especially by the experience of RORG-network , which introduced Peer Reviews in 2008 as one of the quality-building measures of the development education sector in Norway. The main purpose of RORG-network was to develop a certain degree of common understanding of development education. The lessons learnt, especially the engagement of several experts and focus on the uniqueness and added value of each organisation, in line with the appreciative inquiry approach , have served as a basis for developing a Czech system of development CSO Peer Reviews (FoRS, September 2011). FoRS Peer Reviews allow a structured, in-depth debate on each principle of the FoRS Code on Effectiveness and mutual learning among self-selected peer CSOs. The process is facilitated through FoRS on-line Code of Effectiveness questionnaire, where FoRS members indicate their interest in the Peer Review. The member CSOs can also directly approach concrete peers based on the area they would like to get feedback on, ranging from awareness raising activities, to development interventions in the field, to general management. The sector overview of FoRS Secretariat is often helpful to identify such peers from among the member organisations. Drawing from the Norwegian experience, pilot Peer Reviews were launched by FoRS in cooperation with its member organisation SIRIRI in 2012, whereby five organisations were involved in this pilot phase. During the process, evidence is shared to jointly assess each indicator and draw recommendations for any changes if applicable. Moreover, SIRIRI has used the exercise not only to review each principle of the FoRS Code on Effectiveness, but also to get feedback on its overall strategy and ways forward. Other members tested mutual Peer Reviews bilaterally.
Besides annual self-evaluations as the main voluntary principle agreed in the FoRS Code on Effectiveness, the Peer Reviews are strongly recommended in order to increase objectivity of the assessment, to provide valuable external feedback to reviewed organisations and to support mutual learning and capacity building. The Peer Reviews have been inspired by the Global Education Network Europe (GENE) approach and especially by the experience of RORG-network , which introduced Peer Reviews in 2008 as one of the quality-building measures of the development education sector in Norway. The main purpose of RORG-network was to develop a certain degree of common understanding of development education. The lessons learnt, especially the engagement of several experts and focus on the uniqueness and added value of each organisation, in line with the appreciative inquiry approach , have served as a basis for developing a Czech system of development CSO Peer Reviews (FoRS, September 2011). FoRS Peer Reviews allow a structured, in-depth debate on each principle of the FoRS Code on Effectiveness and mutual learning among self-selected peer CSOs. The process is facilitated through FoRS on-line Code of Effectiveness questionnaire, where FoRS members indicate their interest in the Peer Review. The member CSOs can also directly approach concrete peers based on the area they would like to get feedback on, ranging from awareness raising activities, to development interventions in the field, to general management. The sector overview of FoRS Secretariat is often helpful to identify such peers from among the member organisations. Drawing from the Norwegian experience, pilot Peer Reviews were launched by FoRS in cooperation with its member organisation SIRIRI in 2012, whereby five organisations were involved in this pilot phase. During the process, evidence is shared to jointly assess each indicator and draw recommendations for any changes if applicable. Moreover, SIRIRI has used the exercise not only to review each principle of the FoRS Code on Effectiveness, but also to get feedback on its overall strategy and ways forward. Other members tested mutual Peer Reviews bilaterally.
Besides annual self-evaluations as the main voluntary principle agreed in the FoRS Code on Effectiveness, the Peer Reviews are strongly recommended in order to increase objectivity of the assessment, to provide valuable external feedback to reviewed organisations and to support mutual learning and capacity building. The Peer Reviews have been inspired by the Global Education Network Europe (GENE) approach and especially by the experience of RORG-network , which introduced Peer Reviews in 2008 as one of the quality-building measures of the development education sector in Norway. The main purpose of RORG-network was to develop a certain degree of common understanding of development education. The lessons learnt, especially the engagement of several experts and focus on the uniqueness and added value of each organisation, in line with the appreciative inquiry approach , have served as a basis for developing a Czech system of development CSO Peer Reviews (FoRS, September 2011). FoRS Peer Reviews allow a structured, in-depth debate on each principle of the FoRS Code on Effectiveness and mutual learning among self-selected peer CSOs. The process is facilitated through FoRS on-line Code of Effectiveness questionnaire, where FoRS members indicate their interest in the Peer Review. The member CSOs can also directly approach concrete peers based on the area they would like to get feedback on, ranging from awareness raising activities, to development interventions in the field, to general management. The sector overview of FoRS Secretariat is often helpful to identify such peers from among the member organisations. Drawing from the Norwegian experience, pilot Peer Reviews were launched by FoRS in cooperation with its member organisation SIRIRI in 2012, whereby five organisations were involved in this pilot phase. During the process, evidence is shared to jointly assess each indicator and draw recommendations for any changes if applicable. Moreover, SIRIRI has used the exercise not only to review each principle of the FoRS Code on Effectiveness, but also to get feedback on its overall strategy and ways forward. Other members tested mutual Peer Reviews bilaterally.