Skip to main content

Main menu

  • Home
  • About
  • Who we are
  • News
  • Events
  • Publications
  • Search

Secondary Menu

  • Independent Science for Development CouncilISDC
    • Who we are
    • News
    • Events
    • Publications
    • Featured Projects
      • Inclusive Innovation
        • Agricultural Systems Special Issue
      • Proposal Reviews
        • 2025-30 Portfolio
        • Reform Advice
      • Foresight & Trade-Offs
        • Megatrends
      • QoR4D
      • Comparative Advantage
  • Standing Panel on Impact AssessmentSPIA
    • About
      • Who We Are
      • Our Mandate
      • Impact Assessment Focal Points
      • SPIA Affiliates Network
    • Our Work
      • Country Studies
        • Community of Practice
        • Bangladesh Study
        • Ethiopia Study
        • Uganda Study
        • Vietnam Study
      • Causal Impact Assessment
        • Call for Expressions of Interest: Accountability and Learning Impact Studies
      • Use of Evidence
      • Cross-Cutting Areas
        • Capacity Strengthening
        • Methods and Measurement
        • Guidance to IDTs
    • Resources
      • Publications
      • Blog Series on Qualitative Methods for Impact Assessment
      • SPIA-emLab Agricultural Interventions Database
    • Activities
      • News
      • Events
      • Webinars
  • Evaluation
    • Who we are
    • News
    • Events
    • Publications
    • Evaluations
      • Science Group Evaluations
      • Platform Evaluations
        • CGIAR Genebank Platform Evaluation
        • CGIAR GENDER Platform Evaluation
        • CGIAR Excellence in Breeding Platform
        • CGIAR Platform for Big Data in Agriculture
    • Framework and Policy
      • Evaluation Method Notes Resource Hub
      • Management Engagement and Response Resource Hub
      • Evaluating Quality of Science for Sustainable Development
      • Evaluability Assessments – Enhancing Pathway to Impact
      • Evaluation Guidelines
  • Independent Science for Development CouncilISDC
  • Standing Panel on Impact AssessmentSPIA
  • Evaluation
Back to IAES Main Menu

Secondary Menu

  • Who we are
  • News
  • Events
  • Publications
  • Featured Projects
    • Inclusive Innovation
      • Agricultural Systems Special Issue
    • Proposal Reviews
      • 2025-30 Portfolio
      • Reform Advice
    • Foresight & Trade-Offs
      • Megatrends
    • QoR4D
    • Comparative Advantage
Strategic & Synthesis Studies

Application of the Quality of Research for Development Framework to CGIAR Initiative Reviews

You are here

  • Home
  • Independent Science for Development CouncilISDC
  • Publications
  • Application of the Quality of Research for Development Framework to CGIAR Initiative Reviews

Abstract

To improve future ISDC external review of CGIAR proposals, ISDC conducted an ex-post analysis of the Initiative review process through a reviewer survey, CGIAR stakeholder consultations, examination of QoR4D reviewer scoring divergence, and Initiative Design Team (IDT) responses to ISDC reviews. The Lessons Learned report details the analysis’ recommendations grouped by: (1) QoR4D and its application to Initiatives, (2) insights for the design of the Initiative proposal template, and (3) areas for deeper consideration by IDTs and senior leadership in developing future proposals.

  • For QoR4D and its future application, the 17 review criteria will be revised to improve clarity and remove any redundancy. ISDC designed the criteria to apply to Global Thematic and Regional Integrated Initiatives and learned through this analysis they were less well aligned to Initiatives that were service oriented or focused on underpinning technologies (e.g., Genebanks).  In future, the 17 criteria will be modified so they also will be suitable for the assessment of proposals involving different goals. The QoR4D criteria have been revised to explicitly ensure research hypotheses, comparative advantage, and inclusive innovation prompt well considered responses by IDTs.
  • For the Initiative proposal templates designed by CGIAR System Office, recommendations included adding a two-page summary that permits proponents to articulate the value proposition, approach, and projected impact in a more persuasive, narrative form. Reorganization of templates for a  better “flow” with sufficient space to provide important process detail that currently is only located in appendix sections. Although the goal of keeping proposals short continues to be recommended, the right balance still needs to be continuously reviewed.
  • To improve the development of future Initiatives, the analysis recommends that IDTs and senior leadership emphasize consultation and partnerships, comparative advantage, research justification and research questions, as well as the overall cohesion across the portfolio.

The consultations confirmed that the QoR4D criteria and the process used for the ISDC Initiative reviews were beneficial to System Council and assisted in its decision making. The lessons provided in this ex-post analysis will further improve Initiative review processes for independent assessments and will have implications if ISDC participates in future stage-gating of current Initiatives. 

Citation

ISDC. 2022. Application of the Quality of Research for Development framework to Initiative reviews: Lessons learned. Rome: Independent Advisory and Evaluation Service.

Publisher

Independent Science for Development Council (ISDC)

Share on

Science ISDC
Issued on 2022
  • Report

Related Publications

Assessments & Commentaries
Science ISDC
Issued on 2024

ISDC Review of 2025-2030 Research & Innovation Portfolio Proposals

Assessments & Commentaries
Science ISDC
Issued on 2024

ISDC Feedback on CGIAR Portfolio Narrative 2025-2030

ISDC Feedback on CGIAR Portfolio Narrative 2025-2030
Assessments & Commentaries
Science ISDC
Issued on 2024

ISDC Feedback on CGIAR Portfolio Narrative 2025-2030

More publications

Related News

News
Impact SPIA
15 Apr 2025

SPIA Welcomes New Panel Member

News
Science ISDC
05 Jan 2024

New Perspective in Nature Sustainable Agriculture: Evolution of the One CGIAR’s research and innovation portfolio to 2030

More News

CGIAR Independent Advisory and Evaluation Service (IAES)

Alliance of Bioversity International and CIAT
Via di San Domenico,1
00153 Rome, Italy
  • IAES@cgiar.org
  • (39-06) 61181

Follow Us

  • LinkedIn
  • Twitter
  • YouTube
JOIN OUR MAILING LIST
  • Terms and conditions
  • © CGIAR 2025

IAES provides operational support as the secretariat for the Independent Science for Development Council and the Standing Panel on Impact Assessment, and implements CGIAR’s multi-year, independent evaluation plan as approved by the CGIAR’s System Council.