Reviewer Quality Feedback Form

• Please ensure general feedback comments do NOT include comments that are better suited for Evaluation Categories listed below (e.g., Outstanding Contributor or Needs Improvement categories).

A high quality review adheres to the following three criteria:

1. Appropriateness: Review comments are fair, understandable, original, confidential and respectful.
2. Robustness: Review is thorough, complete and credible. It contains sufficient details to justify given rating.
3. Utility: Reviewer feedback is constructive and addresses the needs of reviewers, applicants and funders.

1. Written reviews exceeded expectations (e.g., thorough and insightful comments - detailing both strengths and weaknesses - that will significantly aid both the applicant and other reviewers)

1. Written review(s) lack appropriateness (e.g., contains biased and/or inappropriate comments)
2. Written review(s) lacks robustness (e.g., contain insufficient details to justify given rating)
3. Written review(s) lack utility (e.g., comments are not constructive and not helpful to applicants to improve their future submissions)

1. Professionalism: The Reviewer conducted themselves in a professional manner and responded to inquiries/requests from Chairs and Scientific Officers.
2. Contribution: The Reviewer constructively and meaningfully participated in discussions of their assigned applications and adequately presented the identified strengths and weaknesses that contributed to their application rating.

Note: Please do not flag individuals based on differing personalities, presentation styles/formats (e.g. participation via teleconference) and possible language barriers.

1. Participated constructively in discussions of applications NOT assigned to them
2. Agreed to take additional tasks on short notice (e.g., to review more applications)

1. Lacks professionalism (e.g., stubborn, combative, overly critical/vocal, inappropriate/biased comments)
2. Difficult to chair (e.g., not responsive to chair's suggestions, interrupts, speaks too much)
3. Major presentation weaknesses (e.g., not well prepared, difficulty presenting, difficult to hear, unclear/unfocused comments)
4. Low participation level (e.g., not engaged in discussions of assigned applications, distracted)

Pre-Meeting - Needs Improvement

1. Did not communicate inability to submit scores or reviews by deadline (5 days before meeting)
2. Scores or reviews were not submitted (3 days before the meeting) - regardless of communication with staff

Please take into consideration any circumstances that you are aware of which may explain the late completion of a peer review task.

During and Post-Meeting - Needs Improvement

1. During meeting, all reviews were not submitted and were unavailable to committee members
2. All reviews were not submitted by Notice of Decision

Please take into consideration any circumstances that you are aware of which may explain the late completion of a peer review task.

• Completed additional tasks on short notice
• Please provide feedback (positive and/or negative) on the reviewer's participation