Evaluation Process
Scientific Evaluation of Research Proposals submitted under the Research Promotion Foundation’s Framework Programme 2008-2010
Research Proposals are evaluated by scientists/experts with expertise in the relevant scientific fields. The evaluators are selected without geographical bias provided they have the academic credentials to accomplish the evaluation. Each proposal is evaluated by at least two evaluators. The number of evaluators assigned to each proposal is specified by the Research Promotion Foundation, and depends on the subject, the type of research, the call budget and the number of proposals.
Methods of Evaluation
- Evaluation by Scientific Evaluation Panel: The proposal is evaluated by a Panel that convenes at a specified time and place. At first, each panel member studies the proposal individually and then the panel members meet and discuss the proposal in relation to the evaluation criteria. A consensus report is prepared by the Panel for each proposal with the respective evaluation score. If a consensus cannot be reached, the decision is then based on a majority vote, each panel member having one vote. If the Panel consists of two members only and a consensus is not reached, two separate evaluation reports are prepared and the proposal is referred to a third evaluator. In such case the proposal evaluation score would be the average figure between the two most proximal evaluation scores. It is noted that the RPF may be represented in the Evaluation Panel if this is deemed necessary.
- Evaluation by Individual Evaluators: This procedure is applicable when the physical presence of the evaluators at the same place and time is not possible. In this case each evaluator (up to five individual evaluators per proposal) studies and evaluates a proposal individually and submits his/hers scientific evaluation report to the representative of the Research Promotion Foundation. In the event that the proposal is evaluated by two evaluators, an average score is estimated, unless the deviation between the two evaluation scores is greater than 25%. In that case the proposal is evaluated by a third evaluator and the average score is taken between the two most proximal evaluation scores.
Following the evaluation, and in accordance with the interests of the Research Promotion Foundation, the host organisation of the proposal may be required to give a presentation of its proposal to the Scientific Evaluation Panel. The place of the presentation is decided by the Research Promotion Foundation and could involve the premises of one or more of the organisations of the consortium.
Evaluation Criteria
There are four main sets of criteria:
I. Compatibility of the Proposal with the Objectives of the Programme Action
II. Adequacy of the Proposed Methodology
III. Added Value and Benefit
IV. Adequacy, Quality and Capability of the Consortium
The criteria comprise of subcriteria that may vary in content and weighting so as to comply with the objectives of the various funding Programmes and Actions. The detailed criteria can be found in the Calls for Proposals and in the Scientific Evaluation Reports.
In addition to the abovementioned criteria the evaluators provide their opinion for the following issues:
1.Type of research (e.g. basic/fundamental, industrial/applied, development at a pre-competitive stage).
2..Budget adequacy and justification
3.Compliance of the proposal with the designated thematic area
4.Compliance of the proposal with code of ethics/bioethics and relevant legislations
5.Environmental impact
Confidentiality
The evaluation process is regarded as a transparent but nevertheless confidential process. Proposal contents and evaluator’s identity are considered and treated as confidential information. Evaluators are required to sign a confidentiality agreement before they attain access to the full text of the research proposals.
Evaluation Outcome
A proposal is considered eligible for funding when it receives an overall evaluation score not less than 8 on a scale 1-10. In addition to this, each part of the proposal that corresponds to one of the four main criteria must attain at least 50% of the marking scale. The results of each evaluation process are announced at the Foundation’s website and the table of evaluation results clearly indicates which proposals will be invited to the negotiation stage. In addition to this, the results are communicated to applicants officially in a written reply that contains the Scientific Evaluation Report.
Selection of Proposals and Negotiation Stage
After completion of the evaluation process, the Research Promotion Foundation selects which proposals will be funded and invites the respective coordinators for negotiation of the contract. Proposal selection for funding is done according to evaluation ranking, the thematic area and the available budget. The final decision for funding is taken upon the outcome of the negotiation. Negotiation of the contract may include the following issues:
- Consortium requirements / Consortium agreement
- Validation of the eligibility of applicants
- Budget and eligibility of costs
- Research methodology, objectives, etc.
- Bioethics and ethics code of practice
Related Documents