Establishment of Result-Oriented Evaluation Indicator Framework for International Science and Technology Cooperation Program Evaluation——Based on Delphi and Analytic Hierarchy Process
Chi Jingru1,2, Zhou Xiaolin1,2, Nan Fang1,2, Ren Xiaoping2,3, Yang Yun1,2
1. China Association of Science and Technology Evaluation and Management of Scientific and Technical Achievement Beijing 100081,China;
2. National Center for Science & Technology Evaluation,Beijing 100081,China;
3. International Cooperation and Science and Technology Diplomacy Committee of the Chinese Association of Science of Science and S&T Policy Research,Beijing 100080,China
Abstract：The establishment of a result-oriented evaluation indicator framework for national international science and technology cooperation (program/fund)is conducive to comprehensively summarizing the implementation effectiveness,providing a scientific basis for administrations and management agencies to improve the (program/fund)management performance.This paper focuses on the accomplishments of the “Intergovernmental International Science and Technology Innovation Cooperation Key Program”within the National Key Research and Development Program.Based on the preliminary formulation of the program-level evaluation indicator framework,the Delphi is used to optimize and screen the indicators,and the Analytic Hierarchy Process is combined to determine the weights of the indicators,forming a result-oriented indicator framework.According to the research findings,the result-oriented indicator framework for international science and technology cooperation programs should prioritize program alignment with national strategies,focus on the benefits for both parties,and consider the sustainability of science and technology cooperation.
迟婧茹, 周小林, 南方, 任孝平, 杨云. 国际科技合作计划成果评估指标体系构建——基于德尔菲法和层次分析法[J]. 中国科技论坛, 2025(4): 11-21.
Chi Jingru, Zhou Xiaolin, Nan Fang, Ren Xiaoping, Yang Yun. Establishment of Result-Oriented Evaluation Indicator Framework for International Science and Technology Cooperation Program Evaluation——Based on Delphi and Analytic Hierarchy Process. , 2025(4): 11-21.
[1] GUSMAO R.Developing and using indicators of multilateral S&T cooperation for policy making:The experience from European research programmes.Scientometrics,2000,47 (3):493-514.
[2] BARNETT C,BRYAN B,PINNINGTON R,et al.Development of key performance indicators:Official Development Assistance (ODA)for research and innovation.Hove:Itad Ltd,2020.
[3] LEPORI B,DUNKEL A.Evaluation of the impact of swiss bilateral research programs.Lugano:Università della Svizzera italiana,2011.
[4] 路蒙佳.欧盟科技创新战略及其对中欧科技合作的影响[J].中国科技论坛,2024 (1):158-167.
[5] 王再进,傅晓岚.循证决策体系下英国科技评估的发展及经验借鉴[J].中国科技论坛,2020 (9):176-188.
[6] 王力.自然科学基金项目绩效评价指标体系构建[J].中国科技信息,2017 (3):4.
[7] 陈建俞,杨晓秋.优秀青年科学基金项目绩效评价指标体系构建:基于德尔菲法和层次分析法[J].中国科学基金,2023,37 (3):496-503.
[8] 丛琳,魏林君,李永亮,等.国家科技计划 (专项)绩效评估研究[J].中国科技论坛,2023 (7):13-20,32.
[9] 任孝平,杨云,南方.新时期国际科技合作评估方法研究[J].科技管理研究,2020,40 (22):56-61.
[10] 周小林,杨云,迟婧茹,等.基于变革理论的国际科技合作计划评估体系构建[J].情报杂志,2023,42 (4):203-207,185.
[11] 陶蕊,王勇,南方,等.国际科技合作的评估原则与方法探讨[J].中国科技论坛,2017 (11):21-27.
[12] European Commission.Ex post evaluation of Horizon 2020,the EU framework programme for research and innovation[R].Brussels:European Commission,2024.
[13] Department for Business,Energy and Industrial Strategy.The Newton Fund Final Evaluation Report[R].London:Tetra Tcch,2022.
[14] 穆荣平,马双,陈凯华,等.深化国家自然科学基金国际合作的战略思考[J].中国科学院院刊,2021,36 (12):1441-1447.
[15] 李颖.2012—2021年国家自然科学基金组织间国际 (地区)合作与交流项目特征和趋势分析[J].技术与创新管理,2023,44 (1):35-42.
[16] 联手多国合作伙伴,助力战 “疫”科研攻关——国家自然科学基金委员会积极推进新冠病毒研究国际合作[J].中国科学基金,2020,34 (5):607-608.
[17] 迟婧茹,武思宏,廖苏亮,等.多维多源创新资源集成平台应用绩效评价指标体系研究:基于德尔菲法[J].情报工程,2020,6 (2):48-56.
[18] 邓雪,李家铭,曾浩健,等.层次分析法权重计算方法分析及其应用研究[J].数学的实践与认识,2012,42 (7):93-100.
[19] 涂彦.基于技术转移的国际科技合作价值评估——以杂交水稻国际科技合作项目为例[J].中国科技论坛,2022 (10):178-188.
2025, 
